Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 12/2016

01-12-2016 | Original Article

A comparative study of transformation models for the sequential mosaicing of long retinal sequences of slit-lamp images obtained in a closed-loop motion

Authors: Kristina Prokopetc, Adrien Bartoli

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 12/2016

Login to get access

Abstract

Purpose

Navigated panretinal photocoagulation is a standard care for proliferative diabetic retinopathy. Slit-lamp-based systems used for this treatment provide a narrow view of the retina. Retinal mosaics are used for view expansion and treatment planning. Mosaicing slit-lamp images is a hard task due to the absence of a physical model of the imaging process, large textureless regions and imaging artifacts, mostly reflections.

Methods

We present a comparative study of various geometric transformation models applied to retinal image mosaicing in computer-assisted slit-lamp imaging. We propose an efficient point correspondence-based framework for transformation model evaluation in a typical closed-loop motion scenario. We compare the performance of multiple linear and nonlinear models of different complexities and assess the effect of the number of points used for parameter estimation. We use a local fitting error (LFE) metric to estimate the models’ performance in pairwise registration. Because LFE alone is not conclusive regarding the problem of accumulated drift, we propose a loop closure error (LCE) metric to quantify the effect of accumulated local registration errors. We also provide a new normalization procedure for the quadratic transformation model, widely used in retinal image registration.

Results

In total, seven transformation models were evaluated on three datasets of long image sequences. LFE decreases with increasing complexity of the model, while LCE, in contrast, shows superior performance of simple models. Varying the number of point correspondences did not reveal a common trend for the LCE metric, showing an increase in the error for simple models and an unstable behavior of the complex models.

Conclusion

Our results show that simple models are less sensitive to drift and preferable for sequential mosaicing in slit-lamp imaging, while more complex models are the best choice for short-term registration.
Literature
1.
go back to reference Adal KM, Ensing RM, Couvert R, van Etten P, Martinez JP, Vermeer KA, van Vliet L (2014) A hierarchical coarse-to-fine approach for fundus image registration. In: Ourselin S, Modat M (ed) Biomedical image registration, Springer, pp 93–102 Adal KM, Ensing RM, Couvert R, van Etten P, Martinez JP, Vermeer KA, van Vliet L (2014) A hierarchical coarse-to-fine approach for fundus image registration. In: Ourselin S, Modat M (ed) Biomedical image registration, Springer, pp 93–102
2.
3.
go back to reference Bartoli A (2008) Maximizing the predictivity of smooth deformable image warps through cross-validation. J Math Imaging Vis 31(2–3):133–145CrossRef Bartoli A (2008) Maximizing the predictivity of smooth deformable image warps through cross-validation. J Math Imaging Vis 31(2–3):133–145CrossRef
4.
go back to reference Broehan AM, Rudolph T, Amstutz CA, Kowal JH (2011) Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system. IEEE Trans Biomed Eng 58(10):2816–2824CrossRefPubMed Broehan AM, Rudolph T, Amstutz CA, Kowal JH (2011) Real-time multimodal retinal image registration for a computer-assisted laser photocoagulation system. IEEE Trans Biomed Eng 58(10):2816–2824CrossRefPubMed
5.
go back to reference Can A, Stewart CV, Roysam B, Tanenbaum HL (2002) A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: mosaicing the curved human retina. IEEE Trans Pattern Anal Mach Intell 24(3):412–419CrossRef Can A, Stewart CV, Roysam B, Tanenbaum HL (2002) A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: mosaicing the curved human retina. IEEE Trans Pattern Anal Mach Intell 24(3):412–419CrossRef
6.
go back to reference Chhablani J, Mathai A, Rani P, Gupta V, Arevalo JF, Kozak I (2014) Comparison of conventional pattern and novel navigated panretinal photocoagulation in proliferative diabetic retinopathy comparison of PASCAL and NAVILAS for PRP. Investig Ophthalmol Vis Sci 55(6):3432–3438CrossRef Chhablani J, Mathai A, Rani P, Gupta V, Arevalo JF, Kozak I (2014) Comparison of conventional pattern and novel navigated panretinal photocoagulation in proliferative diabetic retinopathy comparison of PASCAL and NAVILAS for PRP. Investig Ophthalmol Vis Sci 55(6):3432–3438CrossRef
7.
go back to reference Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge university press, Cambridge Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge university press, Cambridge
8.
go back to reference Irani M, Anandan P (1999) About direct methods. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 267–277 Irani M, Anandan P (1999) About direct methods. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 267–277
9.
go back to reference Kernt M, Cheuteu R, Vounotrypidis E, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2011) Focal and panretinal photocoagulation with a navigated laser NAVILAS. Acta Ophthalmol 89(8):662–664CrossRef Kernt M, Cheuteu R, Vounotrypidis E, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2011) Focal and panretinal photocoagulation with a navigated laser NAVILAS. Acta Ophthalmol 89(8):662–664CrossRef
10.
go back to reference Kernt M, Cheuteu RE, Cserhati S, Seidensticker F, Liegl RG, Lang J, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2012) Pain and accuracy of focal laser treatment for diabetic macular edema using a retinal navigated laser (Navilas). Clin Ophthalmol 6(1):289–296CrossRefPubMedPubMedCentral Kernt M, Cheuteu RE, Cserhati S, Seidensticker F, Liegl RG, Lang J, Haritoglou C, Kampik A, Ulbig MW, Neubauer AS (2012) Pain and accuracy of focal laser treatment for diabetic macular edema using a retinal navigated laser (Navilas). Clin Ophthalmol 6(1):289–296CrossRefPubMedPubMedCentral
12.
go back to reference Laliberté F, Gagnon L, Sheng Y (2003) Registration and fusion of retinal images-an evaluation study. IEEE Trans Med Imaging 22(5):661–673CrossRefPubMed Laliberté F, Gagnon L, Sheng Y (2003) Registration and fusion of retinal images-an evaluation study. IEEE Trans Med Imaging 22(5):661–673CrossRefPubMed
13.
go back to reference Lawson CL, Hanson RJ (1974) Solving least squares problems. Series in automatic computation, vol 161. Prentice-Hall, Englewood Cliffs Lawson CL, Hanson RJ (1974) Solving least squares problems. Series in automatic computation, vol 161. Prentice-Hall, Englewood Cliffs
14.
go back to reference Lee S, Abràmoff MD, Reinhardt JM (2007) Validation of retinal image registration algorithms by a projective imaging distortion model. In: Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, pp 6471–6474 Lee S, Abràmoff MD, Reinhardt JM (2007) Validation of retinal image registration algorithms by a projective imaging distortion model. In: Engineering in Medicine and Biology Society, 2007. EMBS 2007. 29th Annual International Conference of the IEEE, pp 6471–6474
15.
go back to reference Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRef
16.
go back to reference McLauchlan PF, Jaenicke A (2002) Image mosaicing using sequential bundle adjustment. Image Vis Comput 20(9):751–759CrossRef McLauchlan PF, Jaenicke A (2002) Image mosaicing using sequential bundle adjustment. Image Vis Comput 20(9):751–759CrossRef
17.
go back to reference Richa R, Linhares R, Comunello E, Von Wangenheim A, Schnitzler JY, Wassmer B, Guillemot C, Thuret G, Gain P, Hager G (2014) Fundus image mosaicking for information augmentation in computer-assisted slit-lamp imaging. IEEE Trans Med Imaging 33(6):1304–1312CrossRefPubMed Richa R, Linhares R, Comunello E, Von Wangenheim A, Schnitzler JY, Wassmer B, Guillemot C, Thuret G, Gain P, Hager G (2014) Fundus image mosaicking for information augmentation in computer-assisted slit-lamp imaging. IEEE Trans Med Imaging 33(6):1304–1312CrossRefPubMed
18.
go back to reference Souza M, Richa R, Puel A, Caetano J, Comunello E, von Wangenheim A (2014) Robust visual tracking for retinal mapping in computer-assisted slit-lamp imaging. In: IEEE 27th International Symposium on Computer-Based Medical Systems (CBMS) 2014, pp 132–137 Souza M, Richa R, Puel A, Caetano J, Comunello E, von Wangenheim A (2014) Robust visual tracking for retinal mapping in computer-assisted slit-lamp imaging. In: IEEE 27th International Symposium on Computer-Based Medical Systems (CBMS) 2014, pp 132–137
19.
go back to reference Stewart CV, Tsai CL, Roysam B (2003) The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans Med Imaging 22(11):1379–1394CrossRefPubMed Stewart CV, Tsai CL, Roysam B (2003) The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Trans Med Imaging 22(11):1379–1394CrossRefPubMed
20.
go back to reference Szeliski R (2006) Image alignment and stitching: a tutorial. Found Trends Comput Graph Vis 2(1):1–104CrossRef Szeliski R (2006) Image alignment and stitching: a tutorial. Found Trends Comput Graph Vis 2(1):1–104CrossRef
21.
go back to reference Torr PH, Zisserman A (1999) Feature based methods for structure and motion estimation. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 278–294 Torr PH, Zisserman A (1999) Feature based methods for structure and motion estimation. In: Triggs B, Zisserman A, Szeliski R (eds) Vision algorithms: theory and practice. Springer, Berlin, Heidelberg, pp 278–294
22.
go back to reference Yang G, Stewart CV (2004) Covariance-driven mosaic formation from sparsely-overlapping image sets with application to retinal image mosaicing. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp I–804 Yang G, Stewart CV (2004) Covariance-driven mosaic formation from sparsely-overlapping image sets with application to retinal image mosaicing. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp I–804
23.
go back to reference Zheng Y, Daniel E, Hunter AA, Xiao R, Gao J, Li H, Maguire MG, Brainard DH, Gee JC (2014) Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix. Med Image Anal 18(6):903–913CrossRefPubMed Zheng Y, Daniel E, Hunter AA, Xiao R, Gao J, Li H, Maguire MG, Brainard DH, Gee JC (2014) Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix. Med Image Anal 18(6):903–913CrossRefPubMed
Metadata
Title
A comparative study of transformation models for the sequential mosaicing of long retinal sequences of slit-lamp images obtained in a closed-loop motion
Authors
Kristina Prokopetc
Adrien Bartoli
Publication date
01-12-2016
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 12/2016
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-016-1439-7

Other articles of this Issue 12/2016

International Journal of Computer Assisted Radiology and Surgery 12/2016 Go to the issue