Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 9/2019

01-09-2019 | Endoscopy | Original Article

Endoscopic navigation in the clinic: registration in the absence of preoperative imaging

Authors: Ayushi Sinha, Masaru Ishii, Gregory D. Hager, Russell H. Taylor

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 9/2019

Login to get access

Abstract

Purpose

Clinical examinations that involve endoscopic exploration of the nasal cavity and sinuses often do not have a reference preoperative image, like a computed tomography (CT) scan, to provide structural context to the clinician. The aim of this work is to provide structural context during clinical exploration without requiring additional CT acquisition.

Methods

We present a method for registration during clinical endoscopy in the absence of CT scans by making use of shape statistics from past CT scans. Using a deformable registration algorithm that uses these shape statistics along with dense point clouds from video, we simultaneously achieve two goals: (1) register the statistically mean shape of the target anatomy with the video point cloud, and (2) estimate patient shape by deforming the mean shape to fit the video point cloud. Finally, we use statistical tests to assign confidence to the computed registration.

Results

We are able to achieve submillimeter errors in registrations and patient shape reconstructions using simulated data. We establish and evaluate the confidence criteria for our registrations using simulated data. Finally, we evaluate our registration method on in vivo clinical data and assign confidence to these registrations using the criteria established in simulation. All registrations that are not rejected by our criteria produce submillimeter residual errors.

Conclusion

Our deformable registration method can produce submillimeter registrations and reconstructions as well as statistical scores that can be used to assign confidence to the registrations.
Literature
3.
go back to reference Banerjee A, Dhillon I, Ghosh J, Sra S (2005) Clustering on the unit hypersphere using von Mises–Fisher distributions. J Mach Learn Res 6:1345–1382 Banerjee A, Dhillon I, Ghosh J, Sra S (2005) Clustering on the unit hypersphere using von Mises–Fisher distributions. J Mach Learn Res 6:1345–1382
4.
6.
go back to reference Billings SD (2015) Probabilistic feature-based registration for interventional medicine. Ph.D. thesis, The Johns Hopkins University Billings SD (2015) Probabilistic feature-based registration for interventional medicine. Ph.D. thesis, The Johns Hopkins University
7.
go back to reference Billings SD, Taylor RH (2014) Iterative most likely oriented point registration. In: Golland P, Hata N, Barillot C, Hornegger J, Howe R (eds) Medical image computing and computer-assisted intervention–MICCAI 2014. MICCAI 2014. Lecture notes in computer science, vol 8673. Springer, Cham. https://doi.org/10.1007/978-3-319-10404-1_23 CrossRef Billings SD, Taylor RH (2014) Iterative most likely oriented point registration. In: Golland P, Hata N, Barillot C, Hornegger J, Howe R (eds) Medical image computing and computer-assisted intervention–MICCAI 2014. MICCAI 2014. Lecture notes in computer science, vol 8673. Springer, Cham. https://​doi.​org/​10.​1007/​978-3-319-10404-1_​23 CrossRef
10.
go back to reference Billings SD, Sinha A, Reiter A, Leonard S, Ishii M, Hager GD, Taylor RH (2016) Anatomically Constrained Video-CT Registration via the V-IMLOP Algorithm. In: Ourselin S, Joskowicz L, Sabuncu M, Unal G, Wells W (eds) Medical image computing and computer-assisted intervention–MICCAI 2016. MICCAI 2016. Lecture notes in computer science, vol 9902. Springer, Cham. https://doi.org/10.1007/978-3-319-46726-9_16 Billings SD, Sinha A, Reiter A, Leonard S, Ishii M, Hager GD, Taylor RH (2016) Anatomically Constrained Video-CT Registration via the V-IMLOP Algorithm. In: Ourselin S, Joskowicz L, Sabuncu M, Unal G, Wells W (eds) Medical image computing and computer-assisted intervention–MICCAI 2016. MICCAI 2016. Lecture notes in computer science, vol 9902. Springer, Cham. https://​doi.​org/​10.​1007/​978-3-319-46726-9_​16
18.
go back to reference Fedorov A, Clunie D, Ulrich E, Bauer C, Wahle A, Brown B, Onken M, Riesmeier J, Pieper S, Kikinis R, Buatti J, Beichel RR (2016) DICOM for quantitative imaging biomarker development: a standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 4:e2057. https://doi.org/10.7717/peerj.2057 CrossRefPubMedPubMedCentral Fedorov A, Clunie D, Ulrich E, Bauer C, Wahle A, Brown B, Onken M, Riesmeier J, Pieper S, Kikinis R, Buatti J, Beichel RR (2016) DICOM for quantitative imaging biomarker development: a standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 4:e2057. https://​doi.​org/​10.​7717/​peerj.​2057 CrossRefPubMedPubMedCentral
19.
go back to reference Fokkens WJ, Lund VJ, Mullol J, Bachert C, Alobid I, Baroody F, Cohen N, Cervin A, Douglas R, Gevaert P, Georgalas C, Goossens H, Harvey R, Hellings P, Hopkins C, Jones N, Joos G, Kalogjera L, Kern B, Kowalski M, Price D, Riechelmann H, Schlosser R, Senior B, Thomas M, Toskala E, Voegels R, de Wang Y, Wormald PJ (2012) EPOS 2012: European position paper on rhinosinusitis and nasal polyps 2012. Rhinology 50(1):1–12. https://doi.org/10.4193/Rhino50E2 CrossRefPubMed Fokkens WJ, Lund VJ, Mullol J, Bachert C, Alobid I, Baroody F, Cohen N, Cervin A, Douglas R, Gevaert P, Georgalas C, Goossens H, Harvey R, Hellings P, Hopkins C, Jones N, Joos G, Kalogjera L, Kern B, Kowalski M, Price D, Riechelmann H, Schlosser R, Senior B, Thomas M, Toskala E, Voegels R, de Wang Y, Wormald PJ (2012) EPOS 2012: European position paper on rhinosinusitis and nasal polyps 2012. Rhinology 50(1):1–12. https://​doi.​org/​10.​4193/​Rhino50E2 CrossRefPubMed
21.
22.
go back to reference Granger S, Pennec X, Roche A (2001) Rigid point-surface registration using oriented points and an EM variant of ICP for computer guided oral implantology. Tech. Rep. RR-4169, INRIA Granger S, Pennec X, Roche A (2001) Rigid point-surface registration using oriented points and an EM variant of ICP for computer guided oral implantology. Tech. Rep. RR-4169, INRIA
26.
go back to reference Leonard S, Reiter A, Sinha A, Ishii M, Taylor RH, Hager GD (2016) Image-based navigation for functional endoscopic sinus surgery using structure from motion. In: Proceedings of SPIE, medical imaging: image processing, vol 9784, pp 97840V–7. https://doi.org/10.1117/12.2217279 Leonard S, Reiter A, Sinha A, Ishii M, Taylor RH, Hager GD (2016) Image-based navigation for functional endoscopic sinus surgery using structure from motion. In: Proceedings of SPIE, medical imaging: image processing, vol 9784, pp 97840V–7. https://​doi.​org/​10.​1117/​12.​2217279
28.
go back to reference Liu X, Sinha A, Unberath M, Ishii M, Hager GD, Taylor RH, Reiter A (2018) Self-supervised learning for dense depth estimation in monocular endoscopy. In: Stoyanov D et al (eds) Computer assisted robotic endoscopy–CARE 2018. Lecture notes in computer science, vol 11041. Springer, Cham. https://doi.org/10.1007/978-3-030-01201-4_15 Liu X, Sinha A, Unberath M, Ishii M, Hager GD, Taylor RH, Reiter A (2018) Self-supervised learning for dense depth estimation in monocular endoscopy. In: Stoyanov D et al (eds) Computer assisted robotic endoscopy–CARE 2018. Lecture notes in computer science, vol 11041. Springer, Cham. https://​doi.​org/​10.​1007/​978-3-030-01201-4_​15
30.
go back to reference Min Z, Wang J, Song S, Meng MQ (2018) Robust generalized point cloud registration with expectation maximization considering anisotropic positional uncertainties. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 1290–1297. https://doi.org/10.1109/IROS.2018.8593558 Min Z, Wang J, Song S, Meng MQ (2018) Robust generalized point cloud registration with expectation maximization considering anisotropic positional uncertainties. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 1290–1297. https://​doi.​org/​10.​1109/​IROS.​2018.​8593558
34.
go back to reference Reiter A, Leonard S, Sinha A, Ishii M, Taylor RH, Hager GD (2016) Endoscopic-CT: learning-based photometric reconstruction for endoscopic sinus surgery. In: Proceeding of SPIE, medical imaging: image processing, vol 9784, pp 978418–6. https://doi.org/10.1117/12.2216296 Reiter A, Leonard S, Sinha A, Ishii M, Taylor RH, Hager GD (2016) Endoscopic-CT: learning-based photometric reconstruction for endoscopic sinus surgery. In: Proceeding of SPIE, medical imaging: image processing, vol 9784, pp 978418–6. https://​doi.​org/​10.​1117/​12.​2216296
37.
go back to reference Sinha A (2018) Deformable registration using shape statistics with applications in sinus surgery. Ph.D. thesis. The Johns Hopkins University Sinha A (2018) Deformable registration using shape statistics with applications in sinus surgery. Ph.D. thesis. The Johns Hopkins University
38.
go back to reference Sinha A, Leonard S, Reiter A, Ishii M, Taylor RH, Hager GD (2016) Automatic segmentation and statistical shape modeling of the paranasal sinuses to estimate natural variations. In: Proceedings of SPIE, medical imaging: image processing, vol 9784, pp 97840D–8. https://doi.org/10.1117/12.2217337 Sinha A, Leonard S, Reiter A, Ishii M, Taylor RH, Hager GD (2016) Automatic segmentation and statistical shape modeling of the paranasal sinuses to estimate natural variations. In: Proceedings of SPIE, medical imaging: image processing, vol 9784, pp 97840D–8. https://​doi.​org/​10.​1117/​12.​2217337
39.
go back to reference Sinha A, Reiter A, Leonard S, Ishii M, Hager GD, Taylor RH (2017) Simultaneous segmentation and correspondence improvement using statistical modes. In: Proceedings of SPIE, medical imaging: image processing, vol 10133, pp 101331B–8. https://doi.org/10.1117/12.2253533 Sinha A, Reiter A, Leonard S, Ishii M, Hager GD, Taylor RH (2017) Simultaneous segmentation and correspondence improvement using statistical modes. In: Proceedings of SPIE, medical imaging: image processing, vol 10133, pp 101331B–8. https://​doi.​org/​10.​1117/​12.​2253533
40.
go back to reference Sinha A, Liu X, Reiter A, Ishii M, Hager GD, Taylor RH (2018) Endoscopic navigation in the absence of CT imaging. In: Frangi A, Schnabel J, Davatzikos C, Alberola-López C, Fichtinger G (eds) Medical image computing and computer assisted intervention–MICCAI 2018. MICCAI 2018. Lecture notes in computer science, vol 11073. Springer, Cham. https://doi.org/10.1007/978-3-030-00937-3_8 CrossRef Sinha A, Liu X, Reiter A, Ishii M, Hager GD, Taylor RH (2018) Endoscopic navigation in the absence of CT imaging. In: Frangi A, Schnabel J, Davatzikos C, Alberola-López C, Fichtinger G (eds) Medical image computing and computer assisted intervention–MICCAI 2018. MICCAI 2018. Lecture notes in computer science, vol 11073. Springer, Cham. https://​doi.​org/​10.​1007/​978-3-030-00937-3_​8 CrossRef
Metadata
Title
Endoscopic navigation in the clinic: registration in the absence of preoperative imaging
Authors
Ayushi Sinha
Masaru Ishii
Gregory D. Hager
Russell H. Taylor
Publication date
01-09-2019
Publisher
Springer International Publishing
Keyword
Endoscopy
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 9/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02005-0

Other articles of this Issue 9/2019

International Journal of Computer Assisted Radiology and Surgery 9/2019 Go to the issue