Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 10/2019

Open Access 01-10-2019 | Glioma | Original Article

Segmentation-based registration of ultrasound volumes for glioma resection in image-guided neurosurgery

Authors: Luca Canalini, Jan Klein, Dorothea Miller, Ron Kikinis

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2019

Login to get access

Abstract

Purpose

In image-guided surgery for glioma removal, neurosurgeons usually plan the resection on images acquired before surgery and use them for guidance during the subsequent intervention. However, after the surgical procedure has begun, the preplanning images become unreliable due to the brain shift phenomenon, caused by modifications of anatomical structures and imprecisions in the neuronavigation system. To obtain an updated view of the resection cavity, a solution is to collect intraoperative data, which can be additionally acquired at different stages of the procedure in order to provide a better understanding of the resection. A spatial mapping between structures identified in subsequent acquisitions would be beneficial. We propose here a fully automated segmentation-based registration method to register ultrasound (US) volumes acquired at multiple stages of neurosurgery.

Methods

We chose to segment sulci and falx cerebri in US volumes, which remain visible during resection. To automatically segment these elements, first we trained a convolutional neural network on manually annotated structures in volumes acquired before the opening of the dura mater and then we applied it to segment corresponding structures in different surgical phases. Finally, the obtained masks are used to register US volumes acquired at multiple resection stages.

Results

Our method reduces the mean target registration error (mTRE) between volumes acquired before the opening of the dura mater and during resection from 3.49 mm (± 1.55 mm) to 1.36 mm (± 0.61 mm). Moreover, the mTRE between volumes acquired before opening the dura mater and at the end of the resection is reduced from 3.54 mm (± 1.75 mm) to 2.05 mm (± 1.12 mm).

Conclusion

The segmented structures demonstrated to be good candidates to register US volumes acquired at different neurosurgical phases. Therefore, our solution can compensate brain shift in neurosurgical procedures involving intraoperative US data.
Footnotes
1
Surgicel (Ethicon, Somerville, NJ).
 
Literature
1.
go back to reference Tronnier VM, Bonsanto MM, Staubert A, Knauth M, Kunze S, Wirtz CR (2001) Comparison of intraoperative MR imaging and 3D-navigated ultrasonography in the detection and resection control of lesions. Neurosurg Focus 15,10(2):E3 Tronnier VM, Bonsanto MM, Staubert A, Knauth M, Kunze S, Wirtz CR (2001) Comparison of intraoperative MR imaging and 3D-navigated ultrasonography in the detection and resection control of lesions. Neurosurg Focus 15,10(2):E3
2.
go back to reference Petridis AK, Anokhin M, Vavruska J, Mahvash M, Scholz M (2015) The value of intraoperative sonography in low grade glioma surgery. Clin Neurol Neurosurg 131:64–68CrossRef Petridis AK, Anokhin M, Vavruska J, Mahvash M, Scholz M (2015) The value of intraoperative sonography in low grade glioma surgery. Clin Neurol Neurosurg 131:64–68CrossRef
3.
go back to reference Bucholz RD, Smith KR, Laycock KA, McDurmont LL (2001) Three-dimensional localization: from image-guided surgery to information-guided therapy. Methods 25(2):186–200CrossRef Bucholz RD, Smith KR, Laycock KA, McDurmont LL (2001) Three-dimensional localization: from image-guided surgery to information-guided therapy. Methods 25(2):186–200CrossRef
4.
go back to reference Gerard IJ, Kersten-Oertel M, Petrecca K, Sirhan D, Hall JA, Collins DL (2017) Brain shift in neuronavigation of brain tumors: a review. Med Image Anal 35:403–420CrossRef Gerard IJ, Kersten-Oertel M, Petrecca K, Sirhan D, Hall JA, Collins DL (2017) Brain shift in neuronavigation of brain tumors: a review. Med Image Anal 35:403–420CrossRef
5.
go back to reference Marko NF, Weil RJ, Schroeder JL, Lang FF, Suki D, Sawaya RE (2014) Extent of resection of glioblastoma revisited: personalized survival modeling facilitates more accurate survival prediction and supports a maximum-safe-resection approach to surgery. J Clin Oncol 32(8):774–782CrossRef Marko NF, Weil RJ, Schroeder JL, Lang FF, Suki D, Sawaya RE (2014) Extent of resection of glioblastoma revisited: personalized survival modeling facilitates more accurate survival prediction and supports a maximum-safe-resection approach to surgery. J Clin Oncol 32(8):774–782CrossRef
6.
go back to reference Brown TJ, Brennan MC, Li M, Church EW, Brandmeir NJ, Rakszawski KL, Patel AS, Rizk EB, Suki D, Sawaya R, Glantz M (2016) Association of the extent of resection with survival in glioblastoma: a systematic review and meta-analysis. JAMA Oncol 2(11):1460–1469CrossRef Brown TJ, Brennan MC, Li M, Church EW, Brandmeir NJ, Rakszawski KL, Patel AS, Rizk EB, Suki D, Sawaya R, Glantz M (2016) Association of the extent of resection with survival in glioblastoma: a systematic review and meta-analysis. JAMA Oncol 2(11):1460–1469CrossRef
7.
go back to reference Almeida JP, Chaichana KL, Rincon-Torroella J, Quinones-Hinojosa A (2015) The value of extent of resection of glioblastomas: clinical evidence and current approach. Curr Neurol Neurosci Rep 15(2):517CrossRef Almeida JP, Chaichana KL, Rincon-Torroella J, Quinones-Hinojosa A (2015) The value of extent of resection of glioblastomas: clinical evidence and current approach. Curr Neurol Neurosci Rep 15(2):517CrossRef
8.
go back to reference Kubben PL, ter Meulen KJ, Schijns OE, ter Laak-Poort MP, van Overbeeke JJ, van Santbrink H (2011) Intraoperative MRI-guided resection of glioblastoma multiforme: a systematic review. Lancet Oncol 12(11):1062–1070CrossRef Kubben PL, ter Meulen KJ, Schijns OE, ter Laak-Poort MP, van Overbeeke JJ, van Santbrink H (2011) Intraoperative MRI-guided resection of glioblastoma multiforme: a systematic review. Lancet Oncol 12(11):1062–1070CrossRef
9.
go back to reference Nimsky C, Ganslandt O, Von Keller B, Romstöck J, Fahlbusch R (2004) Intraoperative high-field-strength MR imaging: implementation and experience in 200 patients. Radiology 233(1):67–78CrossRef Nimsky C, Ganslandt O, Von Keller B, Romstöck J, Fahlbusch R (2004) Intraoperative high-field-strength MR imaging: implementation and experience in 200 patients. Radiology 233(1):67–78CrossRef
10.
go back to reference Mittal S, Black PM (2006) Intraoperative magnetic resonance imaging in neurosurgery: the Brigham concept. Acta Neurochir Suppl 98:77–86CrossRef Mittal S, Black PM (2006) Intraoperative magnetic resonance imaging in neurosurgery: the Brigham concept. Acta Neurochir Suppl 98:77–86CrossRef
11.
go back to reference Unsgaard G, Rygh OM, Selbekk T, Müller TB, Kolstad F, Lindseth F, Hernes TA (2006) Intra-operative 3D ultrasound in neurosurgery. Acta Neurochir 148(3):235–253CrossRef Unsgaard G, Rygh OM, Selbekk T, Müller TB, Kolstad F, Lindseth F, Hernes TA (2006) Intra-operative 3D ultrasound in neurosurgery. Acta Neurochir 148(3):235–253CrossRef
12.
go back to reference Unsgaard G, Gronningsaeter A, Ommedal S, Nagelhus Hernes TA (2002) Brain operations guided by real-time two-dimensional ultrasound: new possibilities as a result of improved image quality. Neurosurgery 51(2):402–411CrossRef Unsgaard G, Gronningsaeter A, Ommedal S, Nagelhus Hernes TA (2002) Brain operations guided by real-time two-dimensional ultrasound: new possibilities as a result of improved image quality. Neurosurgery 51(2):402–411CrossRef
13.
go back to reference Unsgaard G, Ommedal S, Muller T, Gronningsaeter A, Nagelhus Hernes TA (2002) Neuronavigation by intraoperative three-dimensional ultrasound: initial experience during brain tumor resection. Neurosurgery 50(4):804–812CrossRef Unsgaard G, Ommedal S, Muller T, Gronningsaeter A, Nagelhus Hernes TA (2002) Neuronavigation by intraoperative three-dimensional ultrasound: initial experience during brain tumor resection. Neurosurgery 50(4):804–812CrossRef
14.
go back to reference Xiao Y, Fortin M, Unsgård G, Rivaz H, Reinertsen I (2017) REtroSpective Evaluation of Cerebral Tumors (RESECT): a clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. Med Phys 44(7):3875–3882CrossRef Xiao Y, Fortin M, Unsgård G, Rivaz H, Reinertsen I (2017) REtroSpective Evaluation of Cerebral Tumors (RESECT): a clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. Med Phys 44(7):3875–3882CrossRef
15.
go back to reference LeRoux PD, Winter TC, Berger MS, Mack LA, Wang K, Elliott JP (1994) A comparison between preoperative magnetic resonance and intraoperative ultrasound tumor volumes and margins. J Clin Ultrasound 22(1):29–36CrossRef LeRoux PD, Winter TC, Berger MS, Mack LA, Wang K, Elliott JP (1994) A comparison between preoperative magnetic resonance and intraoperative ultrasound tumor volumes and margins. J Clin Ultrasound 22(1):29–36CrossRef
16.
go back to reference Rygh OM, Selbekk T, Torp SH, Lydersen S, Hernes TA, Unsgaard G (2008) Comparison of navigated 3D ultrasound findings with histopathology in subsequent phases of glioblastoma resection. Acta Neurochir 150:1033–1042CrossRef Rygh OM, Selbekk T, Torp SH, Lydersen S, Hernes TA, Unsgaard G (2008) Comparison of navigated 3D ultrasound findings with histopathology in subsequent phases of glioblastoma resection. Acta Neurochir 150:1033–1042CrossRef
17.
go back to reference Rivaz H, Collins DL (2015) Near real-time robust nonrigid registration of volumetric ultrasound images for neurosurgery. Ultrasound Med Biol 41(2):574–587CrossRef Rivaz H, Collins DL (2015) Near real-time robust nonrigid registration of volumetric ultrasound images for neurosurgery. Ultrasound Med Biol 41(2):574–587CrossRef
18.
go back to reference Selbekk T, Jakola AS, Solheim O, Johansen TF, Lindseth F, Reinertsen I, Unsgård G (2013) Ultrasound imaging in neurosurgery: approaches to minimize surgically induced image artefacts for improved resection control. Acta Neurochir 155:973–980CrossRef Selbekk T, Jakola AS, Solheim O, Johansen TF, Lindseth F, Reinertsen I, Unsgård G (2013) Ultrasound imaging in neurosurgery: approaches to minimize surgically induced image artefacts for improved resection control. Acta Neurochir 155:973–980CrossRef
19.
go back to reference Rivaz H, Collins DL (2015) Deformable registration of preoperative MR, pre-resection ultrasound, and post-resection ultrasound images of neurosurgery. Int J Comput Assist Radiol Surg 10(7):1017–1028CrossRef Rivaz H, Collins DL (2015) Deformable registration of preoperative MR, pre-resection ultrasound, and post-resection ultrasound images of neurosurgery. Int J Comput Assist Radiol Surg 10(7):1017–1028CrossRef
20.
go back to reference Letteboer MML, Viergever MA, Niessen WJ (2003) Rigid registration of 3D ultrasound data of brain tumours. Elsevier, AmsterdamCrossRef Letteboer MML, Viergever MA, Niessen WJ (2003) Rigid registration of 3D ultrasound data of brain tumours. Elsevier, AmsterdamCrossRef
21.
go back to reference Letteboer MMJ, Willems PWA, Viergever MA, Niessen WJ (2013) Non-rigid registration of 3D ultrasound images of brain tumours acquired during neurosurgery. In: MICCAI Letteboer MMJ, Willems PWA, Viergever MA, Niessen WJ (2013) Non-rigid registration of 3D ultrasound images of brain tumours acquired during neurosurgery. In: MICCAI
22.
go back to reference Mercier L, Araujo D, Haegelen C, Del Maestro RF, Petrecca K, Collins DL (2013) Registering pre- and postresection 3-dimensional ultrasound for improved visualization of residual brain tumor. Ultrasound Med Biol 39(1):16–29CrossRef Mercier L, Araujo D, Haegelen C, Del Maestro RF, Petrecca K, Collins DL (2013) Registering pre- and postresection 3-dimensional ultrasound for improved visualization of residual brain tumor. Ultrasound Med Biol 39(1):16–29CrossRef
23.
go back to reference Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical MR and ultrasound images of brain tumors. Med Phys 39(6):3253–3261CrossRef Mercier L, Del Maestro RF, Petrecca K, Araujo D, Haegelen C, Collins DL (2012) Online database of clinical MR and ultrasound images of brain tumors. Med Phys 39(6):3253–3261CrossRef
24.
go back to reference Zhou Hang, Rivaz H (2016) Registration of pre- and postresection ultrasound volumes with noncorresponding regions in neurosurgery. IEEE J Biomed Health Inform 20:1240–1249CrossRef Zhou Hang, Rivaz H (2016) Registration of pre- and postresection ultrasound volumes with noncorresponding regions in neurosurgery. IEEE J Biomed Health Inform 20:1240–1249CrossRef
25.
go back to reference Machado I, Toews M, Luo J, Unadkat P, Essayed W, George E, Teodoro P, Carvalho H, Martins J, Golland P, Pieper S, Frisken S, Golby A, Wells W 3rd (2018) Non-rigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching. Int J Comput Assist Radiol Surg 13(10):1525–1538CrossRef Machado I, Toews M, Luo J, Unadkat P, Essayed W, George E, Teodoro P, Carvalho H, Martins J, Golland P, Pieper S, Frisken S, Golby A, Wells W 3rd (2018) Non-rigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching. Int J Comput Assist Radiol Surg 13(10):1525–1538CrossRef
26.
go back to reference Toews M, Wells WM III (2013) Efficient and robust model-to- image registration using 3D scale-invariant features. Med Image Anal 17(3):271–282CrossRef Toews M, Wells WM III (2013) Efficient and robust model-to- image registration using 3D scale-invariant features. Med Image Anal 17(3):271–282CrossRef
27.
go back to reference Nitsch J, Klein J, Dammann P, Wrede K, Gembruch O, Moltz JH, Meine H, Sure U, Kikinis R, Millerce D (2019) Automatic and efficient MRI-US segmentations for improving intraoperative image fusion in image-guided neurosurgery. NeuroImage: Clin 22:101766CrossRef Nitsch J, Klein J, Dammann P, Wrede K, Gembruch O, Moltz JH, Meine H, Sure U, Kikinis R, Millerce D (2019) Automatic and efficient MRI-US segmentations for improving intraoperative image fusion in image-guided neurosurgery. NeuroImage: Clin 22:101766CrossRef
28.
go back to reference Rackerseder J, Baust M, Göbl R, Navab N, Hennersperger C (2018) Initialize globally before acting locally: enabling landmark-free 3D US to MRI registration. In: MICCAI Rackerseder J, Baust M, Göbl R, Navab N, Hennersperger C (2018) Initialize globally before acting locally: enabling landmark-free 3D US to MRI registration. In: MICCAI
29.
go back to reference Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation. MICCAI Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3D U-Net: learning dense volumetric segmentation from sparse annotation. MICCAI
30.
go back to reference Göbl R, Rackerseder J, Navab N, Hennersperger C (2019) Fully automatic segmentation of 3D brain ultrasound: learning from coarse annotations. arXiv preprint arXiv1904.08655 Göbl R, Rackerseder J, Navab N, Hennersperger C (2019) Fully automatic segmentation of 3D brain ultrasound: learning from coarse annotations. arXiv preprint arXiv1904.08655
31.
go back to reference Modersitzki J (2009) Flexible algorithms for image registration. SIAM, PhiladelphiaCrossRef Modersitzki J (2009) Flexible algorithms for image registration. SIAM, PhiladelphiaCrossRef
32.
go back to reference Liu DC, Nocedal J (1989) On the limited memory BFGS method for large scale optimization. Math Program 45:503–528CrossRef Liu DC, Nocedal J (1989) On the limited memory BFGS method for large scale optimization. Math Program 45:503–528CrossRef
33.
go back to reference Nitsch J, Klein J, H. Moltz J, Miller D, Sure U, Kikinis R, Meine H (2019) Neural-network-based automatic segmentation of cerebral ultrasound images for improving image-guided neurosurgery. In: SPIE medical imaging Nitsch J, Klein J, H. Moltz J, Miller D, Sure U, Kikinis R, Meine H (2019) Neural-network-based automatic segmentation of cerebral ultrasound images for improving image-guided neurosurgery. In: SPIE medical imaging
34.
go back to reference Trantakis C, Tittgemeyer M, Schneider JP, Lindner D, Winkler D, Strauss G, Meixensberger J (2003) Investigation of time-dependency of intracranial brain shift and its relation to the extent of tumor removal using intra-operative MRI. Neurol Res 25:9–12CrossRef Trantakis C, Tittgemeyer M, Schneider JP, Lindner D, Winkler D, Strauss G, Meixensberger J (2003) Investigation of time-dependency of intracranial brain shift and its relation to the extent of tumor removal using intra-operative MRI. Neurol Res 25:9–12CrossRef
Metadata
Title
Segmentation-based registration of ultrasound volumes for glioma resection in image-guided neurosurgery
Authors
Luca Canalini
Jan Klein
Dorothea Miller
Ron Kikinis
Publication date
01-10-2019
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 10/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02045-6

Other articles of this Issue 10/2019

International Journal of Computer Assisted Radiology and Surgery 10/2019 Go to the issue