Top

International Journal of Computer Assisted Radiology and Surgery

Published in:

Open Access 01-10-2019 | Computed Tomography | Original Article

Surface deformation analysis of collapsed lungs using model-based shape matching

Authors: Megumi Nakao, Junko Tokuno, Toyofumi Chen-Yoshikawa, Hiroshi Date, Tetsuya Matsuda

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2019

Abstract

Purpose

To facilitate intraoperative localization of lung nodules, this study used model-based shape matching techniques to analyze the inter-subject three-dimensional surface deformation induced by pneumothorax. Methods: Contrast- enhanced computed tomography (CT) images of the left lungs of 11 live beagle dogs were acquired at two bronchial pressures (14 and 2 cm\(\,\hbox {H}_2\hbox {O}\)). To address shape matching problems for largely deformed lung images with pixel intensity shift, a complete Laplacian-based shape matching solution that optimizes the differential displacement field was introduced.

Results

Experiments were performed to confirm the methods’ registration accuracy using CT images of lungs. Shape similarity and target displacement errors in the registered models were improved compared with those from existing shape matching methods. Spatial displacement of the whole lung’s surface was visualized with an average error of within 5 mm.

Conclusion

The proposed methods address problems with the matching of surfaces with large curvatures and deformations and achieved smaller registration errors than existing shape matching methods, even at the tip and ridge regions. The findings and inter-subject statistical representation are directly available for further research on pneumothorax deformation modeling.

Available only for authorised users

Shaw JP, Dembitzer FR, Wisnivesky JP, Litle VR, Weiser TS, Yun J, Chin C, Swanson SJ (2008) Video-assisted thoracoscopic lobectomy: state of the art and future directions. Ann Thorac Surg 85(2):S705–S709CrossRef

Flores RM, Alam N (2008) Video-assisted thoracic surgery lobectomy (VATS), open thoracotomy, and the robot for lung cancer. Ann Thorac Surg 85(2):S710–S715CrossRef

Sato M, Omasa N, Chen F, Sato T, Sonobe M, Bando T, Date H (2014) Use of virtual assisted lung mapping (VAL-MAP), a bronchoscopic multispot dye-marking technique using virtual images, for precise navigation of thoracoscopic sublobar lung resection. J Thorac Cardiovasc Surg 147(6):1813–1819CrossRef

Lin MW, Chen JS (2016) Image-guided techniques for localizing pulmonary nodules in thoracoscopic surgery. J Thorac Dis 8(9):S749–S755CrossRef

Sotiras A, Davatzikos C, Paragios N (2013) Deformable medical image registration: a survey. IEEE Trans Med Imaging 32(7):1153–1190CrossRef

Oh S, Kim S (2017) Deformable image registration in radiation therapy. Radiat Oncol J 35(2):101–111CrossRef

Beg MF, Miller MI, Trouve A, Younes L (2005) Computing large deformation metric mappings via geodesic flows of diffeomorphisms. Int J Comput Vision 61(2):139–157CrossRef

Kenngott HG, Wagner M, Gondan M, Nickel F, Nolden M, Fetzer A, Weitz J, Fischer L, Speidel S, Meinzer HP, Bockler D, Buchler MW, Müller-Stich BP (2014) Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging. Surg Endosc 28(3):933–940CrossRef

Nickel F, Kenngott HG, Neuhaus J, Sommer CM, Gehrig T, Kolb A, Gondan M, Radeleff BA, Schaible A, Meinzer HP, Gutt CN, Müller-Stich BP (2013) Navigation system for minimally invasive esophagectomy: experimental study in a porcine model. Surg Endosc 27(10):3663–3670CrossRef

10.

Wagner M, Gondan M, Zollner C, Wunscher JJ, Nickel F, Albala L, Groch A, Suwelack S, Speidel S, Maier-Hein L, Müller-Stich BP, Kenngott HG (2016) Electromagnetic organ tracking allows for real-time compensation of tissue shift in image-guided laparoscopic rectal surgery: results of a phantom study. Surg Endosc 30(2):495–503CrossRef

11.

Nickel F, Kenngott HG, Neuhaus J, Andrews N, Garrow C, Kast J, Sommer CM, Gehrig T, Gutt CN, Meinzer HP, Müller-Stich BP (2018) Computer tomographic analysis of organ motion caused by respiration and intraoperative pneumoperitoneum in a porcine model for navigated minimally invasive esophagectomy. Surg Endosc 32(10):4216–4227CrossRef

12.

Koo B, Özgür E, Le Roy B, Buc E, Bartoli A (2017) Deformable registration of a preoperative 3D liver volume to a laparoscopy image using contour and shading cues. In: Medical image computing and computer assisted intervention (MICCAI), 326-334

13.

Rühaak J, Polzin T, Heldmann S, Simpson IJA, Handels H, Modersitzki J, Heinrich MP (2017) Estimation of large motion in lung CT by integrating regularized keypoint correspondences into dense deformable registration. IEEE Trans Med Imaging 36(8):1746–1757CrossRef

14.

Nakao M, Minato K (2010) Physics-based interactive volume manipulation for sharing surgical process. IEEE Trans Inf Technol Biomed 14(3):809–816CrossRef

15.

Nakao M, Oda Y, Taura K, Minato K (2014) Direct volume manipulation for visualizing intraoperative liver resection process. Comput Methods Progr Biomed 113(3):725–735CrossRef

16.

Gunay G, Ha LM, Walsum TV, Klein S (2016) Semi-automated registration of pre- and intra-operative liver CT for image-guided interventions. In: SPIE medical imaging: 97841N

17.

Sadeghi-Naini A, Shirzadi Z, Samani A (2012) Towards modeling tumor motion in the deflated lung for minimally invasive ablative procedures. Comput Aided Surg 17(5):211–220CrossRef

18.

Ilegbusi OJ, Li Z, Seyfi B, Min Y, Meeks S, Kupelian P, Santhanam AP (2012) Modeling airflow using subject-specific 4DCT-based deformable volumetric lung models. Int J Biomed Imaging 2012:350853CrossRef

19.

Fuerst B, Mansi T, Carnis F, Salzle M, Zhang J, Declerck J, Boettger T, Bayouth J, Navab N, Kamen A (2015) Patient-specific biomechanical model for the prediction of lung motion from 4-D CT images. IEEE Trans Med Imaging 34(2):599–607CrossRef

20.

Wilms M, Ha IY, Handels H, Heinrich MP (2016) Model-based regularisation for respiratory motion estimation with sparse features in image-guided interventions. In: Medical image computing and computer-assisted intervention (MICCAI), 89–97

21.

Nakao M, Kawashima A, Minato K, Kokubo M, (2007) Simulating lung tumor motion for dynamic tumor-tracking irradiation. In: IEEE nuclear science symposium and medical imaging conference, 4549-4551

22.

Naini AS, Pierce G, Lee TY, Patel RV, Samani A (2011) CT image construction of a totally deflated lung using deformable model extrapolation. Med Phys 38(2):872–883CrossRef

23.

Nakamoto M, Aburaya N, Sato Y, Konishi K, Yoshino I, Hashizume M, Tamura S (2007) Thoracoscopic surgical navigation system for cancer localization in collapsed lung based on estimation of lung deformation. In: Medical image computing and computer-assisted intervention (MICCAI), 68–76

24.

Wu S, Nakao M, Matsuda T (2017) Continuous lung region segmentation from endoscopic images for intra-operative navigation. Comput Biol Med 87(1):200–210CrossRef

25.

Alvarez P, Chabanas M, Rouze S, Castro M, Payan Y, Dillenseger JL (2018) Lung deformation between preoperative CT and intraoperative CBCT for thoracoscopic surgery: a case study. In: SPIE medical imaging, 105761D

26.

Uneri A, Nithiananthan S, Schafer S, Otake Y, Stayman JW, Kleinszig G, Sussman MS, Prince JL, Siewerdsen JH (2013) Deformable registration of the inflated and deflated lung in cone-beam CT-guided thoracic surgery: initial investigation of a combined model- and image-driven approach. Med Phys 40(1):017501CrossRef

27.

Heiselman JS, Collins JA, Clements LW, Weis JA, Simpson AL, Geevarghese SK, Kingham TP, Jarnagin WR, Miga MI (2018) Technical note: nonrigid registration for laparoscopic liver surgery using sparse intraoperative data. In: Proceedings SPIE Medical Imaging, 105760D

28.

Saito A, Nakao M, Uranishi Y, Matsuda T (2015) Deformation estimation of elastic bodies using multiple silhouette images for endoscopic image augmentation. In: IEEE international symposium on mixed and augmented reality, 170-171

29.

Nakao M, Saito A, Matsuda T (2017) A simulation study on deformation estimation of elastic materials using monocular images. Int J Comput Assist Radiol Surg 12(1):S257–258

30.

Klein S, Staring M, Murphy K, Viergever MA, Pluim JPW (2010) Elastix: a toolbox for intensity based medical image registration. IEEE Trans Med Imaging 29(1):196–205CrossRef

31.

Ehrhardt J, Werner R, Schmidt-Richberg A, Handels H (2011) Statistical modeling of 4D respiratory lung motion using diffeomorphic image registration. IEEE Trans Med Imaging 30(2):251–265CrossRef

32.

Kim J, Valdes-Hernandez Mdel C, Royle NA, Park J (2015) Hippocampal shape modeling based on a progressive template surface deformation and its verification. IEEE Trans Med Imaging 34(6):1242–1261CrossRef

33.

Jud C, Giger A, Sandkhler R, Cattin PC (2017) A localized statistical motion model as a reproducing kernel for non-rigid image registration. In: Medical image computing and computer-assisted intervention (MICCAI), 261-269

34.

Kazhdan M, Bolitho M, Hoppe H (2006) Poisson surface reconstruction. In: Symposium on geometry processing, 61–70

35.

Sorkine O, Cohen-Or D, Lipman Y, Alexa M, Rössl C, Seidel HP (2004) Laplacian surface editing. In: Proceedings of the 2004 eurographics/ACM SIGGRAPH symposium on geometry processing, 175–184

36.

Nealen A, Igarashi T, Sorkine O, Alexa M (2006) Laplacian mesh optimization. In: Proceedings of the 4th international conference on computer graphics and interactive techniques in Australasia and Southeast Asia, 381–389

37.

Huttenlocher D, Klanderman G, Rucklidge W (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15:850–863CrossRef

38.

Kobayashi K, Nakao M, Tokuno J, Chen TF, Matsuda T (2018) Analysis of deaeration deformation in ex vivo animal lung by Laplacian-based surface registration. In: 40th Annual international conference of the IEEE engineering in medicine and biology society (EMBC)

39.

Zhou J, Kim S, Jabbour S, Goyal S, Haffty B, Chen T, Levinson L, Metaxas D, Yue NJ (2010) A 3D global-to-local deformable mesh model based registration and anatomy-constrained segmentation method for image guided prostate radiotherapy. Med Phys 37:1298–1308CrossRef

40.

Boscaini D, Masci J, Melzi S, Bronstein MM, Castellani U, Vandergheynst P (2015) Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks. Comput Graph Forum 34(5):13–23CrossRef

Title: Surface deformation analysis of collapsed lungs using model-based shape matching
Authors: Megumi Nakao
Junko Tokuno
Toyofumi Chen-Yoshikawa
Hiroshi Date
Tetsuya Matsuda
Publication date: 01-10-2019
Publisher: Springer International Publishing
Keywords: Computed Tomography
Pneumothorax
Computed Tomography
Pneumothorax
Pneumothorax
Published in: International Journal of Computer Assisted Radiology and Surgery / Issue 10/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-019-02013-0

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Surface deformation analysis of collapsed lungs using model-based shape matching

Abstract

Purpose

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Purpose

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 10/2019

Synthesis of CT images from digital body phantoms using CycleGAN

Some germinal roots of AI and their impact on Computer Assisted Radiology and Surgery (CARS)

Novel automated vessel pattern characterization of larynx contact endoscopic video images

Toward versatile cooperative surgical robotics: a review and future challenges

Automatic annotation of surgical activities using virtual reality environments

CycleGAN for style transfer in X-ray angiography