Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 3/2020

Open Access 01-03-2020 | Original Article

Automated measurement of bone scan index from a whole-body bone scintigram

Authors: Akinobu Shimizu, Hayato Wakabayashi, Takumi Kanamori, Atsushi Saito, Kazuhiro Nishikawa, Hiromitsu Daisaki, Shigeaki Higashiyama, Joji Kawabe

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 3/2020

Login to get access

Abstract

Purpose

We propose a deep learning-based image interpretation system for skeleton segmentation and extraction of hot spots of bone metastatic lesion from a whole-body bone scintigram followed by automated measurement of a bone scan index (BSI), which will be clinically useful.

Methods

The proposed system employs butterfly-type networks (BtrflyNets) for skeleton segmentation and extraction of hot spots of bone metastatic lesions, in which a pair of anterior and posterior images are processed simultaneously. BSI is then measured using the segmented bones and extracted hot spots. To further improve the networks, deep supervision (DSV) and residual learning technologies were introduced.

Results

We evaluated the performance of the proposed system using 246 bone scintigrams of prostate cancer in terms of accuracy of skeleton segmentation, hot spot extraction, and BSI measurement, as well as computational cost. In a threefold cross-validation experiment, the best performance was achieved by BtrflyNet with DSV for skeleton segmentation and BtrflyNet with residual blocks. The cross-correlation between the measured and true BSI was 0.9337, and the computational time for a case was 112.0 s.

Conclusion

We proposed a deep learning-based BSI measurement system for a whole-body bone scintigram and proved its effectiveness by threefold cross-validation study using 246 whole-body bone scintigrams. The automatically measured BSI and computational time for a case are deemed clinically acceptable and reliable.
Literature
1.
go back to reference Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. Cancer J Clin 68(6):394–424CrossRef Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. Cancer J Clin 68(6):394–424CrossRef
2.
go back to reference The editorial board of the cancer statistics in Japan (2018) Caner statistics in Japan 2017, Fundation for promotion of cancer research, ISSN 2433-3212 The editorial board of the cancer statistics in Japan (2018) Caner statistics in Japan 2017, Fundation for promotion of cancer research, ISSN 2433-3212
3.
go back to reference Fogelman I, Citrin DL, McKillop JH, Turner JG, Bessent RG, Greig WR (1979) A clinical comparison of Tc-99 m HEDP and Tc-99 m MDP in the detection of bone metastases: concise communication. J Nucl Med 20(2):98–101PubMed Fogelman I, Citrin DL, McKillop JH, Turner JG, Bessent RG, Greig WR (1979) A clinical comparison of Tc-99 m HEDP and Tc-99 m MDP in the detection of bone metastases: concise communication. J Nucl Med 20(2):98–101PubMed
4.
go back to reference Bevan JA, Tofe AJ, Benedict JJ, Francis MD, Barnett BL (1980) Tc-99 m HMDP(hydroxymethlene diphosphonate): a radiopharmaceutical for skeletal and acute myocardial infarct imaging. I. Synthesis and distribution in animals. J Nuclear Med 21(10):961–966 Bevan JA, Tofe AJ, Benedict JJ, Francis MD, Barnett BL (1980) Tc-99 m HMDP(hydroxymethlene diphosphonate): a radiopharmaceutical for skeletal and acute myocardial infarct imaging. I. Synthesis and distribution in animals. J Nuclear Med 21(10):961–966
5.
go back to reference Solowy MS, Hardeman SW, Hickey D, Raymond J, Todd B, Soloway S, Moinuddin M (1988) Stratification of patients with metastatic prostate cancer based on extent of disease on initial bone scan. Cancer 61(1):195–202CrossRef Solowy MS, Hardeman SW, Hickey D, Raymond J, Todd B, Soloway S, Moinuddin M (1988) Stratification of patients with metastatic prostate cancer based on extent of disease on initial bone scan. Cancer 61(1):195–202CrossRef
6.
go back to reference Erdi YE, Humm JL, Imbriaco M, Yeung H, Larson SM (1997) Quantitative bone metastases analysis based on image segmentation. J Nuclear Med 38(9):1401–1406 Erdi YE, Humm JL, Imbriaco M, Yeung H, Larson SM (1997) Quantitative bone metastases analysis based on image segmentation. J Nuclear Med 38(9):1401–1406
7.
go back to reference Wyngaert TV, Strobel K, Kampen WU, Kuwert T, van der Bruggen W, Mohan HK, Gnanasegaran G, Delgado-Bolton R, Weber WA, Beheshti M, Langsteger W, Giammarile F, Mottaghy FM, Paycha F (2016) The EANM practice guideline for bone scintigraphy. Eur J Nucl Med Mol Imaging 43(9):1723–1738CrossRef Wyngaert TV, Strobel K, Kampen WU, Kuwert T, van der Bruggen W, Mohan HK, Gnanasegaran G, Delgado-Bolton R, Weber WA, Beheshti M, Langsteger W, Giammarile F, Mottaghy FM, Paycha F (2016) The EANM practice guideline for bone scintigraphy. Eur J Nucl Med Mol Imaging 43(9):1723–1738CrossRef
8.
go back to reference Yin TK, Chiu NT (2004) A computer-aided diagnosis for locating abnormalities in bone scintigraphy by a fuzzy system with a three-step minimization approach. IEEE Trans Med Imaging 23(5):639–654CrossRef Yin TK, Chiu NT (2004) A computer-aided diagnosis for locating abnormalities in bone scintigraphy by a fuzzy system with a three-step minimization approach. IEEE Trans Med Imaging 23(5):639–654CrossRef
9.
go back to reference Huang JY, Kao PF, Chen YS (2007) A set of image processing algorithms for computer-aided diagnosis in nuclear medicine whole body bone scan images. IEEE Trans Nuclear Sci 54(3):514–522CrossRef Huang JY, Kao PF, Chen YS (2007) A set of image processing algorithms for computer-aided diagnosis in nuclear medicine whole body bone scan images. IEEE Trans Nuclear Sci 54(3):514–522CrossRef
10.
go back to reference Shiraishi J, Li Q, Appelbaum D, Pu Y, Doi K (2007) Development of a computer-aided diagnostic scheme for detection of interval changes in successive whole-body bone scans. Med Phys 34(1):25–36CrossRef Shiraishi J, Li Q, Appelbaum D, Pu Y, Doi K (2007) Development of a computer-aided diagnostic scheme for detection of interval changes in successive whole-body bone scans. Med Phys 34(1):25–36CrossRef
11.
go back to reference Sajn L, Kononenko I, Milčinski M (2007) Computerized segmentation and diagnostics of whole-body bone scintigrams. Comput Med Imaging Graph 31:531–541CrossRef Sajn L, Kononenko I, Milčinski M (2007) Computerized segmentation and diagnostics of whole-body bone scintigrams. Comput Med Imaging Graph 31:531–541CrossRef
12.
go back to reference Sadik M, Jakobsson D, Olofsson F, Ohlsson M, Suurkula M, Edenbrandt L (2006) A new computer-based decision-support system for the interpretation of bone scans. Nucl Med Commun 27(6):417–423CrossRef Sadik M, Jakobsson D, Olofsson F, Ohlsson M, Suurkula M, Edenbrandt L (2006) A new computer-based decision-support system for the interpretation of bone scans. Nucl Med Commun 27(6):417–423CrossRef
13.
go back to reference Sadik M, Hamadeh I, Nordblom P, Suurkula M, Höglund P, Ohlsson M, Edenbrandt L (2008) Computer-assisted interpretation of planar whole-body bone scans. J Nuclear Med 49(12):1958–1965CrossRef Sadik M, Hamadeh I, Nordblom P, Suurkula M, Höglund P, Ohlsson M, Edenbrandt L (2008) Computer-assisted interpretation of planar whole-body bone scans. J Nuclear Med 49(12):1958–1965CrossRef
14.
go back to reference Sadik M, Suurkula M, Höglund P, Järund A, Edenbrandt L (2009) Improved classifications of planar whole-body bone scans using a computer-assisted diagnosis system: a multicenter, multiple-reader, multiple-case study. J Nuclear Med 50(3):368–375CrossRef Sadik M, Suurkula M, Höglund P, Järund A, Edenbrandt L (2009) Improved classifications of planar whole-body bone scans using a computer-assisted diagnosis system: a multicenter, multiple-reader, multiple-case study. J Nuclear Med 50(3):368–375CrossRef
15.
go back to reference Snyder WS, Cook MJ, Nasset ES, Karhausen LR, Howells GP, Tipton IH (1975) International commission on radiological protection. Report of the task group on reference man, ICRP publication 23, New York Snyder WS, Cook MJ, Nasset ES, Karhausen LR, Howells GP, Tipton IH (1975) International commission on radiological protection. Report of the task group on reference man, ICRP publication 23, New York
16.
go back to reference Kikuchi A, Onoguchi M, Horikoshi H, Sjöstrand K, Edenbrandt L (2012) Automated segmentation of the skeleton whole-body bone scans: influence of difference in atlas. Nucl Med Commun 33(9):947–953CrossRef Kikuchi A, Onoguchi M, Horikoshi H, Sjöstrand K, Edenbrandt L (2012) Automated segmentation of the skeleton whole-body bone scans: influence of difference in atlas. Nucl Med Commun 33(9):947–953CrossRef
17.
go back to reference Horikoshi H, Kikuchi A, Onoguchi M, Sjöstrand K, Edenbrandt L (2012) Computer-aided diagnosis system for bone scintigrams from Japanese patients: importance of training database. Ann Nucl Med 26:622–626CrossRef Horikoshi H, Kikuchi A, Onoguchi M, Sjöstrand K, Edenbrandt L (2012) Computer-aided diagnosis system for bone scintigrams from Japanese patients: importance of training database. Ann Nucl Med 26:622–626CrossRef
18.
go back to reference Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, Abrahamsson PA, Björk T, Gerdtsson A, Bjartell A, Gjertsson P, Höglund P, Lomsky M, Ohlsson M, Richter J, Sadik M, Morris MJ, Scher HI, Larsone SM (2012) A novel automated platform for quantifying the extent of skeletal tumour involvement in prostate cancer patients using the bone scan index. Eur Urol 62(1):78–84CrossRef Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, Abrahamsson PA, Björk T, Gerdtsson A, Bjartell A, Gjertsson P, Höglund P, Lomsky M, Ohlsson M, Richter J, Sadik M, Morris MJ, Scher HI, Larsone SM (2012) A novel automated platform for quantifying the extent of skeletal tumour involvement in prostate cancer patients using the bone scan index. Eur Urol 62(1):78–84CrossRef
19.
go back to reference Nakajima K, Nakajima Y, Horikoshi H, Ueno M, Wakabayashi H, Shiga T, Yoshimura M, Ohtak E, Sugawara Y, Matsuyama H, Edenbrandt L (2013) Enhanced diagnostic accuracy for quantitative bone scan using an artificial neural network system: a Japanese multi-center database project. EJNMMI Res 3:83CrossRef Nakajima K, Nakajima Y, Horikoshi H, Ueno M, Wakabayashi H, Shiga T, Yoshimura M, Ohtak E, Sugawara Y, Matsuyama H, Edenbrandt L (2013) Enhanced diagnostic accuracy for quantitative bone scan using an artificial neural network system: a Japanese multi-center database project. EJNMMI Res 3:83CrossRef
20.
go back to reference Petersen LJ, Mortensen JC, Bertelsen H, Zacho H (2015) Computer-assisted interpretation of planar whole-body bone scintigraphy in patients with newly diagnosed prostate cancer. Nucl Med Commun 36(7):679–685CrossRef Petersen LJ, Mortensen JC, Bertelsen H, Zacho H (2015) Computer-assisted interpretation of planar whole-body bone scintigraphy in patients with newly diagnosed prostate cancer. Nucl Med Commun 36(7):679–685CrossRef
21.
go back to reference Koizumi M, Miyaji N, Murata T, Motegi K, Miwa K, Koyama M, Terauchi T, Wagatsuma K, Kawakami K, Richter J (2015) Evaluation of a revised version of computer-assisted diagnosis system, BONENAVI Version 2.1.7, for bone scintigraphy in cancer patients. Ann Nucl Med 29:659–665CrossRef Koizumi M, Miyaji N, Murata T, Motegi K, Miwa K, Koyama M, Terauchi T, Wagatsuma K, Kawakami K, Richter J (2015) Evaluation of a revised version of computer-assisted diagnosis system, BONENAVI Version 2.1.7, for bone scintigraphy in cancer patients. Ann Nucl Med 29:659–665CrossRef
22.
go back to reference Brown MS, Chu GH, Kim GHJ, Auerbach MA, Poon C, Bridge J, Vidovic A, Ramakrishn B, Ho J, Morris MJ, Larson SM, Scher HI, Goldin JG (2012) Computer-aided quantitative bone scan assessment of prostate cancer treatment response. Nucl Med Commun 33(4):384–394CrossRef Brown MS, Chu GH, Kim GHJ, Auerbach MA, Poon C, Bridge J, Vidovic A, Ramakrishn B, Ho J, Morris MJ, Larson SM, Scher HI, Goldin JG (2012) Computer-aided quantitative bone scan assessment of prostate cancer treatment response. Nucl Med Commun 33(4):384–394CrossRef
23.
go back to reference Brown MS, Kim GHJ, Chu GH, Ramakrishn B, Auerbach MA, Fischer CP, Levine B, Gupta PK, Schiepers CW, Goldin JG (2018) Quantitative bone scan lesion area as an early surrogate outcome measure indicative of overall survival in etastatic prostate cancer. J Med Imaging 5(1):011017-1-6CrossRef Brown MS, Kim GHJ, Chu GH, Ramakrishn B, Auerbach MA, Fischer CP, Levine B, Gupta PK, Schiepers CW, Goldin JG (2018) Quantitative bone scan lesion area as an early surrogate outcome measure indicative of overall survival in etastatic prostate cancer. J Med Imaging 5(1):011017-1-6CrossRef
24.
go back to reference Iglesias JE, Sabuncu MR (2015) Multi-atlas segmentation of biomedical images: a survey. Med Image Anal 24(1):205–219CrossRef Iglesias JE, Sabuncu MR (2015) Multi-atlas segmentation of biomedical images: a survey. Med Image Anal 24(1):205–219CrossRef
25.
go back to reference Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRef Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88CrossRef
26.
go back to reference Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252CrossRef Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252CrossRef
28.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Interv 9351:234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Med Image Comput Comput Assist Interv 9351:234–241
29.
go back to reference Milletari F, Navab N, Ahmadi S-A (2016), V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 4th international conference on 3D vision, pp 565–571 Milletari F, Navab N, Ahmadi S-A (2016), V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 4th international conference on 3D vision, pp 565–571
30.
go back to reference Sekuboyina A, Rempfler M, Kukačka J, Tetteh G, Valentinitsch A, Kirschke JS, Menze BH (2018) Btrfly net: vertebrae labelling with energy based adversarial learning of local spine prior, vol 4, pp 649–657, MICCAI2018 Sekuboyina A, Rempfler M, Kukačka J, Tetteh G, Valentinitsch A, Kirschke JS, Menze BH (2018) Btrfly net: vertebrae labelling with energy based adversarial learning of local spine prior, vol 4, pp 649–657, MICCAI2018
31.
go back to reference Dou Q, Yu L, Chen H, Jin Y, Yang X, Qin J, Heng P-A (2017) 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41(10):40–54CrossRef Dou Q, Yu L, Chen H, Jin Y, Yang X, Qin J, Heng P-A (2017) 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41(10):40–54CrossRef
32.
go back to reference He K, Zhang X, Ren S, Sun J (2017) Deep residual learning for image recognition, CVPR2016, pp 770–778 He K, Zhang X, Ren S, Sun J (2017) Deep residual learning for image recognition, CVPR2016, pp 770–778
33.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification, ICCV2015, pp 1026–1034 He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification, ICCV2015, pp 1026–1034
Metadata
Title
Automated measurement of bone scan index from a whole-body bone scintigram
Authors
Akinobu Shimizu
Hayato Wakabayashi
Takumi Kanamori
Atsushi Saito
Kazuhiro Nishikawa
Hiromitsu Daisaki
Shigeaki Higashiyama
Joji Kawabe
Publication date
01-03-2020
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 3/2020
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-02105-x

Other articles of this Issue 3/2020

International Journal of Computer Assisted Radiology and Surgery 3/2020 Go to the issue