Skip to main content
Top
Published in: Abdominal Radiology 6/2019

01-06-2019 | Special Section: Radiogenomics

Deep transfer learning-based prostate cancer classification using 3 Tesla multi-parametric MRI

Authors: Xinran Zhong, Ruiming Cao, Sepideh Shakeri, Fabien Scalzo, Yeejin Lee, Dieter R. Enzmann, Holden H. Wu, Steven S. Raman, Kyunghyun Sung

Published in: Abdominal Radiology | Issue 6/2019

Login to get access

Abstract

Purpose

The purpose of the study was to propose a deep transfer learning (DTL)-based model to distinguish indolent from clinically significant prostate cancer (PCa) lesions and to compare the DTL-based model with a deep learning (DL) model without transfer learning and PIRADS v2 score on 3 Tesla multi-parametric MRI (3T mp-MRI) with whole-mount histopathology (WMHP) validation.

Methods

With IRB approval, 140 patients with 3T mp-MRI and WMHP comprised the study cohort. The DTL-based model was trained on 169 lesions in 110 arbitrarily selected patients and tested on the remaining 47 lesions in 30 patients. We compared the DTL-based model with the same DL model architecture trained from scratch and the classification based on PIRADS v2 score with a threshold of 4 using accuracy, sensitivity, specificity, and area under curve (AUC). Bootstrapping with 2000 resamples was performed to estimate the 95% confidence interval (CI) for AUC.

Results

After training on 169 lesions in 110 patients, the AUC of discriminating indolent from clinically significant PCa lesions of the DTL-based model, DL model without transfer learning and PIRADS v2 score ≥ 4 were 0.726 (CI [0.575, 0.876]), 0.687 (CI [0.532, 0.843]), and 0.711 (CI [0.575, 0.847]), respectively, in the testing set. The DTL-based model achieved higher AUC compared to the DL model without transfer learning and PIRADS v2 score ≥ 4 in discriminating clinically significant lesions in the testing set.

Conclusion

The DeLong test indicated that the DTL-based model achieved comparable AUC compared to the classification based on PIRADS v2 score (p = 0.89).
Literature
1.
go back to reference Siegel RL, Miller KD, Jemal A (2018) Cancer statistics, 2018. CA Cancer J Clin 68:7–30.CrossRef Siegel RL, Miller KD, Jemal A (2018) Cancer statistics, 2018. CA Cancer J Clin 68:7–30.CrossRef
2.
go back to reference Ahmed HU, Akin O, Coleman JA, Crane S, Emberton M, Goldenberg L, Hricak H, Kattan MW, Kurhanewicz J, Moore CM, Parker C, Polascik TJ, Scardino P, van As N, Villers A (2012) Transatlantic Consensus Group on active surveillance and focal therapy for prostate cancer. BJU Int 109:1636–1647.CrossRefPubMed Ahmed HU, Akin O, Coleman JA, Crane S, Emberton M, Goldenberg L, Hricak H, Kattan MW, Kurhanewicz J, Moore CM, Parker C, Polascik TJ, Scardino P, van As N, Villers A (2012) Transatlantic Consensus Group on active surveillance and focal therapy for prostate cancer. BJU Int 109:1636–1647.CrossRefPubMed
3.
go back to reference Lavery HJ, Droller MJ (2012) Do gleason patterns 3 and 4 prostate cancer represent separate disease states? J Urol 188:1667–1675.CrossRefPubMed Lavery HJ, Droller MJ (2012) Do gleason patterns 3 and 4 prostate cancer represent separate disease states? J Urol 188:1667–1675.CrossRefPubMed
4.
go back to reference Felker ER, Raman SS, Margolis DJ, Lu DSK, Shaheen N, Natarajan S, Sharma D, Huang J, Dorey F, Marks LS (2017) Risk Stratification Among Men With Prostate Imaging Reporting and Data System version 2 Category 3 Transition Zone Lesions: Is Biopsy Always Necessary? Am J Roentgenol 209:1272–1277.CrossRef Felker ER, Raman SS, Margolis DJ, Lu DSK, Shaheen N, Natarajan S, Sharma D, Huang J, Dorey F, Marks LS (2017) Risk Stratification Among Men With Prostate Imaging Reporting and Data System version 2 Category 3 Transition Zone Lesions: Is Biopsy Always Necessary? Am J Roentgenol 209:1272–1277.CrossRef
5.
go back to reference Schröder FH, Hugosson J, Roobol MJ, Tammela TLJ, Ciatto S, Nelen V, Kwiatkowski M, Lujan M, Lilja H, Zappa M, Denis LJ, Recker F, Berenguer A, Määttänen L, Bangma CH, Aus G, Villers A, Rebillard X, van der Kwast T, Blijenberg BG, Moss SM, de Koning HJ, Auvinen A (2009) Screening and Prostate-Cancer Mortality in a Randomized European Study. N Engl J Med 360:1320–1328.CrossRefPubMed Schröder FH, Hugosson J, Roobol MJ, Tammela TLJ, Ciatto S, Nelen V, Kwiatkowski M, Lujan M, Lilja H, Zappa M, Denis LJ, Recker F, Berenguer A, Määttänen L, Bangma CH, Aus G, Villers A, Rebillard X, van der Kwast T, Blijenberg BG, Moss SM, de Koning HJ, Auvinen A (2009) Screening and Prostate-Cancer Mortality in a Randomized European Study. N Engl J Med 360:1320–1328.CrossRefPubMed
6.
go back to reference Caster JM, Falchook AD, Hendrix LH, Chen RC (2015) Risk of Pathologic Upgrading or Locally Advanced Disease in Early Prostate Cancer Patients Based on Biopsy Gleason Score and PSA: A Population-Based Study of Modern Patients. Int J Radiat Oncol Biol Phys 92:244–51.CrossRefPubMed Caster JM, Falchook AD, Hendrix LH, Chen RC (2015) Risk of Pathologic Upgrading or Locally Advanced Disease in Early Prostate Cancer Patients Based on Biopsy Gleason Score and PSA: A Population-Based Study of Modern Patients. Int J Radiat Oncol Biol Phys 92:244–51.CrossRefPubMed
7.
go back to reference Cohen MS, Hanley RS, Kurteva T, Ruthazer R, Silverman ML, Sorcini A, Hamawy K, Roth RA, Tuerk I, Libertino JA (2008) Comparing the Gleason Prostate Biopsy and Gleason Prostatectomy Grading System: The Lahey Clinic Medical Center Experience and an International Meta-Analysis. Eur Urol 54:371–381.CrossRefPubMed Cohen MS, Hanley RS, Kurteva T, Ruthazer R, Silverman ML, Sorcini A, Hamawy K, Roth RA, Tuerk I, Libertino JA (2008) Comparing the Gleason Prostate Biopsy and Gleason Prostatectomy Grading System: The Lahey Clinic Medical Center Experience and an International Meta-Analysis. Eur Urol 54:371–381.CrossRefPubMed
8.
go back to reference Hoeks CMA, Barentsz JO, Hambrock T, Yakar D, Somford DM, Heijmink SWTPJ, Scheenen TWJ, Vos PC, Huisman H, van Oort IM, Witjes JA, Heerschap A, Fütterer JJ (2011) Prostate cancer: multiparametric MR imaging for detection, localization, and staging. Radiology 261:46–66.CrossRefPubMed Hoeks CMA, Barentsz JO, Hambrock T, Yakar D, Somford DM, Heijmink SWTPJ, Scheenen TWJ, Vos PC, Huisman H, van Oort IM, Witjes JA, Heerschap A, Fütterer JJ (2011) Prostate cancer: multiparametric MR imaging for detection, localization, and staging. Radiology 261:46–66.CrossRefPubMed
9.
go back to reference Tan N, Margolis DJ, Lu DY, King KG, Huang J, Reiter RE, Raman SS (2015) Characteristics of detected and missed prostate cancer foci on 3-T multiparametric MRI using an endorectal coil correlated with whole-mount thin-section histopathology. Am J Roentgenol 205:W87–W92.CrossRef Tan N, Margolis DJ, Lu DY, King KG, Huang J, Reiter RE, Raman SS (2015) Characteristics of detected and missed prostate cancer foci on 3-T multiparametric MRI using an endorectal coil correlated with whole-mount thin-section histopathology. Am J Roentgenol 205:W87–W92.CrossRef
10.
go back to reference Litjens GJS, Barentsz JO, Karssemeijer N, Huisman HJ (2015) Clinical evaluation of a computer-aided diagnosis system for determining cancer aggressiveness in prostate MRI. Eur Radiol 3187–3199. Litjens GJS, Barentsz JO, Karssemeijer N, Huisman HJ (2015) Clinical evaluation of a computer-aided diagnosis system for determining cancer aggressiveness in prostate MRI. Eur Radiol 3187–3199.
11.
go back to reference ACM (2015) Pi-Rads Prostate Imaging - Reporting and Data System. Am. Coll. Radiol. ACM (2015) Pi-Rads Prostate Imaging - Reporting and Data System. Am. Coll. Radiol.
12.
go back to reference Giannarini G, Girometti R, Sioletic S, Rossanese M, Palumbo V, Calandriello M, Crestani A, Zuiani C, Ficarra V (2018) Inter-reader agreement of Prostate Imaging Reporting and Data System version 2 in detecting prostate cancer on 3 Tesla multiparametric MRI: A prospective study on patients referred to radical prostatectomy. Eur Urol Suppl 17:e893.CrossRef Giannarini G, Girometti R, Sioletic S, Rossanese M, Palumbo V, Calandriello M, Crestani A, Zuiani C, Ficarra V (2018) Inter-reader agreement of Prostate Imaging Reporting and Data System version 2 in detecting prostate cancer on 3 Tesla multiparametric MRI: A prospective study on patients referred to radical prostatectomy. Eur Urol Suppl 17:e893.CrossRef
13.
go back to reference Vaché T, Bratan F, Mège-Lechevallier F, Roche S, Rabilloud M, Rouvière O (2014) Characterization of Prostate Lesions as Benign or Malignant at Multiparametric MR Imaging: Comparison of Three Scoring Systems in Patients Treated with Radical Prostatectomy. Radiology 272:446–455.CrossRefPubMed Vaché T, Bratan F, Mège-Lechevallier F, Roche S, Rabilloud M, Rouvière O (2014) Characterization of Prostate Lesions as Benign or Malignant at Multiparametric MR Imaging: Comparison of Three Scoring Systems in Patients Treated with Radical Prostatectomy. Radiology 272:446–455.CrossRefPubMed
15.
go back to reference Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J (2016) Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? IEEE Trans Med Imaging 35:1299–1312.CrossRefPubMed Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Liang J (2016) Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? IEEE Trans Med Imaging 35:1299–1312.CrossRefPubMed
16.
go back to reference Wu S, Zhong S, Liu Y (2017) Deep residual learning for image steganalysis. Multimed Tools Appl 1–17. Wu S, Zhong S, Liu Y (2017) Deep residual learning for image steganalysis. Multimed Tools Appl 1–17.
17.
go back to reference Le MH, Chen J, Wang L, Wang Z, Liu W, Cheng K-T (Tim), Yang X (2017) Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks. Phys Med Biol 62:6497–6514.CrossRefPubMed Le MH, Chen J, Wang L, Wang Z, Liu W, Cheng K-T (Tim), Yang X (2017) Automated diagnosis of prostate cancer in multi-parametric MRI based on multimodal convolutional neural networks. Phys Med Biol 62:6497–6514.CrossRefPubMed
18.
go back to reference Krizhevsky A (2009) Learning Multiple Layers of Features from Tiny Images. Krizhevsky A (2009) Learning Multiple Layers of Features from Tiny Images.
19.
go back to reference Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: Convolutional Architecture for Fast Feature Embedding. Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: Convolutional Architecture for Fast Feature Embedding.
20.
go back to reference Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. Shin H-C, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning.
21.
go back to reference He K, Zhang X, Ren S, Sun J (2015) Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. He K, Zhang X, Ren S, Sun J (2015) Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification.
22.
go back to reference Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez J-C, Müller M (2011) pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 12:77.CrossRefPubMedPubMedCentral Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez J-C, Müller M (2011) pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics 12:77.CrossRefPubMedPubMedCentral
23.
go back to reference R Core Team (2014) R: A language and environment for statistical computing. R Found Stat Comput Vienna, Austria 2014. R Core Team (2014) R: A language and environment for statistical computing. R Found Stat Comput Vienna, Austria 2014.
26.
go back to reference Ishioka J, Matsuoka Y, Uehara S, Yasuda Y, Kijima T, Yoshida S, Yokoyama M, Saito K, Kihara K, Numao N, Kimura T, Kudo K, Kumazawa I, Fujii Y (2018) Computer-aided diagnosis of prostate cancer on magnetic resonance imaging using a convolutional neural network algorithm. BJU Int 122:411–417.CrossRefPubMed Ishioka J, Matsuoka Y, Uehara S, Yasuda Y, Kijima T, Yoshida S, Yokoyama M, Saito K, Kihara K, Numao N, Kimura T, Kudo K, Kumazawa I, Fujii Y (2018) Computer-aided diagnosis of prostate cancer on magnetic resonance imaging using a convolutional neural network algorithm. BJU Int 122:411–417.CrossRefPubMed
Metadata
Title
Deep transfer learning-based prostate cancer classification using 3 Tesla multi-parametric MRI
Authors
Xinran Zhong
Ruiming Cao
Sepideh Shakeri
Fabien Scalzo
Yeejin Lee
Dieter R. Enzmann
Holden H. Wu
Steven S. Raman
Kyunghyun Sung
Publication date
01-06-2019
Publisher
Springer US
Published in
Abdominal Radiology / Issue 6/2019
Print ISSN: 2366-004X
Electronic ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-018-1824-5

Other articles of this Issue 6/2019

Abdominal Radiology 6/2019 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.