Skip to main content
Top
Published in: European Radiology 10/2018

01-10-2018 | Magnetic Resonance

Computer-aided diagnosis prior to conventional interpretation of prostate mpMRI: an international multi-reader study

Authors: Matthew D. Greer, Nathan Lay, Joanna H. Shih, Tristan Barrett, Leonardo Kayat Bittencourt, Samuel Borofsky, Ismail Kabakus, Yan Mee Law, Jamie Marko, Haytham Shebel, Francesca V. Mertan, Maria J. Merino, Bradford J. Wood, Peter A. Pinto, Ronald M. Summers, Peter L. Choyke, Baris Turkbey

Published in: European Radiology | Issue 10/2018

Login to get access

Abstract

Objectives

To evaluate if computer-aided diagnosis (CAD) prior to prostate multi-parametric MRI (mpMRI) can improve sensitivity and agreement between radiologists.

Methods

Nine radiologists (three each high, intermediate, low experience) from eight institutions participated. A total of 163 patients with 3-T mpMRI from 4/2012 to 6/2015 were included: 110 cancer patients with prostatectomy after mpMRI, 53 patients with no lesions on mpMRI and negative TRUS-guided biopsy. Readers were blinded to all outcomes and detected lesions per PI-RADSv2 on mpMRI. After 5 weeks, readers re-evaluated patients using CAD to detect lesions. Prostatectomy specimens registered to MRI were ground truth with index lesions defined on pathology. Sensitivity, specificity and agreement were calculated per patient, lesion level and zone—peripheral (PZ) and transition (TZ).

Results

Index lesion sensitivity was 78.2% for mpMRI alone and 86.3% for CAD-assisted mpMRI (p = 0.013). Sensitivity was comparable for TZ lesions (78.7% vs 78.1%; p = 0.929); CAD improved PZ lesion sensitivity (84% vs 94%; p = 0.003). Improved sensitivity came from lesions scored PI-RADS < 3 as index lesion sensitivity was comparable at PI-RADS ≥ 3 (77.6% vs 78.1%; p = 0.859). Per patient specificity was 57.1% for CAD and 70.4% for mpMRI (p = 0.003). CAD improved agreement between all readers (56.9% vs 71.8%; p < 0.001).

Conclusions

CAD-assisted mpMRI improved sensitivity and agreement, but decreased specificity, between radiologists of varying experience.

Key Points

• Computer-aided diagnosis (CAD) assists clinicians in detecting prostate cancer on MRI.
• CAD assistance improves agreement between radiologists in detecting prostate cancer lesions.
• However, this CAD system induces more false positives, particularly for less-experienced clinicians and in the transition zone.
• CAD assists radiologists in detecting cancer missed on MRI, suggesting a path for improved diagnostic confidence.
Appendix
Available only for authorised users
Literature
1.
go back to reference Society AC (2016) Cancer facts & figures 2016. American Cancer Society, Atlanta Society AC (2016) Cancer facts & figures 2016. American Cancer Society, Atlanta
2.
go back to reference Graif T, Loeb S, Roehl KA et al (2007) Under diagnosis and over diagnosis of prostate cancer. J Urol 178:88–92CrossRef Graif T, Loeb S, Roehl KA et al (2007) Under diagnosis and over diagnosis of prostate cancer. J Urol 178:88–92CrossRef
3.
go back to reference Draisma G, Etzioni R, Tsodikov A et al (2009) Lead time and overdiagnosis in prostate-specific antigen screening: importance of methods and context. J Natl Cancer Inst 101:374–383CrossRef Draisma G, Etzioni R, Tsodikov A et al (2009) Lead time and overdiagnosis in prostate-specific antigen screening: importance of methods and context. J Natl Cancer Inst 101:374–383CrossRef
4.
go back to reference Brown AM, Elbuluk O, Mertan F et al (2015) Recent advances in image-guided targeted prostate biopsy. Abdom Imaging 40:1788–1799CrossRef Brown AM, Elbuluk O, Mertan F et al (2015) Recent advances in image-guided targeted prostate biopsy. Abdom Imaging 40:1788–1799CrossRef
5.
go back to reference Meng X, Rosenkrantz AB, Mendhiratta N et al (2016) Relationship between prebiopsy multiparametric magnetic resonance imaging (MRI), biopsy indication, and MRI-ultrasound fusion-targeted prostate biopsy outcomes. Eur Urol 69:512–517CrossRef Meng X, Rosenkrantz AB, Mendhiratta N et al (2016) Relationship between prebiopsy multiparametric magnetic resonance imaging (MRI), biopsy indication, and MRI-ultrasound fusion-targeted prostate biopsy outcomes. Eur Urol 69:512–517CrossRef
6.
go back to reference Siddiqui MM, Rais-Bahrami S, Turkbey B et al (2015) Comparison of MR/ultrasound fusion-guided biopsy with ultrasound-guided biopsy for the diagnosis of prostate cancer. Jama 313:390–397CrossRef Siddiqui MM, Rais-Bahrami S, Turkbey B et al (2015) Comparison of MR/ultrasound fusion-guided biopsy with ultrasound-guided biopsy for the diagnosis of prostate cancer. Jama 313:390–397CrossRef
7.
go back to reference Schoots IG, Roobol MJ, Nieboer D, Bangma CH, Steyerberg EW, Hunink MG (2015) Magnetic resonance imaging-targeted biopsy may enhance the diagnostic accuracy of significant prostate cancer detection compared to standard transrectal ultrasound-guided biopsy: a systematic review and meta-analysis. Eur Urol 68:438–450CrossRef Schoots IG, Roobol MJ, Nieboer D, Bangma CH, Steyerberg EW, Hunink MG (2015) Magnetic resonance imaging-targeted biopsy may enhance the diagnostic accuracy of significant prostate cancer detection compared to standard transrectal ultrasound-guided biopsy: a systematic review and meta-analysis. Eur Urol 68:438–450CrossRef
9.
go back to reference Rosenkrantz AB, Deng FM, Kim S et al (2012) Prostate cancer: multiparametric MRI for index lesion localization–a multiple-reader study. AJR Am J Roentgenol 199:830–837CrossRef Rosenkrantz AB, Deng FM, Kim S et al (2012) Prostate cancer: multiparametric MRI for index lesion localization–a multiple-reader study. AJR Am J Roentgenol 199:830–837CrossRef
11.
go back to reference Garcia-Reyes K, Passoni NM, Palmeri ML et al (2015) Detection of prostate cancer with multiparametric MRI (mpMRI): effect of dedicated reader education on accuracy and confidence of index and anterior cancer diagnosis. Abdom Imaging 40:134–142CrossRef Garcia-Reyes K, Passoni NM, Palmeri ML et al (2015) Detection of prostate cancer with multiparametric MRI (mpMRI): effect of dedicated reader education on accuracy and confidence of index and anterior cancer diagnosis. Abdom Imaging 40:134–142CrossRef
12.
go back to reference Gaziev G, Wadhwa K, Barrett T et al (2016) Defining the learning curve for multiparametric magnetic resonance imaging (MRI) of the prostate using MRI-transrectal ultrasonography (TRUS) fusion-guided transperineal prostate biopsies as a validation tool. BJU Int 117:80–86CrossRef Gaziev G, Wadhwa K, Barrett T et al (2016) Defining the learning curve for multiparametric magnetic resonance imaging (MRI) of the prostate using MRI-transrectal ultrasonography (TRUS) fusion-guided transperineal prostate biopsies as a validation tool. BJU Int 117:80–86CrossRef
13.
go back to reference Wang S, Burtt K, Turkbey B, Choyke P, Summers RM (2014) Computer aided-diagnosis of prostate cancer on multiparametric MRI: a technical review of current research. Biomed Res Int 2014:789561PubMedPubMedCentral Wang S, Burtt K, Turkbey B, Choyke P, Summers RM (2014) Computer aided-diagnosis of prostate cancer on multiparametric MRI: a technical review of current research. Biomed Res Int 2014:789561PubMedPubMedCentral
16.
go back to reference Litjens GJ, Barentsz JO, Karssemeijer N, Huisman HJ (2015) Clinical evaluation of a computer-aided diagnosis system for determining cancer aggressiveness in prostate MRI. Eur Radiol 25:3187–3199CrossRef Litjens GJ, Barentsz JO, Karssemeijer N, Huisman HJ (2015) Clinical evaluation of a computer-aided diagnosis system for determining cancer aggressiveness in prostate MRI. Eur Radiol 25:3187–3199CrossRef
17.
go back to reference Peng Y, Jiang Y, Yang C et al (2013) Quantitative analysis of multiparametric prostate MR images: differentiation between prostate cancer and normal tissue and correlation with Gleason score–a computer-aided diagnosis development study. Radiology 267:787–796CrossRef Peng Y, Jiang Y, Yang C et al (2013) Quantitative analysis of multiparametric prostate MR images: differentiation between prostate cancer and normal tissue and correlation with Gleason score–a computer-aided diagnosis development study. Radiology 267:787–796CrossRef
18.
go back to reference Tiwari P, Kurhanewicz J, Madabhushi A (2013) Multi-kernel graph embedding for detection, Gleason grading of prostate cancer via MRI/MRS. Med Image Anal 17:219–235CrossRef Tiwari P, Kurhanewicz J, Madabhushi A (2013) Multi-kernel graph embedding for detection, Gleason grading of prostate cancer via MRI/MRS. Med Image Anal 17:219–235CrossRef
19.
go back to reference Niaf E, Lartizien C, Bratan F et al (2014) Prostate focal peripheral zone lesions: characterization at multiparametric MR imaging–influence of a computer-aided diagnosis system. Radiology 271:761–769CrossRef Niaf E, Lartizien C, Bratan F et al (2014) Prostate focal peripheral zone lesions: characterization at multiparametric MR imaging–influence of a computer-aided diagnosis system. Radiology 271:761–769CrossRef
20.
go back to reference Niaf E, Rouviere O, Mege-Lechevallier F, Bratan F, Lartizien C (2012) Computer-aided diagnosis of prostate cancer in the peripheral zone using multiparametric MRI. Phys Med Biol 57:3833–3851CrossRef Niaf E, Rouviere O, Mege-Lechevallier F, Bratan F, Lartizien C (2012) Computer-aided diagnosis of prostate cancer in the peripheral zone using multiparametric MRI. Phys Med Biol 57:3833–3851CrossRef
21.
go back to reference Hambrock T, Vos PC, Hulsbergen-van de Kaa CA, Barentsz JO, Huisman HJ (2013) Prostate cancer: computer-aided diagnosis with multiparametric 3-T MR imaging–effect on observer performance. Radiology 266:521–530CrossRef Hambrock T, Vos PC, Hulsbergen-van de Kaa CA, Barentsz JO, Huisman HJ (2013) Prostate cancer: computer-aided diagnosis with multiparametric 3-T MR imaging–effect on observer performance. Radiology 266:521–530CrossRef
22.
go back to reference Berbaum KS, Krupinski EA, Schartz KM et al (2015) Satisfaction of search in chest radiography 2015. Acad Radiol 22:1457–1465CrossRef Berbaum KS, Krupinski EA, Schartz KM et al (2015) Satisfaction of search in chest radiography 2015. Acad Radiol 22:1457–1465CrossRef
23.
go back to reference Lay N, Tsehay Y, Greer MD et al (2017) Detection of prostate cancer in multiparametric MRI using random forest with instance weighting. J Med Imaging (Bellingham) 4:024506CrossRef Lay N, Tsehay Y, Greer MD et al (2017) Detection of prostate cancer in multiparametric MRI using random forest with instance weighting. J Med Imaging (Bellingham) 4:024506CrossRef
25.
go back to reference Radiology ACo (2015) MR Prostate Imaging Reporting and Data System version 2.0. Radiology ACo (2015) MR Prostate Imaging Reporting and Data System version 2.0.
26.
go back to reference Shah V, Pohida T, Turkbey B et al (2009) A method for correlating in vivo prostate magnetic resonance imaging and histopathology using individualized magnetic resonance-based molds. Rev Sci Instrum 80:104301CrossRef Shah V, Pohida T, Turkbey B et al (2009) A method for correlating in vivo prostate magnetic resonance imaging and histopathology using individualized magnetic resonance-based molds. Rev Sci Instrum 80:104301CrossRef
27.
go back to reference Kim YW, Mansfield LT (2014) Fool me twice: delayed diagnoses in radiology with emphasis on perpetuated errors. AJR Am J Roentgenol 202:465–470CrossRef Kim YW, Mansfield LT (2014) Fool me twice: delayed diagnoses in radiology with emphasis on perpetuated errors. AJR Am J Roentgenol 202:465–470CrossRef
30.
go back to reference Rosenkrantz AB, Oto A, Turkbey B, Westphalen AC (2016) Prostate Imaging Reporting and Data System (PI-RADS), Version 2: a critical look. AJR Am J Roentgenol 206:1179–1183CrossRef Rosenkrantz AB, Oto A, Turkbey B, Westphalen AC (2016) Prostate Imaging Reporting and Data System (PI-RADS), Version 2: a critical look. AJR Am J Roentgenol 206:1179–1183CrossRef
Metadata
Title
Computer-aided diagnosis prior to conventional interpretation of prostate mpMRI: an international multi-reader study
Authors
Matthew D. Greer
Nathan Lay
Joanna H. Shih
Tristan Barrett
Leonardo Kayat Bittencourt
Samuel Borofsky
Ismail Kabakus
Yan Mee Law
Jamie Marko
Haytham Shebel
Francesca V. Mertan
Maria J. Merino
Bradford J. Wood
Peter A. Pinto
Ronald M. Summers
Peter L. Choyke
Baris Turkbey
Publication date
01-10-2018
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 10/2018
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5374-6

Other articles of this Issue 10/2018

European Radiology 10/2018 Go to the issue