Skip to main content
Top
Published in: BMC Medical Imaging 1/2017

Open Access 01-12-2017 | Research article

Prospective evaluation of computer-assisted analysis of skeletal lesions for the staging of prostate cancer

Authors: Lars J. Petersen, Jesper C. Mortensen, Henrik Bertelsen, Helle D. Zacho

Published in: BMC Medical Imaging | Issue 1/2017

Login to get access

Abstract

Background

The purpose of this study was to compare the agreement of the bone scan index (BSI) using EXINI BoneBSI versus experts’ readings in the initial staging for bone metastasis in prostate cancer. In addition, the diagnostic outcome was assessed in a large subset of patients where a true reference for metastases could be determined based on clinical and biochemical follow-up and/or supplementary imaging.

Methods

A total of 342 patients had a bone scintigraphy as part of routine staging for prostate cancer. Supplementary imaging was obtained at the discretion of the referring urologist. After full recruitment, the BSI and the number of malignant lesions were calculated using EXINI BoneBSI, and three imaging experts independently classified bone status by a dichotomous outcome (M1 for bone metastasis, M0 for no bone metastasis). A true reference was available in a subset of the patients based on post-operative prostate-specific antigen responses after radical prostatectomy and/or supplementary imaging.

Results

Software analysis with a BSI > 0 as the cut-off for metastasis showed excellent agreement with expert classification for M1 disease (96% of the patients) but modest agreement for M0 disease (38%). With a BSI > 1, the agreement was 58% for M1 and 98% for M0. Software analyses based on individual European Association of Urology risk classification did not improve the diagnostic performance. Among patients with a true reference, the software showed metastasis in 64% of the M0 patients but correctly classified metastases in all M1 patients. The sensitivity was 100%, the specificity was 36%, the positive predictive value was 12.6% and the negative predictive value was 100% with a BSI >0 compared with 66.7%, 97.8%, 72.7%, and 97.0% with a BSI > 1.

Conclusion

The diagnostic value of using EXINI Bone for the BSI in the staging of newly diagnosed prostate cancer is limited.
Literature
1.
go back to reference Mohler JL, Kantoff PW, Armstrong AJ, Bahnson RR, Cohen M, D’Amico AV, Eastham JA, Enke CA, Farrington TA, Higano CS, et al. Prostate cancer, version 2.2014. J Natl Compr Canc Netw. 2014;12(5):686–718.CrossRefPubMed Mohler JL, Kantoff PW, Armstrong AJ, Bahnson RR, Cohen M, D’Amico AV, Eastham JA, Enke CA, Farrington TA, Higano CS, et al. Prostate cancer, version 2.2014. J Natl Compr Canc Netw. 2014;12(5):686–718.CrossRefPubMed
2.
go back to reference Heidenreich A, Bastian PJ, Bellmunt J, Bolla M, Joniau S, van der Kwast T, Mason M, Matveev V, Wiegel T, Zattoni F, et al. EAU guidelines on prostate cancer. part 1: screening, diagnosis, and local treatment with curative intent-update. Eur Urol 2014. 2013;65(1):124–37. Heidenreich A, Bastian PJ, Bellmunt J, Bolla M, Joniau S, van der Kwast T, Mason M, Matveev V, Wiegel T, Zattoni F, et al. EAU guidelines on prostate cancer. part 1: screening, diagnosis, and local treatment with curative intent-update. Eur Urol 2014. 2013;65(1):124–37.
3.
go back to reference Robinson PJ. Radiology’s Achilles’ heel: error and variation in the interpretation of the Rontgen image. Br J Radiol. 1997;70(839):1085–98.CrossRefPubMed Robinson PJ. Radiology’s Achilles’ heel: error and variation in the interpretation of the Rontgen image. Br J Radiol. 1997;70(839):1085–98.CrossRefPubMed
4.
go back to reference Sadik M, Jakobsson D, Olofsson F, Ohlsson M, Suurkula M, Edenbrandt L. A new computer-based decision-support system for the interpretation of bone scans. Nucl Med Commun. 2006;27(5):417–23.CrossRefPubMed Sadik M, Jakobsson D, Olofsson F, Ohlsson M, Suurkula M, Edenbrandt L. A new computer-based decision-support system for the interpretation of bone scans. Nucl Med Commun. 2006;27(5):417–23.CrossRefPubMed
5.
go back to reference Sadik M, Hamadeh I, Nordblom P, Suurkula M, Hoglund P, Ohlsson M, Edenbrandt L. Computer-assisted interpretation of planar whole-body bone scans. J Nucl Med. 2008;49(12):1958–65.CrossRefPubMed Sadik M, Hamadeh I, Nordblom P, Suurkula M, Hoglund P, Ohlsson M, Edenbrandt L. Computer-assisted interpretation of planar whole-body bone scans. J Nucl Med. 2008;49(12):1958–65.CrossRefPubMed
6.
go back to reference Sadik M, Suurkula M, Hoglund P, Jarund A, Edenbrandtl L. Improved Classifications of Planar Whole-Body Bone Scans Using a Computer-Assisted Diagnosis System: A Multicenter, Multiple-Reader. Multiple-Case Study J Nucl Med. 2009;50(3):368–75.PubMed Sadik M, Suurkula M, Hoglund P, Jarund A, Edenbrandtl L. Improved Classifications of Planar Whole-Body Bone Scans Using a Computer-Assisted Diagnosis System: A Multicenter, Multiple-Reader. Multiple-Case Study J Nucl Med. 2009;50(3):368–75.PubMed
7.
go back to reference Tokuda O, Harada Y, Ohishi Y, Matsunaga N, Edenbrandt L. Investigation of computer-aided diagnosis system for bone scans: a retrospective analysis in 406 patients. Ann Nucl Med. 2014;28(4):329–39.CrossRefPubMed Tokuda O, Harada Y, Ohishi Y, Matsunaga N, Edenbrandt L. Investigation of computer-aided diagnosis system for bone scans: a retrospective analysis in 406 patients. Ann Nucl Med. 2014;28(4):329–39.CrossRefPubMed
8.
go back to reference Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, Abrahamsson PA, Bjork T, Gerdtsson A, Bjartell A, et al. A Novel Automated Platform for Quantifying the Extent of Skeletal Tumour Involvement in Prostate Cancer Patients Using the Bone Scan Index. Eur Urol. 2012;62(1):78–84.CrossRefPubMedPubMedCentral Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, Abrahamsson PA, Bjork T, Gerdtsson A, Bjartell A, et al. A Novel Automated Platform for Quantifying the Extent of Skeletal Tumour Involvement in Prostate Cancer Patients Using the Bone Scan Index. Eur Urol. 2012;62(1):78–84.CrossRefPubMedPubMedCentral
9.
go back to reference Anand A, Morris MJ, Kaboteh R, Bath L, Sadik M, Gjertsson P, Lomsky M, Edenbrandt L, Minarik D, Bjartell A. Analytical Validation of the Automated Bone Scan Index as an Imaging Biomarker to Standardize the Quantitative Changes in Bone Scans of Patients with Metastatic Prostate Cancer. J Nucl Med. 2016;57(1):41–5.CrossRefPubMed Anand A, Morris MJ, Kaboteh R, Bath L, Sadik M, Gjertsson P, Lomsky M, Edenbrandt L, Minarik D, Bjartell A. Analytical Validation of the Automated Bone Scan Index as an Imaging Biomarker to Standardize the Quantitative Changes in Bone Scans of Patients with Metastatic Prostate Cancer. J Nucl Med. 2016;57(1):41–5.CrossRefPubMed
10.
go back to reference Anand A, Morris MJ, Larson SM, Minarik D, Josefsson A, Helgstrand JT, Oturai PS, Edenbrandt L, Roder MA, Bjartell A. Automated Bone Scan Index as a quantitative imaging biomarker in metastatic castration-resistant prostate cancer patients being treated with enzalutamide. EJNMMI Res. 2016;6(1):23.CrossRefPubMedPubMedCentral Anand A, Morris MJ, Larson SM, Minarik D, Josefsson A, Helgstrand JT, Oturai PS, Edenbrandt L, Roder MA, Bjartell A. Automated Bone Scan Index as a quantitative imaging biomarker in metastatic castration-resistant prostate cancer patients being treated with enzalutamide. EJNMMI Res. 2016;6(1):23.CrossRefPubMedPubMedCentral
11.
go back to reference Kaboteh R, Damber JE, Gjertsson P, Hoglund P, Lomsky M, Ohlsson M, Edenbrandt L. Bone Scan Index: a prognostic imaging biomarker for high-risk prostate cancer patients receiving primary hormonal therapy. EJNMMI Res. 2013;3(1):9.CrossRefPubMedPubMedCentral Kaboteh R, Damber JE, Gjertsson P, Hoglund P, Lomsky M, Ohlsson M, Edenbrandt L. Bone Scan Index: a prognostic imaging biomarker for high-risk prostate cancer patients receiving primary hormonal therapy. EJNMMI Res. 2013;3(1):9.CrossRefPubMedPubMedCentral
12.
go back to reference Reza M, Bjartell A, Ohlsson M, Kaboteh R, Wollmer P, Edenbrandt L, Tragardh E. Bone Scan Index as a prognostic imaging biomarker during androgen deprivation therapy. EJNMMI Res. 2014;4:58.CrossRefPubMedPubMedCentral Reza M, Bjartell A, Ohlsson M, Kaboteh R, Wollmer P, Edenbrandt L, Tragardh E. Bone Scan Index as a prognostic imaging biomarker during androgen deprivation therapy. EJNMMI Res. 2014;4:58.CrossRefPubMedPubMedCentral
13.
go back to reference Poulsen MH, Rasmussen J, Edenbrandt L, Hoilund-Carlsen PF, Gerke O, Johansen A, Lund L. Bone Scan Index predicts outcome in patients with metastatic hormone-sensitive prostate cancer. BJU Int. 2016;117(5):748–53.CrossRefPubMed Poulsen MH, Rasmussen J, Edenbrandt L, Hoilund-Carlsen PF, Gerke O, Johansen A, Lund L. Bone Scan Index predicts outcome in patients with metastatic hormone-sensitive prostate cancer. BJU Int. 2016;117(5):748–53.CrossRefPubMed
14.
go back to reference Mitsui Y, Shiina H, Yamamoto Y, Haramoto M, Arichi N, Yasumoto H, Kitagaki H, Igawa M. Prediction of survival benefit using an automated bone scan index in patients with castration-resistant prostate cancer. BJU Int. 2012;110(11b):E628–34.CrossRefPubMed Mitsui Y, Shiina H, Yamamoto Y, Haramoto M, Arichi N, Yasumoto H, Kitagaki H, Igawa M. Prediction of survival benefit using an automated bone scan index in patients with castration-resistant prostate cancer. BJU Int. 2012;110(11b):E628–34.CrossRefPubMed
15.
go back to reference Kalderstam J, Sadik M, Edenbrandt L, Ohlsson M. Analysis of regional bone scan index measurements for the survival of patients with prostate cancer. BMC Med Imaging. 2014;14:24.CrossRefPubMedPubMedCentral Kalderstam J, Sadik M, Edenbrandt L, Ohlsson M. Analysis of regional bone scan index measurements for the survival of patients with prostate cancer. BMC Med Imaging. 2014;14:24.CrossRefPubMedPubMedCentral
16.
go back to reference Dennis ER, Jia X, Mezheritskiy IS, Stephenson RD, Schoder H, Fox JJ, Heller G, Scher HI, Larson SM, Morris MJ. Bone scan index: a quantitative treatment response biomarker for castration-resistant metastatic prostate cancer. J Clin Oncol. 2012;30(5):519–24.CrossRefPubMedPubMedCentral Dennis ER, Jia X, Mezheritskiy IS, Stephenson RD, Schoder H, Fox JJ, Heller G, Scher HI, Larson SM, Morris MJ. Bone scan index: a quantitative treatment response biomarker for castration-resistant metastatic prostate cancer. J Clin Oncol. 2012;30(5):519–24.CrossRefPubMedPubMedCentral
17.
go back to reference Armstrong AJ, Eisenberger MA, Halabi S, Oudard S, Nanus DM, Petrylak DP, Sartor AO, Scher HI. Biomarkers in the management and treatment of men with metastatic castration-resistant prostate cancer. Eur Urol. 2012;61(3):549–59.CrossRefPubMed Armstrong AJ, Eisenberger MA, Halabi S, Oudard S, Nanus DM, Petrylak DP, Sartor AO, Scher HI. Biomarkers in the management and treatment of men with metastatic castration-resistant prostate cancer. Eur Urol. 2012;61(3):549–59.CrossRefPubMed
18.
go back to reference Zacho HD, Barsi T, Mortensen JC, Mogensen MK, Bertelsen H, Josephsen N, Petersen LJ. Prospective multicenter study of bone scintigraphy in consecutive patients with newly diagnosed prostate cancer. Clin Nucl Med. 2014;39(1):26–31.CrossRefPubMed Zacho HD, Barsi T, Mortensen JC, Mogensen MK, Bertelsen H, Josephsen N, Petersen LJ. Prospective multicenter study of bone scintigraphy in consecutive patients with newly diagnosed prostate cancer. Clin Nucl Med. 2014;39(1):26–31.CrossRefPubMed
19.
go back to reference Petersen LJ, Mortensen JC, Bertelsen H, Zacho HD. Computer-assisted interpretation of planar whole-body bone scintigraphy in patients with newly diagnosed prostate cancer. Nucl Med Commun. 2015;36(7):679–85.CrossRefPubMed Petersen LJ, Mortensen JC, Bertelsen H, Zacho HD. Computer-assisted interpretation of planar whole-body bone scintigraphy in patients with newly diagnosed prostate cancer. Nucl Med Commun. 2015;36(7):679–85.CrossRefPubMed
20.
go back to reference Zacho HD, Manresa JA, Mortensen JC, Bertelsen H, Petersen LJ. Observer agreement and accuracy in the evaluation of bone scans in newly diagnosed prostate cancer. Nucl Med Commun. 2015;36(5):445–51.PubMed Zacho HD, Manresa JA, Mortensen JC, Bertelsen H, Petersen LJ. Observer agreement and accuracy in the evaluation of bone scans in newly diagnosed prostate cancer. Nucl Med Commun. 2015;36(5):445–51.PubMed
21.
go back to reference Zacho HD, Barsi T, Mortensen JC, Bertelsen H, Petersen LJ. Validation of contemporary guidelines for bone scintigraphy in prostate cancer staging: A prospective study in patients undergoing radical prostatectomy. Scand J Urol. 2016;50(1):29–32.CrossRefPubMed Zacho HD, Barsi T, Mortensen JC, Bertelsen H, Petersen LJ. Validation of contemporary guidelines for bone scintigraphy in prostate cancer staging: A prospective study in patients undergoing radical prostatectomy. Scand J Urol. 2016;50(1):29–32.CrossRefPubMed
22.
go back to reference Erdi YE, Humm JL, Imbriaco M, Yeung H, Larson SM. Quantitative bone metastases analysis based on image segmentation. J Nucl Med. 1997;38(9):1401–6.PubMed Erdi YE, Humm JL, Imbriaco M, Yeung H, Larson SM. Quantitative bone metastases analysis based on image segmentation. J Nucl Med. 1997;38(9):1401–6.PubMed
23.
go back to reference Imbriaco M, Larson SM, Yeung HW, Mawlawi OR, Erdi Y, Venkatraman ES, Scher HI. A new parameter for measuring metastatic bone involvement by prostate cancer: the Bone Scan Index. Clin Cancer Res. 1998;4(7):1765–72.PubMed Imbriaco M, Larson SM, Yeung HW, Mawlawi OR, Erdi Y, Venkatraman ES, Scher HI. A new parameter for measuring metastatic bone involvement by prostate cancer: the Bone Scan Index. Clin Cancer Res. 1998;4(7):1765–72.PubMed
24.
go back to reference Meirelles GS, Schoder H, Ravizzini GC, Gonen M, Fox JJ, Humm J, Morris MJ, Scher HI, Larson SM. Prognostic value of baseline [18 F] fluorodeoxyglucose positron emission tomography and 99mTc-MDP bone scan in progressing metastatic prostate cancer. Clin Cancer Res. 2010;16(24):6093–9.CrossRefPubMedPubMedCentral Meirelles GS, Schoder H, Ravizzini GC, Gonen M, Fox JJ, Humm J, Morris MJ, Scher HI, Larson SM. Prognostic value of baseline [18 F] fluorodeoxyglucose positron emission tomography and 99mTc-MDP bone scan in progressing metastatic prostate cancer. Clin Cancer Res. 2010;16(24):6093–9.CrossRefPubMedPubMedCentral
25.
go back to reference Armstrong AJ, Kaboteh R, Carducci MA, Damber JE, Stadler WM, Hansen M, Edenbrandt L, Forsberg G, Nordle O, Pili R, et al. Assessment of the bone scan index in a randomized placebo-controlled trial of tasquinimod in men with metastatic castration-resistant prostate cancer (mCRPC). Urol Oncol. 2014;32(8):1308–16.CrossRefPubMed Armstrong AJ, Kaboteh R, Carducci MA, Damber JE, Stadler WM, Hansen M, Edenbrandt L, Forsberg G, Nordle O, Pili R, et al. Assessment of the bone scan index in a randomized placebo-controlled trial of tasquinimod in men with metastatic castration-resistant prostate cancer (mCRPC). Urol Oncol. 2014;32(8):1308–16.CrossRefPubMed
26.
go back to reference Sonpavde G, Pond GR, Armstrong AJ, Galsky MD, Leopold L, Wood BA, Wang SL, Paolini J, Chen I, Chow-Maneval E, et al. Radiographic progression by Prostate Cancer Working Group (PCWG)-2 criteria as an intermediate endpoint for drug development in metastatic castration-resistant prostate cancer. BJU Int. 2014;114(6b):E25–31.CrossRefPubMed Sonpavde G, Pond GR, Armstrong AJ, Galsky MD, Leopold L, Wood BA, Wang SL, Paolini J, Chen I, Chow-Maneval E, et al. Radiographic progression by Prostate Cancer Working Group (PCWG)-2 criteria as an intermediate endpoint for drug development in metastatic castration-resistant prostate cancer. BJU Int. 2014;114(6b):E25–31.CrossRefPubMed
27.
go back to reference Kaboteh R, Gjertsson P, Leek H, Lomsky M, Ohlsson M, Sjostrand K, Edenbrandt L. Progression of bone metastases in patients with prostate cancer - automated detection of new lesions and calculation of bone scan index. EJNMMI Res. 2013;3(1):64.CrossRefPubMedPubMedCentral Kaboteh R, Gjertsson P, Leek H, Lomsky M, Ohlsson M, Sjostrand K, Edenbrandt L. Progression of bone metastases in patients with prostate cancer - automated detection of new lesions and calculation of bone scan index. EJNMMI Res. 2013;3(1):64.CrossRefPubMedPubMedCentral
28.
Metadata
Title
Prospective evaluation of computer-assisted analysis of skeletal lesions for the staging of prostate cancer
Authors
Lars J. Petersen
Jesper C. Mortensen
Henrik Bertelsen
Helle D. Zacho
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2017
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/s12880-017-0211-y

Other articles of this Issue 1/2017

BMC Medical Imaging 1/2017 Go to the issue