Skip to main content
Top
Published in: European Journal of Nuclear Medicine and Molecular Imaging 10/2017

01-09-2017 | Original Article

Development of standardized image interpretation for 68Ga-PSMA PET/CT to detect prostate cancer recurrent lesions

Authors: Stefano Fanti, Silvia Minozzi, Joshua James Morigi, Frederik Giesel, Francesco Ceci, Christian Uprimny, Michael S. Hofman, Matthias Eiber, Sarah Schwarzenbock, Paolo Castellucci, Cristina Bellisario, Stéphane Chauvie, Fabrizio Bergesio, Louise Emmett, Uwe Haberkorn, Irene Virgolini, Markus Schwaiger, Rodney J. Hicks, Bernd J. Krause, Arturo Chiti

Published in: European Journal of Nuclear Medicine and Molecular Imaging | Issue 10/2017

Login to get access

Abstract

Methods

After primary treatment, biochemical relapse (BCR) occurs in a substantial number of patients with prostate cancer (PCa). PET/CT imaging with prostate-specific membrane antigen based tracers (68Ga-PSMA) has shown promising results for BCR patients. However, a standardized image interpretation methodology has yet to be properly agreed. The aim of this study, which was promoted and funded by European Association of Nuclear Medicine (EANM), is to define standardized image interpretation criteria for 68Ga-PSMA PET/CT to detect recurrent PCa lesions in patients treated with primary curative intent therapy (radical prostatectomy or radiotherapy) who presented a biochemical recurrence. In the first phase inter-rater agreement between seven readers from seven international centers was calculated on the reading of 68Ga-PSMA PET/CT images of 49 patients with BCR. Each reader evaluated findings in five different sites of recurrence (local, loco-regional lymph nodes, distant lymph nodes, bone, and other). In the second phase the re-analysis was limited to cases with poor, slight, fair, or moderate agreement [Krippendorff’s (K) alpha<0.61]. Finally, on the basis of the consensus readings, we sought to define a list of revised consensus criteria for 68Ga-PSMA PET/CT interpretation.

Results

Between-reader agreement for the presence of anomalous findings in any of the five sites was only moderate (K’s alpha: 0.47). The agreement improved and became substantial when readers had to judge whether the anomalous findings were suggestive for a pathologic, uncertain, or non-pathologic image (K’s alpha: 0.64). K’s alpha calculations for each of the five sites of recurrence were also performed and evaluated. First Delphi round was thus conducted. A more detailed definition of the criteria was proposed by the project coordinator, which was then discussed and finally agreed by the seven readers. After the second Delphi round only four cases of disagreement still remained. These were evaluated for a final round, allowing a final agreement table to be written.

Conclusion

We hope that by developing these consensus guidelines on the interpretation of 68Ga-PSMA PET/CT, clinicians reporting these studies will be able to provide more consistent clinical reports and that within clinical trials, abnormality classifications will be harmonized, allowing more robust assessment of its diagnostic performance.
Appendix
Available only for authorised users
Literature
2.
go back to reference Mohler JL, Kantoff PW, Armstrong AJ, Bahnson RR, Cohen M, D’Amico AV, et al. National Comprehensive Cancer Network. Prostate cancer, version 2.2014. J Natl Compr Cancer Netw. 2014;12(5):686–718.CrossRef Mohler JL, Kantoff PW, Armstrong AJ, Bahnson RR, Cohen M, D’Amico AV, et al. National Comprehensive Cancer Network. Prostate cancer, version 2.2014. J Natl Compr Cancer Netw. 2014;12(5):686–718.CrossRef
3.
go back to reference Pfister D, Bolla M, Briganti A, Carroll P, Cozzarini C, Joniau S, et al. Early salvage radiotherapy following radical prostatectomy. Eur Urol. 2014;65(6):1034–43.CrossRefPubMed Pfister D, Bolla M, Briganti A, Carroll P, Cozzarini C, Joniau S, et al. Early salvage radiotherapy following radical prostatectomy. Eur Urol. 2014;65(6):1034–43.CrossRefPubMed
4.
go back to reference Stephenson AJ, Scardino PT, Kattan MW, Pisansky TM, Slawin KM, Klein EA et al. Predicting the outcome of salvage radiation therapy for recurrent prostate cancer after radical prostatectomy. J Clin Oncol. 2007;25(15):2035–2041. Erratum in: J Clin Oncol. 2007 Sep 10;25(26):4153. Stephenson AJ, Scardino PT, Kattan MW, Pisansky TM, Slawin KM, Klein EA et al. Predicting the outcome of salvage radiation therapy for recurrent prostate cancer after radical prostatectomy. J Clin Oncol. 2007;25(15):2035–2041. Erratum in: J Clin Oncol. 2007 Sep 10;25(26):4153.
5.
go back to reference Stephenson AJ, Bolla M, Briganti A, Cozzarini C, Moul JW, Roach M 3rd, et al. Postoperative radiation therapy for pathologically advanced prostate cancer after radical prostatectomy. Eur Urol. 2012;61(3):443–51.CrossRefPubMed Stephenson AJ, Bolla M, Briganti A, Cozzarini C, Moul JW, Roach M 3rd, et al. Postoperative radiation therapy for pathologically advanced prostate cancer after radical prostatectomy. Eur Urol. 2012;61(3):443–51.CrossRefPubMed
6.
go back to reference Martino P, Scattoni V, Galosi AB, Consonni P, Trombetta C, Palazzo S, et al. Role of imaging and biopsy to assess local recurrence after definitive treatment for prostate carcinoma (surgery, radiotherapy, cryotherapy, HIFU). World J Urol. 2011;29(5):595–605.CrossRefPubMed Martino P, Scattoni V, Galosi AB, Consonni P, Trombetta C, Palazzo S, et al. Role of imaging and biopsy to assess local recurrence after definitive treatment for prostate carcinoma (surgery, radiotherapy, cryotherapy, HIFU). World J Urol. 2011;29(5):595–605.CrossRefPubMed
7.
go back to reference Park SY, Oh YT, Jung DC, Cho NH, Choi YD, Rha KH, et al. Prediction of biochemical recurrence after radical prostatectomy with PI-RADS version 2 in prostate cancers: initial results. Eur Radiol. 2016;26(8):2502–9. doi:10.1007/s00330-015-4077-5.CrossRefPubMed Park SY, Oh YT, Jung DC, Cho NH, Choi YD, Rha KH, et al. Prediction of biochemical recurrence after radical prostatectomy with PI-RADS version 2 in prostate cancers: initial results. Eur Radiol. 2016;26(8):2502–9. doi:10.​1007/​s00330-015-4077-5.CrossRefPubMed
8.
go back to reference Park JJ, Kim CK, Park SY, Park BK, Lee HM, Cho SW. Prostate cancer: role of pretreatment multiparametric 3-T MRI in predicting biochemical recurrence after radical prostatectomy. AJR Am J Roentgenol. 2014;202(5):W459–65. doi:10.2214/AJR.13.11381.CrossRefPubMed Park JJ, Kim CK, Park SY, Park BK, Lee HM, Cho SW. Prostate cancer: role of pretreatment multiparametric 3-T MRI in predicting biochemical recurrence after radical prostatectomy. AJR Am J Roentgenol. 2014;202(5):W459–65. doi:10.​2214/​AJR.​13.​11381.CrossRefPubMed
10.
go back to reference Choueiri TK, Dreicer R, Paciorek A, Carroll PR, Konety B. A model that predicts the probability of positive imaging in prostate cancer cases with biochemical failure after initial definitive local therapy. J Urol. 2008;179(3):906–10.CrossRefPubMed Choueiri TK, Dreicer R, Paciorek A, Carroll PR, Konety B. A model that predicts the probability of positive imaging in prostate cancer cases with biochemical failure after initial definitive local therapy. J Urol. 2008;179(3):906–10.CrossRefPubMed
11.
go back to reference Amzalag G, Rager O, Tabouret-Viaud C, Wissmeyer M, Sfakianaki E, de Perrot T, et al. Target definition in salvage radiotherapy for recurrent prostate cancer: the role of advanced molecular imaging. Front Oncol. 2016;6:73.CrossRefPubMedPubMedCentral Amzalag G, Rager O, Tabouret-Viaud C, Wissmeyer M, Sfakianaki E, de Perrot T, et al. Target definition in salvage radiotherapy for recurrent prostate cancer: the role of advanced molecular imaging. Front Oncol. 2016;6:73.CrossRefPubMedPubMedCentral
12.
go back to reference Fanti S, Minozzi S, Castellucci P, Balduzzi S, Herrmann K, Krause BJ, et al. PET/CT with (11)C-choline for evaluation of prostate cancer patients with biochemical recurrence: meta-analysis and critical review of available data. Eur J Nucl Med Mol Imaging. 2016;43(1):55–69.CrossRefPubMed Fanti S, Minozzi S, Castellucci P, Balduzzi S, Herrmann K, Krause BJ, et al. PET/CT with (11)C-choline for evaluation of prostate cancer patients with biochemical recurrence: meta-analysis and critical review of available data. Eur J Nucl Med Mol Imaging. 2016;43(1):55–69.CrossRefPubMed
13.
go back to reference Graziani T, Ceci F, Castellucci P, Polverari G, Lima GM, Lodi F, et al. (11)C-choline PET/CT for restaging prostate cancer. Results from 4,426 scans in a single-centre patient series. Eur J Nucl Med Mol Imaging. 2016;43(11):1971–9. doi:10.1007/s00259-016-3428-z.CrossRefPubMed Graziani T, Ceci F, Castellucci P, Polverari G, Lima GM, Lodi F, et al. (11)C-choline PET/CT for restaging prostate cancer. Results from 4,426 scans in a single-centre patient series. Eur J Nucl Med Mol Imaging. 2016;43(11):1971–9. doi:10.​1007/​s00259-016-3428-z.CrossRefPubMed
14.
go back to reference Afshar-Oromieh A, Avtzi E, Giesel FL, Holland-Letz T, Linhart HG, Eder M, et al. The diagnostic value of PET/CT imaging with the (68)Ga-labelled PSMA ligand HBED-CC in the diagnosis of recurrent prostate cancer. Eur J Nucl Med Mol Imaging. 2015;42(2):197–209.CrossRefPubMed Afshar-Oromieh A, Avtzi E, Giesel FL, Holland-Letz T, Linhart HG, Eder M, et al. The diagnostic value of PET/CT imaging with the (68)Ga-labelled PSMA ligand HBED-CC in the diagnosis of recurrent prostate cancer. Eur J Nucl Med Mol Imaging. 2015;42(2):197–209.CrossRefPubMed
15.
go back to reference Maurer T, Gschwend JE, Rauscher I, Souvatzoglou M, Haller B, Weirich G, et al. Diagnostic efficacy of (68)gallium-PSMA positron emission tomography compared to conventional imaging for lymph node staging of 130 consecutive patients with intermediate to high risk prostate cancer. J Urol. 2016;195(5):1436–43.CrossRefPubMed Maurer T, Gschwend JE, Rauscher I, Souvatzoglou M, Haller B, Weirich G, et al. Diagnostic efficacy of (68)gallium-PSMA positron emission tomography compared to conventional imaging for lymph node staging of 130 consecutive patients with intermediate to high risk prostate cancer. J Urol. 2016;195(5):1436–43.CrossRefPubMed
16.
go back to reference Afshar-Oromieh A, Zechmann CM, Malcher A, Eder M, Eisenhut M, Linhart HG, et al. Comparison of PET imaging with a (68)Ga-labelled PSMA ligand and (18)F-choline-based PET/CT for the diagnosis of recurrent prostate cancer. Eur J Nucl Med Mol Imaging. 2014;41(1):11–20.CrossRefPubMed Afshar-Oromieh A, Zechmann CM, Malcher A, Eder M, Eisenhut M, Linhart HG, et al. Comparison of PET imaging with a (68)Ga-labelled PSMA ligand and (18)F-choline-based PET/CT for the diagnosis of recurrent prostate cancer. Eur J Nucl Med Mol Imaging. 2014;41(1):11–20.CrossRefPubMed
17.
go back to reference Morigi JJ, Stricker PD, van Leeuwen PJ, Tang R, Ho B, Nguyen Q et al. Prospective comparison of 18F–fluoromethylcholine versus 68 Ga-PSMA PET/CT in prostate cancer patients who have rising PSA after curative treatment and are being considered for targeted therapy. J Nucl Med 56(8):1185–1190. Morigi JJ, Stricker PD, van Leeuwen PJ, Tang R, Ho B, Nguyen Q et al. Prospective comparison of 18F–fluoromethylcholine versus 68 Ga-PSMA PET/CT in prostate cancer patients who have rising PSA after curative treatment and are being considered for targeted therapy. J Nucl Med 56(8):1185–1190.
18.
go back to reference Pfob CH, Ziegler S, Graner FP, Köhner M, Schachoff S, Blechert B, et al. Biodistribution and radiation dosimetry of (68)Ga-PSMA HBED CC-a PSMA specific probe for PET imaging of prostate cancer. Eur J Nucl Med Mol Imaging. 2016;43(11):1962–70. doi:10.1007/s00259-016-3424-3.CrossRefPubMed Pfob CH, Ziegler S, Graner FP, Köhner M, Schachoff S, Blechert B, et al. Biodistribution and radiation dosimetry of (68)Ga-PSMA HBED CC-a PSMA specific probe for PET imaging of prostate cancer. Eur J Nucl Med Mol Imaging. 2016;43(11):1962–70. doi:10.​1007/​s00259-016-3424-3.CrossRefPubMed
19.
go back to reference Fendler WP, Eiber M, Beheshti M, Bomanji J, Ceci F, Cho S, et al. 68Ga-PSMA PET/CT: joint EANM and SNMMI procedure guideline for prostate cancer imaging: version 1.0. Eur J Nucl Med Mol Imaging. 2017; doi:10.1007/s00259-017-3670-z. Fendler WP, Eiber M, Beheshti M, Bomanji J, Ceci F, Cho S, et al. 68Ga-PSMA PET/CT: joint EANM and SNMMI procedure guideline for prostate cancer imaging: version 1.0. Eur J Nucl Med Mol Imaging. 2017; doi:10.​1007/​s00259-017-3670-z.
20.
go back to reference Rauscher I, Maurer T, Fendler WP, Sommer WH, Schwaiger M, Eiber M. 68 Ga-PSMA ligand PET/CT in patients with prostate cancer: how we review and report. Cancer Imaging. 2016;16(1):14.CrossRefPubMedPubMedCentral Rauscher I, Maurer T, Fendler WP, Sommer WH, Schwaiger M, Eiber M. 68 Ga-PSMA ligand PET/CT in patients with prostate cancer: how we review and report. Cancer Imaging. 2016;16(1):14.CrossRefPubMedPubMedCentral
21.
go back to reference Jacene HA, Leboulleux S, Baba S, Chatzifotiadis D, Goudarzi B, Teytelbaum O, et al. Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy. J Nucl Med. 2009;50(11):1760–9. doi:10.2967/jnumed.109.063321. CrossRefPubMed Jacene HA, Leboulleux S, Baba S, Chatzifotiadis D, Goudarzi B, Teytelbaum O, et al. Assessment of interobserver reproducibility in quantitative 18F-FDG PET and CT measurements of tumor response to therapy. J Nucl Med. 2009;50(11):1760–9. doi:10.​2967/​jnumed.​109.​063321.​ CrossRefPubMed
22.
go back to reference Nanni C, Zanoni L, Pultrone C, Schiavina R, Brunocilla E, Lodi F, et al. (18)F-FACBC (anti1-amino-3-(18)F-fluorocyclobutane-1-carboxylic acid) versus (11)C-choline PET/CT in prostate cancer relapse: results of a prospective trial. Eur J Nucl Med Mol Imaging. 2016;43(9):1601–10. doi:10.1007/s00259-016-3329-1.CrossRefPubMed Nanni C, Zanoni L, Pultrone C, Schiavina R, Brunocilla E, Lodi F, et al. (18)F-FACBC (anti1-amino-3-(18)F-fluorocyclobutane-1-carboxylic acid) versus (11)C-choline PET/CT in prostate cancer relapse: results of a prospective trial. Eur J Nucl Med Mol Imaging. 2016;43(9):1601–10. doi:10.​1007/​s00259-016-3329-1.CrossRefPubMed
24.
go back to reference Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1:77–89.CrossRef Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas. 2007;1:77–89.CrossRef
25.
go back to reference Krippendorff K. Estimating the reliability, systematic error, and random error of interval data. Educ Psychol Meas. 1970;30:61–70.CrossRef Krippendorff K. Estimating the reliability, systematic error, and random error of interval data. Educ Psychol Meas. 1970;30:61–70.CrossRef
26.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:59–174. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:59–174.
27.
go back to reference Krippendorff K. Content analysis: an introduction to its methodology. Beverly Hills, CA: Sage Publications; 1980. Krippendorff K. Content analysis: an introduction to its methodology. Beverly Hills, CA: Sage Publications; 1980.
28.
go back to reference Dalkey NC. The Delphi method: an experimental study of group opinion. Rand Corp public RM-58888-PR. Santa Monica: Rand Corp; 1969. Dalkey NC. The Delphi method: an experimental study of group opinion. Rand Corp public RM-58888-PR. Santa Monica: Rand Corp; 1969.
29.
go back to reference Bennett C, Vakil N, Bergman J, Harrison R, Odze R, Vieth M, et al. Consensus statements for management of Barrett’s dysplasia and early-stage esophageal adenocarcinoma, based on a Delphi process. Gastroenterology. 2012;143(2):336–46.CrossRefPubMed Bennett C, Vakil N, Bergman J, Harrison R, Odze R, Vieth M, et al. Consensus statements for management of Barrett’s dysplasia and early-stage esophageal adenocarcinoma, based on a Delphi process. Gastroenterology. 2012;143(2):336–46.CrossRefPubMed
30.
go back to reference Meshkat B, Cowman S, Gethin G, Ryan K, Wiley M, Brick A, et al. Using an e-Delphi technique in achieving consensus across disciplines for developing best practice in day surgery in Ireland. J Hosp Adm. 2014;3(4):1–8. Meshkat B, Cowman S, Gethin G, Ryan K, Wiley M, Brick A, et al. Using an e-Delphi technique in achieving consensus across disciplines for developing best practice in day surgery in Ireland. J Hosp Adm. 2014;3(4):1–8.
31.
go back to reference Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2(3):i–88. Murphy MK, Black NA, Lamping DL, McKee CM, Sanderson CF, Askham J, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2(3):i–88.
33.
go back to reference Vakil N, van Zanten SV, Kahrilas P, Dent J, Jones R. The Montreal definition and classification of gastroesophageal reflux disease: a global evidence based consensus. Am J Gastroenterol. 2006;101(8):1900–20.CrossRefPubMed Vakil N, van Zanten SV, Kahrilas P, Dent J, Jones R. The Montreal definition and classification of gastroesophageal reflux disease: a global evidence based consensus. Am J Gastroenterol. 2006;101(8):1900–20.CrossRefPubMed
34.
go back to reference Wood L, Black P, Heng D, Kollmannsberger C, Moore R, Soulieres D, et al. Using the Dephi technique to improve clinical outcomes through the development of quality indicators in renal cell carcinoma. J Oncology Practice. 2013;9(5):262–7.CrossRef Wood L, Black P, Heng D, Kollmannsberger C, Moore R, Soulieres D, et al. Using the Dephi technique to improve clinical outcomes through the development of quality indicators in renal cell carcinoma. J Oncology Practice. 2013;9(5):262–7.CrossRef
35.
go back to reference Hsu CC & Sandford BA. The Delphi Technique: Making Sense Of Consensus. Practical Assessment, Research & Evaluation, 2007; 12 (10). Hsu CC & Sandford BA. The Delphi Technique: Making Sense Of Consensus. Practical Assessment, Research & Evaluation, 2007; 12 (10).
37.
go back to reference Krohn T, Verburg FA, Pufe T, Neuhuber W, Vogg A, Heinzel A, et al. [(68)Ga]PSMA-HBED uptake mimicking lymph node metastasis in coeliac ganglia: an important pitfall in clinical practice. Eur J Nucl Med Mol Imaging. 2015;42:210–4.CrossRefPubMed Krohn T, Verburg FA, Pufe T, Neuhuber W, Vogg A, Heinzel A, et al. [(68)Ga]PSMA-HBED uptake mimicking lymph node metastasis in coeliac ganglia: an important pitfall in clinical practice. Eur J Nucl Med Mol Imaging. 2015;42:210–4.CrossRefPubMed
38.
go back to reference Boellaard R, Delgado-Bolton R, Oyen WJ, Giammarile F, Tatsch K, Eschner W, et al. European Association of Nuclear Medicine (EANM). FDG PET/CT: EANM procedure guidelines for tumour imaging: version 2.0. Eur J Nucl Med Mol Imaging. 2015;42(2):328–54. doi:10.1007/s00259-014-2961-x.CrossRefPubMed Boellaard R, Delgado-Bolton R, Oyen WJ, Giammarile F, Tatsch K, Eschner W, et al. European Association of Nuclear Medicine (EANM). FDG PET/CT: EANM procedure guidelines for tumour imaging: version 2.0. Eur J Nucl Med Mol Imaging. 2015;42(2):328–54. doi:10.​1007/​s00259-014-2961-x.CrossRefPubMed
39.
go back to reference Hicks RJ. Invited commentary: the customer is always right, even when you are justifiably wrong. The Journal of Nuclear Medicine. 2014;55:1923–4.CrossRefPubMed Hicks RJ. Invited commentary: the customer is always right, even when you are justifiably wrong. The Journal of Nuclear Medicine. 2014;55:1923–4.CrossRefPubMed
Metadata
Title
Development of standardized image interpretation for 68Ga-PSMA PET/CT to detect prostate cancer recurrent lesions
Authors
Stefano Fanti
Silvia Minozzi
Joshua James Morigi
Frederik Giesel
Francesco Ceci
Christian Uprimny
Michael S. Hofman
Matthias Eiber
Sarah Schwarzenbock
Paolo Castellucci
Cristina Bellisario
Stéphane Chauvie
Fabrizio Bergesio
Louise Emmett
Uwe Haberkorn
Irene Virgolini
Markus Schwaiger
Rodney J. Hicks
Bernd J. Krause
Arturo Chiti
Publication date
01-09-2017
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging / Issue 10/2017
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-017-3725-1

Other articles of this Issue 10/2017

European Journal of Nuclear Medicine and Molecular Imaging 10/2017 Go to the issue