Skip to main content
Top
Published in: EJNMMI Research 1/2014

Open Access 01-12-2014 | Original research

Insight on automated lesion delineation methods for PET data

Authors: Azadeh Firouzian, Matthew D Kelly, Jérôme M Declerck

Published in: EJNMMI Research | Issue 1/2014

Login to get access

Abstract

Background

Defining tumour volume for treatment response and radiotherapy planning is challenging and prone to inter- and intra-observer variability. Various automated tumour delineation methods have been proposed in the literature, each having abilities and limitations. Therefore, there is a need to provide clinicians with practical information on delineation method selection.

Methods

Six different automated positron emission tomography (PET) delineation methods were evaluated and compared using National Electrical Manufacturer Association image quality (NEMA IQ) phantom data and three in-house synthetic phantoms with clinically relevant lesion shapes including spheres with necrotic core and irregular shapes. The impact of different contrast ratios, emission counts, realisations and reconstruction algorithms on delineation performance was also studied using similarity index (SI) and percentage volume error (%VE) as performance measures.

Results

With the NEMA IQ phantom, contrast thresholding (CT) performed best on average for all sphere sizes and parameter settings (SI = 0.83; %VE = 5.65% ± 24.34%). Adaptive thresholding at 40% (AT40) was the next best method and required no prior parameter tuning (SI = 0.78; %VE = 23.22% ± 70.83%). When using SUV harmonisation filtering prior to delineation (EQ.PET), AT40 remains the best method without prior parameter tuning (SI = 0.81; %VE = 11.39% ± 85.28%).
For necrotic core spheres and irregular shapes of the synthetic phantoms, CT remained the best performing method (SI = 0.83; %VE = 26.31% ± 38.26% and SI = 0.62; %VE = 24.52% ± 46.89%, respectively). The second best method was fuzzy locally adaptive Bayesian (FLAB) (SI = 0.83; %VE = 29.51% ± 81.79%) for necrotic core sphere and AT40 (SI = 0.58; %VE = 25.11% ± 32.41%) for irregular shapes. When using EQ.PET prior to delineation, AT40 was the best performing method without prior parameter tuning for both necrotic core (SI = 0.83; %VE = 27.98% ± 59.58%) and complex shapes phantoms (SI = 0.61; %VE = 14.83% ± 49.39%).

Conclusions

CT and AT40/AT50 are recommended for all lesion sizes and contrasts. Overall, considering background uptake information improves PET delineation accuracy. Applying EQ.PET prior to delineation improves accuracy and reduces coefficient of variation (CV) across different reconstructions and acquisitions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fletcher JW, Djulbegovic B, Soares HP, Siegel BA, Lowe VJ, Lyman GH, Coleman RE, Wahl R, Paschold JC, Avril N, Einhorn LH, Suh WW, Samson D, Delbeke D, Gorman M, Shields AF: Recommendations on the use of 18F-FDG PET in oncology. J Nucl Med 2008, 49: 480–508. 10.2967/jnumed.107.047787CrossRefPubMed Fletcher JW, Djulbegovic B, Soares HP, Siegel BA, Lowe VJ, Lyman GH, Coleman RE, Wahl R, Paschold JC, Avril N, Einhorn LH, Suh WW, Samson D, Delbeke D, Gorman M, Shields AF: Recommendations on the use of 18F-FDG PET in oncology. J Nucl Med 2008, 49: 480–508. 10.2967/jnumed.107.047787CrossRefPubMed
2.
go back to reference Van de Wiele C, Kruse V, Smeets P, Sathekge M, Maes A: Predictive and prognostic value of metabolic tumour volume and total lesion glycolysis in solid tumours. Eur J Nucl Med Mol Imag 2013, 40: 290–301. 10.1007/s00259-012-2280-zCrossRef Van de Wiele C, Kruse V, Smeets P, Sathekge M, Maes A: Predictive and prognostic value of metabolic tumour volume and total lesion glycolysis in solid tumours. Eur J Nucl Med Mol Imag 2013, 40: 290–301. 10.1007/s00259-012-2280-zCrossRef
3.
go back to reference Van Baardwijk A, Baumert BG, Bosmans G, van Kroonenburgh M, Stroobants S, Gregoire V, Lambin P, De Ruysscher D: The current status of FDG-PET in tumour volume definition in radiotherapy treatment planning. Cancer Treat Rev 2006, 32: 245–260. 10.1016/j.ctrv.2006.02.002CrossRefPubMed Van Baardwijk A, Baumert BG, Bosmans G, van Kroonenburgh M, Stroobants S, Gregoire V, Lambin P, De Ruysscher D: The current status of FDG-PET in tumour volume definition in radiotherapy treatment planning. Cancer Treat Rev 2006, 32: 245–260. 10.1016/j.ctrv.2006.02.002CrossRefPubMed
4.
go back to reference Wahl RL, Jacene H, Kasamon Y, Lodge MA: From RECIST to PERCIST: evolving considerations for PET response criteria in solid tumors. J Nucl Med 2009, 50(Suppl 1):122S-150S. 10.2967/jnumed.108.057307PubMedCentralCrossRefPubMed Wahl RL, Jacene H, Kasamon Y, Lodge MA: From RECIST to PERCIST: evolving considerations for PET response criteria in solid tumors. J Nucl Med 2009, 50(Suppl 1):122S-150S. 10.2967/jnumed.108.057307PubMedCentralCrossRefPubMed
5.
go back to reference Van Baardwijk A, Bosmans G, Boersma L, Buijsen J, Wanders S, Hochstenbag M, van Suylen R-J, Dekker A, Dehing-Oberije C, Houben R, Bentzen SM, van Kroonenburgh M, Lambin P, De Ruysscher D: PET-CT-based auto-contouring in non-small-cell lung cancer correlates with pathology and reduces interobserver variability in the delineation of the primary tumor and involved nodal volumes. Int J Radiat Oncol Biol Phys 2007, 68: 771–778. 10.1016/j.ijrobp.2006.12.067CrossRefPubMed Van Baardwijk A, Bosmans G, Boersma L, Buijsen J, Wanders S, Hochstenbag M, van Suylen R-J, Dekker A, Dehing-Oberije C, Houben R, Bentzen SM, van Kroonenburgh M, Lambin P, De Ruysscher D: PET-CT-based auto-contouring in non-small-cell lung cancer correlates with pathology and reduces interobserver variability in the delineation of the primary tumor and involved nodal volumes. Int J Radiat Oncol Biol Phys 2007, 68: 771–778. 10.1016/j.ijrobp.2006.12.067CrossRefPubMed
6.
go back to reference Petit S, Van EW, Oberije C, Vegt E, Dingemans A, Lambin P, Dekker A, De RD: 18F-Fluorodeoxyglucose uptake patterns in the lung before radiotherapy identify areas that are more susceptible to radiation-induced lung toxicity in non-small cell lung cancer patients. Int J Radiat Oncol Biol Phys 2011, 81: 698–705. 10.1016/j.ijrobp.2010.06.016CrossRefPubMed Petit S, Van EW, Oberije C, Vegt E, Dingemans A, Lambin P, Dekker A, De RD: 18F-Fluorodeoxyglucose uptake patterns in the lung before radiotherapy identify areas that are more susceptible to radiation-induced lung toxicity in non-small cell lung cancer patients. Int J Radiat Oncol Biol Phys 2011, 81: 698–705. 10.1016/j.ijrobp.2010.06.016CrossRefPubMed
7.
go back to reference Cheson BD, Pfistner B, Juweid ME, Gascoyne RD, Specht L, Horning SJ, Coiffier B, Fisher RI, Hagenbeek A, Zucca E, Rosen ST, Stroobants S, Lister TA, Hoppe RT, Dreyling M, Tobinai K, Vose JM, Connors JM, Federico M, Diehl V: Revised response criteria for malignant lymphoma. J Clin Oncol 2007, 25: 579–586. 10.1200/JCO.2006.09.2403CrossRefPubMed Cheson BD, Pfistner B, Juweid ME, Gascoyne RD, Specht L, Horning SJ, Coiffier B, Fisher RI, Hagenbeek A, Zucca E, Rosen ST, Stroobants S, Lister TA, Hoppe RT, Dreyling M, Tobinai K, Vose JM, Connors JM, Federico M, Diehl V: Revised response criteria for malignant lymphoma. J Clin Oncol 2007, 25: 579–586. 10.1200/JCO.2006.09.2403CrossRefPubMed
8.
go back to reference Juweid ME, Stroobants S, Hoekstra OS, Mottaghy FM, Dietlein M, Guermazi A, Wiseman GA, Kostakoglu L, Scheidhauer K, Buck A, Naumann R, Spaepen K, Hicks RJ, Weber WA, Reske SN, Schwaiger M, Schwartz LH, Zijlstra JM, Siegel BA, Cheson BD: Use of positron emission tomography for response assessment of lymphoma: consensus of the Imaging Subcommittee of International Harmonization Project in Lymphoma. J Clin Oncol 2007, 25: 571–578. 10.1200/JCO.2006.08.2305CrossRefPubMed Juweid ME, Stroobants S, Hoekstra OS, Mottaghy FM, Dietlein M, Guermazi A, Wiseman GA, Kostakoglu L, Scheidhauer K, Buck A, Naumann R, Spaepen K, Hicks RJ, Weber WA, Reske SN, Schwaiger M, Schwartz LH, Zijlstra JM, Siegel BA, Cheson BD: Use of positron emission tomography for response assessment of lymphoma: consensus of the Imaging Subcommittee of International Harmonization Project in Lymphoma. J Clin Oncol 2007, 25: 571–578. 10.1200/JCO.2006.08.2305CrossRefPubMed
9.
go back to reference MacManus M, Nestle U, Rosenzweig KE, Carrio I, Messa C, Belohlavek O, Danna M, Inoue T, Deniaud-Alexandre E, Schipani S, Watanabe N, Dondi M, Jeremic B: Use of PET and PET/CT for radiation therapy planning: IAEA expert report 2006–2007. Radiother Oncol 2009, 91: 85–94. 10.1016/j.radonc.2008.11.008CrossRefPubMed MacManus M, Nestle U, Rosenzweig KE, Carrio I, Messa C, Belohlavek O, Danna M, Inoue T, Deniaud-Alexandre E, Schipani S, Watanabe N, Dondi M, Jeremic B: Use of PET and PET/CT for radiation therapy planning: IAEA expert report 2006–2007. Radiother Oncol 2009, 91: 85–94. 10.1016/j.radonc.2008.11.008CrossRefPubMed
10.
go back to reference Boellaard R, Krak NC, Hoekstra OS, Lammertsma AA: Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values: a simulation study. J Nucl Med 2004, 45: 1519–1527.PubMed Boellaard R, Krak NC, Hoekstra OS, Lammertsma AA: Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values: a simulation study. J Nucl Med 2004, 45: 1519–1527.PubMed
11.
go back to reference Schaefer A, Kremp S, Hellwig D, Rübe C, Kirsch C-M, Nestle U: A contrast-oriented algorithm for FDG-PET-based delineation of tumour volumes for the radiotherapy of lung cancer: derivation from phantom measurements and validation in patient data. Eur J Nucl Med Mol Imag 2008, 35: 1989–1999. 10.1007/s00259-008-0875-1CrossRef Schaefer A, Kremp S, Hellwig D, Rübe C, Kirsch C-M, Nestle U: A contrast-oriented algorithm for FDG-PET-based delineation of tumour volumes for the radiotherapy of lung cancer: derivation from phantom measurements and validation in patient data. Eur J Nucl Med Mol Imag 2008, 35: 1989–1999. 10.1007/s00259-008-0875-1CrossRef
12.
go back to reference Geets X, Lee JA, Bol A, Lonneux M, Grégoire V: A gradient-based method for segmenting FDG-PET images: methodology and validation. Eur J Nucl Med Mol Imag 2007, 34: 1427–1438. 10.1007/s00259-006-0363-4CrossRef Geets X, Lee JA, Bol A, Lonneux M, Grégoire V: A gradient-based method for segmenting FDG-PET images: methodology and validation. Eur J Nucl Med Mol Imag 2007, 34: 1427–1438. 10.1007/s00259-006-0363-4CrossRef
13.
go back to reference Van Dalen JA, Hoffmann AL, Dicken V, Vogel WV, Wiering B, Ruers TJ, Karssemeijer N, Oyen WJG: A novel iterative method for lesion delineation and volumetric quantification with FDG PET. Nucl Med Commun 2007, 28: 485–493. 10.1097/MNM.0b013e328155d154CrossRefPubMed Van Dalen JA, Hoffmann AL, Dicken V, Vogel WV, Wiering B, Ruers TJ, Karssemeijer N, Oyen WJG: A novel iterative method for lesion delineation and volumetric quantification with FDG PET. Nucl Med Commun 2007, 28: 485–493. 10.1097/MNM.0b013e328155d154CrossRefPubMed
14.
go back to reference Hatt M, Cheze le Rest C, Turzo A, Roux C, Visvikis D: A fuzzy locally adaptive Bayesian segmentation approach for volume determination in PET. IEEE Trans Med Imag 2009, 28: 881–893. 10.1109/TMI.2008.2012036CrossRef Hatt M, Cheze le Rest C, Turzo A, Roux C, Visvikis D: A fuzzy locally adaptive Bayesian segmentation approach for volume determination in PET. IEEE Trans Med Imag 2009, 28: 881–893. 10.1109/TMI.2008.2012036CrossRef
15.
go back to reference Cheebsumon P, Boellaard R, de Ruysscher D, van Elmpt W, van Baardwijk A, Yaqub M, Hoekstra OS, Comans EF, Lammertsma AA, van Velden FH: Assessment of tumour size in PET/CT lung cancer studies: PET- and CT-based methods compared to pathology. EJNMMI Res 2012, 2: 56. 10.1186/2191-219X-2-56PubMedCentralCrossRefPubMed Cheebsumon P, Boellaard R, de Ruysscher D, van Elmpt W, van Baardwijk A, Yaqub M, Hoekstra OS, Comans EF, Lammertsma AA, van Velden FH: Assessment of tumour size in PET/CT lung cancer studies: PET- and CT-based methods compared to pathology. EJNMMI Res 2012, 2: 56. 10.1186/2191-219X-2-56PubMedCentralCrossRefPubMed
16.
go back to reference Cheebsumon P, Yaqub M, van Velden FHP, Hoekstra OS, Lammertsma AA, Boellaard R: Impact of [18F]FDG PET imaging parameters on automatic tumour delineation: need for improved tumour delineation methodology. Eur J Nucl Med Mol Imag 2011, 38: 2136–2144. 10.1007/s00259-011-1899-5CrossRef Cheebsumon P, Yaqub M, van Velden FHP, Hoekstra OS, Lammertsma AA, Boellaard R: Impact of [18F]FDG PET imaging parameters on automatic tumour delineation: need for improved tumour delineation methodology. Eur J Nucl Med Mol Imag 2011, 38: 2136–2144. 10.1007/s00259-011-1899-5CrossRef
17.
go back to reference Cheebsumon P, van Velden FHP, Yaqub M, Frings V, de Langen AJ, Hoekstra OS, Lammertsma AA, Boellaard R: Effects of image characteristics on performance of tumor delineation methods: a test-retest assessment. J Nucl Med 2011, 52: 1550–1558. 10.2967/jnumed.111.088914CrossRefPubMed Cheebsumon P, van Velden FHP, Yaqub M, Frings V, de Langen AJ, Hoekstra OS, Lammertsma AA, Boellaard R: Effects of image characteristics on performance of tumor delineation methods: a test-retest assessment. J Nucl Med 2011, 52: 1550–1558. 10.2967/jnumed.111.088914CrossRefPubMed
18.
go back to reference Shepherd T, Teräs M, Beichel RR, Boellaard R, Bruynooghe M, Dicken V, Gooding MJ, Julyan PJ, Lee JA, Lefevre S, Mix M, Naranjo V, Wu X, Zaidi H, Zeng Z, Minn H: Comparative study with new accuracy metrics for target volume contouring in PET image guided radiation therapy. IEEE Trans Med Imag 2012, 31: 2006–2023. 10.1109/TMI.2012.2202322CrossRef Shepherd T, Teräs M, Beichel RR, Boellaard R, Bruynooghe M, Dicken V, Gooding MJ, Julyan PJ, Lee JA, Lefevre S, Mix M, Naranjo V, Wu X, Zaidi H, Zeng Z, Minn H: Comparative study with new accuracy metrics for target volume contouring in PET image guided radiation therapy. IEEE Trans Med Imag 2012, 31: 2006–2023. 10.1109/TMI.2012.2202322CrossRef
19.
go back to reference National Electrical Manufacturers Association:NEMA Standards Publication NU 2–2012 Performance Measurements of Positron Emission Tomographs. National Electrical Manufacturers Association, Rosslyn; 2007. National Electrical Manufacturers Association:NEMA Standards Publication NU 2–2012 Performance Measurements of Positron Emission Tomographs. National Electrical Manufacturers Association, Rosslyn; 2007.
20.
go back to reference Boellaard R: Standards for PET image acquisition and quantitative data analysis. J Nucl Med 2009, 50(Suppl 1):11S-20S. 10.2967/jnumed.108.057182CrossRefPubMed Boellaard R: Standards for PET image acquisition and quantitative data analysis. J Nucl Med 2009, 50(Suppl 1):11S-20S. 10.2967/jnumed.108.057182CrossRefPubMed
21.
go back to reference Versus A, Contouring M: Letters to the editor autocontouring versus manual contouring. J Nucl Med 2011, 52: 658–659. Versus A, Contouring M: Letters to the editor autocontouring versus manual contouring. J Nucl Med 2011, 52: 658–659.
23.
go back to reference Jakoby BW, Bercier Y, Conti M, Casey ME, Bendriem B, Townsend DW: Physical and clinical performance of the mCT time-of-flight PET/CT scanner. Phys Med Biol 2011, 56: 2375–2389. 10.1088/0031-9155/56/8/004CrossRefPubMed Jakoby BW, Bercier Y, Conti M, Casey ME, Bendriem B, Townsend DW: Physical and clinical performance of the mCT time-of-flight PET/CT scanner. Phys Med Biol 2011, 56: 2375–2389. 10.1088/0031-9155/56/8/004CrossRefPubMed
24.
go back to reference Sung-Cheng H: Anatomy of SUV. Nucl Med Biol 2000, 27: 643–646. 10.1016/S0969-8051(00)00155-4CrossRef Sung-Cheng H: Anatomy of SUV. Nucl Med Biol 2000, 27: 643–646. 10.1016/S0969-8051(00)00155-4CrossRef
25.
go back to reference Arens AIJ, Troost EGC, Hoeben BAW, Grootjans W, Lee JA, Grégoire V, Hatt M, Visvikis D, Bussink J, Oyen WJG, Kaanders JHAM, Visser EP: Semiautomatic methods for segmentation of the proliferative tumour volume on sequential FLT PET/CT images in head and neck carcinomas and their relation to clinical outcome. Eur J Nucl Med Mol Imag 2014, 41: 915–924. 10.1007/s00259-013-2651-0CrossRef Arens AIJ, Troost EGC, Hoeben BAW, Grootjans W, Lee JA, Grégoire V, Hatt M, Visvikis D, Bussink J, Oyen WJG, Kaanders JHAM, Visser EP: Semiautomatic methods for segmentation of the proliferative tumour volume on sequential FLT PET/CT images in head and neck carcinomas and their relation to clinical outcome. Eur J Nucl Med Mol Imag 2014, 41: 915–924. 10.1007/s00259-013-2651-0CrossRef
Metadata
Title
Insight on automated lesion delineation methods for PET data
Authors
Azadeh Firouzian
Matthew D Kelly
Jérôme M Declerck
Publication date
01-12-2014
Publisher
Springer Berlin Heidelberg
Published in
EJNMMI Research / Issue 1/2014
Electronic ISSN: 2191-219X
DOI
https://doi.org/10.1186/s13550-014-0069-8

Other articles of this Issue 1/2014

EJNMMI Research 1/2014 Go to the issue