Skip to main content
Top
Published in: EJNMMI Research 1/2019

Open Access 01-12-2019 | Positron Emission Tomography | Original research

Interobserver variability of image-derived arterial blood SUV in whole-body FDG PET

Authors: Frank Hofheinz, Jens Maus, Sebastian Zschaeck, Julian Rogasch, Georg Schramm, Liane Oehme, Ivayla Apostolova, Jörg Kotzerke, Jörg van den Hoff

Published in: EJNMMI Research | Issue 1/2019

Login to get access

Abstract

Background

Today, the standardized uptake value (SUV) is essentially the only means for quantitative evaluation of static [18F-]fluorodeoxyglucose (FDG) positron emission tomography (PET) investigations. However, the SUV approach has several well-known shortcomings which adversely affect the reliability of the SUV as a surrogate of the metabolic rate of glucose consumption. The standard uptake ratio (SUR), i.e., the uptake time-corrected ratio of tumor SUV to image-derived arterial blood SUV, has been shown in the first clinical studies to overcome most of these shortcomings, to decrease test-retest variability, and to increase the prognostic value in comparison to SUV. However, it is unclear, to what extent the SUR approach is vulnerable to observer variability of the additionally required blood SUV (BSUV) determination. The goal of the present work was the investigation of the interobserver variability of image-derived BSUV.

Methods

FDG PET/CT scans from 83 patients (72 male, 11 female) with non-small cell lung cancer (N = 46) or head and neck cancer (N = 37) were included. BSUV was determined by 8 individuals, each applying a dedicated delineation tool for the BSUV determination in the aorta. Two of the observers applied two further tools. Altogether, five different delineation tools were used. With each used tool, delineation was performed for the whole patient group, resulting in 12 distinct observations per patient. Intersubject variability of BSUV determination was assessed using the fractional deviations for the individual patients from the patient group average and was quantified as standard deviation (SD is), 95% confidence interval, and range.
Interobserver variability of BSUV determination was assessed using the fractional deviations of the individual observers from the observer-average for the considered patient and quantified as standard deviations (SD p, SD d) or root mean square (RMS), 95% confidence interval, and range in each patient, each observer, and the pooled data respectively.

Results

Interobserver variability in the pooled data amounts to RMS = 2.8% and is much smaller than the intersubject variability of BSUV (SD is= 16%). Averaged over the whole patient group, deviations of individual observers from the observer average are very small and fall in the range [ − 0.96, 1.05]%. However, interobserver variability partly differs distinctly for different patients, covering a range of [0.7, 7.4]% in the investigated patient group.

Conclusion

The present investigation demonstrates that the image-based manual determination of BSUV in the aorta is sufficiently reproducible across different observers and delineation tools which is a prerequisite for accurate SUR determination. This finding is in line with the already demonstrated superior prognostic value of SUR in comparison to SUV in the first clinical studies.
Literature
1.
go back to reference Hamberg LM, Hunter GJ, Alpert NM, Choi NC, Babich JW, Fischman AJ. The dose uptake ratio as an index of glucose metabolism: useful parameter or oversimplification?J Nucl Med. 1994; 35(8):1308–12.PubMed Hamberg LM, Hunter GJ, Alpert NM, Choi NC, Babich JW, Fischman AJ. The dose uptake ratio as an index of glucose metabolism: useful parameter or oversimplification?J Nucl Med. 1994; 35(8):1308–12.PubMed
2.
go back to reference Keyes Jr JW. SUV: standard uptake or silly useless value?J Nucl Med. 1995; 36(10):1836–9. Keyes Jr JW. SUV: standard uptake or silly useless value?J Nucl Med. 1995; 36(10):1836–9.
4.
go back to reference Malik V, Lucey JA, Duffy GJ, Wilson L, McNamara L, Keogan M, Gillham C, Reynolds JV. Early repeated 18F-FDG PET scans during neoadjuvant chemoradiation fail to predict histopathologic response or survival benefit in adenocarcinoma of the esophagus. J Nucl Med. 2010; 51(12):1863–9.CrossRef Malik V, Lucey JA, Duffy GJ, Wilson L, McNamara L, Keogan M, Gillham C, Reynolds JV. Early repeated 18F-FDG PET scans during neoadjuvant chemoradiation fail to predict histopathologic response or survival benefit in adenocarcinoma of the esophagus. J Nucl Med. 2010; 51(12):1863–9.CrossRef
5.
go back to reference Suzuki A, Xiao L, Hayashi Y, Macapinlac HA, Welsh J, Lin SH, Lee JH, Bhutani MS, Maru DM, Hofstetter WL, et al. Prognostic significance of baseline positron emission tomography and importance of clinical complete response in patients with esophageal or gastroesophageal junction cancer treated with definitive chemoradiotherapy. Cancer. 2011; 117(21):4823–33.CrossRef Suzuki A, Xiao L, Hayashi Y, Macapinlac HA, Welsh J, Lin SH, Lee JH, Bhutani MS, Maru DM, Hofstetter WL, et al. Prognostic significance of baseline positron emission tomography and importance of clinical complete response in patients with esophageal or gastroesophageal junction cancer treated with definitive chemoradiotherapy. Cancer. 2011; 117(21):4823–33.CrossRef
6.
go back to reference Palie O, Michel P, Ménard JF, Rousseau C, Rio E, Bridji B, Benyoucef A, Meyer ME, Jalali K, Bardet S, et al. The predictive value of treatment response using FDG PET performed on day 21 of chemoradiotherapy in patients with oesophageal squamous cell carcinoma. A prospective, multicentre study (RTEP3). Eur J Nucl Med Mol Imaging. 2013; 40(9):1345–55.CrossRef Palie O, Michel P, Ménard JF, Rousseau C, Rio E, Bridji B, Benyoucef A, Meyer ME, Jalali K, Bardet S, et al. The predictive value of treatment response using FDG PET performed on day 21 of chemoradiotherapy in patients with oesophageal squamous cell carcinoma. A prospective, multicentre study (RTEP3). Eur J Nucl Med Mol Imaging. 2013; 40(9):1345–55.CrossRef
7.
go back to reference Elimova E, Wang X, Etchebehere E, Shiozaki H, Shimodaira Y, Wadhwa R, Planjery V, Charalampakis N, Blum MA, Hofstetter W, et al. 18-Fluorodeoxy-glucose positron emission computed tomography as predictive of response after chemoradiation in oesophageal cancer patients. Eur J Cancer. 2015; 51(17):2545–52.CrossRef Elimova E, Wang X, Etchebehere E, Shiozaki H, Shimodaira Y, Wadhwa R, Planjery V, Charalampakis N, Blum MA, Hofstetter W, et al. 18-Fluorodeoxy-glucose positron emission computed tomography as predictive of response after chemoradiation in oesophageal cancer patients. Eur J Cancer. 2015; 51(17):2545–52.CrossRef
8.
go back to reference Lemarignier C, Di Fiore F, Marre C, Hapdey S, Modzelewski R, Gouel P, Michel P, Dubray B, Vera P. Pretreatment metabolic tumour volume is predictive of disease-free survival and overall survival in patients with oesophageal squamous cell carcinoma. Eur J Nucl Med Mol Imaging. 2014; 41(11):2008–16.CrossRef Lemarignier C, Di Fiore F, Marre C, Hapdey S, Modzelewski R, Gouel P, Michel P, Dubray B, Vera P. Pretreatment metabolic tumour volume is predictive of disease-free survival and overall survival in patients with oesophageal squamous cell carcinoma. Eur J Nucl Med Mol Imaging. 2014; 41(11):2008–16.CrossRef
9.
go back to reference Haerle SK, Huber G, Hany T, Ahmad N, Schmid D. Is there a correlation between 18F-FDG-PET standardized uptake value, T-classification, histological grading and the anatomic subsites in newly diagnosed squamous cell carcinoma of the head and neck?Eur Arch Otorhinolaryngol. 2010; 267(10):1635–40.CrossRef Haerle SK, Huber G, Hany T, Ahmad N, Schmid D. Is there a correlation between 18F-FDG-PET standardized uptake value, T-classification, histological grading and the anatomic subsites in newly diagnosed squamous cell carcinoma of the head and neck?Eur Arch Otorhinolaryngol. 2010; 267(10):1635–40.CrossRef
10.
go back to reference Schinagl DA, Span PN, Oyen WJ, Kaanders JH. Can FDG PET predict radiation treatment outcome in head and neck cancer? Results of a prospective study. Eur J Nucl Med Mol Imaging. 2011; 38(8):1449–58.CrossRef Schinagl DA, Span PN, Oyen WJ, Kaanders JH. Can FDG PET predict radiation treatment outcome in head and neck cancer? Results of a prospective study. Eur J Nucl Med Mol Imaging. 2011; 38(8):1449–58.CrossRef
11.
go back to reference Romesser PB, Qureshi MM, Shah BA, Chatburn LT, Jalisi S, Devaiah AK, Subramaniam RM, Truong MT. Superior prognostic utility of gross and metabolic tumor volume compared to standardized uptake value using PET/CT in head and neck squamous cell carcinoma patients treated with intensity-modulated radiotherapy. Ann Nucl Med. 2012; 26(7):527–34.CrossRef Romesser PB, Qureshi MM, Shah BA, Chatburn LT, Jalisi S, Devaiah AK, Subramaniam RM, Truong MT. Superior prognostic utility of gross and metabolic tumor volume compared to standardized uptake value using PET/CT in head and neck squamous cell carcinoma patients treated with intensity-modulated radiotherapy. Ann Nucl Med. 2012; 26(7):527–34.CrossRef
12.
go back to reference Cacicedo J, Fernandez I, Del Hoyo O, Navarro A, Gomez-Iturriaga A, Pijoan JI, Martinez-Indart L, Escudero J, Gomez-Suarez J, de Zarate RO, et al. Prognostic value of maximum standardized uptake value measured by pretreatment 18F-FDG PET/CT in locally advanced head and neck squamous cell carcinoma. Clin Transl Oncol. 2017; 19(11):1337–49.CrossRef Cacicedo J, Fernandez I, Del Hoyo O, Navarro A, Gomez-Iturriaga A, Pijoan JI, Martinez-Indart L, Escudero J, Gomez-Suarez J, de Zarate RO, et al. Prognostic value of maximum standardized uptake value measured by pretreatment 18F-FDG PET/CT in locally advanced head and neck squamous cell carcinoma. Clin Transl Oncol. 2017; 19(11):1337–49.CrossRef
13.
go back to reference Agarwal M, Brahmanday G, Bajaj SK, Ravikrishnan K, Wong C-YO. Revisiting the prognostic value of preoperative 18 f-fluoro-2-deoxyglucose (18 F-FDG) positron emission tomography (PET) in early-stage (I & II) non-small cell lung cancers (NSCLC). Eur J Nucl Med Mol Imaging. 2010; 37(4):691–8.CrossRef Agarwal M, Brahmanday G, Bajaj SK, Ravikrishnan K, Wong C-YO. Revisiting the prognostic value of preoperative 18 f-fluoro-2-deoxyglucose (18 F-FDG) positron emission tomography (PET) in early-stage (I & II) non-small cell lung cancers (NSCLC). Eur J Nucl Med Mol Imaging. 2010; 37(4):691–8.CrossRef
14.
go back to reference Machtay M, Duan F, Siegel BA, Snyder BS, Gorelick JJ, Reddin JS, Munden R, Johnson DW, Wilf LH, DeNittis A, et al. Prediction of survival by [18F] fluorodeoxyglucose positron emission tomography in patients with locally advanced non–small-cell lung cancer undergoing definitive chemoradiation therapy: results of the ACRIN 6668/RTOG 0235 trial. J Clin Oncol. 2013; 31(30):3823.CrossRef Machtay M, Duan F, Siegel BA, Snyder BS, Gorelick JJ, Reddin JS, Munden R, Johnson DW, Wilf LH, DeNittis A, et al. Prediction of survival by [18F] fluorodeoxyglucose positron emission tomography in patients with locally advanced non–small-cell lung cancer undergoing definitive chemoradiation therapy: results of the ACRIN 6668/RTOG 0235 trial. J Clin Oncol. 2013; 31(30):3823.CrossRef
15.
go back to reference Soussan M, Chouahnia K, Maisonobe JA, Boubaya M, Eder V, Morère JF, Buvat I. Prognostic implications of volume-based measurements on FDG PET/CT in stage III non-small-cell lung cancer after induction chemotherapy. Eur J Nucl Med Mol Imaging. 2013; 40(5):668–76.CrossRef Soussan M, Chouahnia K, Maisonobe JA, Boubaya M, Eder V, Morère JF, Buvat I. Prognostic implications of volume-based measurements on FDG PET/CT in stage III non-small-cell lung cancer after induction chemotherapy. Eur J Nucl Med Mol Imaging. 2013; 40(5):668–76.CrossRef
16.
go back to reference Vu CC, Matthews R, Kim B, Franceschi D, Bilfinger TV, Moore WH. Prognostic value of metabolic tumor volume and total lesion glycolysis from 18F-FDG PET/CT in patients undergoing stereotactic body radiation therapy for stage I non-small-cell lung cancer. Nucl Med Commun. 2013; 34(10):959–63.CrossRef Vu CC, Matthews R, Kim B, Franceschi D, Bilfinger TV, Moore WH. Prognostic value of metabolic tumor volume and total lesion glycolysis from 18F-FDG PET/CT in patients undergoing stereotactic body radiation therapy for stage I non-small-cell lung cancer. Nucl Med Commun. 2013; 34(10):959–63.CrossRef
17.
go back to reference van den Hoff J, Oehme L, Schramm G, Maus J, Lougovski A, Petr J, Beuthien-Baumann B, Hofheinz F. The pet-derived tumor-to-blood standard uptake ratio SUR is superior to tumor SUV as a surrogate parameter of the metabolic rate of FDG. EJNMMI Res. 2013; 3(1):77.CrossRef van den Hoff J, Oehme L, Schramm G, Maus J, Lougovski A, Petr J, Beuthien-Baumann B, Hofheinz F. The pet-derived tumor-to-blood standard uptake ratio SUR is superior to tumor SUV as a surrogate parameter of the metabolic rate of FDG. EJNMMI Res. 2013; 3(1):77.CrossRef
18.
go back to reference van den Hoff J, Lougovski A, Schramm G, Maus J, Oehme L, Petr J, Beuthien-Baumann B, Kotzerke J, Hofheinz F. Correction of scan time dependence of standard uptake values in oncological pet. EJNMMI Res. 2014; 4(1):18.CrossRef van den Hoff J, Lougovski A, Schramm G, Maus J, Oehme L, Petr J, Beuthien-Baumann B, Kotzerke J, Hofheinz F. Correction of scan time dependence of standard uptake values in oncological pet. EJNMMI Res. 2014; 4(1):18.CrossRef
19.
go back to reference Hofheinz F, Apostolova I, Oehme L, Kotzerke J, van den Hoff J. Test–retest variability in lesion SUV and lesion SUR in 18F-FDG PET: an analysis of data from two prospective multicenter trials. J Nucl Med. 2017; 58(11):1770–5.CrossRef Hofheinz F, Apostolova I, Oehme L, Kotzerke J, van den Hoff J. Test–retest variability in lesion SUV and lesion SUR in 18F-FDG PET: an analysis of data from two prospective multicenter trials. J Nucl Med. 2017; 58(11):1770–5.CrossRef
20.
go back to reference Bütof R, Hofheinz F, Zöphel K, Stadelmann T, Schmollack J, Jentsch C, Löck S, Kotzerke J, Baumann M, van den Hoff J. Prognostic value of pretherapeutic tumor-to-blood standardized uptake ratio in patients with esophageal carcinoma. J Nucl Med. 2015; 56(8):1150–6.CrossRef Bütof R, Hofheinz F, Zöphel K, Stadelmann T, Schmollack J, Jentsch C, Löck S, Kotzerke J, Baumann M, van den Hoff J. Prognostic value of pretherapeutic tumor-to-blood standardized uptake ratio in patients with esophageal carcinoma. J Nucl Med. 2015; 56(8):1150–6.CrossRef
21.
go back to reference Bütof R, Hofheinz F, Zöphel K, Schmollack J, Jentsch C, Zschaeck S, Kotzerke J, van den Hoff J, Baumann M. Prognostic value of SUR in patients with trimodality treatment of locally advanced esophageal carcinoma. J Nucl Med. 2019; 60(2):192–8.CrossRef Bütof R, Hofheinz F, Zöphel K, Schmollack J, Jentsch C, Zschaeck S, Kotzerke J, van den Hoff J, Baumann M. Prognostic value of SUR in patients with trimodality treatment of locally advanced esophageal carcinoma. J Nucl Med. 2019; 60(2):192–8.CrossRef
22.
go back to reference Hofheinz F, van den Hoff J, Steffen IG, Lougovski A, Ego K, Amthauer H, Apostolova I. Comparative evaluation of SUV, tumor-to-blood standard uptake ratio (SUR), and dual time point measurements for assessment of the metabolic uptake rate in FDG PET. EJNMMI Res. 2016; 6(1):1–9.CrossRef Hofheinz F, van den Hoff J, Steffen IG, Lougovski A, Ego K, Amthauer H, Apostolova I. Comparative evaluation of SUV, tumor-to-blood standard uptake ratio (SUR), and dual time point measurements for assessment of the metabolic uptake rate in FDG PET. EJNMMI Res. 2016; 6(1):1–9.CrossRef
23.
24.
go back to reference Boktor RR, Walker G, Stacey R, Gledhill S, Pitman AG. Reference range for intrapatient variability in blood-pool and liver SUV for 18F-FDG PET. J Nucl Med. 2013; 54(5):677–82.CrossRef Boktor RR, Walker G, Stacey R, Gledhill S, Pitman AG. Reference range for intrapatient variability in blood-pool and liver SUV for 18F-FDG PET. J Nucl Med. 2013; 54(5):677–82.CrossRef
25.
go back to reference Hofheinz F, Bütof R, Apostolova I, Zöphel K, Steffen IG, Amthauer H, Kotzerke J, Baumann M, van den Hoff J. An investigation of the relation between tumor-to-liver ratio (TLR) and tumor-to-blood standard uptake ratio (SUR) in oncological FDG PET. EJNMMI Res. 2016; 6(1):1.CrossRef Hofheinz F, Bütof R, Apostolova I, Zöphel K, Steffen IG, Amthauer H, Kotzerke J, Baumann M, van den Hoff J. An investigation of the relation between tumor-to-liver ratio (TLR) and tumor-to-blood standard uptake ratio (SUR) in oncological FDG PET. EJNMMI Res. 2016; 6(1):1.CrossRef
26.
go back to reference Hager A, Kaemmerer H, Rapp-Bernhardt U, Blücher S, Rapp K, Bernhardt TM, Galanski M, Hess J. Diameters of the thoracic aorta throughout life as measured with helical computed tomography. J Thorac Cardiovasc Surg. 2002; 123(6):1060–6.CrossRef Hager A, Kaemmerer H, Rapp-Bernhardt U, Blücher S, Rapp K, Bernhardt TM, Galanski M, Hess J. Diameters of the thoracic aorta throughout life as measured with helical computed tomography. J Thorac Cardiovasc Surg. 2002; 123(6):1060–6.CrossRef
27.
go back to reference Wolak A, Gransar H, Thomson LE, Friedman JD, Hachamovitch R, Gutstein A, Shaw LJ, Polk D, Wong ND, Saouaf R, et al. Aortic size assessment by noncontrast cardiac computed tomography: normal limits by age, gender, and body surface area. JACC: Cardiovasc Imaging. 2008; 1(2):200–9. Wolak A, Gransar H, Thomson LE, Friedman JD, Hachamovitch R, Gutstein A, Shaw LJ, Polk D, Wong ND, Saouaf R, et al. Aortic size assessment by noncontrast cardiac computed tomography: normal limits by age, gender, and body surface area. JACC: Cardiovasc Imaging. 2008; 1(2):200–9.
Metadata
Title
Interobserver variability of image-derived arterial blood SUV in whole-body FDG PET
Authors
Frank Hofheinz
Jens Maus
Sebastian Zschaeck
Julian Rogasch
Georg Schramm
Liane Oehme
Ivayla Apostolova
Jörg Kotzerke
Jörg van den Hoff
Publication date
01-12-2019
Publisher
Springer Berlin Heidelberg
Published in
EJNMMI Research / Issue 1/2019
Electronic ISSN: 2191-219X
DOI
https://doi.org/10.1186/s13550-019-0486-9

Other articles of this Issue 1/2019

EJNMMI Research 1/2019 Go to the issue