Top

Published in:

Open Access 01-12-2017 | Research

Considerable interobserver variation in delineation of pancreatic cancer on 3DCT and 4DCT: a multi-institutional study

Authors: Eva Versteijne, Oliver J. Gurney-Champion, Astrid van der Horst, Eelco Lens, M. Willemijn Kolff, Jeroen Buijsen, Gati Ebrahimi, Karen J. Neelis, Coen R. N. Rasch, Jaap Stoker, Marcel van Herk, Arjan Bel, Geertjan van Tienhoven

Published in: Radiation Oncology | Issue 1/2017

Abstract

Background

The delineation of pancreatic tumors on CT is challenging. In this study, we quantified the interobserver variation for pancreatic tumor delineation on 3DCT as well as on 4DCT.

Methods

Eight observers (radiation oncologists) from six institutions delineated pancreatic tumors of four patients with (borderline) resectable pancreatic cancer. The study consisted of two stages. In the 3DCT-stage, the gross tumor volume (GTV) was delineated on a contrast-enhanced scan. In the 4DCT-stage, the internal GTV (iGTV) was delineated, accounting for the respiratory motion. We calculated the volumes of the (i)GTV, the overlap of the delineated volumes (expressed as generalized conformity index: CI_gen), the local observer variation (local standard deviation: SD) and the overall observer variation (overall SD). We compared these results between GTVs and iGTVs. Additionally, observers were asked to fill out a questionnaire concerning the difficulty of the delineation and their experience in delineating pancreatic tumors.

Results

The ratios of the largest to the smallest delineated GTV and iGTV within the same patient were 6.8 and 16.5, respectively. As the iGTV incorporates the GTV during all respiratory phases, the mean volumes of the iGTV (40.07 cm³) were larger than those of the GTV (29.91 cm³). For all patients, CI_gen was larger for the iGTV than for the GTV. The mean overall observer variation (root-mean-square of all local SDs over four patients) was 0.63 cm and 0.80 cm for GTV and iGTV, respectively. The largest local observer variations were seen close to biliary stents and suspicious pathological enlarged lymph nodes, as some observers included them and some did not. This variation was more pronounced for the iGTV than for the GTV. The observers rated the 3DCT-stage and 4DCT-stage equally difficult and treated on average three to four pancreatic cancer patients per year.

Conclusions

A considerable interobserver variation in delineation of pancreatic tumors was observed. This variation was larger for 4D than for 3D delineation. The largest local observer variation was found around biliary stents and suspicious pathological enlarged lymph nodes.

Available only for authorised users

Mancosu P, Bettinardi V, Passoni P, Gusmini S, Cappio S, Gilardi MC, et al. Contrast enhanced 4D-CT imaging for target volume definition in pancreatic ductal adenocarcinoma. Radiother Oncol. 2008;87(3):339–42. doi:10.1016/j.radonc.2008.04.007.CrossRefPubMed

Cattaneo GM, Passino P, Sangalli G, Slim N, Longobardi B, Mancosu P, et al. Internal target volume defined by contrast-enhanced 4D-CT scan in unresectable pancreatic tumour: evaluation and reproducibility. Radiother Oncol. 2010;97(3):525–9. doi:10.1016/j.radonc.2010.08.007.CrossRefPubMed

Mori S, Hara R, Yanagi T, Sharp GC, Kumagai M, Asakura H, et al. Four-dimensional measurement of intrafractional respiratory motion of pancreatic tumors using a 256 multi-slice CT scanner. Radiother Oncol. 2009;92(2):231–7. doi:10.1016/j.radonc.2008.12.015.CrossRefPubMed

Lens E, van der Horst A, Kroon PS, van Hooft JE, Dávila Fajardo R, Fockens P, et al. Differences in respiratory-induced pancreatic tumor motion between 4D treatment planning CT and daily cone beam CT, measured using intratumoral fiducials. Acta Oncol. 2014;53(9):1257–64. doi:10.3109/0284186X.2014.905699.CrossRefPubMed

ICRU. Prescribing, recording and reporting photon-beam intensity modulated radiation therapy (IMRT) (ICRU Report 83). 2010.

Lens E, van der Horst A, Versteijne E, van Tienhoven G, Bel A. Dosimetric advantages of midventilation compared with internal target volume for radiation therapy of pancreatic cancer. Int J Radiat Oncol Biol Phys. 2015;92(3):675–82.CrossRefPubMed

van Mourik AM, Elkhuize PH, Minkema D, Duppen JC, van Vliet-Vroegindeweij C. Multiinstitutional study on target volume delineation variation in breast radiotherapy in the presence of guidelines. Radiother Oncol. 2010;94(3):286–91. doi:10.1016/j.radonc.2010.01.009.CrossRefPubMed

Steenbakkers RJHM, Duppen JC, Fitton I, Deurloo KE, Zijp L, Uitterhoeve AL, et al. Observer variation in target volume delineation of lung cancer related to radiation oncologist–computer interaction: a ‘Big Brother’ evaluation. Radiother Oncol. 2005;77(2):182–90.CrossRefPubMed

Genovesi D, Ausili Cefaro G, Trignani M, Vinciguerra A, Augurio A, Di Tommaso M, et al. Interobserver variability of clinical target volume delineation in soft-tissue sarcomas. Cancer Radiother. 2014;18(2):89–96. doi:10.1016/j.canrad.2013.11.011.CrossRefPubMed

10.

Nijkamp J, de Haas-Kock DF, Beukema JC, Neelis KJ, Woutersen D, Ceha H, et al. Target volume delineation variation in radiotherapy for early stage rectal cancer in the Netherlands. Radiother Oncol. 2012;102(1):14–21. doi:10.1016/j.radonc.2011.08.011.CrossRefPubMed

11.

Villeirs GM, Van Vaerenbergh K, Vakaet L, Bral S, Claus F, De Neve WJ, et al. Interobserver delineation variation using CT versus combined CT + MRI in intensity-modulated radiotherapy for prostate cancer. Strahlenther Onkol. 2005;181(7):424–30.CrossRefPubMed

12.

Goodman KA, Regine WF, Dawson LA, Ben-Josef E, Haustermans K, Bosch WR, et al. Consensus panel contouring atlas for the delineation of the clinical target volume in the postoperative treatment of pancreatic cancer. Int J Radiat Oncol Biol Phys. 2012;83(3):901–8. doi:10.1016/j.ijrobp.2012.01.022.CrossRefPubMed

13.

Carvatta L, Sallustio G, Pacelli F, Padula GD, Deodato F, Macchia G, et al. Clinical target volume delineation including elective nodal irradiation in preoperative and definitive radiotherapy of pancreatic cancer. Radiat Oncol. 2012;7:86. doi:10.1186/1748-717X-7-86.CrossRef

14.

Caravatta L, Macchia G, Mattiuci GC, Sainato A, Cernusco NL, Mantello G, et al. Inter-observer variability of clinical target volume delineation in radiotherapy treatment of pancreatic cancer: a multi-institutional contouring experience. Radiat Oncol. 2014;9:198. doi:10.1186/1748-717X-9-198.CrossRefPubMedPubMedCentral

15.

Yamazaki H, Nishiyama K, Tanaka E, Koiwai K, Shikama N, Ito Y, et al. Dummy run for a phase II multi-institute trial of chemoradiotherapy for unresectable pancreatic cancer: inter-observer variance in contour delineation. Anticancer Res. 2007;27(4C):2965–71.PubMed

16.

Fokas E, Clifford C, Spezi E, Joseph G, Branagan J, Hurt C, et al. Comparison of investigator-delineated gross tumor volumes and quality assurance in pancreatic cancer: analysis of the pretrial benchmark case for the SCALOP trial. Radiother Oncol. 2015;117(3):432–7. doi:10.1016/j.radonc.2015.08.026.CrossRefPubMed

17.

Versteijne E, van Eijck CH, Punt CJ, Suker M, Zwinderman AH, Dohmen MA, et al. Preoperative radiochemotherapy versus immediate surgery for resectable and borderline resectable pancreatic cancer (PREOPANC trial): study protocol for a multicentre randomized controlled trial. Trials. 2016;17(1):127. doi:10.1186/s13063-016-1262-z.CrossRefPubMedPubMedCentral

18.

Van der Horst A, Wognum S, Dávila Fajardo R, de Jong R, van Hooft JE, Fockens P, et al. Interfractional position variation of pancreatic tumors quantified using intratumoral fiducial markers and daily cone beam computed tomography. Int J Radiat Oncol Biol Phys. 2013;87(1):202–8. doi:10.1016/j.ijrobp.2013.05.001.CrossRefPubMed

19.

Dávila Fajardo R, Lekkerkerker SJ, van der Horst A, Lens E, Bergman JJ, Fockens P, et al. EUS-guided fiducial markers placement with a 22-gauge needle for image-guided radiation therapy in pancreatic cancer. Gastrointest Endosc. 2014;79(5):851–5. doi:10.1016/j.gie.2013.12.027.CrossRefPubMed

20.

Kouwenhoven E, Giezen M, Struikmans H. Measuring the similarity of target volume delineations independent of the number of observers. Phys Med Biol. 2009;54(9):2863–73. doi:10.1088/0031-9155/54/9/018.CrossRefPubMed

21.

Deurloo KE, Steenbakkers RJ, Zijp LJ, de Bois JA, Nowak PJ, Rasch CR, van Herk M. Quantification of shape variation of prostate and seminal vesicles during external beam radiotherapy. Int J Radiat Oncol Biol Phys. 2005;61(1):228–38.CrossRefPubMed

22.

Jager EA, Kasperts N, Caldas-Magalhaes J, Philippens ME, Pameijer FA, Terhaard CH, Raaijmakers CP, et al. GTV delineation in supraglottic laryngeal carcinoma: interobserver agreement of CT versus CT-MR delineation. Radiat Oncol. 2015;10:26. doi:10.1186/s13014-014-0321-4.CrossRefPubMedPubMedCentral

23.

den Hartogh MD, Philippens ME, van Dam IE, Kleynen CE, Tersteeg RJ, Pijnappel RM, et al. MRI and CT imaging for preoperative target volume delineation in breast-conserving therapy. Radiat Oncol. 2014;9:63. doi:10.1186/1748-717X-9-63.CrossRef

24.

Goldstein SD, Ford EC, Duhon M, McNutt T, Wong J, Herman JM. Use of respiratory-correlated four-dimensional computed tomography to determine acceptable treatment margins for locally advanced pancreatic adenocarcinoma. Int J Radiat Oncol Biol Phys. 2010;76(2):597602. doi:10.1016/j.ijrobp.2009.06.009.CrossRef

25.

Rasch CR, Steenbakkers RJ, Fitton I, Duppen JC, Nowak PJ, Pameijer FA, et al. Decreased 3D observer variation with matched CT-MRI, for target delineation in Nasopharynx cancer. Radiat Oncol. 2010;5:21. doi:10.1186/1748-717X-5-21.CrossRefPubMedPubMedCentral

26.

Abrams RA, Winter KA, Regine WF, Safran H, Hoffman JP, Lustig R, et al. Failure to adhere to protocol specified radiation therapy guidelines was associated with decreased survival in RTOG 9704 - a phase III trial of adjuvant chemotherapy and chemoradiotherapy for patients with resected adenocarcinoma of the pancreas. Int J Radiat Oncol Biol Phys. 2012;82(2):809–16. doi:10.1016/j.ijrobp.2010.11.039.CrossRefPubMed

27.

Yang DS, Yoon WS, Lee JA, Lee NK, Lee S, Kim CY, et al. The effectiveness of gadolinium MRI to improve target delineation for radiotherapy in hepatocellular carcinoma: a comparative study of rigid image registration techniques. Phys Med. 2014;30(6):676–81. doi:10.1016/j.ejmp.2014.05.003.CrossRefPubMed

28.

Djan I, Petrovic B, Erak M, Nikolic I, Lucic S. Radiotherapy treatment planning: benefits of CT-MR image registration and fusion in tumor volume delineation. Vojnosanit Pregl. 2013;70(8):735–9.CrossRefPubMed

29.

Bird D, Scarsbrook AF, Sykes J, Ramasamy S, Subesinghe M, Carey B, et al. Multimodality imaging with CT, MR and FDG-PET for radiotherapy target volume delineation in oropharyngeal squamous cell carcinoma. BMC Cancer. 2015;15:844. doi:10.1186/s12885-015-1867-8.CrossRefPubMedPubMedCentral

30.

Fletcher JG, Wiersema MJ, Farrell MA, Fidler JL, Burgart LJ, Koyama T, et al. Pancreatic malignancy: value of arterial, pancreatic, and hepatic phase imaging with multi-detector row CT. Radiology. 2003;229(1):81–90.CrossRefPubMed

31.

McNulty NJ, Francis IR, Platt JF, Cohan RH, Korobkin M, Gebremariam A. Multi--detector row helical CT of the pancreas: effect of contrast-enhanced multiphasic imaging on enhancement of the pancreas, peripancreatic vasculature, and pancreatic adenocarcinoma. Radiology. 2001;220(1):97–102.CrossRefPubMed

32.

Li XX, Liu NB, Zhu L, Yuan XK, Yang CW, Ren P, et al. Consequences of additional use of contrast-enhanced (18)F-FDG PET/CT in target volume delineation and dose distribution for pancreatic cancer. Br J Radiol. 2015;88(1051):20140590. doi:10.1259/bjr.20140590.CrossRefPubMedPubMedCentral

33.

Dalah E, Moraru I, Paulson E, Erickson B, Li XA. Variability of target and normal structure delineation using multimodality imaging for radiation therapy of pancreatic cancer. Int J Radiat Oncol Biol Phys. 2014;89(3):633–40. doi:10.1016/j.ijrobp.2014.02.035.CrossRefPubMed

Title: Considerable interobserver variation in delineation of pancreatic cancer on 3DCT and 4DCT: a multi-institutional study
Authors: Eva Versteijne
Oliver J. Gurney-Champion
Astrid van der Horst
Eelco Lens
M. Willemijn Kolff
Jeroen Buijsen
Gati Ebrahimi
Karen J. Neelis
Coen R. N. Rasch
Jaap Stoker
Marcel van Herk
Arjan Bel
Geertjan van Tienhoven
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: Radiation Oncology / Issue 1/2017
Electronic ISSN: 1748-717X
DOI: https://doi.org/10.1186/s13014-017-0777-0

At a glance: The STEP trials

Springer Medicine

Considerable interobserver variation in delineation of pancreatic cancer on 3DCT and 4DCT: a multi-institutional study

Abstract

Background

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2017

Dosimetric comparison of interstitial brachytherapy with multi-channel vaginal cylinder plans in patients with vaginal tumors

Intraoperative radiation therapy (IORT) in pancreatic cancer

Seven fractions to deliver partial breast irradiation: the toxicity is Low

“HEATPAC” - a phase II randomized study of concurrent thermochemoradiotherapy versus chemoradiotherapy alone in locally advanced pancreatic cancer

Clinical implementation of a knowledge based planning tool for prostate VMAT

Influence of autophagy on the efficacy of radiotherapy