Skip to main content
Top
Published in: European Radiology 9/2018

01-09-2018 | Gastrointestinal

Inter-operator variability and source of errors in tumour response assessment for hepatocellular carcinoma treated with sorafenib

Authors: Francesco Tovoli, Matteo Renzulli, Giulia Negrini, Stefano Brocchi, Alessia Ferrarini, Andrea Andreone, Francesca Benevento, Rita Golfieri, Antonio Maria Morselli-Labate, Marianna Mastroroberto, Radu Ion Badea, Fabio Piscaglia

Published in: European Radiology | Issue 9/2018

Login to get access

Abstract

Objectives

To assess the inter-operator concordance and the potential sources of discordance in defining response to sorafenib in hepatocellular carcinoma (HCC).

Methods

All patients who received sorafenib between September 2008 and February 2015 were scrutinised for this retrospective study. Images were evaluated separately by three radiologists with different expertise in liver imaging (operator 1, >10 years; operator 2, 5 years; operator 3, no specific training in liver imaging), according to: response evaluation radiological criteria in solid tumours (RECIST) 1.1, modified RECIST (mRECIST) and response evaluation criteria in cancer of the liver (RECICL).

Results

The overall response concordance between the more expert operators was good, irrespective of the criteria (RECIST 1.1, ĸ = 0.840; mRECIST, ĸ = 0.871; RECICL, ĸ = 0.819). Concordance between the less expert operator and the other colleagues was lower. The most evident discordance was in target lesion response assessment, with expert operators disagreeing mostly on lesion selection and less expert operators on lesion measurement. As a clinical correlate, overall survival was more tightly related with “progressive disease” as assessed by the expert compared to the same assessment performed by operator 3.

Conclusions

Decision on whether a patient is a responder or progressor under sorafenib may vary among different operators, especially in case of a non-specifically trained radiologist. Regardless of the adopted criteria, patients should be evaluated by experienced radiologists to minimise variability in this critical instance.

Key Points

• Inter-operator variability in the assessment of response to sorafenib is poorly known.
• The concordance between operators with expertise in liver imaging was good.
• Target lesions selection was the main source of discordance between expert operators.
• Concordance with non-specifically trained operator was lower, independently from the response criteria.
• The non-specifically trained operator was mainly discordant in measurements of target lesions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nagilla M, Brown RL, Cohen EE (2012) Cabozantinib for the treatment of advanced medullary thyroid cancer. Adv Ther 29:925–934CrossRefPubMed Nagilla M, Brown RL, Cohen EE (2012) Cabozantinib for the treatment of advanced medullary thyroid cancer. Adv Ther 29:925–934CrossRefPubMed
2.
go back to reference Mocellin S, Baretta Z, Roqué I et al (2017) Second-line systemic therapy for metastatic colorectal cancer. Cochrane Database Syst Rev 1:CD006875PubMed Mocellin S, Baretta Z, Roqué I et al (2017) Second-line systemic therapy for metastatic colorectal cancer. Cochrane Database Syst Rev 1:CD006875PubMed
4.
go back to reference Wang Y, Schmid-Bindert G, Zhou C (2012) Erlotinib in the treatment of advanced non-small cell lung cancer: an update for clinicians. Ther Adv Med Oncol 4:19–29CrossRefPubMedPubMedCentral Wang Y, Schmid-Bindert G, Zhou C (2012) Erlotinib in the treatment of advanced non-small cell lung cancer: an update for clinicians. Ther Adv Med Oncol 4:19–29CrossRefPubMedPubMedCentral
5.
go back to reference Therasse P, Arbuck SG, Eisenhauer EA et al (2000) New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst 92:205–216CrossRefPubMed Therasse P, Arbuck SG, Eisenhauer EA et al (2000) New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst 92:205–216CrossRefPubMed
6.
go back to reference Lencioni R, Llovet JM (2010) Modified RECIST (mRECIST) assessment for hepatocellular carcinoma. Semin Liver Dis 30:52–60CrossRefPubMed Lencioni R, Llovet JM (2010) Modified RECIST (mRECIST) assessment for hepatocellular carcinoma. Semin Liver Dis 30:52–60CrossRefPubMed
7.
go back to reference Kudo M, Ueshima K, Kubo S et al (2015) Response Evaluation Criteria in Cancer of the Liver (RECICL) (2015 Revised version). Hepatol Res 46:3–9CrossRefPubMed Kudo M, Ueshima K, Kubo S et al (2015) Response Evaluation Criteria in Cancer of the Liver (RECICL) (2015 Revised version). Hepatol Res 46:3–9CrossRefPubMed
8.
go back to reference Choi H, Charnsangavej C, Faria SC et al (2007) Correlation of computed tomography and positron emission tomography in patients with metastatic gastrointestinal stromal tumor treated at a single institution with imatinib mesylate: proposal of new computed tomography response criteria. J Clin Oncol 25:1753–1759CrossRefPubMed Choi H, Charnsangavej C, Faria SC et al (2007) Correlation of computed tomography and positron emission tomography in patients with metastatic gastrointestinal stromal tumor treated at a single institution with imatinib mesylate: proposal of new computed tomography response criteria. J Clin Oncol 25:1753–1759CrossRefPubMed
9.
go back to reference Llovet JM, Ricci S, Mazzaferro V et al (2008) Sorafenib in advanced hepatocellular carcinoma. N Engl J Med 359:378–390CrossRefPubMed Llovet JM, Ricci S, Mazzaferro V et al (2008) Sorafenib in advanced hepatocellular carcinoma. N Engl J Med 359:378–390CrossRefPubMed
10.
go back to reference Bruix J, Sherman M, Practice Guidelines Committee, American Association for the Study of Liver Diseases (2005) Management of hepatocellular carcinoma. Hepatology 42:1208–1236CrossRefPubMed Bruix J, Sherman M, Practice Guidelines Committee, American Association for the Study of Liver Diseases (2005) Management of hepatocellular carcinoma. Hepatology 42:1208–1236CrossRefPubMed
11.
go back to reference Renzulli M, Brocchi S, Cucchetti A et al (2016) Can current preoperative imaging be used to detect microvascular invasion of hepatocellular carcinoma? Radiology. 279:432–442CrossRefPubMed Renzulli M, Brocchi S, Cucchetti A et al (2016) Can current preoperative imaging be used to detect microvascular invasion of hepatocellular carcinoma? Radiology. 279:432–442CrossRefPubMed
12.
go back to reference Sneag DB, Krajewski K, Giardino A et al (2011) Extrahepatic spread of hepatocellular carcinoma: spectrum of imaging findings. AJR Am J Roentgenol 197:W658–W664CrossRefPubMed Sneag DB, Krajewski K, Giardino A et al (2011) Extrahepatic spread of hepatocellular carcinoma: spectrum of imaging findings. AJR Am J Roentgenol 197:W658–W664CrossRefPubMed
13.
go back to reference Katyal S, Oliver JH 3rd, Peterson MS et al (2000) Extrahepatic metastases of hepatocellular carcinoma. Radiology 216:698-703 Katyal S, Oliver JH 3rd, Peterson MS et al (2000) Extrahepatic metastases of hepatocellular carcinoma. Radiology 216:698-703
14.
go back to reference Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin 76:352–378CrossRef Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin 76:352–378CrossRef
15.
go back to reference Portney LG, Watkins MP (2009) Foundations of clinical research: applications to practice, 3rd edn. Pearson/Prentice Hall, Upper Saddle River Portney LG, Watkins MP (2009) Foundations of clinical research: applications to practice, 3rd edn. Pearson/Prentice Hall, Upper Saddle River
16.
go back to reference Bruix J, Qin S, Merle P et al (2017) Regorafenib for patients with hepatocellular carcinoma who progressed on sorafenib treatment (RESORCE): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet 389:56–66CrossRefPubMed Bruix J, Qin S, Merle P et al (2017) Regorafenib for patients with hepatocellular carcinoma who progressed on sorafenib treatment (RESORCE): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet 389:56–66CrossRefPubMed
17.
go back to reference Bargellini I, Scionti A, Mismas V et al (2014) Identification of responders to sorafenib in hepatocellular carcinoma: is tumor volume measurement the way forward? Oncology. 86:191–198CrossRefPubMed Bargellini I, Scionti A, Mismas V et al (2014) Identification of responders to sorafenib in hepatocellular carcinoma: is tumor volume measurement the way forward? Oncology. 86:191–198CrossRefPubMed
18.
go back to reference Sato Y, Watanabe H, Sone M et al (2013) Tumor response evaluation criteria for HCC (hepatocellular carcinoma) treated using TACE (transcatheter arterial chemoembolization): RECIST (response evaluation criteria in solid tumors) version 1.1 and mRECIST (modified RECIST): JIVROSG-0602. Ups J Med Sci 118:16–22CrossRefPubMedPubMedCentral Sato Y, Watanabe H, Sone M et al (2013) Tumor response evaluation criteria for HCC (hepatocellular carcinoma) treated using TACE (transcatheter arterial chemoembolization): RECIST (response evaluation criteria in solid tumors) version 1.1 and mRECIST (modified RECIST): JIVROSG-0602. Ups J Med Sci 118:16–22CrossRefPubMedPubMedCentral
19.
go back to reference Seyal AR, Gonzalez-Guindalini FD, Arslanoglu A et al (2015) Reproducibility of mRECIST in assessing response to transarterial radioembolization therapy in hepatocellular carcinoma. Hepatology 62:1111–1121CrossRefPubMed Seyal AR, Gonzalez-Guindalini FD, Arslanoglu A et al (2015) Reproducibility of mRECIST in assessing response to transarterial radioembolization therapy in hepatocellular carcinoma. Hepatology 62:1111–1121CrossRefPubMed
20.
go back to reference Lee S, Kim JH, Lee JH et al (2018) Non-invasive monitoring of the therapeutic response in sorafenib-treated hepatocellular carcinoma based on photoacoustic imaging. Eur Radiol 28:372–381CrossRefPubMed Lee S, Kim JH, Lee JH et al (2018) Non-invasive monitoring of the therapeutic response in sorafenib-treated hepatocellular carcinoma based on photoacoustic imaging. Eur Radiol 28:372–381CrossRefPubMed
21.
go back to reference Tovoli F, Renzulli M, Granito A et al (2017) Radiologic criteria of response to systemic treatments for hepatocellular carcinoma. Hepatic Oncology 4:129–137CrossRefPubMedPubMedCentral Tovoli F, Renzulli M, Granito A et al (2017) Radiologic criteria of response to systemic treatments for hepatocellular carcinoma. Hepatic Oncology 4:129–137CrossRefPubMedPubMedCentral
22.
go back to reference Lencioni R, Montal R, Torres F et al (2017) Objective response by mRECIST as a predictor and potential surrogate end-point of overall survival in advanced HCC. J Hepatol 66:1166–1172CrossRefPubMed Lencioni R, Montal R, Torres F et al (2017) Objective response by mRECIST as a predictor and potential surrogate end-point of overall survival in advanced HCC. J Hepatol 66:1166–1172CrossRefPubMed
23.
go back to reference Bruix J, Reig M, Sangro B (2017) Assessment of treatment efficacy in hepatocellular carcinoma: Response rate, delay in progression or none of them. J Hepatol 66:1114–1117CrossRefPubMed Bruix J, Reig M, Sangro B (2017) Assessment of treatment efficacy in hepatocellular carcinoma: Response rate, delay in progression or none of them. J Hepatol 66:1114–1117CrossRefPubMed
24.
go back to reference Ronot M, Bouattour M, Wassermann J et al (2014) Alternative Response Criteria (Choi, European association for the study of the liver, and modified Response Evaluation Criteria in Solid Tumors [RECIST]) Versus RECIST 1.1 in patients with advanced hepatocellular carcinoma treated with sorafenib. Oncologist 19:394–402CrossRefPubMedPubMedCentral Ronot M, Bouattour M, Wassermann J et al (2014) Alternative Response Criteria (Choi, European association for the study of the liver, and modified Response Evaluation Criteria in Solid Tumors [RECIST]) Versus RECIST 1.1 in patients with advanced hepatocellular carcinoma treated with sorafenib. Oncologist 19:394–402CrossRefPubMedPubMedCentral
25.
go back to reference Gavanier M, Ayav A, Sellal C et al (2016) CT imaging findings in patients with advanced hepatocellular carcinoma treated with sorafenib: alternative response criteria (Choi), European Association for the Study of the Liver, and modified Response Evaluation Criteria in Solid Tumor (mRECIST) versus RECIST 1.1. Eur J Radiol 85:103–112CrossRefPubMed Gavanier M, Ayav A, Sellal C et al (2016) CT imaging findings in patients with advanced hepatocellular carcinoma treated with sorafenib: alternative response criteria (Choi), European Association for the Study of the Liver, and modified Response Evaluation Criteria in Solid Tumor (mRECIST) versus RECIST 1.1. Eur J Radiol 85:103–112CrossRefPubMed
26.
go back to reference Arizumi T, Ueshima K, Takeda H et al (2014). Comparison of systems for assessment of post-therapeutic response to sorafenib for hepatocellular carcinoma. J Gastroenterol 49:1578-1587 Arizumi T, Ueshima K, Takeda H et al (2014). Comparison of systems for assessment of post-therapeutic response to sorafenib for hepatocellular carcinoma. J Gastroenterol 49:1578-1587
Metadata
Title
Inter-operator variability and source of errors in tumour response assessment for hepatocellular carcinoma treated with sorafenib
Authors
Francesco Tovoli
Matteo Renzulli
Giulia Negrini
Stefano Brocchi
Alessia Ferrarini
Andrea Andreone
Francesca Benevento
Rita Golfieri
Antonio Maria Morselli-Labate
Marianna Mastroroberto
Radu Ion Badea
Fabio Piscaglia
Publication date
01-09-2018
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 9/2018
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5393-3

Other articles of this Issue 9/2018

European Radiology 9/2018 Go to the issue