Skip to main content
Top
Published in: Journal of Cancer Research and Clinical Oncology 12/2017

01-12-2017 | Original Article – Clinical Oncology

Tumor response assessment: comparison between unstructured free text reporting in routine clinical workflow and computer-aided evaluation based on RECIST 1.1 criteria

Authors: Juliane Goebel, Julia Hoischen, Carolin Gramsch, Haemi P. Schemuth, Andreas-Claudius Hoffmann, Lale Umutlu, Kai Nassenstein

Published in: Journal of Cancer Research and Clinical Oncology | Issue 12/2017

Login to get access

Abstract

Purpose

Standardized computer-aided tumor response assessment is common in clinical trials. In contrast, unstructured free text reporting (UFTR) is common in daily routine. Therefore, this study aimed to discern and quantify differences between UFTR and computer-aided standardized tumor response evaluation based on RECIST 1.1 criteria (RECIST), serving as gold standard, in clinical workflow.

Methods

One-hundred consecutive patients with cancer eligible for RECIST 1.1 evaluation, who received five follow-up CTs of the trunk, were retrospectively included. All UFTRs were assigned to RECIST response categories [complete response, partial response (PR), stable disease (SD), progressive disease (PD)]. All CTs were re-evaluated using dedicated software (mint lesion™) applying RECIST 1.1. The accordance in tumor response ratings was analyzed using Cohen’s kappa.

Results

At the first follow-up, 47 cases were rated differently with an SD underrepresentation and a PR and PD overrepresentation in UFTR. In the subsequent follow-ups, categorical differences were seen in 38, 44, 37, and 44%. Accordance between UFTR and RECIST was fair to moderate (Cohen’s kappa: 0.356, 0.477, 0.390, 0.475, 0.376; always p < 0.001). Differences were mainly caused by the rating of even small tumor burden changes as PD or PR in UFTR or by comparison to the most recent prior CT scan in UFTR instead of comparison to nadir or baseline.

Conclusions

Significant differences in tumor response ratings were detected comparing UFTR and computer-aided standardized evaluation based on RECIST 1.1. Thus, standardized reporting should be implemented in daily routine workflow.
Literature
go back to reference Abramson RG, McGhee CR, Lakomkin N, Arteaga CL (2015) Pitfalls in RECIST data extraction for clinical trials: beyond the basics. Acad Radiol 22:779–786CrossRefPubMedPubMedCentral Abramson RG, McGhee CR, Lakomkin N, Arteaga CL (2015) Pitfalls in RECIST data extraction for clinical trials: beyond the basics. Acad Radiol 22:779–786CrossRefPubMedPubMedCentral
go back to reference Buyse M, Thirion P, Carlson RW, Burzykowski T, Molenberghs G, Piedbois P (2000) Relation between tumour response to first-line chemotherapy and survival in advanced colorectal cancer: a meta-analysis. Meta-Analysis Group in Cancer. Lancet (London, England) 356:373–378CrossRef Buyse M, Thirion P, Carlson RW, Burzykowski T, Molenberghs G, Piedbois P (2000) Relation between tumour response to first-line chemotherapy and survival in advanced colorectal cancer: a meta-analysis. Meta-Analysis Group in Cancer. Lancet (London, England) 356:373–378CrossRef
go back to reference Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measur 20:37–46CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measur 20:37–46CrossRef
go back to reference Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer (Oxford, England 1990) 45:228–247CrossRef Eisenhauer EA, Therasse P, Bogaerts J et al (2009) New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer (Oxford, England 1990) 45:228–247CrossRef
go back to reference El-Maraghi RH, Eisenhauer EA (2008) Review of phase II trial designs used in studies of molecular targeted agents: outcomes and predictors of success in phase III. J Clin Oncol 26:1346–1354CrossRefPubMed El-Maraghi RH, Eisenhauer EA (2008) Review of phase II trial designs used in studies of molecular targeted agents: outcomes and predictors of success in phase III. J Clin Oncol 26:1346–1354CrossRefPubMed
go back to reference Folio LR, Nelson CJ, Benjamin M, Ran A, Engelhard G, Bluemke DA (2015) Quantitative radiology reporting in oncology: survey of oncologists and radiologists. AJR Am J Roentgenol 205:W233–W243CrossRefPubMed Folio LR, Nelson CJ, Benjamin M, Ran A, Engelhard G, Bluemke DA (2015) Quantitative radiology reporting in oncology: survey of oncologists and radiologists. AJR Am J Roentgenol 205:W233–W243CrossRefPubMed
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRefPubMed
go back to reference Miller AB, Hoogstraten B, Staquet M, Winkler A (1981) Reporting results of cancer treatment. Cancer 47:207–214CrossRefPubMed Miller AB, Hoogstraten B, Staquet M, Winkler A (1981) Reporting results of cancer treatment. Cancer 47:207–214CrossRefPubMed
go back to reference Paesmans M, Sculier JP, Libert P et al (1997) Response to chemotherapy has predictive value for further survival of patients with advanced non-small cell lung cancer: 10 years experience of the European Lung Cancer Working Party. Eur J Cancer (Oxford, England: 1990) 33:2326–2332CrossRef Paesmans M, Sculier JP, Libert P et al (1997) Response to chemotherapy has predictive value for further survival of patients with advanced non-small cell lung cancer: 10 years experience of the European Lung Cancer Working Party. Eur J Cancer (Oxford, England: 1990) 33:2326–2332CrossRef
go back to reference Scartozzi M, Giampieri R, Maccaroni E et al (2012) Pre-treatment lactate dehydrogenase levels as predictor of efficacy of first-line bevacizumab-based therapy in metastatic colorectal cancer patients. Br J Cancer 106:799–804CrossRefPubMedPubMedCentral Scartozzi M, Giampieri R, Maccaroni E et al (2012) Pre-treatment lactate dehydrogenase levels as predictor of efficacy of first-line bevacizumab-based therapy in metastatic colorectal cancer patients. Br J Cancer 106:799–804CrossRefPubMedPubMedCentral
go back to reference Schwartz LH, Litiere S, de Vries E et al (2016a) RECIST 1.1-update and clarification: from the RECIST committee. Eur J Cancer 62:132–137CrossRefPubMed Schwartz LH, Litiere S, de Vries E et al (2016a) RECIST 1.1-update and clarification: from the RECIST committee. Eur J Cancer 62:132–137CrossRefPubMed
go back to reference Schwartz LH, Seymour L, Litiere S et al (2016b) RECIST 1.1—standardisation and disease-specific adaptations: perspectives from the RECIST Working Group. Eur J Cancer 62:138–145CrossRefPubMed Schwartz LH, Seymour L, Litiere S et al (2016b) RECIST 1.1—standardisation and disease-specific adaptations: perspectives from the RECIST Working Group. Eur J Cancer 62:138–145CrossRefPubMed
go back to reference Therasse P, Arbuck SG, Eisenhauer EA et al (2000) New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst 92:205–216CrossRefPubMed Therasse P, Arbuck SG, Eisenhauer EA et al (2000) New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst 92:205–216CrossRefPubMed
go back to reference Tirkes T, Hollar MA, Tann M, Kohli MD, Akisik F, Sandrasegaran K et al (2013) Response criteria in oncologic imaging: review of traditional and new criteria. Radiogr Rev Publ Radiol Soc North Am Inc 33:1323–1341 Tirkes T, Hollar MA, Tann M, Kohli MD, Akisik F, Sandrasegaran K et al (2013) Response criteria in oncologic imaging: review of traditional and new criteria. Radiogr Rev Publ Radiol Soc North Am Inc 33:1323–1341
Metadata
Title
Tumor response assessment: comparison between unstructured free text reporting in routine clinical workflow and computer-aided evaluation based on RECIST 1.1 criteria
Authors
Juliane Goebel
Julia Hoischen
Carolin Gramsch
Haemi P. Schemuth
Andreas-Claudius Hoffmann
Lale Umutlu
Kai Nassenstein
Publication date
01-12-2017
Publisher
Springer Berlin Heidelberg
Published in
Journal of Cancer Research and Clinical Oncology / Issue 12/2017
Print ISSN: 0171-5216
Electronic ISSN: 1432-1335
DOI
https://doi.org/10.1007/s00432-017-2488-1

Other articles of this Issue 12/2017

Journal of Cancer Research and Clinical Oncology 12/2017 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.