Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Study protocol

Evaluating the use of the EORTC patient-reported outcome measures for improving inter-rater reliability of CTCAE ratings in a mixed population of cancer patients: study protocol for a randomized controlled trial

Authors: Lisa M. Wintner, Johannes M. Giesinger, Monika Sztankay, Andrew Bottomley, Bernhard Holzner, on behalf of the EORTC Quality of Life Group

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

In oncology, detection and tracking of adverse events are of top priority and rely mostly on the Common Terminology Criteria for Adverse Events (CTCAE). Besides, clinical trials use as well patient-reported outcomes (PROs) to assess those adverse events, which are only accessible through patient self-reporting, such as fatigue, pain, and sleep disorders. Especially those issues that are not visible from the outside are often misinterpreted and underestimated by mere provider ratings. This trial aims at evaluating the impact of providing PRO data to providers on the accuracy of adverse event assessment in terms of inter-rater reliability of CTCAE ratings.

Methods

The trial uses a cross-sectional, unblinded, randomized controlled trial design with two trial arms and a single assessment time point. Eligible patients (aged 18 and above, any cancer diagnosis, currently under treatment, inpatient or day clinic setting, present symptom burden, no psychiatric or mental problems, written informed consent) complete an electronic version of the EORTC QLQ-C30 and 16 additional questions taken from the EORTC Item Library. PRO data is immediately processed and made available to CTCAE rating providers for conducting their ratings during the medical encounter. Patients are randomly assigned 1:1 to the intervention group (providers see PRO results on the same screen as the CTCAE rating) and the control group (no access to PRO data during the CTCAE rating). A superiority analysis will compare the inter-rater reliability (using intra-class correlation (ICC) coefficients) between the control and the intervention groups for each adverse event evaluated.

Discussion

The presented trial will demonstrate potential benefits of using PRO measures to improve the reliability of CTCAE ratings in cancer trials and the identification of adverse events. The new insights gained may lead to a new strategy for evaluating adverse events in clinical trials by combining patient and provider ratings. This might also have implications for daily clinical practice and cancer registries.

Trial registration

ClinicalTrials.gov NCT04066868. Registered on August 26, 2019. Competence Center for Clinical Trials of the Medical University of Innsbruck 20190513-2007. Registered on May 14, 2019. (version 6.0, March 18, 2019)
Literature
2.
go back to reference Fayers P, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. 2nd ed. Chichester: Wiley; 2007. Fayers P, Machin D. Quality of life: the assessment, analysis and interpretation of patient-reported outcomes. 2nd ed. Chichester: Wiley; 2007.
3.
go back to reference U.S. Department of Health and Human Services. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.CrossRef U.S. Department of Health and Human Services. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes. 2006;4:79.CrossRef
4.
go back to reference Basch E, Iasonos A, McDonough T, Barz A, Culkin A, Kris MG, et al. Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: results of a questionnaire-based study. Lancet Oncol. 2006;7(11):903–9.CrossRef Basch E, Iasonos A, McDonough T, Barz A, Culkin A, Kris MG, et al. Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: results of a questionnaire-based study. Lancet Oncol. 2006;7(11):903–9.CrossRef
5.
go back to reference Trotti A, Colevas AD, Setser A, Basch E. Patient-reported outcomes and the evolution of adverse event reporting in oncology. J Clin Oncol. 2007;25(32):5121–7.CrossRef Trotti A, Colevas AD, Setser A, Basch E. Patient-reported outcomes and the evolution of adverse event reporting in oncology. J Clin Oncol. 2007;25(32):5121–7.CrossRef
6.
go back to reference Atkinson TM, Rogak LJ, Heon N, Ryan SJ, Shaw M, Stark LP, et al. Exploring differences in adverse symptom event grading thresholds between clinicians and patients in the clinical trial setting. J Cancer Res Clin Oncol. 2017;143(4):735–43.CrossRef Atkinson TM, Rogak LJ, Heon N, Ryan SJ, Shaw M, Stark LP, et al. Exploring differences in adverse symptom event grading thresholds between clinicians and patients in the clinical trial setting. J Cancer Res Clin Oncol. 2017;143(4):735–43.CrossRef
7.
go back to reference Neben-Wittich MA, Atherton PJ, Schwartz DJ, Sloan JA, Griffin PC, Deming RL, et al. Comparison of provider-assessed and patient-reported outcome measures of acute skin toxicity during a phase III trial of mometasone cream versus placebo during breast radiotherapy: the North Central Cancer Treatment Group (N06C4). Int J Radiat Oncol Biol Phys. 2011;81(2):397–402.CrossRef Neben-Wittich MA, Atherton PJ, Schwartz DJ, Sloan JA, Griffin PC, Deming RL, et al. Comparison of provider-assessed and patient-reported outcome measures of acute skin toxicity during a phase III trial of mometasone cream versus placebo during breast radiotherapy: the North Central Cancer Treatment Group (N06C4). Int J Radiat Oncol Biol Phys. 2011;81(2):397–402.CrossRef
8.
go back to reference Atkinson TM, Andreotti CF, Roberts KE, Saracino RM, Hernandez M, Basch E. The level of association between functional performance status measures and patient-reported outcomes in cancer patients: a systematic review. Support Care Cancer. 2015;23(12):3645–52.CrossRef Atkinson TM, Andreotti CF, Roberts KE, Saracino RM, Hernandez M, Basch E. The level of association between functional performance status measures and patient-reported outcomes in cancer patients: a systematic review. Support Care Cancer. 2015;23(12):3645–52.CrossRef
9.
go back to reference Atkinson TM, Li Y, Coffey CW, Sit L, Shaw M, Lavene D, et al. Reliability of adverse symptom event reporting by clinicians. Qual Life Res. 2012;21(7):1159–64.CrossRef Atkinson TM, Li Y, Coffey CW, Sit L, Shaw M, Lavene D, et al. Reliability of adverse symptom event reporting by clinicians. Qual Life Res. 2012;21(7):1159–64.CrossRef
10.
go back to reference Kaba H, Fukuda H, Yamamoto S, Ohashi Y. Reliability at the National Cancer Institute-Common Toxicity Criteria version 2.0. Gan To Kagaku Ryoho. 2004;31(8):1187–92.PubMed Kaba H, Fukuda H, Yamamoto S, Ohashi Y. Reliability at the National Cancer Institute-Common Toxicity Criteria version 2.0. Gan To Kagaku Ryoho. 2004;31(8):1187–92.PubMed
11.
go back to reference Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef
12.
go back to reference Holzner B, Giesinger JM, Pinggera J, Zugal S, Schopf F, Oberguggenberger AS, et al. The Computer-based Health Evaluation Software (CHES): a software for electronic patient-reported outcome monitoring. BMC Med Inform Decis Mak. 2012;12:126.CrossRef Holzner B, Giesinger JM, Pinggera J, Zugal S, Schopf F, Oberguggenberger AS, et al. The Computer-based Health Evaluation Software (CHES): a software for electronic patient-reported outcome monitoring. BMC Med Inform Decis Mak. 2012;12:126.CrossRef
13.
go back to reference Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.CrossRef Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.CrossRef
14.
go back to reference Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
15.
go back to reference Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. Hoboken: Wiley; 2013. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. Hoboken: Wiley; 2013.
16.
go back to reference Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press, USA; 2015. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press, USA; 2015.
Metadata
Title
Evaluating the use of the EORTC patient-reported outcome measures for improving inter-rater reliability of CTCAE ratings in a mixed population of cancer patients: study protocol for a randomized controlled trial
Authors
Lisa M. Wintner
Johannes M. Giesinger
Monika Sztankay
Andrew Bottomley
Bernhard Holzner
on behalf of the EORTC Quality of Life Group
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-04745-w

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue