Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2021

Open Access 01-12-2021 | Commentary

Enabling patient-reported outcome measures in clinical trials, exemplified by cardiovascular trials

Authors: Theresa M. Coles, Adrian F. Hernandez, Bryce B. Reeve, Karon Cook, Michael C. Edwards, Marc Boutin, Elizabeth Bush, Arnold Degboe, Lothar Roessig, Amy Rudolph, Pauline McNulty, Nikunj Patel, Trish Kay-Mugford, Margaret Vernon, Michael Woloschak, Gustavo Buchele, John A. Spertus, Matthew T. Roe, Denise Bury, Kevin Weinfurt

Published in: Health and Quality of Life Outcomes | Issue 1/2021

Login to get access

Abstract

Objectives

There has been limited success in achieving integration of patient-reported outcomes (PROs) in clinical trials. We describe how stakeholders envision a solution to this challenge.

Methods

Stakeholders from academia, industry, non-profits, insurers, clinicians, and the Food and Drug Administration convened at a Think Tank meeting funded by the Duke Clinical Research Institute to discuss the challenges of incorporating PROs into clinical trials and how to address those challenges. Using examples from cardiovascular trials, this article describes a potential path forward with a focus on applications in the United States.

Results

Think Tank members identified one key challenge: a common understanding of the level of evidence that is necessary to support patient-reported outcome measures (PROMs) in trials. Think Tank participants discussed the possibility of creating general evidentiary standards depending upon contextual factors, but such guidelines could not be feasibly developed because many contextual factors are at play. The attendees posited that a more informative approach to PROM evidentiary standards would be to develop validity arguments akin to courtroom briefs, which would emphasize a compelling rationale (interpretation/use argument) to support a PROM within a specific context. Participants envisioned a future in which validity arguments would be publicly available via a repository, which would be indexed by contextual factors, clinical populations, and types of claims.

Conclusions

A publicly available repository would help stakeholders better understand what a community believes constitutes compelling support for a specific PROM in a trial. Our proposed strategy is expected to facilitate the incorporation of PROMs into cardiovascular clinical trials and trials in general.
Literature
1.
go back to reference Lee CS, Hiatt SO, Denfeld QE, Mudd JO, Chien C, Gelow JM. Symptom-hemodynamic mismatch and heart failure event risk. J Cardiovasc Nurs. 2015;30:394–402.CrossRef Lee CS, Hiatt SO, Denfeld QE, Mudd JO, Chien C, Gelow JM. Symptom-hemodynamic mismatch and heart failure event risk. J Cardiovasc Nurs. 2015;30:394–402.CrossRef
2.
go back to reference Rumsfeld JS, Alexander KP, Goff DC Jr, Graham MM, Ho PM, Masoudi FA, et al. Cardiovascular health: the importance of measuring patient-reported health status: a scientific statement from the American Heart Association. Circulation. 2013;127:2233–49.CrossRef Rumsfeld JS, Alexander KP, Goff DC Jr, Graham MM, Ho PM, Masoudi FA, et al. Cardiovascular health: the importance of measuring patient-reported health status: a scientific statement from the American Heart Association. Circulation. 2013;127:2233–49.CrossRef
3.
go back to reference Luther SA, McCullough PA, Havranek EP, Rumsfeld JS, Jones PG, Heidenreich PA, et al. The relationship between B-type natriuretic peptide and health status in patients with heart failure. J Card Fail. 2005;11:414–21.CrossRef Luther SA, McCullough PA, Havranek EP, Rumsfeld JS, Jones PG, Heidenreich PA, et al. The relationship between B-type natriuretic peptide and health status in patients with heart failure. J Card Fail. 2005;11:414–21.CrossRef
4.
go back to reference Tarkin JM, Kaski JC. Nicorandil and long-acting nitrates: vasodilator therapies for the management of chronic stable angina pectoris. Eur Cardiol. 2018;13:23–8.CrossRef Tarkin JM, Kaski JC. Nicorandil and long-acting nitrates: vasodilator therapies for the management of chronic stable angina pectoris. Eur Cardiol. 2018;13:23–8.CrossRef
5.
go back to reference Scirica BM. Ranolazine in patients with coronary artery disease. Expert Opin Pharmacother. 2007;8:2149–57.CrossRef Scirica BM. Ranolazine in patients with coronary artery disease. Expert Opin Pharmacother. 2007;8:2149–57.CrossRef
7.
go back to reference Taichman DB, McGoon MD, Harhay MO, Archer-Chicko C, Sager JS, Murugappan M, et al. Wide variation in clinicians’ assessment of New York Heart Association/World Health Organization functional class in patients with pulmonary arterial hypertension. Mayo Clin Proc. 2009;84:586–92.CrossRef Taichman DB, McGoon MD, Harhay MO, Archer-Chicko C, Sager JS, Murugappan M, et al. Wide variation in clinicians’ assessment of New York Heart Association/World Health Organization functional class in patients with pulmonary arterial hypertension. Mayo Clin Proc. 2009;84:586–92.CrossRef
8.
go back to reference Raphael C, Briscoe C, Davies J, Whinnett ZI, Manisty C, Sutton R, et al. Limitations of the New York Heart Association functional classification system and self-reported walking distances in chronic heart failure. Heart. 2007;93:476–82.CrossRef Raphael C, Briscoe C, Davies J, Whinnett ZI, Manisty C, Sutton R, et al. Limitations of the New York Heart Association functional classification system and self-reported walking distances in chronic heart failure. Heart. 2007;93:476–82.CrossRef
9.
go back to reference Spertus JA, Jones PG. Development and validation of a short version of the Kansas City Cardiomyopathy Questionnaire. Circ Cardiovasc Qual Outcomes. 2015;8:469–76.CrossRef Spertus JA, Jones PG. Development and validation of a short version of the Kansas City Cardiomyopathy Questionnaire. Circ Cardiovasc Qual Outcomes. 2015;8:469–76.CrossRef
10.
go back to reference Ahmad FS, Kallen MA, Schifferdecker KE, Carluzzo KL, Yount SE, Gelow JM, et al. Development and initial validation of the PROMIS®-Plus-HF Profile Measure. Circ Heart Fail. 2019;12:e005751.CrossRef Ahmad FS, Kallen MA, Schifferdecker KE, Carluzzo KL, Yount SE, Gelow JM, et al. Development and initial validation of the PROMIS®-Plus-HF Profile Measure. Circ Heart Fail. 2019;12:e005751.CrossRef
11.
go back to reference U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, Center for Biologics Evaluation Research, Center for Devices and Radiological Health. Guidance document: patient-reported outcome measures, use in medical product development to support labeling claims. U.S. FDA web site. https://www.fda.gov/downloads/drugs/guidances/UCM193282.pdf. Published December 2009. Accessed 13 Nov 2019. U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, Center for Biologics Evaluation Research, Center for Devices and Radiological Health. Guidance document: patient-reported outcome measures, use in medical product development to support labeling claims. U.S. FDA web site. https://​www.​fda.​gov/​downloads/​drugs/​guidances/​UCM193282.​pdf. Published December 2009. Accessed 13 Nov 2019.
12.
go back to reference Anker SD, Agewall S, Borggrefe M, Calvert M, Caro JJ, Cowie MR, et al. The importance of patient-reported outcomes: a call for their comprehensive integration in cardiovascular clinical trials. Eur Heart J. 2014;35:2001–9.CrossRef Anker SD, Agewall S, Borggrefe M, Calvert M, Caro JJ, Cowie MR, et al. The importance of patient-reported outcomes: a call for their comprehensive integration in cardiovascular clinical trials. Eur Heart J. 2014;35:2001–9.CrossRef
13.
go back to reference Rothman M, Burke L, Erickson P, Leidy NK, Patrick DL, Petrie CD. Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value Health. 2009;12:1075–83.CrossRef Rothman M, Burke L, Erickson P, Leidy NK, Patrick DL, Petrie CD. Use of existing patient-reported outcome (PRO) instruments and their modification: the ISPOR Good Research Practices for Evaluating and Documenting Content Validity for the Use of Existing Instruments and Their Modification PRO Task Force Report. Value Health. 2009;12:1075–83.CrossRef
14.
go back to reference Benjamin K, Vernon MK, Patrick DL, Perfetto E, Nestler-Parr S, Burke L. Patient-reported outcome and observer-reported outcome assessment in rare disease clinical trials: an ISPOR COA Emerging Good Practices Task Force Report. Value Health. 2017;20:838–55.CrossRef Benjamin K, Vernon MK, Patrick DL, Perfetto E, Nestler-Parr S, Burke L. Patient-reported outcome and observer-reported outcome assessment in rare disease clinical trials: an ISPOR COA Emerging Good Practices Task Force Report. Value Health. 2017;20:838–55.CrossRef
15.
go back to reference Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 2—assessing respondent understanding. Value Health. 2011;14:978–88.CrossRef Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 2—assessing respondent understanding. Value Health. 2011;14:978–88.CrossRef
16.
go back to reference Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1—eliciting concepts for a new PRO instrument. Value Health. 2011;14:967–77.CrossRef Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1—eliciting concepts for a new PRO instrument. Value Health. 2011;14:967–77.CrossRef
21.
go back to reference U.S. Center for Devices and Radiological Health, Food and Drug Administration (FDA). Value and use of patient-reported outcomes in assessing effects of medical devices: CDRH strategic priorities 2016–2017. U.S. FDA web site. https://www.fda.gov/media/109626/download. Accessed 13 Nov 2019. U.S. Center for Devices and Radiological Health, Food and Drug Administration (FDA). Value and use of patient-reported outcomes in assessing effects of medical devices: CDRH strategic priorities 2016–2017. U.S. FDA web site. https://​www.​fda.​gov/​media/​109626/​download. Accessed 13 Nov 2019.
24.
go back to reference Zumbo BD. Validity: foundational issues and statistical methodology. In: Rao CR, Sinharay S, editors. Handbook of statistics, vol. 26. Amsterdam: Elsevier; 2006. p. 45–79. Zumbo BD. Validity: foundational issues and statistical methodology. In: Rao CR, Sinharay S, editors. Handbook of statistics, vol. 26. Amsterdam: Elsevier; 2006. p. 45–79.
25.
go back to reference Edwards MC, Slagle A, Rubright JD, Wirth RJ. Fit for purpose and modern validity theory in clinical outcomes assessment. Qual Life Res. 2018;27:1711–20.CrossRef Edwards MC, Slagle A, Rubright JD, Wirth RJ. Fit for purpose and modern validity theory in clinical outcomes assessment. Qual Life Res. 2018;27:1711–20.CrossRef
26.
go back to reference Hawkins M, Elsworth GR, Osborne RH. Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. Qual Life Res. 2018;27:1695–710.CrossRef Hawkins M, Elsworth GR, Osborne RH. Application of validity theory and methodology to patient-reported outcome measures (PROMs): building an argument for validity. Qual Life Res. 2018;27:1695–710.CrossRef
27.
go back to reference Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49:560–75.CrossRef Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ. 2015;49:560–75.CrossRef
28.
go back to reference Hatala R, Cook DA, Brydges R, Hawkins R. Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ. 2015;20:1149–75.CrossRef Hatala R, Cook DA, Brydges R, Hawkins R. Constructing a validity argument for the Objective Structured Assessment of Technical Skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ. 2015;20:1149–75.CrossRef
29.
go back to reference Hill HC, Charalambous CY, Blazar D, McGinn D, Kraft MA, Beisiegel M, et al. Validating arguments for observational instruments: attending to multiple sources of variation. Educ Assess. 2012;17:88–106.CrossRef Hill HC, Charalambous CY, Blazar D, McGinn D, Kraft MA, Beisiegel M, et al. Validating arguments for observational instruments: attending to multiple sources of variation. Educ Assess. 2012;17:88–106.CrossRef
30.
go back to reference Reeves TD, Marbach-Ad G. Contemporary test validity in theory and practice: a primer for discipline-based education researchers. CBE Life Sci Educ. 2016;15(1):rm1.CrossRef Reeves TD, Marbach-Ad G. Contemporary test validity in theory and practice: a primer for discipline-based education researchers. CBE Life Sci Educ. 2016;15(1):rm1.CrossRef
31.
go back to reference Royal KD. Four tenets of modern validity theory for medical education assessment and evaluation. Adv Med Educ Pract. 2017;8:567–70.CrossRef Royal KD. Four tenets of modern validity theory for medical education assessment and evaluation. Adv Med Educ Pract. 2017;8:567–70.CrossRef
Metadata
Title
Enabling patient-reported outcome measures in clinical trials, exemplified by cardiovascular trials
Authors
Theresa M. Coles
Adrian F. Hernandez
Bryce B. Reeve
Karon Cook
Michael C. Edwards
Marc Boutin
Elizabeth Bush
Arnold Degboe
Lothar Roessig
Amy Rudolph
Pauline McNulty
Nikunj Patel
Trish Kay-Mugford
Margaret Vernon
Michael Woloschak
Gustavo Buchele
John A. Spertus
Matthew T. Roe
Denise Bury
Kevin Weinfurt
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2021
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-021-01800-1

Other articles of this Issue 1/2021

Health and Quality of Life Outcomes 1/2021 Go to the issue