Skip to main content
Top
Published in: Journal of General Internal Medicine 2/2020

Open Access 01-11-2020 | Review Article

Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI)

Authors: Laura C. Esmail, PhD, Rebecca Barasky, MPH, Brian S. Mittman, PhD, David H. Hickam, MD, MPH

Published in: Journal of General Internal Medicine | Special Issue 2/2020

Login to get access

Abstract

Introduction

Complex health interventions (CHIs) are increasingly studied in comparative effectiveness research (CER), and there is a need for improvements in CHI research practices. The Patient-Centered Outcomes Research Institute (PCORI) Methodology Committee (MC) launched an effort in 2016 to develop formal guidance on this topic.

Objective

To develop a set of minimal standards for scientifically valid, transparent, and reproducible CER studies of CHIs. The standards are intended to apply to research examining a broad range of healthcare interventions including delivery system, behavior change, and other non-pharmacological interventions.

Methods

We conducted a literature review, reviewed existing methods guidance, and developed standards through an iterative process involving the MC, two panels of external research methods experts, and a 60-day public comment period. The final standards were approved by the PCORI MC and adopted by the PCORI Board of Governors on April 30, 2018.

Results

The final standards include the following: (1) fully describe the intervention and comparator and define their core functions, (2) specify the hypothesized causal pathways and their theoretical basis, (3) specify how adaptations to the form of the intervention and comparator will be allowed and recorded, (4) plan and describe a process evaluation, and (5) select patient outcomes informed by the causal pathway.

Discussion

The new standards offer three major contributions to research: (1) they provide a simple framework to help investigators address the major methodological features of a CHI study, (2) they emphasize the importance of the causal model and the need to understand how a CHI achieves its effects rather than simply measuring these effects, and (3) they require description of a CHI using the concepts of core functions and forms. While these standards apply formally to PCORI-funded CER studies, they have broad applicability.
Appendix
Available only for authorised users
Literature
3.
go back to reference The PCORI Methodology Committee. The PCORI Methodology Report 2019. The PCORI Methodology Committee. The PCORI Methodology Report 2019.
6.
go back to reference Richards DA, Hallberg IR. Complex Interventions in Health: an Overview of Research Methods: Routledge; 2015. Richards DA, Hallberg IR. Complex Interventions in Health: an Overview of Research Methods: Routledge; 2015.
8.
go back to reference The PCORI Methodology Committee. Appendix B: Response to public comment. The PCORI Methodology Report 2019. p. 73-82. The PCORI Methodology Committee. Appendix B: Response to public comment. The PCORI Methodology Report 2019. p. 73-82.
17.
go back to reference Hawe P, Shiell A, Riley T. In response to Spillane V., Byrne M.C., Byrne M., Leathem C.S., O’Malley M. & Cupples M.E. (2007) Monitoring treatment fidelity in a randomized trial of a complex intervention. J Adv Nurs 60(3), 343-352. Important considerations for standardizing complex interventions. J Adv Nurs. 2008;62(2):267. https://doi.org/10.1111/j.1365-2648.2008.04686.x Hawe P, Shiell A, Riley T. In response to Spillane V., Byrne M.C., Byrne M., Leathem C.S., O’Malley M. & Cupples M.E. (2007) Monitoring treatment fidelity in a randomized trial of a complex intervention. J Adv Nurs 60(3), 343-352. Important considerations for standardizing complex interventions. J Adv Nurs. 2008;62(2):267. https://​doi.​org/​10.​1111/​j.​1365-2648.​2008.​04686.​x
21.
go back to reference Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res 2008;8(1):274.CrossRefPubMedPubMedCentral Byng R, Norman I, Redfern S, Jones R. Exposing the key functions of a complex intervention for shared care in mental health: case study of a process evaluation. BMC Health Serv Res 2008;8(1):274.CrossRefPubMedPubMedCentral
22.
go back to reference Hill J, Cuthel AM, Lin P, Grudzen CR. Primary Palliative Care for Emergency Medicine (PRIM-ER): applying form and function to a theory-based complex intervention. Contemp Clin Trials Commun 2020:100570. Hill J, Cuthel AM, Lin P, Grudzen CR. Primary Palliative Care for Emergency Medicine (PRIM-ER): applying form and function to a theory-based complex intervention. Contemp Clin Trials Commun 2020:100570.
26.
go back to reference Newhouse RP, Himmelfarb CD, Morlock L, Frick KD, Pronovost P, Liang Y. A phased cluster-randomized trial of rural hospitals testing a quality collaborative to improve heart failure care: organizational context matters. Med Care 2013:396-403. Newhouse RP, Himmelfarb CD, Morlock L, Frick KD, Pronovost P, Liang Y. A phased cluster-randomized trial of rural hospitals testing a quality collaborative to improve heart failure care: organizational context matters. Med Care 2013:396-403.
28.
go back to reference Stirman SW, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci 2019;14(1):58.CrossRef Stirman SW, Baumann AA, Miller CJ. The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci 2019;14(1):58.CrossRef
29.
go back to reference Bauman LJ, Stein RE, Ireys HT. Reinventing fidelity: the transfer of social technology among settings. Am J Community Psychol 1991;19(4):619-39.CrossRefPubMed Bauman LJ, Stein RE, Ireys HT. Reinventing fidelity: the transfer of social technology among settings. Am J Community Psychol 1991;19(4):619-39.CrossRefPubMed
30.
31.
go back to reference Craig P, Di Ruggiero E, Frolich KL, Mykhalovskiy E, White M, Campbell R, et al. Taking account of context in population health intervention research: guidance for producers, users and funders of research. 2018. Craig P, Di Ruggiero E, Frolich KL, Mykhalovskiy E, White M, Campbell R, et al. Taking account of context in population health intervention research: guidance for producers, users and funders of research. 2018.
32.
go back to reference AcademyHealth. Evaluating Complex Health Interventions: A Guide to Rigorous Research Designs. 2017. AcademyHealth. Evaluating Complex Health Interventions: A Guide to Rigorous Research Designs. 2017.
35.
go back to reference O’Cathain A, Thomas K, Drabble S, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open 2013;3(6):e002889.CrossRefPubMedPubMedCentral O’Cathain A, Thomas K, Drabble S, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. BMJ Open 2013;3(6):e002889.CrossRefPubMedPubMedCentral
36.
go back to reference Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ (Clin Res Ed.). 2009;339:b3496.CrossRef Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ (Clin Res Ed.). 2009;339:b3496.CrossRef
37.
go back to reference Craig P, Matthews L, Moore L, Simpson S, Skivington K. Updated Guidance: Developing and Evaluating Complex Interventions [Draft for Consultation]. 2019. Craig P, Matthews L, Moore L, Simpson S, Skivington K. Updated Guidance: Developing and Evaluating Complex Interventions [Draft for Consultation]. 2019.
Metadata
Title
Improving Comparative Effectiveness Research of Complex Health Interventions: Standards from the Patient-Centered Outcomes Research Institute (PCORI)
Authors
Laura C. Esmail, PhD
Rebecca Barasky, MPH
Brian S. Mittman, PhD
David H. Hickam, MD, MPH
Publication date
01-11-2020
Publisher
Springer International Publishing
Published in
Journal of General Internal Medicine / Issue Special Issue 2/2020
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-020-06093-6

Other articles of this Special Issue 2/2020

Journal of General Internal Medicine 2/2020 Go to the issue