Skip to main content
Top
Published in: Trials 1/2021

Open Access 01-12-2021 | Opioids | Update

Barriers impacting the POINT pragmatic trial: the unavoidable overlap between research and intervention procedures in “real-world” research

Authors: Allyson L. Dir, Dennis P. Watson, Matthew Zhiss, Lisa Taylor, Bethany C. Bray, Alan McGuire

Published in: Trials | Issue 1/2021

Login to get access

Abstract

Background

This manuscript provides a research update to the ongoing pragmatic trial of Project POINT (Planned Outreach, Intervention, Naloxone, and Treatment), an emergency department-based peer recovery coaching intervention for linking patients with opioid use disorder to evidence-based treatment. The research team has encountered a number of challenges related to the “real-world” study setting since the trial began. Using an implementation science lens, we sought to identify and describe barriers impacting both the intervention and research protocols of the POINT study, which are often intertwined in pragmatic trials due to the focus on external validity.

Method

Qualitative data were collected from 3 peer recovery coaches, 2 peer recovery coach supervisors, and 3 members of the research team. Questions and deductive qualitative analysis were guided by the Consolidated Framework for Implementation Research (CFIR).

Results

Nine unique barriers were noted, with 5 of these barriers impacting intervention and research protocol implementation simultaneously. These simultaneous barriers were timing of intervention delivery, ineffective communication with emergency department staff, lack of privacy in the emergency department, the fast-paced emergency department setting, and patient’s limited resources. Together, these barriers represent the intervention characteristics, inner setting, and outer setting domains of the CFIR.

Conclusion

Results highlight the utility of employing an implementation science framework to assess implementation issues in pragmatic trials and how this approach might be used as a quality assurance mechanism given the considerable overlap that exists between research and intervention protocols in real-world trial settings. Previously undocumented changes to the trial design that have been made as a result of the identified barriers are discussed.
Literature
1.
go back to reference Watson DP, Brucker K, Mcguire A, Snow-Hill NL, Xu H, Cohen A, et al. Replication of an emergency department-based recovery coaching intervention and pilot testing of pragmatic trial protocols within the context of Indiana’s Opioid State Targeted Response plan. J Subst Abuse Treat. 2020;108:88–94. Watson DP, Brucker K, Mcguire A, Snow-Hill NL, Xu H, Cohen A, et al. Replication of an emergency department-based recovery coaching intervention and pilot testing of pragmatic trial protocols within the context of Indiana’s Opioid State Targeted Response plan. J Subst Abuse Treat. 2020;108:88–94.
2.
go back to reference Hedegaard H, Miniño AM, Warner M. Drug overdose deaths in the United States, 1999–2018. NCHS Data Brief No. 356. Hyattsville: National Center for Health Statistics; 2020. Hedegaard H, Miniño AM, Warner M. Drug overdose deaths in the United States, 1999–2018. NCHS Data Brief No. 356. Hyattsville: National Center for Health Statistics; 2020.
3.
go back to reference Watson DP, Andraka-Christou B, Clarke T, Wiegandt J. Introduction to the special issue on innovative interventions and approaches to expand medication assisted treatment: seizing research opportunities made available by the opioid STR program. J Subst Abus Treat. 2019;108:1–3.CrossRef Watson DP, Andraka-Christou B, Clarke T, Wiegandt J. Introduction to the special issue on innovative interventions and approaches to expand medication assisted treatment: seizing research opportunities made available by the opioid STR program. J Subst Abus Treat. 2019;108:1–3.CrossRef
4.
go back to reference Delitto A. Pragmatic clinical trials: implementation opportunity, or just another fad? Phys Ther. 2016;96:137–8.CrossRef Delitto A. Pragmatic clinical trials: implementation opportunity, or just another fad? Phys Ther. 2016;96:137–8.CrossRef
5.
6.
go back to reference Eddie D, Hoffman L, Vilsaint C, Abry A, Bergman B, Hoeppner B, et al. Lived experience in new models of care for substance use disorder: a systematic review of peer recovery support services and recovery coaching. Front Psychol. 2019;10:1052. Eddie D, Hoffman L, Vilsaint C, Abry A, Bergman B, Hoeppner B, et al. Lived experience in new models of care for substance use disorder: a systematic review of peer recovery support services and recovery coaching. Front Psychol. 2019;10:1052.
7.
go back to reference Samuels EA, Baird J, Yang ES, Mello MJ. Adoption and utilization of an emergency department naloxone distribution and peer recovery coach consultation program. Acad Emerg Med. 2019;26:160–73.PubMed Samuels EA, Baird J, Yang ES, Mello MJ. Adoption and utilization of an emergency department naloxone distribution and peer recovery coach consultation program. Acad Emerg Med. 2019;26:160–73.PubMed
8.
go back to reference McGuire AB, Powell KG, Treitler PC, Wagner KD, Smith KP, Cooperman N, et al. Emergency department-based peer support for opioid use disorder: emergent functions and forms. J Subst Abus Treat. 2019. McGuire AB, Powell KG, Treitler PC, Wagner KD, Smith KP, Cooperman N, et al. Emergency department-based peer support for opioid use disorder: emergent functions and forms. J Subst Abus Treat. 2019.
9.
go back to reference Reif S, Braude L, Lyman DR, Dougherty RH, Daniels AS, Ghose SS, et al. Peer recovery support for individuals with substance use disorders: assessing the evidence. Psychiatr Serv. 2014;65:853–61.CrossRef Reif S, Braude L, Lyman DR, Dougherty RH, Daniels AS, Ghose SS, et al. Peer recovery support for individuals with substance use disorders: assessing the evidence. Psychiatr Serv. 2014;65:853–61.CrossRef
10.
go back to reference Bassuk EL, Hanson J, Greene RN, Richard M, Laudet A. Peer-delivered recovery support services for addictions in the United States: a systematic review. J Subst Abus Treat. 2016;63:1–9.CrossRef Bassuk EL, Hanson J, Greene RN, Richard M, Laudet A. Peer-delivered recovery support services for addictions in the United States: a systematic review. J Subst Abus Treat. 2016;63:1–9.CrossRef
12.
go back to reference Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.
13.
go back to reference Pawson R. Pragmatic trials and implementation science: grounds for divorce? BMC Med Res Methodol. 2019;19:176.CrossRef Pawson R. Pragmatic trials and implementation science: grounds for divorce? BMC Med Res Methodol. 2019;19:176.CrossRef
14.
go back to reference Wensing M, Bosch M, Grol R. Developing and selecting interventions for translating knowledge to action. CMAJ. 2010;182:E85–8.CrossRef Wensing M, Bosch M, Grol R. Developing and selecting interventions for translating knowledge to action. CMAJ. 2010;182:E85–8.CrossRef
15.
go back to reference Alexander JA, Hearld LR. Methods and metrics challenges of delivery-system research. Implement Sci. 2012;7:15.CrossRef Alexander JA, Hearld LR. Methods and metrics challenges of delivery-system research. Implement Sci. 2012;7:15.CrossRef
16.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRef
17.
go back to reference Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: pragmatic application of and adaptations to the consolidated framework for implementation research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Sys. 2020;4:e10201.CrossRef Safaeinili N, Brown-Johnson C, Shaw JG, Mahoney M, Winget M. CFIR simplified: pragmatic application of and adaptations to the consolidated framework for implementation research (CFIR) for evaluation of a patient-centered care transformation within a learning health system. Learn Health Sys. 2020;4:e10201.CrossRef
18.
go back to reference Watson DP, Snow-Hill N, Saldana L, Walden AL, Staton M, Kong A, Donenberg G. A longitudinal mixed method approach for assessing implementation context and process factors: comparison of three sites from a housing first implementation strategy pilot. Implement Res Pract. 2020;1:1–13. Watson DP, Snow-Hill N, Saldana L, Walden AL, Staton M, Kong A, Donenberg G. A longitudinal mixed method approach for assessing implementation context and process factors: comparison of three sites from a housing first implementation strategy pilot. Implement Res Pract. 2020;1:1–13.
19.
go back to reference Palmer JA, Parker VA, Mor V, Volandes AE, Barre LR, Belanger E, et al. Barriers and facilitators to implementing a pragmatic trial to improve advance care planning in the nursing home setting. BMC Health Serv Res. 2019;19:527.CrossRef Palmer JA, Parker VA, Mor V, Volandes AE, Barre LR, Belanger E, et al. Barriers and facilitators to implementing a pragmatic trial to improve advance care planning in the nursing home setting. BMC Health Serv Res. 2019;19:527.CrossRef
20.
go back to reference Gale RC, Wu J, Erhardt T, Bounthavong M, Reardon CM, Damschroder LJ, Midboe AM. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in veterans health. Implement Sci. 2019;14:11.CrossRef Gale RC, Wu J, Erhardt T, Bounthavong M, Reardon CM, Damschroder LJ, Midboe AM. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in veterans health. Implement Sci. 2019;14:11.CrossRef
23.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.CrossRef
24.
go back to reference D’Onofrio G, Edelman EJ, Hawk KF, Pantalon MV, Chawarski MC, Owens PH, et al. Implementation facilitation to promote emergency department-initiated buprenorphine for opioid use disorder: protocol for a hybrid type III effectiveness-implementation study (Project ED HEALTH). Implement Sci. 2019;14:48.CrossRef D’Onofrio G, Edelman EJ, Hawk KF, Pantalon MV, Chawarski MC, Owens PH, et al. Implementation facilitation to promote emergency department-initiated buprenorphine for opioid use disorder: protocol for a hybrid type III effectiveness-implementation study (Project ED HEALTH). Implement Sci. 2019;14:48.CrossRef
25.
go back to reference Palmer JA, Parker VA, Barre LR, Mor V, Volandes AE, Belanger E, et al. Understanding implementation fidelity in a pragmatic randomized clinical trial in the nursing home setting: a mixed-methods examination. Trials. 2019;20:656.CrossRef Palmer JA, Parker VA, Barre LR, Mor V, Volandes AE, Belanger E, et al. Understanding implementation fidelity in a pragmatic randomized clinical trial in the nursing home setting: a mixed-methods examination. Trials. 2019;20:656.CrossRef
26.
go back to reference Pawson R. The “pragmatic trial”: an essentially contested concept? J Eval Clin Pract. 2019;25:943–54.CrossRef Pawson R. The “pragmatic trial”: an essentially contested concept? J Eval Clin Pract. 2019;25:943–54.CrossRef
27.
go back to reference Scanlon JW, Horst H, Nay JN, Schmidt RE, Waller AE. Evaluability assessment: avoiding type III and IV errors. In: Evaluation management: a source book for readings. Charlottesville, VA: U. S. Civil Service Commission; 1997. p. 71–90. Scanlon JW, Horst H, Nay JN, Schmidt RE, Waller AE. Evaluability assessment: avoiding type III and IV errors. In: Evaluation management: a source book for readings. Charlottesville, VA: U. S. Civil Service Commission; 1997. p. 71–90.
28.
go back to reference Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, et al. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.CrossRef Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, et al. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.CrossRef
29.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455.CrossRef Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455.CrossRef
30.
go back to reference Nicholls SG, Carroll K, Zwarenstein M, Brehaut JC, Weijer C, Hey SP, et al. The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders. Trials. 2019;20:765.CrossRef Nicholls SG, Carroll K, Zwarenstein M, Brehaut JC, Weijer C, Hey SP, et al. The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders. Trials. 2019;20:765.CrossRef
31.
go back to reference Grady C. Enduring and emerging challenges of informed consent. New Engl J Med. 2015;372:855–62.CrossRef Grady C. Enduring and emerging challenges of informed consent. New Engl J Med. 2015;372:855–62.CrossRef
32.
go back to reference Jackson CB, Brabson LA, Quetsch LB, Herschell AD. Training transfer: a systematic review of the impact of inner setting factors. Adv Health Sci Educ. 2019;24:167–83.CrossRef Jackson CB, Brabson LA, Quetsch LB, Herschell AD. Training transfer: a systematic review of the impact of inner setting factors. Adv Health Sci Educ. 2019;24:167–83.CrossRef
33.
go back to reference Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57.CrossRef Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, Bunger AC, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69:123–57.CrossRef
34.
go back to reference Watson DP, Adams EL, Shue S, Coates H, McGuire A, Chesher J, et al. Defining the external implementation context: an integrative systematic literature review. BMC Health Serv Res. 2018;18:209.CrossRef Watson DP, Adams EL, Shue S, Coates H, McGuire A, Chesher J, et al. Defining the external implementation context: an integrative systematic literature review. BMC Health Serv Res. 2018;18:209.CrossRef
35.
go back to reference Ziemann A, Brown L, Sadler E, Ocloo J, Boaz A, Sandall J. Influence of external contextual factors on the implementation of health and social care interventions into practice within or across countries—a protocol for a ‘best fit’ framework synthesis. Syst Rev. 2019;8:258.CrossRef Ziemann A, Brown L, Sadler E, Ocloo J, Boaz A, Sandall J. Influence of external contextual factors on the implementation of health and social care interventions into practice within or across countries—a protocol for a ‘best fit’ framework synthesis. Syst Rev. 2019;8:258.CrossRef
Metadata
Title
Barriers impacting the POINT pragmatic trial: the unavoidable overlap between research and intervention procedures in “real-world” research
Authors
Allyson L. Dir
Dennis P. Watson
Matthew Zhiss
Lisa Taylor
Bethany C. Bray
Alan McGuire
Publication date
01-12-2021
Publisher
BioMed Central
Keywords
Opioids
Opioids
Published in
Trials / Issue 1/2021
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-021-05065-3

Other articles of this Issue 1/2021

Trials 1/2021 Go to the issue