Top

Published in:

Open Access 01-12-2019 | Opioids | Study protocol

Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM)

Authors: Matthew Chinman, Walid F. Gellad, Sharon McCarthy, Adam J. Gordon, Shari Rogal, Maria K. Mor, Leslie R. M. Hausmann

Published in: Implementation Science | Issue 1/2019

Abstract

Background

Mitigating the risks of adverse outcomes from opioids is critical. Thus, the Veterans Affairs (VA) Healthcare System developed the Stratification Tool for Opioid Risk Management (STORM), a dashboard to assist clinicians with opioid risk evaluation and mitigation. Updated daily, STORM calculates a “risk score” of adverse outcomes (e.g., suicide-related events, overdoses, overdose death) from variables in the VA medical record for all patients with an opioid prescription and displays this information along with documentation of recommended risk mitigation strategies and non-opioid pain treatments. In March 2018, the VA issued a policy notice requiring VA Medical Centers (VAMCs) to complete case reviews for patients whom STORM identifies as very high-risk (i.e., top 1% of STORM risk scores). Half of VAMCs were randomly assigned notices that also stated that additional support and oversight would be required for VAMCs that failed to meet an established percentage of case reviews. Using a stepped-wedge cluster randomized design, VAMCs will be further randomized to conduct case reviews for an expanded pool of patients (top 5% of STORM risk scores vs. 1%) starting either 9 or 15 months after the notice was released, creating four natural arms. VA commissioned an evaluation to understand the implementation strategies and factors associated with case review completion rates, whose protocol is described in this report.

Methods

This mixed-method study will include an online survey of all VAMCs to identify implementation strategies and interviews at a subset of facilities to identify implementation barriers and facilitators. The survey is based on the Expert Recommendations for Implementing Change (ERIC) project, which engaged experts to create consensus on 73 implementation strategies. We will use regression models to compare the number and types of implementation strategies across arms and their association with case review completion rates. Using questions from the Consolidated Framework for Implementation Research, we will interview stakeholders at 40 VAMCs with the highest and lowest adherence to opioid therapy guidelines.

Discussion

By identifying which implementation strategies, barriers, and facilitators influence case reviews to reduce opioid-related adverse outcomes, this unique implementation evaluation will enable the VA to improve the design of future opioid safety initiatives.

Trial registration

This project is registered at the ISRCTN Registry with number ISRCTN16012111. The trial was first registered on 5/3/2017.

Available only for authorised users

Centers for Disease Control and Prevention. Accidents or unintentional injuries. 2017. http://www.cdc.gov/nchs/fastats/accidental-injury.htm. Accessed January 10 2018 2018.

Guy GP Jr, Zhang K, Bohm MK, Losby J, Lewis B, Young R, et al. Vital signs: changes in opioid prescribing in the United States, 2006–2015. Morbidity Mortality Weekly Report. 2017;66(26):697–704. https://doi.org/10.15585/mmwr.mm6626a4.CrossRefPubMedPubMedCentral

Manchikanti L, Helm S 2nd, Fellows B, Janata JW, Pampati V, Grider JS, et al. Opioid epidemic in the United States. Pain Physician. 2012;15(3 Suppl):ES9–38.PubMed

McCarthy M. Containing the opioid overdose epidemic. BMJ. 2012;345:e8340. https://doi.org/10.1136/bmj.e8340.CrossRefPubMed

Nelson LS, Perrone J. Curbing the opioid epidemic in the United States: the risk evaluation and mitigation strategy (REMS). JAMA. 2012;308(5):457–8. https://doi.org/10.1001/jama.2012.8165.CrossRefPubMed

Schofferman J, Fishman SM, Harden RN, Kirschner KL. Did we reach too far? The opioid epidemic and chronic pain. PM R. 2014;6(1):78–84. https://doi.org/10.1016/j.pmrj.2013.12.003.CrossRefPubMed

Volkow ND, Frieden TR, Hyde PS, Cha SS. Medication-assisted therapies - tackling the opioid-overdose epidemic. N Engl J Med. 2014. https://doi.org/10.1056/NEJMp1402780.

Bohnert AS, Ilgen MA, Trafton JA, Kerns RD, Eisenberg A, Ganoczy D, et al. Trends and regional variation in opioid overdose mortality among veterans health administration patients, fiscal year 2001 to 2009. Clin J Pain. 2013. https://doi.org/10.1097/AJP.0000000000000011.

Bohnert AS, Valenstein M, Bair MJ, Ganoczy D, McCarthy JF, Ilgen MA, et al. Association between opioid prescribing patterns and opioid overdose-related deaths. JAMA. 2011;305(13):1315–21. https://doi.org/10.1001/jama.2011.370.CrossRefPubMed

10.

Okie S. A flood of opioids, a rising tide of deaths. N Engl J Med. 2010;363(21):1981–5. https://doi.org/10.1056/NEJMp1011512.CrossRefPubMed

11.

Dunn KM, Saunders KW, Rutter CM, Banta-Green CJ, Merrill JO, Sullivan MD, et al. Opioid prescriptions for chronic pain and overdose: a cohort study. Ann Intern Med. 2010;152(2):85–92. https://doi.org/10.7326/0003-4819-152-2-201001190-00006.CrossRefPubMedPubMedCentral

12.

Baumblatt JA, Wiedeman C, Dunn JR, Schaffner W, Paulozzi LJ, Jones TF. High-risk use by patients prescribed opioids for pain and its role in overdose deaths. JAMA Intern Med. 2014. https://doi.org/10.1001/jamainternmed.2013.12711.

13.

Center for Behavioral Health Statistics and Quality. Behavioral health trends in the United States: Results from the 2014 National Survey on Drug Use and Health (HHS Publication No. SMA 15-4927, NSDUH Series H-50). 2015. Retrieved from http://www.samhsa.gov/data/. Accessed 1 Oct 2018.

14.

Baser O, Xie L, Mardekian J, Schaaf D, Wang L, Joshi AV. Prevalence of diagnosed opioid abuse and its economic burden in the veterans health administration. Pain Practice. 2014;14(5):437–45. https://doi.org/10.1111/papr.12097.CrossRefPubMed

15.

Gellad WF, Good CB, Shulkin DJ. Addressing the Opioid Epidemic in the United States: Lessons From the Department of Veterans Affairs. JAMA Intern Med. 2017;177(5):611–2. https://doi.org/10.1001/jamainternmed.2017.0147.CrossRefPubMed

16.

Petzel RA. Opioid Safety Initiative Requirements. Memorandum from VA Under Secretary for Health; April 2, 2014.

17.

Oliva EM, Bowe T, Tavakoli S, Martins S, Lewis E, Paik M, et al. Development and Applications of the Veterans Health Administration’s Stratification Tool for Opioid Risk Mitigation (STORM) to improve opioid safety and prevent overdose and suicide. Psychol Serv. 2017;14(1):34–49.CrossRefPubMed

18.

Commission on Care. Commission on care final report. Washington: Commission on Care; 2016.

19.

Minegishi T, Garrido MM, Pizer SD, Frakt AB. Effectiveness of policy and risk targeting for opioid-related risk mitigation: a randomised programme evaluation with stepped-wedge design. BMJ Open. 2018;8(6):e020097. https://doi.org/10.1136/bmjopen-2017-020097.CrossRefPubMedPubMedCentral

20.

Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of “external facilitation” in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1:23. https://doi.org/10.1186/1748-5908-1-23.CrossRefPubMedPubMedCentral

21.

Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21. https://doi.org/10.1186/s13012-015-0209-1.CrossRefPubMedPubMedCentral

22.

Waltz TJ, Powell BJ, Matthieu MM. Implement Sci. 2015;10:109. https://doi.org/10.1186/s13012-015-0295-0.CrossRefPubMedPubMedCentral

23.

Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. https://doi.org/10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral

24.

Gaglio B. Evaluation approaches for dissemination and implementation research. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health: translating science into practice. New York: Oxford University Press; 2012. p. 327–56.CrossRef

25.

Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1. https://doi.org/10.1186/1748-5908-3-1.CrossRefPubMedPubMedCentral

26.

Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol. 2012;50(3–4):462–80. https://doi.org/10.1007/s10464-012-9522-x.CrossRefPubMed

27.

Chinman M, Acosta J, Ebener P, Malone PS, Slaughter ME. Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of getting to outcomes(R). Implement Sci. 2016;11(1):78. https://doi.org/10.1186/s13012-016-0446-y.CrossRefPubMedPubMedCentral

28.

Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Admin Pol Ment Health. 2011;38(1):44–53. https://doi.org/10.1007/s10488-010-0314-z.CrossRef

29.

Cresswell JW, Plano Clark VL. Designing and conducting mixed method research. Thousand Oaks: Sage; 2007.

30.

Rogal SS, Yakovchenko V, Waltz TJ, Powell BJ, Kirchner JE, Proctor EK, et al. The association between implementation strategy use and the uptake of hepatitis C treatment in a national sample. Implement Sci. 2017;12(1):60. https://doi.org/10.1186/s13012-017-0588-6.CrossRefPubMedPubMedCentral

31.

Glasgow JM, Yano EM, Kaboli PJ. Impacts of organizational context on quality improvement. Am J Med Qual. 2013;28(3):196–205. https://doi.org/10.1177/1062860612456730.CrossRefPubMed

32.

Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2016;11:72. https://doi.org/10.1186/s13012-016-0437-z.CrossRefPubMedPubMedCentral

33.

Buscaglia AC, Paik MC, Lewis E, Trafton JA. Baseline variation in use of VA/DOD clinical practice guideline recommended opioid prescribing practices across VA health care systems. Clin J Pain. 2015;31(9):803–12.PubMed

34.

Hagens V, Dobrow MJ, Chafe R. Interviewee transcript review: assessing the impact on qualitative research. BMC Med Res Methodol. 2009;9:47. https://doi.org/10.1186/1471-2288-9-47.CrossRefPubMedPubMedCentral

35.

Preacher KJ, Hayes AF. SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behav Res Methods Instrum Comput. 2004;36(4):717–31.CrossRefPubMed

36.

Miller WL, Crabtree BF. Primary care research: a multi typology and qualitative road map. In: Crabtree BF, Miller WL, editors. Doing qualitative research. London: Sage Press; 1992.

37.

Damschroder LJ, Waltz TJ, Abadie B, Powell BJ. Choosing implementation strategies to address local contextual barriers. Seattle: SIRC Bi-annual Conference; 2017.

38.

Gordon AJ, Trafton JA, Saxon AJ, Gifford AL, Goodman F, Calabrese VS, et al. Implementation of buprenorphine in the veterans health administration: results of the first 3 years. Drug Alcohol Depend. 2007;90(2–3):292–6. https://doi.org/10.1016/j.drugalcdep.2007.03.010.CrossRefPubMed

39.

Oliva EM, Harris AH, Trafton JA, Gordon AJ. Receipt of opioid agonist treatment in the veterans health administration: facility and patient factors. Drug Alcohol Depend. 2012;122(3):241–6. https://doi.org/10.1016/j.drugalcdep.2011.10.004.CrossRefPubMed

40.

Oliva EM, Maisel NC, Gordon AJ, Harris AH. Barriers to use of pharmacotherapy for addiction disorders and how to overcome them. Curr Psychiatry Rep. 2011;13(5):374–81. https://doi.org/10.1007/s11920-011-0222-2.CrossRefPubMedPubMedCentral

41.

Wagner TH, Upadhyay A, Cowgill E, Stefos T, Moran E, Asch SM, et al. Risk adjustment tools for learning health systems: a comparison of DxCG and CMS-HCC V21. Health Serv Res. 2016;51(5):2002–19. https://doi.org/10.1111/1475-6773.12454.CrossRefPubMedPubMedCentral

Title: Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM)
Authors: Matthew Chinman
Walid F. Gellad
Sharon McCarthy
Adam J. Gordon
Shari Rogal
Maria K. Mor
Leslie R. M. Hausmann
Publication date: 01-12-2019
Publisher: BioMed Central
Keywords: Opioids
Opioids
Published in: Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI: https://doi.org/10.1186/s13012-019-0852-z

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM)

Abstract

Background

Methods

Discussion

Trial registration

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Discussion

Trial registration

Please log in to get access to this content

Other articles of this Issue 1/2019

Correction to: Hospital organizational context and delivery of evidence-based stroke care: a cross-sectional study

Building capacity for Public Health 3.0: introducing implementation science into an MPH curriculum

Process evaluation of a complex intervention to optimize quality of prescribing in nursing homes (COME-ON study)

Designing high-quality implementation research: development, application, feasibility and preliminary evaluation of the implementation science research development (ImpRes) tool and guide

Exploring the effect of implementation and context on a stepped-wedge randomised controlled trial of a vital sign triage device in routine maternity care in low-resource settings

Physician-reported barriers to using evidence-based recommendations for low back pain in clinical practice: a systematic review and synthesis of qualitative studies using the Theoretical Domains Framework