Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach

Authors: Sarah B. Hunter, Bing Han, Mary E. Slaughter, Susan H. Godley, Bryan R. Garner

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Few empirical studies longitudinally examine evidence-based practice (EBP) sustainment and the hypothesized factors that influence it. In an effort to address this gap, the current study examined sustainment of an EBP for adolescent substance use called the adolescent community reinforcement approach (A-CRA).

Methods

A-CRA sustainment was assessed via information collected as part of key informant interviews and surveys with clinical staff from community-based treatment organizations that had received federal funding to implement A-CRA. Administrative data from the funding period on implementation was also used. Using discrete-time survival analysis, we regressed A-CRA sustainment on several factors theorized to influence EBP sustainment. Factors examined included outer setting, inner setting, implementation quality during the funding period, and intervention-related characteristics.

Results

Overall, data from 83 % of the targeted sample of treatment organizations was collected. A-CRA sustainment was strongly related to the time since funding loss. Strong relationships were found between sustainment status and implementation quality during the funding period, agency focus, funding stability, and political support for the treatment along with staff perceptions of the treatment’s complexity and implementation difficulty.

Conclusions

Consistent with the Consolidated Framework for Implementation Research, the current study found several factors related to the outer setting (e.g., funding stability), inner setting (e.g., agency focus), implementation quality during the funding period (e.g., staff trained, clients served), and characteristics of the intervention (e.g., implementation complexity) to be associated with EBP sustainment. Future research is warranted to examine the extent to which these relationships are stable over time. Efforts to ensure that adequate implementation occurs during the initial implementation period and that adequate funding, infrastructure, and staff support following the ending of initial support are critical to a program’s survival.
Literature
1.
Godley SH, Godley MD, Hagen RJ. Community resources: a practical guide for human service professionals. In: Crimando W, Riggar TF, editors. Alcohol-drug treatment programs. Prospect Heights, IL: Waveland Press, Inc.; 2005.
2.
Stevens SJ, Morral AR. Adolescent substance abuse treatment in the United States: exemplary models from a national evaluation study. New York: Haworth Press; 2003.
3.
Dennis M, Godley SH, Diamond G, Tims FM, Babor T, Donaldson J, et al. The Cannabis Youth Treatment (CYT) study: main findings from two randomized trials. J Subst Abuse Treat. 2004;27(3):197–213.PubMedCrossRef
4.
Gans J, Falco M, Schackman BR, Winters KC. An in-depth survey of the screening and assessment practices of highly regarded adolescent substance abuse treatment programs. J Child Adolesc Subst Abuse. 2010;19(1):33–47.PubMedPubMedCentralCrossRef
5.
Schackman BR, Rojas EG, Gans J, Falco M, Millman RB. Does higher cost mean better quality? Evidence from highly-regarded adolescent drug treatment programs. BioMed Central Ltd. 2007;2:23.
6.
National Drug Intelligence Center (U.S.). The economic impact of illicit drug use on American society/U.S. Department of Justice, National Drug Intelligence Center. Johnstown, Pa: U.S. Department of Justice National Drug Intelligence Center; 2011; 2011.
7.
Center for Disease Control. Smoking-attributable mortality, years of potential life lost, and productivity losses United States, 2000–2004. Atlanta, GA: Centers for Disease Control and Prevention; 2008.
8.
Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet. 2009;373(9682):2223–33.PubMedCrossRef
9.
Godley MD, Godley SH, Dennis ML, Funk RR, Passetti LL. The effect of assertive continuing care on continuing care linkage, adherence and abstinence following residential treatment for adolescents with substance use disorders. Addiction. 2007;102(1):81–93.PubMedCrossRef
10.
Slesnick N, Prestopnik JL, Meyers RJ, Glassman M. Treatment outcome for street-living, homeless youth. Addict Behav. 2007;32(6):1237–51.PubMedCrossRef
11.
Godley SH, Garner BR, Smith JE, Meyers RJ, Godley MD. A large-scale dissemination and implementation model for evidence-based treatment and continuing care. Clin Psychol (New York). 2011;18(1):67–83.
12.
Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34.PubMedCrossRef
13.
Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, et al. Sustainability science: an integrated approach for health-programme planning. Lancet. 2008;372(9649):1579–89.PubMedCrossRef
14.
Scheirer MA, Hartling G, Hagerman D. Defining sustainability outcomes of health programs: illustrations from an on-line survey. Eval Program Plann. 2008;31(4):335–46.PubMedCrossRef
15.
Ellis P, Robinson P, Ciliska D, Armour T, Raina P, Brouwers M, et al. Diffusion and dissemination of evidence-based cancer control interventions. Evid Rep Technol Assess (Summ). 2003;79(79):1–5.
16.
O’Loughlin J, Renaud L, Richard L, Gomez LS, Paradis G. Correlates of the sustainability of community-based heart health promotion interventions. Prev Med. 1998;27(5 Pt 1):702–12.PubMedCrossRef
17.
Pluye P, Potvin L, Denis JL, Pelletier J, Mannoni C. Program sustainability begins with the first events. Eval Program Plann. 2005;28(2):123–37.CrossRef
18.
Shediac-Rizkallah MC, Bone LR. Planning for the sustainability of community-based health programs: conceptual frameworks and future directions for research, practice and policy. Health Educ Res. 1998;13(1):87–108.PubMedCrossRef
19.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.PubMedPubMedCentralCrossRef
20.
Rogers EM. Diffusion of innovations. 5th ed. New York: Free Press; 2003.
21.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.PubMedPubMedCentralCrossRef
22.
Fixsen DL, Louis de la Parte Florida Mental Health Institute., University of South Florida. Implementation research: a synthesis of the literature. Tampa, Florida: National Implementation Research Network; 2005.
23.
Shortell SM. Increasing value: a research agenda for addressing the managerial and organizational challenges facing health care delivery in the United States. Med Care Res Rev. 2004;61(3 Suppl):12S–30S.PubMedCrossRef
24.
Garner BR, Barnes B, Godley SH. Monitoring fidelity in the adolescent community reinforcement approach (A-CRA): the training process for A-CRA raters. J Behav Anal Health Sports Fit Med. 2009;2(1):43–54.PubMedPubMedCentral
25.
Simpson DD. A conceptual framework for transferring research to practice. J Subst Abuse Treat. 2002;22(4):171–82.PubMedCrossRef
26.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.PubMedCrossRef
27.
28.
Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. BioMed Central Ltd. 2012;7:17.
29.
Tibbits MK, Bumbarger BK, Kyler SJ, Perkins DF. Sustaining evidence-based interventions under real-world conditions: results from a large-scale diffusion project. Prev Sci. 2010;11(3):252–62.PubMedPubMedCentralCrossRef
30.
Peterson AE, Bond GR, Drake RE, McHugo GJ, Jones AM, Williams JR. Predicting the long-term sustainability of evidence-based practices in mental health care: an 8-year longitudinal analysis. J Behav Health Serv Res. 2014;41(3):337–46.PubMedCrossRef
31.
Swain K, Whitley R, McHugo GJ, Drake RE. The sustainability of evidence-based practices in routine mental health agencies. Community Ment Health J. 2010;46(2):119–29.PubMedCrossRef
32.
Cooper BR, Bumbarger BK, Moore JE. Sustaining evidence-based prevention programs: correlates in a large-scale dissemination initiative. Prev Sci. 2015;16(1):145–57.PubMedCrossRef
33.
Eby LT, Burk H, Maher CP. How serious of a problem is staff turnover in substance abuse treatment? A longitudinal study of actual turnover. J Subst Abuse Treat. 2010;39(3):264–71.PubMedPubMedCentralCrossRef
34.
35.
Substance Abuse and Mental Health Services Administration. Results from the 2010 national survey on drug use and health: summary of national findings. National survey on drug use and health series, vol. 41. Rockville, MD: U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality; 2011.
36.
Dillman DA, Smyth JD, Christian LM, Dillman DA. Internet, mail, and mixed-mode surveys: the tailored design method. 3rd ed. Hoboken, N.J.: Wiley; 2009.
37.
Substance Abuse and Mental Health Services Administration. National survey of substance abuse treatment services (N-SSATS): 2010. Data on substance abuse treatment facilities. National survey on drug use and health series, vol S-59. Rockville, MD: U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality; 2011.
38.
Schell SF, Luke DA, Schooley MW, Elliott MB, Herbers SH, Mueller NB, et al. Public health program capacity for sustainability: a new framework. Implement Sci. 2013;8:15.PubMedPubMedCentralCrossRef
39.
40.
Klein KJ, Sorra JS. The challenge of innovation implementation. Acad Manage Rev. 1996;21(4):1055–80.
41.
Steckler A, Goodman RM, McLeroy KR, Davis S, Koch G. Measuring the diffusion of innovative health promotion programs. Am J Health Promot. 1992;6(3):214–24.PubMedCrossRef
42.
Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Stat. 2001;29(4):1165–88.CrossRef
43.
Singer JD, Willett JB. It’s about time: using discrete-time survival analysis to study duration and the timing of events. J Educ Behav Stat. 1993;18(2):155–95.CrossRef
44.
Scheirer MA. Is sustainability possible? A review and commentary on empirical studies of program sustainability. Am J Eval. 2005;26(3):320–47.CrossRef
45.
Goodman RM, McLeroy KR, Steckler AB, Hoyle RH. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20(2):161–78.PubMedCrossRef
46.
Godley SH, Smith JE, Passetti LL, Subramaniam G. The adolescent community reinforcement approach (A-CRA) as a model paradigm for the management of adolescents with substance use disorders and co-occurring psychiatric disorders. Subst Abus. 2014;35(4):352–63.PubMedCrossRef
47.
Hunter BD, Godley SH, Hesson-McInnis MS, Roozen HG. Longitudinal change mechanisms for substance use and illegal activity for adolescents in treatment. Psychol Addict Behav. 2014;28(2):507–15.PubMedCrossRef
48.
Godley SH, Hunter BD, Fernandez-Artamendi S, Smith JE, Meyers RJ, Godley MD. A comparison of treatment outcomes for adolescent community reinforcement approach participants with and without co-occurring problems. J Subst Abuse Treat. 2014;46(4):463–71.PubMedCrossRef
49.
Substance Abuse & Mental Health Services Administration. Cooperative agreements for State Adolescent Treatment Enhancement and Dissemination (SAT-ED). http://​media.​samhsa.​gov/​grants/​2012/​ti_​12_​006.​aspx
50.
Hunter S, Godley S, Garner B, Han B, Ayer L, Slaughter M, et al. The sustainment of evidence-based adolescent substance abuse treatment in community settings. Addict Sci Clin Pract. 2015;10 Suppl 1:A23.
51.
Substance Abuse and Mental Health Services Administration . Office of Applied Studies. Treatment Episode Data Set (TEDS): 2007. vol S-51. Rockville, MD: U.S. Dept. of Health and Human Services Substance Abuse and Mental Health Services Administration Center for Behavioral Health Statistics and Quality; 2007.
Metadata
Title
Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach
Authors
Sarah B. Hunter
Bing Han
Mary E. Slaughter
Susan H. Godley
Bryan R. Garner
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0364-4

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue

Systematic review

A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare

Systematic review

Trends in guideline implementation: a scoping systematic review

Debate

“Entrenched practices and other biases”: unpacking the historical, economic, professional, and social resistance to de-implementation

Study protocol

Study protocol: identifying and delivering point-of-care information to improve care coordination

Research

Perceptions of national guidelines and their (non) implementation in mental healthcare: a deductive and inductive content analysis

Study protocol

Study protocol: an evaluation of the effectiveness, experiences and costs of a patient-directed strategy compared with a multi-faceted strategy to implement physical cancer rehabilitation programmes for cancer survivors in a European healthcare system; a controlled before and after study