Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2013

Open Access 01-12-2013 | Research

An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets-Getting To Outcomes

Authors: Joie Acosta, Matthew Chinman, Patricia Ebener, Patrick S Malone, Susan Paddock, Andrea Phillips, Peter Scales, Mary Ellen Slaughter

Published in: Implementation Science | Issue 1/2013

Login to get access

Abstract

Background

Studies have shown that communities have not always been able to implement evidence-based prevention programs with quality and achieve outcomes demonstrated by prevention science. Implementation support interventions are needed to bridge this gap between science and practice. The purpose of this article is to present two-year outcomes from an evaluation of the Assets Getting To Outcomes (AGTO) intervention in 12 Maine communities engaged in promoting Developmental Assets, a positive youth development approach to prevention. AGTO is an implementation support intervention that consists of: a manual of text and tools; face-to-face training, and onsite technical assistance, focused on activities shown to be associated with obtaining positive results across any prevention program.

Methods

This study uses a nested and cross-sectional, cluster randomized controlled design. Participants were coalition members and program staff from 12 communities in Maine. Each coalition nominated up to five prevention programs to participate. At random, six coalitions and their respective 30 programs received the two-year AGTO intervention and the other six maintained routine operations. The study assessed prevention practitioner capacity (efficacy and behaviors), practitioner exposure to and use of AGTO, practitioner perceptions of AGTO, and prevention program performance. Capacity of coalition members and performance of their programs were compared between the two groups across the baseline, one-, and two-year time points.

Results

We found no significant differences between AGTO and control group’s prevention capacity. However, within the AGTO group, significant differences were found between those with greater exposure to and use of AGTO. Programs that received the highest number of technical assistance hours showed the most program improvement.

Conclusions

This study is the first of its kind to show that use of an implementation support intervention-AGTO -yielded improvements in practitioner capacity and consequently in program performance on a large sample of practitioners and programs using a randomized controlled design.

ClinicalTrials.gov identifier

NCT00780338
Appendix
Available only for authorised users
Literature
1.
Miller T, Hendrie D: Substance abuse prevention dollars and cents: A cost-benefit analysis (DHHS Pub. No. (SMA) 07–4298). 2009, Rockville, MD: Center for Substance Abuse Prevention, Substance Abuse and Mental Health Services Administration
2.
Backer TE: Finding the balance: program fidelity and adaptation in substance abuse prevention: CSAP. 2001
3.
Ennett ST, Ringwalt CL, Thorne J, Rohrbach LA, Vincus A, Simons-Rudolph A: A comparison of current practice in school-based substance abuse prevention programs with meta-analysis findings. Prev Sci. 2003, 4: 1-14. 10.1023/A:1021777109369.CrossRefPubMed
4.
Cantor D, Crosse S, Hagen CA, Mason MJ, Siler AJ, Von Glatz A: Wide Scope, Questionable Quality: Drug and Violence Prevention Efforts in American Schools. Report on the Study on School Violence and Prevention. In. 2001, Washington, DC: U.S. Department of Education, Planning and Evaluation Service
5.
Crosse S, Burr M, Cantor D, Hagen CA, Hantman I: Wide Scope, Questionable Quality: Drug and Violence Prevention Efforts in American Schools. Report on the Study on School Violence and Prevention. In. 2001, Washington, DC: U.S. Department of Education, Planning and Evaluation Service
6.
Reuter P, Timpane JM: Assessing options for the safe and drug free schools and communities act. 2001, Santa Monica, CA: RAND, No. MR-1328
7.
Silvia ES, Thorne J: School-based drug prevention programs: A longitudinal study in selected school districts. In. 1997, North Carolina: Research Triangle Institute
8.
U.S. Department of Education OoP, Evaluation and Policy Development, Policy and Program Studies Service: Prevalence and Implementation Fidelity of Research-Based Prevention Programs in Public Schools: Final Report. 2011, Washington, D.C:
9.
Wandersman A, Florin P: Community interventions and effective prevention: bringing researchers/evaluators, funders and practitioners together for accountability. Am Psychol. 2003, 58 (6/7): 441-448.CrossRefPubMed
10.
Green L: From research to 'Best Practices' in other settings and populations. Am J Health Behav. 2001, 25 (3): 165-178. 10.5993/AJHB.25.3.2.CrossRefPubMed
11.
Livet M, Wandersman A: Organizational functioning: facilitating effective interventions and increasing the odds of programming success. Empowerment evaluation in practice. Edited by: Fetterman DM, Wandersman A. 2005, New York, NY: Guilford, 123-154.
12.
Chinman M, Hunter S, Ebener P, Paddock S, Stillman L, Imm P, Wandersman A: The Getting To Outcomes demonstration and evaluation: an illustration of the prevention support system. Am J Community Psychol. 2008, 41: 206-224. 10.1007/s10464-008-9163-2.CrossRefPubMedPubMedCentral
13.
Chinman M, Tremain B, Imm P, Wandersman A: Strengthening prevention performance using technology: a formative evaluation of interactive Getting To OutcomesTM. Am J Orthopsychiatry. 2009, 79: 469-481.CrossRefPubMedPubMedCentral
14.
Fishbein M, Ajzen A: Beliefs, attitudes, intentions, and behavior: An introduction to theory and research. 1975, Reading, MA: Addison-Wesley
15.
Ajzen I, Fishbein M: Attitude-behavior relations: a theoretical analysis and review of empirical research. Psychol Bull. 1977, 84: 888-918.CrossRef
16.
Bandura A: Health promotion by social cognitive means. Health Educ Behav. 2004, 31 (2): 143-164. 10.1177/1090198104263660.CrossRefPubMed
17.
Fishbein M, Ajzen I: Atitudes toward objects as predictive of single and multiple behavioral criteria. Psychol Rev. 1974, 81: 59-74.CrossRef
18.
19.
Benson PL, Scales PC, Leffert N, Roehlkepartain ER: A fragile foundation: The state of developmental assets among American youth. 1999, Minneapolis, MN: Search Institute
20.
Leffert N, Benson PL, Scales PC, Sharma AR, Drake DR, Blyth DA: Developmental assets: measurement and prediction of risk behaviors among adolescents. Appl Dev Sci. 1998, 2: 209-230. 10.1207/s1532480xads0204_4.CrossRef
21.
Scales PC, Benson PL, Leffert N, Blyth DA: Contribution of developmental assets to the prediction of thriving among adolescents. Appl Dev Sci. 2000, 4: 27-46. 10.1207/S1532480XADS0401_3.CrossRef
22.
Fisher D, Imm PS, Chinman M, Wandersman A: Getting To Outcomes with Developmental Assets: Ten steps to measuring success in youth programs and communities. 2006, Minneapolis, MN: Search Institute
23.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-65. 10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral
24.
Rohrbach LA, D’Onofrio CN, Backer TE, Montgomery SB: Diffusion of school-based substance abuse prevention programs. Am Behav Sci. 1996, 39: 919-934. 10.1177/0002764296039007012.CrossRef
25.
Rohrbach LA, Graham JW, Hansen WB: Diffusion of a school-based substance abuse prevention program: predictors of program implementation. Prev Med. 1993, 22 (2): 237-260. 10.1006/pmed.1993.1020.CrossRefPubMed
26.
McCormick LK, Steckler AB, McLeroy KR: Diffusion of innovations in schools: a study of adoption and implementation of school-based tobacco prevention curricula. Am J Health Promot. 1995, 9: 210-219. 10.4278/0890-1171-9.3.210.CrossRefPubMed
27.
Steckler AB, McLeroy KR, Goodman RM, McCormick L, Bird ST: Toward integrating qualitative and quantitative methods: an introduction. Health Educ Q. 1992, 19: 1-8. 10.1177/109019819201900101.CrossRefPubMed
28.
Parcel GS, Erikson MP, Lovato CY, Gottlieb NH, Brink SG, Green LW: The diffusion of school-based tobacco-use prevention program: project description and baseline data. Health Educ Res. 1989, 4: 111-124. 10.1093/her/4.1.111.CrossRef
29.
Cividin TM, Ottoson JM: Linking reasons for continuing professional education participation with post-program application. J Contin Educ Health Professions. 1997, 17: 46-55. 10.1002/chp.4750170107.CrossRef
30.
Ottoson JM: After the applause: exploring multiple influences on application following an adult education program. Adult Educ Quart. 1997, 47: 92-107. 10.1177/074171369704700203.CrossRef
31.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 1-10.1186/1748-5908-4-1.CrossRef
32.
Murray DM: Design and analysis of group-randomized trials. 1998, Oxford, UK: Press OU
33.
Battelle: Annual findings report: Drug-free communities support program national evaluation. 2008, Washington, DC: Executive Office of the President Office of Administration Office of National Drug Control Policy
34.
Butterfoss FD, Goodman RM, Wandersman A: Community coalitions for prevention and health promotion. Health Educ Res. 1993, 8: 315-330. 10.1093/her/8.3.315.CrossRefPubMed
35.
Ellickson PL, Bell RM: Drug prevention in junior high: a multi-site longitudinal test. Science. 1990, 247: 1265-1372.CrossRef
36.
Botvin GJ, Baker E, Dusenbury L, Botvin EM, Diaz T: Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA. 1995, 273 (14): 1106-1112. 10.1001/jama.1995.03520380042033.CrossRefPubMed
37.
Jemmott JB, Jemmott L, Spears H, Hewitt N, Cruz-Collins M: Self-efficacy, hedonistic expectancies, and condom-use intentions among inner-city Black adolescent women: a social cognitive approach to AIDS risk behavior. J Adolescent Health. 1992, 13: 512-519. 10.1016/1054-139X(92)90016-5.CrossRef
38.
Jemmott JB, Jemmott LS, Fong GT: Reductions in HIV risk-associated sexual behaviors among Black male adolescents: effects of an AIDS prevention intervention. Am J Public Health. 1992, 82: 372-377. 10.2105/AJPH.82.3.372.CrossRefPubMedPubMedCentral
39.
Jemmott JB, Jemmott LS, Fong GT, McCaffree K: Reducing HIV risk-associated sexual behavior among African American adolescents: Testing the generality of intervention effects. Am J Community Psychol. 1999, 27: 161-187. 10.1007/BF02503158.CrossRefPubMed
40.
Chinman M, Hannah G, Wandersman A, Ebener P, Hunter S, Imm P, Sheldon J: Developing a community science research agenda for building community capacity for effective preventive interventions. Am J Community Psychol. 2005, 3/4: 143-157.CrossRef
41.
Mitchell R, Stone-Wiggins B, Stevenson JF, Florin P: Cultivating capacity: outcomes of a statewide support system for prevention coalitions. J Prev Interv Community. 2004, 27: 67-87. 10.1300/J005v27n02_05.CrossRef
42.
O’Donnell LO, Scattergood P, Adler M, San Doval A, Barker M, Kelly JA: The role of technical assistance in the replication of effective HIV interventions. AIDS Educ Prev. 2000, 12: 99-111.PubMed
43.
Stevenson JF, Florin P, Mills DS, Andrade M: Building evaluation capacity in human service organizations: a case study. Eval Program Plann. 2002, 25 (3): 233-243. 10.1016/S0149-7189(02)00018-6.CrossRef
44.
Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998, 7: 149-158. 10.1136/qshc.7.3.149.CrossRefPubMedPubMedCentral
45.
Rycroft-Malone J, Harvey G, Seers K, Kitson A, McCormack B, Titchen A: An exploration of the factors that influence the implementation of evidence into practice. J Clin Nurs. 2002, 13: 913-924.CrossRef
46.
Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M: Role of 'external facilitation' in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006, 23:
47.
Weiss E, Miller-Anderson R, Lasker R: Making the most of collaboration: exploring the relationship between partnership synergy and partnership functioning. Health Educ Behav. 2002, 29: 683-698. 10.1177/109019802237938.CrossRefPubMed
48.
Lehman WEK, Greener JM, Simpson DD: Assessing organizational readiness for change. J Subst Abuse Treat. 2002, 22 (4): 197-209. 10.1016/S0740-5472(02)00233-7.CrossRefPubMed
49.
Hall GE, Hord SM: Implementing change. 2001, Boston, MA: Allyn and Bacon
50.
Hall GE, Loucks SF, Rutherford WL, Newlove BW: Levels of use of the innovation: a framework for analyzing innovation adoption. J Teach Educ. 1975, 26: 52-10.1177/002248717502600114.CrossRef
51.
Hall GE, Loucks SF: A developmental model for determining whether the treatment is actually implemented. Am Educ Res J. 1977, 14 (3): 263-276. 10.3102/00028312014003263.CrossRef
52.
Chinman M, Acosta J, Ebener P, Burkhart Q, Clifford M, Corsello M, Duffy T, Hunter S, Jones M, Lahti M: Intervening with practitioners to improve the quality of prevention: One year findings from a randomized trial of Assets-Getting To Outcomes. J Prim Prev. In press
53.
Chinman M, Tremain B, Imm P, Wandersman A: Strengthening prevention performance using technology: a formative evaluation of interactive Getting To Outcomes. Am J Orthopsychiatry. 2009, 79: 469-481. PMC2859836CrossRefPubMedPubMedCentral
54.
Bryt T, Bishop J, Carlin JB: Bias, prevalence and kappa. J Clin Epidemiol. 1993, 46 (5): 423-429. 10.1016/0895-4356(93)90018-V.CrossRef
55.
Lincoln YS, Guba EG: Naturalistic inquiry. In. 1985, Beverly Hills, CA: Sage
56.
Graham ID, Logan J: Innovations in knowledge transfer and continuity of care. Can J Nurs Res. 2004, 36 (2): 89-103.PubMed
57.
Hunter SB, Chinman M, Ebener P, Imm P, Wandersman A, Ryan G: Technical assistance as a prevention capacity-building tool: a demonstration using the Getting To Outcomes framework. Health Educ Behav. 2009, 36: 810-828. 10.1177/1090198108329999.CrossRefPubMed
58.
Keener DC: Toward a science of capacity building: An examination of technical assistance following a training program for prevention professionals. In. 2007, Columbia, SC, USA: University of South Carolina
59.
Feinberg ME, Ridenour TA, Greenberg MT: The longitudinal effect of technical assistance dosage on the functioning of communities that care prevention boards in Pennsylvania. J Prim Prev. 2008, 29 (2): 145-165. 10.1007/s10935-008-0130-3.CrossRefPubMed
60.
Hawkins JD, Oesterle S, Brown EC, Arthur MW, Abbott RD, Fagan AA, Catalano RF: Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: a test of communities that care. Arch Pediatr Adolesc Med. 2009 September, 163 (9): 789-798. 10.1001/archpediatrics.2009.141.CrossRefPubMedPubMedCentral
61.
Spoth R, Redmond C, Shin C, Greenberg M, Clair S, Feinberg M: Substance-use outcomes at 18 months past baseline: the PROSPER Community-University partnership trial. Am J Prev Med. 2007 May, 32 (5): 395-402. 10.1016/j.amepre.2007.01.014.CrossRefPubMedPubMedCentral
62.
Wandersman A: Four keys to success (theory, implementation, evaluation, and resource/system support): high hopes and challenges in participation. Am J Community Psychol. 2009, 43: 3-21. 10.1007/s10464-008-9212-x.CrossRefPubMed
63.
Wandersman A, Chien VH, Katz J: Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Cultivating communities of practice. Edited by: Wenger E, McDermott R, Snyder WM. 2002, Boston, MA: Harvard Business School Press, In press
Metadata
Title
An intervention to improve program implementation: findings from a two-year cluster randomized trial of Assets-Getting To Outcomes
Authors
Joie Acosta
Matthew Chinman
Patricia Ebener
Patrick S Malone
Susan Paddock
Andrea Phillips
Peter Scales
Mary Ellen Slaughter
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2013
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-8-87

Other articles of this Issue 1/2013

Implementation Science 1/2013 Go to the issue

Research

What supports do health system organizations have in place to facilitate evidence-informed decision-making? a qualitative study

Debate

Never the twain shall meet? - a comparison of implementation science and policy implementation research

Research

Synthesising practice guidelines for the development of community-based exercise programmes after stroke

Methodology

Designing a valid randomized pragmatic primary care implementation trial: the my own health report (MOHR) project

Methodology

A time-responsive tool for informing policy making: rapid realist review

Study protocol

Improving implementation of evidence-based practice in mental health service delivery: protocol for a cluster randomised quasi-experimental investigation of staff-focused values interventions