Top

Published in:

01-09-2011

Effects of Communities That Care on the Adoption and Implementation Fidelity of Evidence-Based Prevention Programs in Communities: Results from a Randomized Controlled Trial

Authors: Abigail A. Fagan, Michael W. Arthur, Koren Hanson, John S. Briney, J. David Hawkins

Published in: Prevention Science | Issue 3/2011

Abstract

This paper describes findings from the Community Youth Development Study (CYDS), a randomized controlled trial of the Communities That Care (CTC) prevention system, on the adoption and implementation fidelity of science-based prevention programming in 24 communities. Data were collected using the Community Resource Documentation (CRD), which entailed a multi-tiered sampling process and phone and web-based surveys with directors of community-based agencies and coalitions, school principals, service providers, and teachers. Four years after the initiation of the CTC prevention system, the results indicated increased use of tested, effective prevention programs in the 12 CTC intervention communities compared to the 12 control communities, and significant differences favoring the intervention communities in the numbers of children and families participating in these programs. Few significant differences were found regarding implementation quality; respondents from both intervention and control communities reported high rates of implementation fidelity across the services provided.

At the conclusion of the Diffusion Project, 13 pairs of communities were identified as eligible for the CYDS, and 12 pairs agreed to participate; see Hawkins et al. (2008) for details.

Coalitions eligible for inclusion were those defined as “a group of community leaders, service providers, and/or community residents representing different organizations and sectors of the community that meet to plan, coordinate, and integrate the community’s prevention activities.” The 2005 and 2007 coalition interviews in the intervention communities included the 12 coalitions that were trained in the CTC system, as well as any other coalitions operating in these communities. Most control communities also had prevention-oriented coalitions, though their characteristics tended to differ from CTC coalitions (Arthur et al. 2010).

A list of the programs included on the Program Interviews and in the Teacher Surveys is available upon request from Blair Brook-Weiss (bbrooke@u.washington.edu) at the Social Development Research Group.

If multiple respondents from the same community reported implementation of the same program, the program was counted only once in the adoption measure.

Fidelity scores were not calculated for the 2002 Program Interview or the 2005 Teacher Survey data, given that fewer items assessing fidelity were included on these surveys and because only a few programs were identified in each of the four Program Interviews conducted in 2002.

These figures represent the total number of programs reported in the year prior to the survey administration. Given the possibility that programs identified at earlier time points were also identified at later time points, adding these results across the three times could over-estimate the total number of programs implemented in communities. The same is true of the program participation results.

Respondents on the Social Competence Interviews could have reported adoption of the same programs as teachers, given that community/school collaborations did occur; thus, adding up the participation rates across the Program Interviews and Teacher Surveys would over-estimate the total number of residents served.

Arthur, M. W., Glaser, R. R., & Hawkins, J. D. (2005). Steps towards community-level resilience: Community adoption of science-based prevention programming. In Peters, R.D., Leadbeater, B. & McMahon, R.J. (Eds.), Resilience in children, families, and communities: Linking context to practice and policy (pp 177–194). New York: Kluwer Academic/Plenum Publishers.CrossRef

Arthur, M. W., Hawkins, J. D., Brown, E. C., Briney, J. S., Oesterle, S., & Abbott, R. D. (2010). Implementation of the Communities That Care prevention system by coalitions in the Community Youth Development Study. Journal of Community Psychology, 38, 245–258.CrossRef

Dariotis, J. K., Bumbarger, B. K., Duncan, L. G., & Greenberg, M. (2008). How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors. Journal of Community Psychology, 36, 744–760.CrossRef

Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of the research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.PubMedCrossRef

Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.PubMedCrossRef

Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–53.PubMedCrossRef

Fagan, A. A., Brooke-Weiss, B., Cady, R., & Hawkins, J. D. (2009). If at first you don’t succeed…keep trying: Strategies to enhance coalition/school partnerships to implement school-based prevention programming. Australian and New Zealand Journal of Criminology, 42, 387–405.PubMedCrossRef

Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008a). Bridging science to practice: Achieving prevention program fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41, 235–249.PubMedCrossRef

Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008b). Implementing effective community-based prevention programs in the Community Youth Development Study. Youth Violence and Juvenile Justice, 6, 256–278.CrossRef

Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2009). Translational research in action: Implementation of the Communities That Care prevention system in 12 communities. Journal of Community Psychology, 37, 809–829.CrossRef

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).

Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D. C., Kellam, S. G., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness, and dissemination. Prevention Science, 6, 151–176.PubMedCrossRef

Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93, 1261–1267.PubMedCrossRef

Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39, 3–35.CrossRef

Gottfredson, D. C., Kumpfer, K., Polizzi-Fox, D., Wilson, D., Puryear, V., Beatty, P., et al. (2006). The Strengthening Families Washington D.C. Families project: A randomized effectiveness trial of family-based prevention. Prevention Science, 7, 57–73.PubMedCrossRef

Griner Hill, L., Maucione, K., & Hood, B. K. (2006). A focused approach to assessing program fidelity. Prevention Science, 8, 25–34.CrossRef

Hallfors, D., & Godette, D. (2002). Will the “Principles of Effectiveness” improve prevention practice? Early findings from a diffusion study. Health Education Research, 17, 461–470.PubMedCrossRef

Hawkins, J. D., & Catalano, R. F. (2004). Communities That Care prevention strategies guide. South Deerfield, MA: Channing Bete Company.

Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951–976.PubMedCrossRef

Hawkins, J. D., Catalano, R. F., Arthur, M. W., Egan, E., Brown, E. C., Abbott, R. D., et al. (2008). Testing Communities That Care: Rationale and design of the Community Youth Development Study. Prevention Science, 9, 178–190.PubMedCrossRef

Johnson, S. L. (2009). Improving the school environment to reduce school violence: A review of the literature. The Journal of School Health, 79, 451–465.PubMedCrossRef

Komro, K., Perry, C. L., Veblen-Mortenson, S., Farbakhsh, K., Toomey, T. L., Stigler, M. H., et al. (2008). Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction, 103, 606–618.PubMedCrossRef

Kumpfer, K. L., & Alvarado, R. (2003). Family-strengthening approaches for the prevention of youth problem behaviors. The American Psychologist, 58, 457–465.PubMedCrossRef

Lillehoj, C. J., Griffin, K. W., & Spoth, R. (2004). Program provider and observer ratings of school-based preventive intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31, 242–257.CrossRef

Melde, C., Esbensen, F.-A., & Tusinski, K. (2006). Addressing program fidelity using onsite observations and program provider descriptions of program delivery. Evaluation Review, 30, 714–740.PubMedCrossRef

National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Committee on the prevention of mental disorders and substance abuse among children, youth, and young adults: Research advances and promising interventions. Washington, DC: Board on Children, Youth, and Families, Division of Behavioral and Social Sciences and Education. The National Academies Press.

Polizzi Fox, D., Gottfredson, D. C., Kumpfer, K. L., & Beatty, P. (2004). Challenges in disseminating model programs: A qualitative analysis of the Strengthening Washington D.C. Families program. Clinical Child and Family Psychology Review, 7, 165–176.CrossRef

Prinz, R. J., Sanders, M. R., Shapiro, C. J., Whitaker, D. J., & Lutzker, J. R. (2009). Population-based prevention of child maltreatment: The US Triple P system population trial. Prevention Science, 10, 1–12.PubMedCrossRef

Ringwalt, C., Hanley, S., Vincus, A. A., Ennett, S. T., Rohrbach, L. A., & Bowling, J. M. (2008). The prevalence of effective substance use prevention curricula in the nation’s high schools. The Journal of Primary Prevention, 29, 479–488.PubMedCrossRef

Ringwalt, C., Vincus, A. A., Hanley, S., Ennett, S. T., Bowling, J. M., & Haws, S. (2011). The prevalence of evidence-based drug use prevention curricula in U.S. middle schools in 2008. Prevention Science, 12, 63–70.

Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRef

Saul, J., Duffy, J., Noonan, R., Lubell, K., Wandersman, A., Flaspohler, P., et al. (2008). Bridging science and practice in violence prevention: Addressing ten key challenges. American Journal of Community Psychology, 41, 197–205.PubMedCrossRef

Saul, J., Wandersman, A., Flaspohler, P., Duffy, J., Lubell, K., & Noonan, R. (2008). Research and action for bridging science and practice in prevention. American Journal of Community Psychology, 41, 165–170.PubMedCrossRef

Sloboda, Z., Pyakuryal, A., Stephens, P. C., Teasdale, B., Forrest, D., Stephens, R. C., et al. (2008). Reports of substance abuse prevention programming available in schools. Prevention Science, 9, 276–287.PubMedCrossRef

Title: Effects of Communities That Care on the Adoption and Implementation Fidelity of Evidence-Based Prevention Programs in Communities: Results from a Randomized Controlled Trial
Authors: Abigail A. Fagan
Michael W. Arthur
Koren Hanson
John S. Briney
J. David Hawkins
Publication date: 01-09-2011
Publisher: Springer US
Published in: Prevention Science / Issue 3/2011
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI: https://doi.org/10.1007/s11121-011-0226-5

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Effects of Communities That Care on the Adoption and Implementation Fidelity of Evidence-Based Prevention Programs in Communities: Results from a Randomized Controlled Trial

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2011

Unintended Pregnancy and Perinatal Depression Trajectories in Low-Income, High-Risk Hispanic Immigrants

The Prevention of Child and Adolescent Anxiety: A Meta-analytic Review

The Effects of Priming on a Public Health Campaign Targeting Cardiovascular Risks

Affective Antecedents of the Perceived Effectiveness of Antidrug Advertisements: An Analysis of Adolescents’ Momentary and Retrospective Evaluations

Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway

The Developmental Impact of Two First Grade Preventive Interventions on Aggressive/Disruptive Behavior in Childhood and Adolescence: An Application of Latent Transition Growth Mixture Modeling