Skip to main content
Top
Published in: Prevention Science 7/2016

01-10-2016

Methodological and Design Considerations in Evaluating the Impact of Prevention Programs on Violence and Related Health Outcomes

Authors: Greta M. Massetti, Thomas R. Simon, Deborah Gorman Smith

Published in: Prevention Science | Issue 7/2016

Login to get access

Abstract

Drawing on research that has identified specific predictors and trajectories of risk for violence and related negative outcomes, a multitude of small- and large-scale preventive interventions for specific risk behaviors have been developed, implemented, and evaluated. One of the principal challenges of these approaches is that a number of separate problem-specific programs targeting different risk areas have emerged. However, as many negative health behaviors such as substance abuse and violence share a multitude of risk factors, many programs target identical risk factors. There are opportunities to understand whether evidence-based programs can be leveraged for potential effects across a spectrum of outcomes and over time. Some recent work has documented longitudinal effects of evidence-based interventions on generalized outcomes. This work has potential for advancing our understanding of the effectiveness of promising and evidence-based prevention strategies. However, conducting longitudinal follow-up of established interventions presents a number of methodological and design challenges. To answer some of these questions, the Centers for Disease Control and Prevention convened a panel of multidisciplinary experts to discuss opportunities to take advantage of evaluations of early prevention programs and evaluating multiple long-term outcomes. This special section of the journal Prevention Science includes a series of papers that begin to address the relevant considerations for conducting longitudinal follow-up evaluation research. This collection of papers is intended to inform our understanding of the challenges and strategies for conducting longitudinal follow-up evaluation research that could be used to drive future research endeavors.
Literature
go back to reference Basile, K. C., DeGue, S., Jones, K., Freire, K., Dills, J., Smith, S. G., & Raiford, J. L. (2016). STOP SV: A technical package to prevent sexual violence. Atlanta: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention. Basile, K. C., DeGue, S., Jones, K., Freire, K., Dills, J., Smith, S. G., & Raiford, J. L. (2016). STOP SV: A technical package to prevent sexual violence. Atlanta: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.
go back to reference Bor, J., Moscoe, E., Mutevedzi, P., Newell, M.-L., & Bärnighausen, T. (2014). Regression discontinuity designs in epidemiology: Causal inference without randomized trials. Epidemiology (Cambridge, Mass), 25, 729–737.CrossRef Bor, J., Moscoe, E., Mutevedzi, P., Newell, M.-L., & Bärnighausen, T. (2014). Regression discontinuity designs in epidemiology: Causal inference without randomized trials. Epidemiology (Cambridge, Mass), 25, 729–737.CrossRef
go back to reference Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: Results of a 3-year study. Journal of Consulting and Clinical Psychology 58, 437–446. Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., Botvin, E. M. (1990). Preventing adolescent drug abuse through a multimodal cognitive-behavioral approach: Results of a 3-year study. Journal of Consulting and Clinical Psychology 58, 437–446.
go back to reference Botvin, G. J., Griffin, K. W., Nichols, T. D. (2006). Preventing youth violence and delinquency through a universal school-based prevention approach. Prevention Science 7, 403–408. Botvin, G. J., Griffin, K. W., Nichols, T. D. (2006). Preventing youth violence and delinquency through a universal school-based prevention approach. Prevention Science 7, 403–408.
go back to reference Capaldi, D., Kerr, D. C. R., Eddy, J. M., & Tiberio, S. S. (2016). Understanding persistence and desistence in crime and risk behaviors in adulthood: Implications for theory and prevention. Prevention Science. Capaldi, D., Kerr, D. C. R., Eddy, J. M., & Tiberio, S. S. (2016). Understanding persistence and desistence in crime and risk behaviors in adulthood: Implications for theory and prevention. Prevention Science.
go back to reference Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Moscicki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.CrossRefPubMed Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Moscicki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.CrossRefPubMed
go back to reference Fortson, B. L., Klevens, J., Merrick, M. T., Gilbert, L. K., & Alexander, S. P. (2016). Preventing child abuse and neglect: A technical package for policy, norm, and programmatic activities. Atlanta: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention. Fortson, B. L., Klevens, J., Merrick, M. T., Gilbert, L. K., & Alexander, S. P. (2016). Preventing child abuse and neglect: A technical package for policy, norm, and programmatic activities. Atlanta: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention.
go back to reference Foshee, V. A., Reyes, L. M., Agnew-Brune, C. B., Simon, T. R., Vagi, K. J., Lee, R. D., & Suchindran, C. (2014). The effects of the evidence-based Safe Dates dating abuse prevention program on other youth violence outcomes. Prevention Science, 15, 907–916.CrossRefPubMed Foshee, V. A., Reyes, L. M., Agnew-Brune, C. B., Simon, T. R., Vagi, K. J., Lee, R. D., & Suchindran, C. (2014). The effects of the evidence-based Safe Dates dating abuse prevention program on other youth violence outcomes. Prevention Science, 15, 907–916.CrossRefPubMed
go back to reference Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16, 893–926.CrossRefPubMedPubMedCentral Gottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16, 893–926.CrossRefPubMedPubMedCentral
go back to reference Griffin, K. W., Botvin, G. J., Nichols, T. R. (2006). Effects of a school-based drug abuse prevention program for adolescents on HIV risk behavior in young adulthood. Prevention Science 7, 103–112. Griffin, K. W., Botvin, G. J., Nichols, T. R. (2006). Effects of a school-based drug abuse prevention program for adolescents on HIV risk behavior in young adulthood. Prevention Science 7, 103–112.
go back to reference Hawkins, J. D., Herrenkohl, T. I., Farrington, D. P., Brewer, D., Catalano, R. F., Harachi, T. W., & Cothern, L. (2000). Predictors of youth violence. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.CrossRef Hawkins, J. D., Herrenkohl, T. I., Farrington, D. P., Brewer, D., Catalano, R. F., Harachi, T. W., & Cothern, L. (2000). Predictors of youth violence. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.CrossRef
go back to reference Hawkins, J. D., Oesterle, S., Brown, E. C., Monahan, K. C., Abbott, R. D., Arthur, M. W., & Catalano, R. F. (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the Communities That Care prevention system in a randomized trial. Archives of Pediatric Adolescent Medicine, 166, 141–148.CrossRef Hawkins, J. D., Oesterle, S., Brown, E. C., Monahan, K. C., Abbott, R. D., Arthur, M. W., & Catalano, R. F. (2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the Communities That Care prevention system in a randomized trial. Archives of Pediatric Adolescent Medicine, 166, 141–148.CrossRef
go back to reference Herrenkohl, T. I., Maguin, E., Hill, K. G., Hawkins, J. D., Abbott, R. D., & Catalano, R. F. (2000). Developmental risk factors for youth violence. Journal of Adolescent Health, 26, 176–186.CrossRefPubMed Herrenkohl, T. I., Maguin, E., Hill, K. G., Hawkins, J. D., Abbott, R. D., & Catalano, R. F. (2000). Developmental risk factors for youth violence. Journal of Adolescent Health, 26, 176–186.CrossRefPubMed
go back to reference Hill, K. G., Woodward, D., Woelfel, T. P., & Hawkins, J. D. (2016). Planning for long-term follow-up: Strategies learned from longitudinal studies. Prevention Science. Hill, K. G., Woodward, D., Woelfel, T. P., & Hawkins, J. D. (2016). Planning for long-term follow-up: Strategies learned from longitudinal studies. Prevention Science.
go back to reference Kellam, S. G., Wang, W., Mackenzie, A. C. L., Brown, C. H., Ompad, D. C., Or, F., Ialongo, N. S., Poduska, J. M., & Windham, A. (2014). The impact of the Good Behavior Game, a universal classroom based preventive intervention in first and second grades, on high risk sexual behaviors and drug abuse and dependence disorders in young adulthood. Prevention Science, 15, S6–S18.CrossRefPubMed Kellam, S. G., Wang, W., Mackenzie, A. C. L., Brown, C. H., Ompad, D. C., Or, F., Ialongo, N. S., Poduska, J. M., & Windham, A. (2014). The impact of the Good Behavior Game, a universal classroom based preventive intervention in first and second grades, on high risk sexual behaviors and drug abuse and dependence disorders in young adulthood. Prevention Science, 15, S6–S18.CrossRefPubMed
go back to reference Ludwig, J., & Miller, D. L. (2007). Does head start improve children’s life chances? Evidence from a regression discontinuity design. Quarterly Journal of Economics, 122, 159–208.CrossRef Ludwig, J., & Miller, D. L. (2007). Does head start improve children’s life chances? Evidence from a regression discontinuity design. Quarterly Journal of Economics, 122, 159–208.CrossRef
go back to reference Matjasko, J. L., Vivolo-Kantor, A. M., Massetti, G. M., Holland, K. M., Holt, M. K., & Dela Cruz, J. (2012). A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews. Aggression and Violent Behavior, 17, 540–552.CrossRef Matjasko, J. L., Vivolo-Kantor, A. M., Massetti, G. M., Holland, K. M., Holt, M. K., & Dela Cruz, J. (2012). A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews. Aggression and Violent Behavior, 17, 540–552.CrossRef
go back to reference Miller Brotman, L., Gouley, K. K., Huang, K., Kamboukos, D., Fratto, C., & Pine, D. S. (2007). Effects of a psychosocial family-based preventive intervention on cortisol response to a social challenge in preschoolers at high risk for antisocial behavior. Archives of General Psychiatry, 64, 1172–1179.CrossRef Miller Brotman, L., Gouley, K. K., Huang, K., Kamboukos, D., Fratto, C., & Pine, D. S. (2007). Effects of a psychosocial family-based preventive intervention on cortisol response to a social challenge in preschoolers at high risk for antisocial behavior. Archives of General Psychiatry, 64, 1172–1179.CrossRef
go back to reference Oesterle, S., Hawkins, J. D., Kuklinski, M. R., Fagan, A. A., Fleming, C., Rhew, I. C., Brown, E. C., Abbott, R. D., & Catalano, R. F. (2015). Effects of communities that care on males’ and females’ drug use and delinquency 9 years after baseline in a community-randomized trial. American Journal of Community Psychology, 56, 217–228.CrossRefPubMed Oesterle, S., Hawkins, J. D., Kuklinski, M. R., Fagan, A. A., Fleming, C., Rhew, I. C., Brown, E. C., Abbott, R. D., & Catalano, R. F. (2015). Effects of communities that care on males’ and females’ drug use and delinquency 9 years after baseline in a community-randomized trial. American Journal of Community Psychology, 56, 217–228.CrossRefPubMed
go back to reference Petras, H. (2016). Longitudinal assessment design and statistical power for detecting an intervention impact. Prevention Science. Petras, H. (2016). Longitudinal assessment design and statistical power for detecting an intervention impact. Prevention Science.
go back to reference Reynolds, A., & Ou, S. (2016). Generative mechanisms in early childhood interventions: A confirmatory research framework for prevention. Prevention Science. Reynolds, A., & Ou, S. (2016). Generative mechanisms in early childhood interventions: A confirmatory research framework for prevention. Prevention Science.
go back to reference Spoth, R. L., Redmond, C., Trudeau, L., Shin, C. (2002). Longitudinal substance initiation outcomes for a universal preventive intervention combining family and school programs. Psychology of Addictive Behaviors 16, 129–134. Spoth, R. L., Redmond, C., Trudeau, L., Shin, C. (2002). Longitudinal substance initiation outcomes for a universal preventive intervention combining family and school programs. Psychology of Addictive Behaviors 16, 129–134.
go back to reference Spoth, R. L., Randall, G. K., Trudeau, L., Shin, C., Redmond, C. (2008). Substance use outcomes 5½ years past baseline for partnership-based, family-school preventive interventions. Drug and Alcohol Dependence 96, 57–68. Spoth, R. L., Randall, G. K., Trudeau, L., Shin, C., Redmond, C. (2008). Substance use outcomes 5½ years past baseline for partnership-based, family-school preventive interventions. Drug and Alcohol Dependence 96, 57–68.
go back to reference Spoth, R. L., Trudeau, L., Guyll, M., Shin, C., & Redmond, C. (2009). Universal intervention effects on substance use among young adults mediated by delayed adolescent substance initiation. Journal of Consulting and Clinical Psychology, 77, 620–632.CrossRefPubMedPubMedCentral Spoth, R. L., Trudeau, L., Guyll, M., Shin, C., & Redmond, C. (2009). Universal intervention effects on substance use among young adults mediated by delayed adolescent substance initiation. Journal of Consulting and Clinical Psychology, 77, 620–632.CrossRefPubMedPubMedCentral
go back to reference Spoth, R., Clair, S., & Trudeau, L. (2014). Universal family-focused intervention with young adolescents: Effects on health-risking sexual behaviors and STDs among young adults. Prevention Science, 15, S47–S58.CrossRefPubMed Spoth, R., Clair, S., & Trudeau, L. (2014). Universal family-focused intervention with young adolescents: Effects on health-risking sexual behaviors and STDs among young adults. Prevention Science, 15, S47–S58.CrossRefPubMed
Metadata
Title
Methodological and Design Considerations in Evaluating the Impact of Prevention Programs on Violence and Related Health Outcomes
Authors
Greta M. Massetti
Thomas R. Simon
Deborah Gorman Smith
Publication date
01-10-2016
Publisher
Springer US
Published in
Prevention Science / Issue 7/2016
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-016-0704-x

Other articles of this Issue 7/2016

Prevention Science 7/2016 Go to the issue