Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Research

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Authors: Bo Wang, Bonita Stanton, Lynette Deveaux, Sonja Lunn, Glenda Rolle, Richard Adderley, Maxwell Poitier, Veronica Koci, Sharon Marshall, Perry Gomez

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

Intervention effects observed in efficacy trials are rarely replicated when the interventions are broadly disseminated, underscoring the need for more information about factors influencing real-life implementation and program impact. Using data from the ongoing national implementation of an evidence-based HIV prevention program [Focus on Youth in The Caribbean (FOYC)] in The Bahamas, this study examines factors influencing teachers’ patterns of implementation, the impact of teachers’ initial implementation of FOYC, and subsequent delivery of the booster sessions on students’ outcomes.

Methods

Data were collected from the 80 government elementary and 34 middle schools between 2011 and 2014, involving 208 grade 6, 75 grade 7, and 58 grade 8 teachers and 4411 students initially in grade 6 and followed for 3 years. Student outcomes include HIV/AIDS knowledge, reproductive health skills, self-efficacy, and intention to use protection. Data from teachers includes implementation and modification of the curriculum, attitudes towards the prevention program, comfort level with the curriculum, and attendance at training workshops. Structural equation modeling and mixed-effect modeling analyses were applied to examine the impact of teachers’ implementation.

Results

Teachers’ attitudes towards and comfort with the intervention curriculum, and attendance at the curriculum training workshop had a direct effect on teachers’ patterns of implementation, which had a direct effect on student outcomes. Teachers’ attitudes had a direct positive effect on student outcomes. Teachers’ training in interactive teaching methods and longer duration as teachers were positively associated with teachers’ comfort with the curriculum. High-quality implementation in grade 6 was significantly related to student outcomes in grades 6 and 7 post-implementation. Level of implementation of the booster sessions in grades 7 and 8 were likewise significantly related to subsequent student outcomes in both grades.

Conclusions

High-quality initial implementation of a prevention program is significantly related to better program outcomes. Poor subsequent delivery of booster sessions can undermine the positive effects from the initial implementation while strong subsequent delivery of booster sessions can partially overcome poor initial implementation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. doi:10.1186/1748-5908-7-17.CrossRef Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. doi:10.​1186/​1748-5908-7-17.CrossRef
2.
go back to reference Feldman MB, Silapaswan A, Schaefer N, Schermele D. Is there life after DEBI? Examining health behavior maintenance in the diffusion of effective behavioral interventions initiative. Am J Community Psychol. 2014;53(3-4):286–313.CrossRefPubMed Feldman MB, Silapaswan A, Schaefer N, Schermele D. Is there life after DEBI? Examining health behavior maintenance in the diffusion of effective behavioral interventions initiative. Am J Community Psychol. 2014;53(3-4):286–313.CrossRefPubMed
3.
go back to reference Galbraith JS, Stanton B, Boekeloo B, King W, Desmond S, Howard D, et al. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: lessons learned from the Focus on Kids diffusion case study. Health Educ Behav. 2009;36(3):532–49.CrossRefPubMed Galbraith JS, Stanton B, Boekeloo B, King W, Desmond S, Howard D, et al. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: lessons learned from the Focus on Kids diffusion case study. Health Educ Behav. 2009;36(3):532–49.CrossRefPubMed
4.
go back to reference Lundgren L, Amodeo M, Cohen A, Chassler D, Horowitz A. Modifications of evidence-based practices in community-based addiction treatment organizations: a qualitative research study. Addict Behav. 2011;36(6):630–5.CrossRefPubMed Lundgren L, Amodeo M, Cohen A, Chassler D, Horowitz A. Modifications of evidence-based practices in community-based addiction treatment organizations: a qualitative research study. Addict Behav. 2011;36(6):630–5.CrossRefPubMed
5.
go back to reference Collins Jr CB, Sapiano TN. Lessons learned from dissemination of evidence-based interventions for HIV prevention. Am J Prev Med. 2016;51(4 Suppl 2):S140–7.CrossRefPubMed Collins Jr CB, Sapiano TN. Lessons learned from dissemination of evidence-based interventions for HIV prevention. Am J Prev Med. 2016;51(4 Suppl 2):S140–7.CrossRefPubMed
6.
go back to reference Domitrovich CE, Bradshaw CP, Poduska JM, Hoagwood K, Buckley JA, Olin S, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv Sch Ment Health Promot. 2008;1(3):6–28.CrossRefPubMedPubMedCentral Domitrovich CE, Bradshaw CP, Poduska JM, Hoagwood K, Buckley JA, Olin S, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv Sch Ment Health Promot. 2008;1(3):6–28.CrossRefPubMedPubMedCentral
7.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.CrossRefPubMed Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.CrossRefPubMed
8.
go back to reference Renju JR, Andrew B, Medard L, Kishamawe C, Kimaryo M, Changalucha J, et al. Scaling up adolescent sexual and reproductive health interventions through existing government systems? A detailed process evaluation of a school-based intervention in Mwanza region in the northwest of Tanzania. J Adolesc Health. 2011;48(1):79–86.CrossRefPubMed Renju JR, Andrew B, Medard L, Kishamawe C, Kimaryo M, Changalucha J, et al. Scaling up adolescent sexual and reproductive health interventions through existing government systems? A detailed process evaluation of a school-based intervention in Mwanza region in the northwest of Tanzania. J Adolesc Health. 2011;48(1):79–86.CrossRefPubMed
9.
go back to reference Sawyer MG, Harchak TF, Spence SH, Bond L, Graetz B, Kay D, et al. School-based prevention of depression: a 2-year follow-up of a randomized controlled trial of the beyond blue schools research initiative. J Adolesc Health. 2010;47(3):297–304.CrossRefPubMed Sawyer MG, Harchak TF, Spence SH, Bond L, Graetz B, Kay D, et al. School-based prevention of depression: a 2-year follow-up of a randomized controlled trial of the beyond blue schools research initiative. J Adolesc Health. 2010;47(3):297–304.CrossRefPubMed
10.
go back to reference Sarma H, Oliveras E. Implementing HIV/AIDS education: impact of teachers' training on HIV/AIDS education in Bangladesh. J Health Popul Nutr. 2013;31(1):20–7.CrossRefPubMedPubMedCentral Sarma H, Oliveras E. Implementing HIV/AIDS education: impact of teachers' training on HIV/AIDS education in Bangladesh. J Health Popul Nutr. 2013;31(1):20–7.CrossRefPubMedPubMedCentral
11.
go back to reference Ozer EJ, Wanis MG, Bazell N. Diffusion of school-based prevention programs in two urban districts: adaptations, rationales, and suggestions for change. Prev Sci. 2010;11(1):42–55.CrossRefPubMed Ozer EJ, Wanis MG, Bazell N. Diffusion of school-based prevention programs in two urban districts: adaptations, rationales, and suggestions for change. Prev Sci. 2010;11(1):42–55.CrossRefPubMed
12.
go back to reference Rijsdijk LE, Bos AE, Lie R, Leerlooijer JN, Eiling E, Atema V, et al. Implementation of The World Starts With Me, a comprehensive rights-based sex education programme in Uganda. Health Educ Res. 2014;29(2):340–53.CrossRefPubMed Rijsdijk LE, Bos AE, Lie R, Leerlooijer JN, Eiling E, Atema V, et al. Implementation of The World Starts With Me, a comprehensive rights-based sex education programme in Uganda. Health Educ Res. 2014;29(2):340–53.CrossRefPubMed
13.
go back to reference Ennett ST, Haws S, Ringwalt CL, Vincus AA, Hanley S, Bowling JM, et al. Evidence-based practice in school substance use prevention: fidelity of implementation under real-world conditions. Health Educ Res. 2011;26(2):361–71.CrossRefPubMedPubMedCentral Ennett ST, Haws S, Ringwalt CL, Vincus AA, Hanley S, Bowling JM, et al. Evidence-based practice in school substance use prevention: fidelity of implementation under real-world conditions. Health Educ Res. 2011;26(2):361–71.CrossRefPubMedPubMedCentral
14.
go back to reference Draper CE, Nemutandani SM, Grimsrud AT, Rudolph M, Kolbe-Alexander TL, de Kock L, et al. Qualitative evaluation of a physical activity-based chronic disease prevention program in a low-income, rural South African setting. Rural Remote Health. 2010;10(3):1467.PubMed Draper CE, Nemutandani SM, Grimsrud AT, Rudolph M, Kolbe-Alexander TL, de Kock L, et al. Qualitative evaluation of a physical activity-based chronic disease prevention program in a low-income, rural South African setting. Rural Remote Health. 2010;10(3):1467.PubMed
15.
go back to reference Zimmerman RS, DiClemente RJ, Andrus JK, Hosein EN, editors. Introduction to global health promotion. San Francisco: Jossey-Bass; 2016. Zimmerman RS, DiClemente RJ, Andrus JK, Hosein EN, editors. Introduction to global health promotion. San Francisco: Jossey-Bass; 2016.
19.
go back to reference Flaspohler P, Lesesne CA, Puddy RW, Smith E, Wandersman A. Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. Am J Community Psychol. 2012;50(3-4):271–81.CrossRefPubMedPubMedCentral Flaspohler P, Lesesne CA, Puddy RW, Smith E, Wandersman A. Advances in bridging research and practice: introduction to the second special issue on the interactive system framework for dissemination and implementation. Am J Community Psychol. 2012;50(3-4):271–81.CrossRefPubMedPubMedCentral
20.
go back to reference Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.CrossRefPubMed Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4–23.CrossRefPubMed
21.
go back to reference Han SS, Weiss B. Sustainability of teacher implementation of school-based mental health programs. J Abnorm Child Psychol. 2005;33(6):665–79.CrossRefPubMed Han SS, Weiss B. Sustainability of teacher implementation of school-based mental health programs. J Abnorm Child Psychol. 2005;33(6):665–79.CrossRefPubMed
22.
go back to reference Deveaux L, Stanton B, Lunn S, Cottrell L, Yu S, Brathwaite N, et al. Reduction in human immunodeficiency virus risk among youth in developing countries. Arch Pediatr Adolesc Med. 2007;161(12):1130–9.CrossRefPubMed Deveaux L, Stanton B, Lunn S, Cottrell L, Yu S, Brathwaite N, et al. Reduction in human immunodeficiency virus risk among youth in developing countries. Arch Pediatr Adolesc Med. 2007;161(12):1130–9.CrossRefPubMed
24.
go back to reference Gong J, Stanton B, Lunn S, Deveaux L, Li X, Marshall S, et al. Effects through 24 months of an HIV/AIDS prevention intervention program based on protection motivation theory among preadolescents in the Bahamas. Pediatrics. 2009;123(5):e917–28.CrossRefPubMedPubMedCentral Gong J, Stanton B, Lunn S, Deveaux L, Li X, Marshall S, et al. Effects through 24 months of an HIV/AIDS prevention intervention program based on protection motivation theory among preadolescents in the Bahamas. Pediatrics. 2009;123(5):e917–28.CrossRefPubMedPubMedCentral
25.
go back to reference Chen X, Stanton B, Gomez P, Lunn S, Deveaux L, Brathwaite N, et al. Effects on condom use of an HIV prevention programme 36 months postintervention: a cluster randomized controlled trial among Bahamian youth. Int J STD AIDS. 2010;21(9):622–30.CrossRefPubMedPubMedCentral Chen X, Stanton B, Gomez P, Lunn S, Deveaux L, Brathwaite N, et al. Effects on condom use of an HIV prevention programme 36 months postintervention: a cluster randomized controlled trial among Bahamian youth. Int J STD AIDS. 2010;21(9):622–30.CrossRefPubMedPubMedCentral
26.
go back to reference Stanton B, Wang B, Deveaux L, Lunn S, Rolle G, Mortimer A, et al. Teachers' patterns of implementation of an evidence-based intervention and their impact on student outcomes: results from a nationwide dissemination over 24-months follow-up. AIDS Behav. 2015;19(10):1828–40.CrossRefPubMedPubMedCentral Stanton B, Wang B, Deveaux L, Lunn S, Rolle G, Mortimer A, et al. Teachers' patterns of implementation of an evidence-based intervention and their impact on student outcomes: results from a nationwide dissemination over 24-months follow-up. AIDS Behav. 2015;19(10):1828–40.CrossRefPubMedPubMedCentral
27.
go back to reference Blase KA, Fixsen DL. Core intervention components: identifying and operationalizing “what makes programs work”. Washington: U.S. Department of Health and Human Services; 2013. Blase KA, Fixsen DL. Core intervention components: identifying and operationalizing “what makes programs work”. Washington: U.S. Department of Health and Human Services; 2013.
28.
go back to reference Stanton B, Deveaux L, Lunn S, Yu S, Brathwaite N, Li X, et al. Condom-use skills checklist: a proxy for assessing condom-use knowledge and skills when direct observation is not possible. J Health Popul Nutr. 2009;27(3):406–13.CrossRefPubMedPubMedCentral Stanton B, Deveaux L, Lunn S, Yu S, Brathwaite N, Li X, et al. Condom-use skills checklist: a proxy for assessing condom-use knowledge and skills when direct observation is not possible. J Health Popul Nutr. 2009;27(3):406–13.CrossRefPubMedPubMedCentral
29.
go back to reference Muthén LK, Muthén BO. Mplus user’s guide. 7th ed. Los Angeles: Muthén & Muthén; 2012. Muthén LK, Muthén BO. Mplus user’s guide. 7th ed. Los Angeles: Muthén & Muthén; 2012.
30.
go back to reference Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6(1):53–60. Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6(1):53–60.
31.
go back to reference Wang B, Deveaux L, Knowles V, Koci V, Rolle G, Lunn S, et al. Fidelity of implementation of an evidence-based HIV prevention program among Bahamian sixth grade students. Prev Sci. 2015;16(1):110–21.CrossRefPubMed Wang B, Deveaux L, Knowles V, Koci V, Rolle G, Lunn S, et al. Fidelity of implementation of an evidence-based HIV prevention program among Bahamian sixth grade students. Prev Sci. 2015;16(1):110–21.CrossRefPubMed
Metadata
Title
Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention
Authors
Bo Wang
Bonita Stanton
Lynette Deveaux
Sonja Lunn
Glenda Rolle
Richard Adderley
Maxwell Poitier
Veronica Koci
Sharon Marshall
Perry Gomez
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-016-0539-7

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue