Skip to main content
Top
Published in: Prevention Science 1/2015

Open Access 01-01-2015

Fidelity of Implementation of an Evidence-Based HIV Prevention Program among Bahamian Sixth Grade Students

Authors: Bo Wang, Lynette Deveaux, Valerie Knowles, Veronica Koci, Glenda Rolle, Sonja Lunn, Xiaoming Li, Bonita Stanton

Published in: Prevention Science | Issue 1/2015

Login to get access

Abstract

The Bahamian Ministry of Education has elected to implement at a national level in all Bahamian government grade six classes an evidence-based HIV prevention intervention [Focus on Youth in the Caribbean (FOYC)]. This study explores fidelity of implementation of the intervention, factors that may influence implementation fidelity, and the impact of variations in the implementation fidelity on student outcomes. Data were collected in the first wave of national implementation in 2011, involving 35 government primary schools and 110 teachers and 2,811 students. Structural equation modeling was performed to examine the relationships among factors which facilitated or impeded teachers’ implementation of FOYC. Results indicate that teachers taught 16.3 out of 30 core activities, 24.9 out of 46 total activities, and 4.4 out of 8 sessions on average. The strongest predictor of implementation fidelity was teacher comfort level with the FOYC curriculum. Teachers who did not perceive the FOYC intervention to be important for their students or who had attended only part of a FOYC training workshop were more likely to change the curriculum. Increased duration of experience as a teacher (>10 years) was negatively associated with fidelity of implementation. Teacher’s perception of the importance of the FOYC intervention and implementation fidelity had direct positive effects on students’ HIV/AIDS knowledge, reproductive health skills, protective intentions, and self-efficacy. Youth did not appear to benefit from FOYC if two or fewer sessions were delivered. We concluded that an evidence-based HIV prevention intervention can be implemented at a national level. Prior training of teachers in the intervention curriculum, teacher perception of the importance of the intervention, and fewer years as a teacher are associated with implementation fidelity. Implementation fidelity is associated with improved student outcomes.
Literature
go back to reference Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K. K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: a diffusion of innovations model. Prevention Science, 9, 264–275.CrossRefPubMed Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K. K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: a diffusion of innovations model. Prevention Science, 9, 264–275.CrossRefPubMed
go back to reference Brown, C. H., Mohr, D. C., Gallo, C. G., Mader, C., Palinkas, L., Wingood, G., et al. (2013). A computational future for preventing HIV in minority communities: How advanced technology can improve implementation of effective programs. Journal Acquired Immune Deficiency Syndromes, 63, S72–S84.CrossRef Brown, C. H., Mohr, D. C., Gallo, C. G., Mader, C., Palinkas, L., Wingood, G., et al. (2013). A computational future for preventing HIV in minority communities: How advanced technology can improve implementation of effective programs. Journal Acquired Immune Deficiency Syndromes, 63, S72–S84.CrossRef
go back to reference Collins, C., Harshbarger, C., Sawyer, R., & Hamdallah, M. (2006). The diffusion of effective behavioral interventions project: Development, implementation, and lessons learned. AIDS Education and Prevention, 18, 5–20.CrossRefPubMed Collins, C., Harshbarger, C., Sawyer, R., & Hamdallah, M. (2006). The diffusion of effective behavioral interventions project: Development, implementation, and lessons learned. AIDS Education and Prevention, 18, 5–20.CrossRefPubMed
go back to reference Deveaux, L., Stanton, B., Lunn, S., Cottrell, L., Yu, S., Brathwaite, N., et al. (2007). Reduction in human immunodeficiency virus risk among youth in developing countries. Archives of Pediatrics & Adolescent Medicine, 161, 1130–1139.CrossRef Deveaux, L., Stanton, B., Lunn, S., Cottrell, L., Yu, S., Brathwaite, N., et al. (2007). Reduction in human immunodeficiency virus risk among youth in developing countries. Archives of Pediatrics & Adolescent Medicine, 161, 1130–1139.CrossRef
go back to reference Deveaux, L., Lunn, S., Bain, R. M., Gomez, P., Kelly, T., Brathwaite, N., et al. (2011). Focus on youth in the Caribbean: Beyond the numbers. Journal of the International Association of Physicians in AIDS Care, 10, 316–325.PubMedCentralCrossRefPubMed Deveaux, L., Lunn, S., Bain, R. M., Gomez, P., Kelly, T., Brathwaite, N., et al. (2011). Focus on youth in the Caribbean: Beyond the numbers. Journal of the International Association of Physicians in AIDS Care, 10, 316–325.PubMedCentralCrossRefPubMed
go back to reference Draper, C. E., Nemutandani, S. M., Grimsrud, A. T., Rudolph, M., Kolbe-Alexander, T. L., de Kock, L., et al. (2010). Qualitative evaluation of a physical activity-based chronic disease prevention program in a low-income, rural South African setting. Rural and Remote Health, 10, 1467.PubMed Draper, C. E., Nemutandani, S. M., Grimsrud, A. T., Rudolph, M., Kolbe-Alexander, T. L., de Kock, L., et al. (2010). Qualitative evaluation of a physical activity-based chronic disease prevention program in a low-income, rural South African setting. Rural and Remote Health, 10, 1467.PubMed
go back to reference Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.CrossRefPubMed Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.CrossRefPubMed
go back to reference Galbraith, J. S., Stanton, B., Boekeloo, B., King, W., Desmond, S., Howard, D., et al. (2009). Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: Lessons learned from the focus on kid’s diffusion case study. Health Education & Behavior, 36, 532–549.CrossRef Galbraith, J. S., Stanton, B., Boekeloo, B., King, W., Desmond, S., Howard, D., et al. (2009). Exploring implementation and fidelity of evidence-based behavioral interventions for HIV prevention: Lessons learned from the focus on kid’s diffusion case study. Health Education & Behavior, 36, 532–549.CrossRef
go back to reference Gong, J., Stanton, B., Lunn, S., Deveaux, L., Li, X., Marshall, S., et al. (2009). Effects through 24 months of an HIV/AIDS prevention intervention program based on protection motivation theory among preadolescents in the Bahamas. Pediatrics, 123, e917–e928.PubMedCentralCrossRefPubMed Gong, J., Stanton, B., Lunn, S., Deveaux, L., Li, X., Marshall, S., et al. (2009). Effects through 24 months of an HIV/AIDS prevention intervention program based on protection motivation theory among preadolescents in the Bahamas. Pediatrics, 123, e917–e928.PubMedCentralCrossRefPubMed
go back to reference Hatcher, L. (2005). A step-by-step approach to using the SAS system for factor analysis and structural equation modeling. Cary, NC: SAS Institute Inc. Hatcher, L. (2005). A step-by-step approach to using the SAS system for factor analysis and structural equation modeling. Cary, NC: SAS Institute Inc.
go back to reference Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef
go back to reference International Group on Analysis of Trends in HIV Prevalence and Behaviours in Young People in Countries most Affected by HIV. (2010). Trends in HIV prevalence and sexual behaviour among young people aged 15–24 years in countries most affected by HIV. Sexually Transmitted Infections, 86, ii72–ii83. International Group on Analysis of Trends in HIV Prevalence and Behaviours in Young People in Countries most Affected by HIV. (2010). Trends in HIV prevalence and sexual behaviour among young people aged 15–24 years in countries most affected by HIV. Sexually Transmitted Infections, 86, ii72–ii83.
go back to reference Kelly, J. A., Heckman, T. G., Stevenson, L. Y., Williams, P. N., Ertl, T., Hays, R. B., et al. (2000). Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12, 87–98.PubMed Kelly, J. A., Heckman, T. G., Stevenson, L. Y., Williams, P. N., Ertl, T., Hays, R. B., et al. (2000). Transfer of research-based HIV prevention interventions to community service providers: Fidelity and adaptation. AIDS Education and Prevention, 12, 87–98.PubMed
go back to reference Knowles, V., Kaljee, L., Deveaux, L., Lunn, S., Rolle, G., & Stanton, B. (2012). National implementation of an evidence-based HIV prevention and reproductive health program for Bahamian youth. The International Electronic Journal of Health Education, 15, 173–190.PubMedCentralPubMed Knowles, V., Kaljee, L., Deveaux, L., Lunn, S., Rolle, G., & Stanton, B. (2012). National implementation of an evidence-based HIV prevention and reproductive health program for Bahamian youth. The International Electronic Journal of Health Education, 15, 173–190.PubMedCentralPubMed
go back to reference Lyles, C. M., Kay, L. S., Crepaz, N., Herbst, J. H., Passin, W. F., Kim, A. S., et al. (2007). Best-evidence interventions: Findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000–2004. American Journal of Public Health, 97, 133–143.PubMedCentralCrossRefPubMed Lyles, C. M., Kay, L. S., Crepaz, N., Herbst, J. H., Passin, W. F., Kim, A. S., et al. (2007). Best-evidence interventions: Findings from a systematic review of HIV behavioral interventions for US populations at high risk, 2000–2004. American Journal of Public Health, 97, 133–143.PubMedCentralCrossRefPubMed
go back to reference McGrew, J. H., Bond, G. R., Dietzen, L., & Salyers, M. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670–678.CrossRefPubMed McGrew, J. H., Bond, G. R., Dietzen, L., & Salyers, M. (1994). Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology, 62, 670–678.CrossRefPubMed
go back to reference Mihalic, S. F., Fagan, A. A., & Argamaso, S. (2008). Implementing the LifeSkills training drug prevention program: Factors related to implementation fidelity. Implementation Science, 3, 5.PubMedCentralCrossRefPubMed Mihalic, S. F., Fagan, A. A., & Argamaso, S. (2008). Implementing the LifeSkills training drug prevention program: Factors related to implementation fidelity. Implementation Science, 3, 5.PubMedCentralCrossRefPubMed
go back to reference Muthén, L. K., & Muthén, B. O. (2012). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (2012). Mplus User’s Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
go back to reference Parcel, G. S., Ross, J. G., Lavin, A. T., Portnoy, B., Nelson, G. D., & Winters, F. (1991). Enhancing implementation of the teenage health teaching modules. The Journal of School Health, 61, 35–38.CrossRefPubMed Parcel, G. S., Ross, J. G., Lavin, A. T., Portnoy, B., Nelson, G. D., & Winters, F. (1991). Enhancing implementation of the teenage health teaching modules. The Journal of School Health, 61, 35–38.CrossRefPubMed
go back to reference Payton, J. W., Wardlaw, D. M., Graczyk, P. A., Bloodworth, M. R., Tompsett, C. J., & Weissberg, R. P. (2000). Social and emotional learning: a framework for promoting mental health and reducing risk behavior in children and youth. The Journal of School Health, 70, 179–185.CrossRefPubMed Payton, J. W., Wardlaw, D. M., Graczyk, P. A., Bloodworth, M. R., Tompsett, C. J., & Weissberg, R. P. (2000). Social and emotional learning: a framework for promoting mental health and reducing risk behavior in children and youth. The Journal of School Health, 70, 179–185.CrossRefPubMed
go back to reference Perry, C. L., Murray, D. M., & Griffin, G. (1990). Evaluating the statewide dissemination of smoking prevention curricula: Factors in teacher compliance. The Journal of School Health, 60, 501–504.CrossRefPubMed Perry, C. L., Murray, D. M., & Griffin, G. (1990). Evaluating the statewide dissemination of smoking prevention curricula: Factors in teacher compliance. The Journal of School Health, 60, 501–504.CrossRefPubMed
go back to reference Perry, C. L., Sellers, D. E., Johnson, C., Pedersen, S., Bachman, K. J., Parcel, G. S., et al. (1997). The Child and Adolescent Trial for Cardiovascular Health (CATCH): Intervention, implementation, and feasibility for elementary schools in the United States. Health Education & Behavior, 24, 716–735. Perry, C. L., Sellers, D. E., Johnson, C., Pedersen, S., Bachman, K. J., Parcel, G. S., et al. (1997). The Child and Adolescent Trial for Cardiovascular Health (CATCH): Intervention, implementation, and feasibility for elementary schools in the United States. Health Education & Behavior, 24, 716–735.
go back to reference Rebchook, G. M., Kegeles, S. M., Huebner, D., & TRIP Research Team. (2006). Translating research into practice: the dissemination and initial implementation of an evidence-based HIV prevention program. AIDS Education and Prevention, 18, 119–136.CrossRefPubMed Rebchook, G. M., Kegeles, S. M., Huebner, D., & TRIP Research Team. (2006). Translating research into practice: the dissemination and initial implementation of an evidence-based HIV prevention program. AIDS Education and Prevention, 18, 119–136.CrossRefPubMed
go back to reference Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.CrossRefPubMed Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.CrossRefPubMed
go back to reference Stanton, B., Deveaux, L., Lunn, S., Yu, S., Brathwaite, N., Li, X., et al. (2009). Condom-use skills checklist: a proxy for assessing condom-use knowledge and skills when direct observation is not possible. Journal of Health, Population and Nutrition, 27, 406–413.CrossRef Stanton, B., Deveaux, L., Lunn, S., Yu, S., Brathwaite, N., Li, X., et al. (2009). Condom-use skills checklist: a proxy for assessing condom-use knowledge and skills when direct observation is not possible. Journal of Health, Population and Nutrition, 27, 406–413.CrossRef
go back to reference Stanton, B., Chen, X., Koci, V., Deveaux, L., Lunn, S., Harris, C., et al. (2012). Effect of a grade 6 HIV risk reduction intervention four years later among students who were and were not enrolled in the study trial. The Journal of Adolescent Health, 50, 243–249.PubMedCentralCrossRefPubMed Stanton, B., Chen, X., Koci, V., Deveaux, L., Lunn, S., Harris, C., et al. (2012). Effect of a grade 6 HIV risk reduction intervention four years later among students who were and were not enrolled in the study trial. The Journal of Adolescent Health, 50, 243–249.PubMedCentralCrossRefPubMed
Metadata
Title
Fidelity of Implementation of an Evidence-Based HIV Prevention Program among Bahamian Sixth Grade Students
Authors
Bo Wang
Lynette Deveaux
Valerie Knowles
Veronica Koci
Glenda Rolle
Sonja Lunn
Xiaoming Li
Bonita Stanton
Publication date
01-01-2015
Publisher
Springer US
Published in
Prevention Science / Issue 1/2015
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-014-0486-y

Other articles of this Issue 1/2015

Prevention Science 1/2015 Go to the issue