Skip to main content
Top
Published in: Prevention Science 8/2020

01-11-2020 | Contraception

Cost analysis of a randomized trial of Getting to Outcomes implementation support for a teen pregnancy prevention program offered in Boys and Girls Clubs in Alabama and Georgia

Authors: Patricia M. Herman, Matthew Chinman, Patricia Ebener, Patrick S. Malone, Joie Acosta

Published in: Prevention Science | Issue 8/2020

Login to get access

Abstract

Implementation support can improve outcomes of evidence-based programs (EBP) for adolescents, but with a cost. To assist in determining whether this cost is worthwhile, this study estimated the cost of adding Getting To Outcomes© (GTO) implementation support to a teen pregnancy and sexually transmitted infection prevention EBP called Making Proud Choices (MPC) in 32 Boys and Girls Clubs (BGCs) in Alabama and Georgia. Enhancing Quality Interventions Promoting Healthy Sexuality (EQUIPS) was a 2-year, cluster-randomized controlled trial comparing MPC with MPC + GTO. We used micro-costing to estimate costs and captured MPC and GTO time from activity logs completed by GTO staff. Key resource use and cost components were compared between the randomized groups, years, and states (to capture different community site circumstances) using 2-sample t tests. There were no significant differences between randomized groups in attendees per site, resource use, or costs for either year. However, there were significant differences between states. Adding GTO to MPC increased the societal costs per attendee from $67 to $144 (2015 US dollars) in Georgia and from $106 to $314 in Alabama. The higher Alabama cost was due to longer travel distances and to more BGC staff time spent on GTO in that state. GTO also improved adherence, classroom delivery, and condom-use intentions more in Alabama youth. Thus, Alabama’s GTO-related BGC staff time costs may be better estimates of effective GTO. If teen childbearing costs taxpayers approximately $20,000 per teen birth, adding GTO to MPC would be worthwhile to society if it prevented one more teen birth per 140 attendees than MPC alone.
Appendix
Available only for authorised users
Literature
go back to reference Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.PubMedPubMedCentral Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6(2), 61–74.PubMedPubMedCentral
go back to reference Aarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009). Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science, 4(1), 83.PubMed Aarons, G. A., Sommerfeld, D. H., & Walrath-Greene, C. M. (2009). Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science, 4(1), 83.PubMed
go back to reference Acosta, J., Chinman, M., Ebener, P., Malone, P. S., Paddock, S., Phillips, A., et al. (2013). An intervention to improve program implementation: Findings from a two-year cluster randomized trial of Assets-Getting To Outcomes. Implementation Science, 8(1), 87.PubMed Acosta, J., Chinman, M., Ebener, P., Malone, P. S., Paddock, S., Phillips, A., et al. (2013). An intervention to improve program implementation: Findings from a two-year cluster randomized trial of Assets-Getting To Outcomes. Implementation Science, 8(1), 87.PubMed
go back to reference Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211.
go back to reference Bandura, A. (1992). A social cognitive approach to the exercise of control over AIDS infection. In R. DiClemente (Ed.), Adolescents and AIDS: A generation in jeopardy (pp. 89–116). Newbury Park, CA: Sage Publications. Bandura, A. (1992). A social cognitive approach to the exercise of control over AIDS infection. In R. DiClemente (Ed.), Adolescents and AIDS: A generation in jeopardy (pp. 89–116). Newbury Park, CA: Sage Publications.
go back to reference Barnett, P. G. (2009). An improved set of standards for finding cost for cost-effectiveness analysis. Medical Care, 47(7_Supplement_1), S82–S88.PubMed Barnett, P. G. (2009). An improved set of standards for finding cost for cost-effectiveness analysis. Medical Care, 47(7_Supplement_1), S82–S88.PubMed
go back to reference Chen, S.-Y., Feng, Z., & Yi, X. (2017). A general introduction to adjustment for multiple comparisons. Journal of Thoracic Disease, 9(6), 1725.PubMedPubMedCentral Chen, S.-Y., Feng, Z., & Yi, X. (2017). A general introduction to adjustment for multiple comparisons. Journal of Thoracic Disease, 9(6), 1725.PubMedPubMedCentral
go back to reference Chinman, M., Imm, P., & Wandersman, A. (2004). Getting to outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. Santa Monica: RAND Corporation. Chinman, M., Imm, P., & Wandersman, A. (2004). Getting to outcomes 2004: Promoting accountability through methods and tools for planning, implementation, and evaluation. Santa Monica: RAND Corporation.
go back to reference Chinman, M., Acosta, J., Ebener, P., Driver, J., Keith, J., & Peebles, D. (2013). Enhancing quality interventions promoting healthy sexuality (EQUIPS): A novel application of translational research methods. Clinical and Translational Science, 6(3), 232–237.PubMedPubMedCentral Chinman, M., Acosta, J., Ebener, P., Driver, J., Keith, J., & Peebles, D. (2013). Enhancing quality interventions promoting healthy sexuality (EQUIPS): A novel application of translational research methods. Clinical and Translational Science, 6(3), 232–237.PubMedPubMedCentral
go back to reference Chinman, M., Acosta, J., Ebener, P., Malone, P. S., & Slaughter, M. E. (2016a). Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®. Implementation Science, 11(1), 78.PubMed Chinman, M., Acosta, J., Ebener, P., Malone, P. S., & Slaughter, M. E. (2016a). Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®. Implementation Science, 11(1), 78.PubMed
go back to reference Chinman, M., Acosta, J. D., Ebener, P., Sigel, C., & Keith, J. (2016b). Getting To Outcomes: A guide for teen pregnancy prevention. Santa Monica, CA: RAND Corporation. Chinman, M., Acosta, J. D., Ebener, P., Sigel, C., & Keith, J. (2016b). Getting To Outcomes: A guide for teen pregnancy prevention. Santa Monica, CA: RAND Corporation.
go back to reference Chinman, M., Acosta, J., Ebener, P., Malone, P. S., & Slaughter, M. E. (2018a). A cluster-randomized trial of Getting To Outcomes’ impact on sexual health outcomes in community-based settings. Prevention Science, 19, 437–448.PubMedPubMedCentral Chinman, M., Acosta, J., Ebener, P., Malone, P. S., & Slaughter, M. E. (2018a). A cluster-randomized trial of Getting To Outcomes’ impact on sexual health outcomes in community-based settings. Prevention Science, 19, 437–448.PubMedPubMedCentral
go back to reference Chinman, M., Ebener, P., Malone, P. S., Cannon, J., D’Amico, E. J., & Acosta, J. (2018b). Testing implementation support for evidence-based programs in community settings: A replication cluster-randomized trial of Getting To Outcomes®. Implementation Science, 13, Article number 131.PubMed Chinman, M., Ebener, P., Malone, P. S., Cannon, J., D’Amico, E. J., & Acosta, J. (2018b). Testing implementation support for evidence-based programs in community settings: A replication cluster-randomized trial of Getting To Outcomes®. Implementation Science, 13, Article number 131.PubMed
go back to reference Crowley, D. M., Jones, D. E., Greenberg, M. T., Feinberg, M. E., & Spoth, R. L. (2012). Resource consumption of a diffusion model for prevention programs: The PROSPER delivery system. Journal of Adolescent Health, 50(3), 256–263.PubMed Crowley, D. M., Jones, D. E., Greenberg, M. T., Feinberg, M. E., & Spoth, R. L. (2012). Resource consumption of a diffusion model for prevention programs: The PROSPER delivery system. Journal of Adolescent Health, 50(3), 256–263.PubMed
go back to reference Crowley, D. M., Dodge, K. A., Barnett, W. S., Corso, P., Duffy, S., Graham, P., et al. (2018). Standards of evidence for conducting and reporting economic evaluations in prevention science. Prevention Science, 19(3), 366–390.PubMedPubMedCentral Crowley, D. M., Dodge, K. A., Barnett, W. S., Corso, P., Duffy, S., Graham, P., et al. (2018). Standards of evidence for conducting and reporting economic evaluations in prevention science. Prevention Science, 19(3), 366–390.PubMedPubMedCentral
go back to reference Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41(3–4), 235–249.PubMed Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Bridging science to practice: Achieving prevention program implementation fidelity in the Community Youth Development Study. American Journal of Community Psychology, 41(3–4), 235–249.PubMed
go back to reference Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley. Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
go back to reference Fisher, D., Imm, P., Chinman, M., & Wandersman, A. (2006). Getting To Outcomes with Developmental Assets: Ten steps to measuring success in youth programs and communities. Minneapolis, MN: Search Institute. Fisher, D., Imm, P., Chinman, M., & Wandersman, A. (2006). Getting To Outcomes with Developmental Assets: Ten steps to measuring success in youth programs and communities. Minneapolis, MN: Search Institute.
go back to reference Goesling, B., Colman, S., Trenholm, C., Terzian, M., & Moore, K. (2014). Programs to reduce teen pregnancy, sexually transmitted infections, and associated sexual risk behaviors: A systematic review. Journal of Adolescent Health, 54(5), 499–507.PubMed Goesling, B., Colman, S., Trenholm, C., Terzian, M., & Moore, K. (2014). Programs to reduce teen pregnancy, sexually transmitted infections, and associated sexual risk behaviors: A systematic review. Journal of Adolescent Health, 54(5), 499–507.PubMed
go back to reference Hamilton, B. E., & Mathews, T. J. (2016). Continued declines in teen births in the United States, 2015. NCHS data brief, no 259. Hyattsville, MD: National Center for Health Statistics. Hamilton, B. E., & Mathews, T. J. (2016). Continued declines in teen births in the United States, 2015. NCHS data brief, no 259. Hyattsville, MD: National Center for Health Statistics.
go back to reference Hamilton, B. E., Rossen, L. M., & Branum, A. M. (2016). Teen birth rates for urban and rural areas in the United States, 2007-2015. NCHS Data Brief, 264, 1–8. Hamilton, B. E., Rossen, L. M., & Branum, A. M. (2016). Teen birth rates for urban and rural areas in the United States, 2007-2015. NCHS Data Brief, 264, 1–8.
go back to reference Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics and Adolescent Medicine, 163(9), 789–798.PubMed Hawkins, J. D., Oesterle, S., Brown, E. C., Arthur, M. W., Abbott, R. D., Fagan, A. A., et al. (2009). Results of a type 2 translational research trial to prevent adolescent drug use and delinquency: A test of Communities That Care. Archives of Pediatrics and Adolescent Medicine, 163(9), 789–798.PubMed
go back to reference Hill, A. B. (1965). The enfironment and disease: Association or causation? Proceedings of the Royal Society of Medicine, 48, 295–300. Hill, A. B. (1965). The enfironment and disease: Association or causation? Proceedings of the Royal Society of Medicine, 48, 295–300.
go back to reference Hoffman, S., & Maynard, R. (2008). Kids having kids: Economic costs and social consequences of teen pregnancy (2nd ed.). Washington, DC: The Urban Institute Press. Hoffman, S., & Maynard, R. (2008). Kids having kids: Economic costs and social consequences of teen pregnancy (2nd ed.). Washington, DC: The Urban Institute Press.
go back to reference Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 65–70. Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 65–70.
go back to reference Imm, P., Chinman, M., Wandersman, A., Rosenbloom, D., Guckenburg, S., & Leis, R. (2007). Preventing underage drinking: Using getting to outcomes with the SAMHSA strategic prevention framework to achieve results. Santa Monica, CA: RAND Corporation. Imm, P., Chinman, M., Wandersman, A., Rosenbloom, D., Guckenburg, S., & Leis, R. (2007). Preventing underage drinking: Using getting to outcomes with the SAMHSA strategic prevention framework to achieve results. Santa Monica, CA: RAND Corporation.
go back to reference Jemmott III, J. B., Jemmott, L. S., Spears, H., Hewitt, N., & Cruz-Collins, M. (1992). Self-efficacy, hedonistic expectancies, and condom-use intentions among inner-city black adolescent women: A social cognitive approach to AIDS risk behavior. Journal of Adolescent Health, 13(6), 512–519.PubMed Jemmott III, J. B., Jemmott, L. S., Spears, H., Hewitt, N., & Cruz-Collins, M. (1992). Self-efficacy, hedonistic expectancies, and condom-use intentions among inner-city black adolescent women: A social cognitive approach to AIDS risk behavior. Journal of Adolescent Health, 13(6), 512–519.PubMed
go back to reference Jemmott III, J. B., Jemmott, L. S., & Fong, G. T. (1998). Abstinence and safer sex HIV risk-reduction interventions for African American adolescents: A randomized controlled trial. JAMA, 279(19), 1529–1536.PubMed Jemmott III, J. B., Jemmott, L. S., & Fong, G. T. (1998). Abstinence and safer sex HIV risk-reduction interventions for African American adolescents: A randomized controlled trial. JAMA, 279(19), 1529–1536.PubMed
go back to reference Johnson, B. T., Carey, M. P., Marsh, K. L., Levin, K. D., & Scott-Sheldon, L. A. (2003). Interventions to reduce sexual risk for the human immunodeficiency virus in adolescents, 1985-2000: A research synthesis. Archives of Pediatrics and Adolescent Medicine, 157(4), 381–388.PubMed Johnson, B. T., Carey, M. P., Marsh, K. L., Levin, K. D., & Scott-Sheldon, L. A. (2003). Interventions to reduce sexual risk for the human immunodeficiency virus in adolescents, 1985-2000: A research synthesis. Archives of Pediatrics and Adolescent Medicine, 157(4), 381–388.PubMed
go back to reference Johnson, B. T., Scott-Sheldon, L. A., Huedo-Medina, T. B., & Carey, M. P. (2011). Interventions to reduce sexual risk for human immunodeficiency virus in adolescents: A meta-analysis of trials, 1985-2008. Archives of Pediatrics and Adolescent Medicine, 165(1), 77–84.PubMed Johnson, B. T., Scott-Sheldon, L. A., Huedo-Medina, T. B., & Carey, M. P. (2011). Interventions to reduce sexual risk for human immunodeficiency virus in adolescents: A meta-analysis of trials, 1985-2008. Archives of Pediatrics and Adolescent Medicine, 165(1), 77–84.PubMed
go back to reference Jutte, D. P., Roos, N. P., Brownell, M. D., Briggs, G., MacWilliam, L., & Roos, L. L. (2010). The ripples of adolescent motherhood: Social, educational, and medical outcomes for children of teen and prior teen mothers. Academic Pediatrics, 10(5), 293–301.PubMed Jutte, D. P., Roos, N. P., Brownell, M. D., Briggs, G., MacWilliam, L., & Roos, L. L. (2010). The ripples of adolescent motherhood: Social, educational, and medical outcomes for children of teen and prior teen mothers. Academic Pediatrics, 10(5), 293–301.PubMed
go back to reference Kramer, J. S., Philliber, S., Brindis, C. D., Kamin, S. L., Chadwick, A. E., Revels, M. L., et al. (2005). Coalition models: Lessons learned from the CDC’s community coalition partnership programs for the prevention of teen pregnancy. Journal of Adolescent Health, 37(3), S20–S30.PubMed Kramer, J. S., Philliber, S., Brindis, C. D., Kamin, S. L., Chadwick, A. E., Revels, M. L., et al. (2005). Coalition models: Lessons learned from the CDC’s community coalition partnership programs for the prevention of teen pregnancy. Journal of Adolescent Health, 37(3), S20–S30.PubMed
go back to reference Kuklinski, M. R., Briney, J. S., Hawkins, J. D., & Catalano, R. F. (2012). Cost-benefit analysis of communities that care outcomes at eighth grade. Prevention Science, 13(2), 150–161.PubMedPubMedCentral Kuklinski, M. R., Briney, J. S., Hawkins, J. D., & Catalano, R. F. (2012). Cost-benefit analysis of communities that care outcomes at eighth grade. Prevention Science, 13(2), 150–161.PubMedPubMedCentral
go back to reference Lee, D. (2010). The early socioeconomic effects of teenage childbearing: A propensity score matching approach. Demographic Research, 23, 697–736. Lee, D. (2010). The early socioeconomic effects of teenage childbearing: A propensity score matching approach. Demographic Research, 23, 697–736.
go back to reference Levin, H. M., & Belfield, C. (2015). Guiding the development and use of cost-effectiveness analysis in education. Journal of Research on Educational Effectiveness, 8(3), 400–418. Levin, H. M., & Belfield, C. (2015). Guiding the development and use of cost-effectiveness analysis in education. Journal of Research on Educational Effectiveness, 8(3), 400–418.
go back to reference Livet, M., & Wandersman, A. (2005). Organizational functioning: Facilitating effective interventions and increasing the odds of programming success. In D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation in practice (pp. 123–154). New York, NY: Guilford. Livet, M., & Wandersman, A. (2005). Organizational functioning: Facilitating effective interventions and increasing the odds of programming success. In D. M. Fetterman & A. Wandersman (Eds.), Empowerment evaluation in practice (pp. 123–154). New York, NY: Guilford.
go back to reference Mullen, P. D., Ramirez, G., Strouse, D., Hedges, L. V., & Sogolow, E. (2002). Meta-analysis of the effects of behavioral HIV prevention interventions on the sexual risk behavior of sexually experienced adolescents in controlled studies in the United States. Journal of Acquired Immune Deficiency Syndromes, 30(Suppl 1), S94–S105.PubMed Mullen, P. D., Ramirez, G., Strouse, D., Hedges, L. V., & Sogolow, E. (2002). Meta-analysis of the effects of behavioral HIV prevention interventions on the sexual risk behavior of sexually experienced adolescents in controlled studies in the United States. Journal of Acquired Immune Deficiency Syndromes, 30(Suppl 1), S94–S105.PubMed
go back to reference Oringanje, C., Meremikwu, M. M., Eko, H., Esu, E., Meremikwu, A., & Ehiri, J. E. (2016). Interventions for preventing unintended pregnancies among adolescents. Cochrane Database of Systematic Reviews, 2. Oringanje, C., Meremikwu, M. M., Eko, H., Esu, E., Meremikwu, A., & Ehiri, J. E. (2016). Interventions for preventing unintended pregnancies among adolescents. Cochrane Database of Systematic Reviews, 2.
go back to reference Scher, L. S., Maynard, R. A., Stagner, M., & Maynard, R. (2006). Interventions intended to reduce pregnancy-related outcomes among. Campbell Systematic Reviews, 12. Scher, L. S., Maynard, R. A., Stagner, M., & Maynard, R. (2006). Interventions intended to reduce pregnancy-related outcomes among. Campbell Systematic Reviews, 12.
go back to reference Sedgh, G., Finer, L. B., Bankole, A., Eilers, M. A., & Singh, S. (2015). Adolescent pregnancy, birth, and abortion rates across countries: Levels and recent trends. Journal of Adolescent Health, 56(2), 223–230.PubMed Sedgh, G., Finer, L. B., Bankole, A., Eilers, M. A., & Singh, S. (2015). Adolescent pregnancy, birth, and abortion rates across countries: Levels and recent trends. Journal of Adolescent Health, 56(2), 223–230.PubMed
go back to reference Sheeran, P., & Orbell, S. (1998). Do intentions predict condom use? Metaanalysis and examination of six moderator variables. British Journal of Social Psychology, 37(2), 231–250.PubMed Sheeran, P., & Orbell, S. (1998). Do intentions predict condom use? Metaanalysis and examination of six moderator variables. British Journal of Social Psychology, 37(2), 231–250.PubMed
go back to reference Spoth, R., Guyll, M., Lillehoj, C. J., Redmond, C., & Greenberg, M. (2007). Prosper study of evidence-based intervention implementation quality by community–university partnerships. Journal of Community Psychology, 35(8), 981–999.PubMedPubMedCentral Spoth, R., Guyll, M., Lillehoj, C. J., Redmond, C., & Greenberg, M. (2007). Prosper study of evidence-based intervention implementation quality by community–university partnerships. Journal of Community Psychology, 35(8), 981–999.PubMedPubMedCentral
go back to reference Tibbits, M., & Siahpush, M. (2017). Implementation of sexually transmitted infection interventions: Insights from a community-wide assessment. Health Promotion Practice, 18(2), 290–297.PubMed Tibbits, M., & Siahpush, M. (2017). Implementation of sexually transmitted infection interventions: Insights from a community-wide assessment. Health Promotion Practice, 18(2), 290–297.PubMed
go back to reference Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention. American Psychologist, 58(6–7), 441–448.PubMed Wandersman, A., & Florin, P. (2003). Community interventions and effective prevention. American Psychologist, 58(6–7), 441–448.PubMed
Metadata
Title
Cost analysis of a randomized trial of Getting to Outcomes implementation support for a teen pregnancy prevention program offered in Boys and Girls Clubs in Alabama and Georgia
Authors
Patricia M. Herman
Matthew Chinman
Patricia Ebener
Patrick S. Malone
Joie Acosta
Publication date
01-11-2020
Publisher
Springer US
Published in
Prevention Science / Issue 8/2020
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-020-01162-y

Other articles of this Issue 8/2020

Prevention Science 8/2020 Go to the issue