Skip to main content
Top
Published in: Prevention Science 7/2021

Open Access 01-10-2021

The “Haves, Have Some, and Have Nots:” a Latent Profile Analysis of Capacity, Quality, and Implementation in Community-Based Afterschool Programs

Authors: Emilie Phillips Smith, Professor of Human Dev & Fam Stud, College of Social Science Distinguished Senior Scholar, Dawn P. Witherspoon, McCourtney Family Early Career Professor of Psychology, Pui-Wa Lei, Professor of Education

Published in: Prevention Science | Issue 7/2021

Login to get access

Abstract

Implementation of evidence-based practices is a critical factor in whether afterschool programs are successful in having a positive impact upon risk reduction and positive youth development. However, important prevention research reveals that contextual and organizational factors can affect implementation (Bradshaw & Pas in School Psychology Review, 40, 530–548, 2011) (Flaspohler et al., in American Journal of Community Psychology, 50(3-4), 271-281, 2012) (Gottfredson et al., Prevention Science, 3, 43–56, 2002) (McIntosh et al., Journal of Positive Behavior Interventions, 18(4), 209-218, 2016) (Payne in Prevention Science, 10, 151–167, 2009). Using a latent profile approach (LPA), this paper examines multiple organizational and neighborhood contextual factors that might affect the degree to which afterschool programs effectively implement evidence-based practices in the context of a cluster-randomized trial of the Paxis Good Behavior Game (PaxGBG). The Interactive Systems Framework (ISF) explores dimensions of capacity that might matter for prevention efforts. As expected, we found that well-resourced and high-quality programs performed well in terms of implementation (the Haves) and, in neighborhood contexts rich in racial-ethnic diversity. Yet, we found that some programs with less physical and material capacity (the Have Nots), demonstrated greater program quality (i.e., supportive adult and peer relationships, engagement, a sense of belonging) and implementation, relative to programs with better capacity (e.g., space, material resources, staffing, and leadership, the Have Somes). While capacity matters, intentional prevention initiatives that seek to promote evidence-based practices are helpful to sites in supporting organizations that might otherwise fail to provide quality programming for youth. This paper addresses a conundrum in prevention science, namely, how to make programming accessible to those who need it with a focus on organizational processes, program quality, and implementation of evidence-based practices.
Footnotes
1
See Oh, Osgood, and Smith (2015) for more information about these setting-level (i.e., afterschool program) observations.
 
Literature
go back to reference Alliance, A. (2014). America after 3PM: Afterschool programs in demand. Afterschool Alliance. Alliance, A. (2014). America after 3PM: Afterschool programs in demand. Afterschool Alliance.
go back to reference Eccles, J. & Gootman, J. A. (Eds.). (2002). Community programs to promote youth Development. National Academies Press. Eccles, J. & Gootman, J. A. (Eds.). (2002). Community programs to promote youth Development. National Academies Press.
go back to reference Embry, D. D. (2002). A Scientific and Research History of the PAX (Good Behavior) Game. PAXIS Institute, Clinical Child and Family Psychology Review, 5, 273–297.CrossRef Embry, D. D. (2002). A Scientific and Research History of the PAX (Good Behavior) Game. PAXIS Institute, Clinical Child and Family Psychology Review, 5, 273–297.CrossRef
go back to reference Hall, G., Yohalem, N., Tolman, J., & Wilson, A. (2003). How afterschool programs can most effectively promote positive youth development as a support to academic achievement. Wellesley, MA: National Institute on Out-of-School Time. Hall, G., Yohalem, N., Tolman, J., & Wilson, A. (2003). How afterschool programs can most effectively promote positive youth development as a support to academic achievement. Wellesley, MA: National Institute on Out-of-School Time.
go back to reference Huang, S., Cordova, D., Estrada, Y., Brincks, A. M., Asfour, L. S., & Prado, G. (2014). An application of the Complier Average Causal Effect analysis to examine the effects of a family intervention in reducing illicit drug use among high-risk Hispanic adolescents. Family Process, 53, 336–347. https://doi.org/10.1111/famp.12068CrossRefPubMed Huang, S., Cordova, D., Estrada, Y., Brincks, A. M., Asfour, L. S., & Prado, G. (2014). An application of the Complier Average Causal Effect analysis to examine the effects of a family intervention in reducing illicit drug use among high-risk Hispanic adolescents. Family Process, 53, 336–347. https://​doi.​org/​10.​1111/​famp.​12068CrossRefPubMed
go back to reference James-Burdumy, S., Dynarski, M., Moore, M., Deke, J., Mansfield, W., & Pistorino, C. (2007). When Elementary Schools Stay Open Late: Results from The National Evaluation of the 21st Century Community Learning Centers. Educational Evaluation and Policy Analysis, 29, 296–318. https://doi.org/10.3102/0162373707309077CrossRef James-Burdumy, S., Dynarski, M., Moore, M., Deke, J., Mansfield, W., & Pistorino, C. (2007). When Elementary Schools Stay Open Late: Results from The National Evaluation of the 21st Century Community Learning Centers. Educational Evaluation and Policy Analysis, 29, 296–318. https://​doi.​org/​10.​3102/​0162373707309077​CrossRef
go back to reference Kendi, I. X. (2019). How to be an antiracist. One world. Kendi, I. X. (2019). How to be an antiracist. One world.
go back to reference Kuperminc, G. P., Seitz, S., Joseph, H., Khatib, N., Wilson, C., Collins, K., & Guessous, O. (2019). Enhancing program quality in a national sample of after-school settings: The role of youth–Staff interactions and staff/organizational functioning. American Journal of Community Psychology, 63, 391–404. https://doi.org/10.1002/ajcp.12329CrossRefPubMed Kuperminc, G. P., Seitz, S., Joseph, H., Khatib, N., Wilson, C., Collins, K., & Guessous, O. (2019). Enhancing program quality in a national sample of after-school settings: The role of youth–Staff interactions and staff/organizational functioning. American Journal of Community Psychology, 63, 391–404. https://​doi.​org/​10.​1002/​ajcp.​12329CrossRefPubMed
go back to reference Little, P., Wimer, C., & Weiss, H. B. (2008). After school programs in the 21st century: Their potential and what it takes to achieve it. Issues and Opportunities in out-of-School Time Evaluation, 10, 1–12. Little, P., Wimer, C., & Weiss, H. B. (2008). After school programs in the 21st century: Their potential and what it takes to achieve it. Issues and Opportunities in out-of-School Time Evaluation, 10, 1–12.
go back to reference Lochman, J. E., Boxmeyer, C., Powell, N., Roth, D. L., & Windle, M. (2006). Masked intervention effects: Analytic methods for addressing low dosage of intervention. New Directions for Evaluation, 110, 19–32.https://doi.org/10.1002/ev.184 Lochman, J. E., Boxmeyer, C., Powell, N., Roth, D. L., & Windle, M. (2006). Masked intervention effects: Analytic methods for addressing low dosage of intervention. New Directions for Evaluation, 110, 19–32.https://​doi.​org/​10.​1002/​ev.​184
go back to reference Mahoney, J. L., Stattin, H., & Lord, H. (2004). Unstructured youth recreation centre participation and antisocial behavior development: Selection influences and the moderating role of antisocial peers. International Journal of Behavioral Development, 28, 553–560.CrossRef Mahoney, J. L., Stattin, H., & Lord, H. (2004). Unstructured youth recreation centre participation and antisocial behavior development: Selection influences and the moderating role of antisocial peers. International Journal of Behavioral Development, 28, 553–560.CrossRef
go back to reference McKnight, J. L., & Kretzmann, J. (1996). Mapping community capacity. Institute for Policy Research, Northwestern University. McKnight, J. L., & Kretzmann, J. (1996). Mapping community capacity. Institute for Policy Research, Northwestern University.
go back to reference Muthén, B.O. (1998–2004). Mplus Technical Appendices. Los Angeles, CA: Muthén & Muthén. Muthén, B.O. (1998–2004). Mplus Technical Appendices. Los Angeles, CA: Muthén & Muthén.
go back to reference Sampson, R. J. (2008). Moving to inequality: Neighborhood effects and experiments meet social structure. American Journal of Sociology, 114, 189–231.CrossRef Sampson, R. J. (2008). Moving to inequality: Neighborhood effects and experiments meet social structure. American Journal of Sociology, 114, 189–231.CrossRef
go back to reference Simon, T. R., Ikeda, R. M., Smith, E. P., Reese, L. E., Rabiner, D. L., Miller, S., Winn, D.-M., Dodge, K. A., Asher, S. R., Horne, A. M., Orpinas, P., Martin, R., Quinn, W. H., Tolan, P. H., Gorman-Smith, D., Henry, D. B., Gay, F. N., Schoeny, M., Farrell, A. D., Meyer, A. L., Sullivan, T. N., & Allison, K. W. (2009). The ecological effects of universal and selective violence prevention programs for middle school students: A randomized trial. Journal of Consulting and Clinical Psychology, 77, 526–542. https://doi.org/10.1037/a0014395 Simon, T. R., Ikeda, R. M., Smith, E. P., Reese, L. E., Rabiner, D. L., Miller, S., Winn, D.-M., Dodge, K. A., Asher, S. R., Horne, A. M., Orpinas, P., Martin, R., Quinn, W. H., Tolan, P. H., Gorman-Smith, D., Henry, D. B., Gay, F. N., Schoeny, M., Farrell, A. D., Meyer, A. L., Sullivan, T. N., & Allison, K. W. (2009). The ecological effects of universal and selective violence prevention programs for middle school students: A randomized trial. Journal of Consulting and Clinical Psychology, 77, 526–542. https://​doi.​org/​10.​1037/​a0014395
go back to reference Smith, C., & Hohmann, C. (2005). Full findings from the youth program quality assessment validation study. Ypsilanti, MI: High/Scope Educational Research Foundation. Smith, C., & Hohmann, C. (2005). Full findings from the youth program quality assessment validation study. Ypsilanti, MI: High/Scope Educational Research Foundation.
go back to reference Smith, E. P., Gorman-Smith, D., Quinn, W. H., Rabiner, D. L., Tolan, P. H., Winn, D. M., & the Multi-Site Violence Prevention Project (MVPP). (2004). Community-based multiple family groups to prevent and reduce violent and aggressive behavior: The GREAT Families Program. American Journal of Preventive Medicine, 26, 39–47. https://doi.org/10.1016/j.amepre.2003.09.018CrossRef Smith, E. P., Gorman-Smith, D., Quinn, W. H., Rabiner, D. L., Tolan, P. H., Winn, D. M., & the Multi-Site Violence Prevention Project (MVPP). (2004). Community-based multiple family groups to prevent and reduce violent and aggressive behavior: The GREAT Families Program. American Journal of Preventive Medicine, 26, 39–47. https://​doi.​org/​10.​1016/​j.​amepre.​2003.​09.​018CrossRef
go back to reference Snyder, H.N. and Sickmund, M. (2006) Juvenile Offenders and Victims: 2006 National Report. U.S. Department of Justice. pp 1–261. Snyder, H.N. and Sickmund, M. (2006) Juvenile Offenders and Victims: 2006 National Report. U.S. Department of Justice. pp 1–261.
go back to reference St. George, S. M., St. George, S. M., Huang, S., Huang, S., Vidot, D. C., Vidot, D. C., … Prado, G. (2016). Factors associated with the implementation of the familias unidas intervention in a type 3 translational trial. Translational Behavioral Medicine, 6, 105–114. https://doi.org/10.1007/s13142-015-0344-xCrossRef St. George, S. M., St. George, S. M., Huang, S., Huang, S., Vidot, D. C., Vidot, D. C., … Prado, G. (2016). Factors associated with the implementation of the familias unidas intervention in a type 3 translational trial. Translational Behavioral Medicine, 6, 105–114. https://​doi.​org/​10.​1007/​s13142-015-0344-xCrossRef
go back to reference Stuhlman, M. W., Hamre, B. K., Downer, J. T., & Pianta, R. C. (2010). A practitioner’s guide to conducting classroom observations: What the research tells us about choosing and using observational systems. Charlottesville, VA: The Center for Advanced Study of Teaching and Learning, University of Virginia. Stuhlman, M. W., Hamre, B. K., Downer, J. T., & Pianta, R. C. (2010). A practitioner’s guide to conducting classroom observations: What the research tells us about choosing and using observational systems. Charlottesville, VA: The Center for Advanced Study of Teaching and Learning, University of Virginia.
go back to reference Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2017). Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health and Mental Health Services Research, 44, 269–283. https://doi.org/10.1007/s10488-016-0742-5CrossRefPubMed Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2017). Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health and Mental Health Services Research, 44, 269–283. https://​doi.​org/​10.​1007/​s10488-016-0742-5CrossRefPubMed
Metadata
Title
The “Haves, Have Some, and Have Nots:” a Latent Profile Analysis of Capacity, Quality, and Implementation in Community-Based Afterschool Programs
Authors
Emilie Phillips Smith, Professor of Human Dev & Fam Stud, College of Social Science Distinguished Senior Scholar
Dawn P. Witherspoon, McCourtney Family Early Career Professor of Psychology
Pui-Wa Lei, Professor of Education
Publication date
01-10-2021
Publisher
Springer US
Published in
Prevention Science / Issue 7/2021
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-021-01258-z

Other articles of this Issue 7/2021

Prevention Science 7/2021 Go to the issue