Top

Published in:

01-08-2019 | Original Paper

Examining the Differential Effects of a Universal SEL Curriculum on Student Functioning Through the Dual Continua Model of Mental Health

Authors: Andrew J. Thayer, Daniel M. Campa, Mollie R. Weeks, Joanne Buntain-Ricklefs, Sabina Low, Madeline Larson, Clayton R. Cook

Published in: Journal of Prevention | Issue 4/2019

Abstract

Social-emotional learning (SEL) curricula, such as Second Step, are increasingly being adopted and implemented as universal supports in schools in order to prevent social-emotional and behavioral problems and promote wellbeing and success. Notwithstanding the empirical support for SEL as a universal prevention strategy, a closer look at the literature indicates that students display differential responses to SEL based on their behavioral functioning at baseline; those students with the highest need benefit the most from SEL. The primary purpose of this study was to evaluate whether a widely-adopted SEL program produces significant effects for different theoretically-constructed groups of students who are representative of the full spectrum of students in a school. Using data from a large-scale randomized controlled trial evaluating Second Step, analyses examined the extent to which group membership according to the dual continua model of mental health differentially changed based on whether the student was in the intervention or control condition. Overall, results evidenced significant effects favoring the intervention condition across groups in line with our general hypotheses, although both conditions experienced transitions in membership. As expected, those in the intervention condition experienced greater transition between groups, which was indicative of either treatment or prevention effects. Implications, limitations, and future directions of the findings for SEL programming in schools are discussed.

We chose not to use mixture modeling (e.g., LTA) because our classification approach was theoretically, rather than empirically, driven. Our approach here is highly similar, though, to that method.

Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Department of Psychiatry, University of Vermont.

Antaramian, S. P., Huebner, E. S., Hills, K. J., & Valois, R. F. (2010). A dual-factor model of mental health: Toward a more comprehensive understanding of youth functioning. American Journal of Orthopsychiatry, 80(4), 462–472. https://doi.org/10.1111/j.1939-0025.2010.01049.x.CrossRefPubMed

Austin, E. J., Saklofske, D. H., & Egan, V. (2005). Personality, well-being and health correlates of trait emotional intelligence. Personality and Individual Differences, 38(3), 547–558. https://doi.org/10.1016/j.paid.2004.05.009.CrossRef

Bear, G. (2010). Discipline: Effective school practices. National Association of School Psychologists, pp. 1–5.

Berry, V., Axford, N., Blower, S., Taylor, R. S., Edwards, R. T., Tobin, K., et al. (2016). The effectiveness and micro-costing analysis of a universal, school-based, social–emotional learning programme in the UK: A cluster-randomised controlled trial. School Mental Health, 8(2), 238–256. https://doi.org/10.1007/s12310-015-9160-1.CrossRef

Bierman, K. L., Coie, J. D., Dodge, K. A., Greenberg, M. T., Lochman, J. E., McMahon, R. J., et al. (2010). The effects of a multiyear universal social–emotional learning program: The role of student and school characteristics. Journal of Consulting and Clinical Psychology, 78(2), 156. https://doi.org/10.1037/a0018607.CrossRef

Brackett, M. A., & Rivers, S. E. (2014). Transforming students’ lives with social and emotional learning. In R. Pekrun & L. Linnenbrink-Garcia (Eds.), International handbook of emotions in education (pp. 368–388). New York, NY: Routledge.

Bürkner, P. C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80(1), 1–28.CrossRef

Burrus, J., Betancourt, A., Holtzman, S., Minsky, J., MacCann, C., & Roberts, R. D. (2012). Emotional intelligence relates to well-being: Evidence from the Situational Judgment Test of Emotional Management. Applied Psychology: Health and Well-Being, 4(2), 151–166. https://doi.org/10.1111/j.1758-0854.2012.0166.x.CrossRef

Bushaw, W. J., & Lopez, S. J. (2010). A time for change. The 42nd annual Phi DeltKappa/Gallup poll of the public’s attitudes toward schools. Kappan, 92(1), 9–26.

Campbell, I. (2007). Chi squared and Fisher–Irwin tests of two-by-two tables with small sample recommendations. Statistics in Medicine, 26(19), 3661–3675. https://doi.org/10.1002/sim.2832.CrossRefPubMed

CASEL. (2015). Effective social and emotional learning programs. Middle and high school edition. A guide. Retrieved April 19, 2019 from http://secondaryguide.casel.org/casel-secondary-guide.pdf.

Census Bureau, U. S. (2011). Statistical abstract of the United States: 2011 (130th ed.). Washington, DC: Author.

Cook, C. R., Frye, M., Slemrod, T., Lyon, A. R., Renshaw, T. L., & Zhang, Y. (2015). An integrated approach to universal prevention: Independent and combined effects of PBIS and SEL on youths’ mental health. School Psychology Quarterly, 30(2), 166. https://doi.org/10.1037/spq0000102.CrossRefPubMedPubMedCentral

Cook, C. R., Low, S., Buntain-Ricklefs, J., Whitaker, K., Pullmann, M. D., & Lally, J. (2018). Evaluation of second step on early elementary students’ academic outcomes: A randomized controlled trial. School Psychology Quarterly, 33, 561–572. https://doi.org/10.1037/spq0000233.CrossRefPubMed

de Boer, M. R., Waterlander, W. E., Kuijper, L. D., Steenhuis, I. H., & Twisk, J. W. (2015). Testing for baseline differences in randomized controlled trials: An unhealthy research behavior that is hard to eradicate. International Journal of Behavioral Nutrition and Physical Activity, 12(1), 4. https://doi.org/10.1186/s12966-015-0162-z.CrossRefPubMedPubMedCentral

Devereux Center for Resilient Children. (2012). Devereux Student Strengths Assessment (DESSA)—Second Step. Villanova, VA: Devereux Center for Resilient Children.

Dodge, K. A., & Conduct Problems Prevention Research Group. (2007). Fast track randomized controlled trial to prevent externalizing psychiatric disorders: Findings from grades 3 to 9. Journal of the American Academy of Child and Adolescent Psychiatry, 46(10), 1250–1262. https://doi.org/10.1097/chi.0b013e31813e5d39.CrossRefPubMed

Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47(1), 71–88. https://doi.org/10.1002/pits.20452.CrossRefPubMedPubMedCentral

Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432. https://doi.org/10.1111/j.1467-8624.2010.01564.x.CrossRefPubMed

Dusenbury, L., & Weissberg, R. P. (2017). State efforts to promote social and emotional learning in students. A status report. In Collaborative for academic, social, and emotional learning. Retrieved April 19, 2019 from https://files.eric.ed.gov/fulltext/ED581609.pdf.

Elias, M. J., Arnold, H., & Hussey, C. S. (2003). Introduction: Learning from others, connecting to others. In M. J. Elias, H. Arnold, & C. S. Hussey (Eds.), EQ + IQ = Best leadership practices for caring and successful schools (pp. 177–183). Thousand Oaks: Corwin Press.

Gelman, A. (2019, May 2nd). Prior choice recommendations. Retrieved July 24, 2019, from https://github.com/stan-dev/stan/wiki/Prior-Choice-Recommendations.

Gigerenzer, G. (2018). Statistical rituals: The replication delusion and how we got there. Advances in Methods and Practices in Psychological Science, 1(2), 198–218. https://doi.org/10.1177/2515245918771329.CrossRef

Goodman, R. N. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x.CrossRefPubMed

Goodman, R., & Scott, S. (1999). Comparing the Strengths and Difficulties Questionnaire and the Child Behavior Checklist: Is small beautiful? Journal of Abnormal Child Psychology, 27, 17–24. https://doi.org/10.1023/A:1022658222914.CrossRefPubMed

Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. https://doi.org/10.1146/annurev.psych.58.110405.08550.CrossRefPubMed

Greenberg, M. T., & Abenavoli, R. (2017). Universal interventions: Fully exploring their impacts and potential to produce population-level impacts. Journal of Research on Educational Effectiveness, 10(1), 40–67. https://doi.org/10.1080/19345747.2016.1246632.CrossRef

Greenspoon, P. J., & Saklofske, D. H. (2001). Toward an integration of subjective well-being and psychopathology. Social Indicators Research, 54, 81–108. https://doi.org/10.1023/A:1007219227883.CrossRef

Jones, S. M., Brown, J. L., Hoglund, W., & Aber, J. L. (2010). A school-randomized clinical trial of an integrated social-emotional learning and literacy intervention: Impacts after 1 school year. Journal of Consulting and Clinical Psychology, 78(6), 829–842. https://doi.org/10.1037/a0021383.CrossRefPubMed

Jones, D. E., Greenberg, M., & Crowley, M. (2015). Early social-emotional functioning and public health: The relationship between kindergarten social competence and future wellness. American Journal of Public Health, 105, 2283–2290. https://doi.org/10.2105/AJPH.2015.302630.CrossRefPubMedPubMedCentral

Kelly, R. M., Hills, K. J., Huebner, E. S., & McQuillin, S. D. (2012). Longitudinal stability and dynamics of group membership in the dual-factor model of mental health: Psychosocial predictors of mental health. Canadian Journal of School Psychology, 27(4), 337–355. https://doi.org/10.1177/0829573512458505.CrossRef

Keyes, C. L., & Simoes, E. J. (2012). To flourish or not: Positive mental health and all-cause mortality. American Journal of Public Health, 102(11), 2164–2172. https://doi.org/10.2105/AJPH.2012.300918.CrossRefPubMedPubMedCentral

LeBuffe, P. A., Naglieri, J. A., & Shapiro, V. B. (2011). The Devereux Strengths Assessment (DESSA) assessment—Second Step. Lewisville, NC: Kaplan.

Low, S., Cook, C. R., Smolkowski, K., & Buntain-Ricklefs, J. (2015). Promoting social–emotional competence: An evaluation of the elementary version of Second Step^®. Journal of School Psychology, 53(6), 463–477. https://doi.org/10.1016/j.jsp2015.09.002.CrossRefPubMed

Low, S., Smolkowski, K., & Cook, C. (2016). What constitutes high-quality implementation of SEL programs? A latent class analysis of Second Step® implementation. Prevention Science, 17(8), 981–991.CrossRefPubMed

Martins, A., Ramalho, N., & Morin, E. (2010). A comprehensive meta-analysis of the relationship between emotional intelligence and health. Personality and Individual Differences, 49(6), 554–564. https://doi.org/10.1016/j.paid.2010.05.029.CrossRef

McIntosh, K., Predy, L. K., Upreti, G., Hume, A. E., Turri, M. G., & Mathews, S. (2014). Perceptions of contextual features related to implementation and sustainability of school-wide positive behavior support. Journal of Positive Behavior Interventions, 16(1), 31–43. https://doi.org/10.1177/1098300712470723.CrossRef

McMahan, M. M. (2012). A longitudinal examination of high school students’ group membership in a dual-factor model of mental health: Stability of mental health status and predictors of change (Unpublished doctoral dissertation). Tampa: University of Southern Florida.

Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford University Press.

Nickerson, A., & Fishman, C. (2009). Convergent and divergent validity of the Devereux Student Strengths Assessment. School Psychology Quarterly, 24, 48–59. https://doi.org/10.1037/a0015147.CrossRef

Osher, D., Bear, G. G., Sprague, J. R., & Doyle, W. (2010). How can we improve school discipline? Educational Researcher, 39(1), 48–58.CrossRef

Raghunathan, T. E. (2004). What do we do with missing data? Some options for analysis of incomplete data. Annual Review of Public Health, 25, 99–117. https://doi.org/10.1146/annurev.publhealth.25.102802.124410.CrossRefPubMed

R Core Team (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.

Reinke, W. M., Herman, K. C., & Ialongo, N. S. (2012). Developing and implementing integrated school-based mental health interventions. Advances in School Mental Health Promotion, 5(3), 158–160. https://doi.org/10.1080/1754730X.2012.707420.CrossRef

Reinke, W. M., Stormont, M., Herman, K. C., Puri, R., & Goel, N. (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26, 1–13. https://doi.org/10.1037/a0022714.CrossRef

Rindskopf, D. (2010). Latent transition analysis. In G. R. Hancok & R. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the social sciences (pp. 199–207). New York: Routledge.

Rubin, D. B. (1996). Multiple imputation after 18+ years. Journal of the American statistical Association, 91(434), 473–489. https://doi.org/10.1080/01621459.1996.10476908.CrossRef

Schafer, J. L. (1999). Multiple imputation: A primer. Statistical Methods in Medical Research, 8(1), 3–15. https://doi.org/10.1177/096228029900800102.CrossRefPubMed

Suldo, S. M., & Shaffer, E. J. (2008). Looking beyond psychopathology: The dual factor model of mental health in youth. School Psychology Review, 37, 52–68.

van Buuren, S., & Groothuis-Oudshoorn, K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://www.jstatsoft.org/v45/i03/.

Title: Examining the Differential Effects of a Universal SEL Curriculum on Student Functioning Through the Dual Continua Model of Mental Health
Authors: Andrew J. Thayer
Daniel M. Campa
Mollie R. Weeks
Joanne Buntain-Ricklefs
Sabina Low
Madeline Larson
Clayton R. Cook
Publication date: 01-08-2019
Publisher: Springer US
Published in: Journal of Prevention / Issue 4/2019
Print ISSN: 2731-5533
Electronic ISSN: 2731-5541
DOI: https://doi.org/10.1007/s10935-019-00557-0

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Examining the Differential Effects of a Universal SEL Curriculum on Student Functioning Through the Dual Continua Model of Mental Health

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 4/2019

The Prevention of Drugged Driving: Needs, Barriers, and Self-Efficacy of Prevention Professionals

Correction to: Meta-Review on the Effectiveness of Classroom-Based Psychological Interventions Aimed at Improving Student Mental Health and Well-Being, and Preventing Mental Illness

Volunteerism, Alcohol Beliefs, and First-Year College Students’ Drinking Behaviors: Implications for Prevention

National Trends in Parental Communication With Their Teenage Children About the Dangers of Substance Use, 2002–2016

An Applied Contextual Model for Promoting Self-Regulation Enactment Across Development: Implications for Prevention, Public Health and Future Research

Lowering Risk for Significant Behavior Problems Through Cognitive-Behavioral Intervention: Effects of the Tools for Getting Along Curriculum 2 Years Following Implementation