Skip to main content
Top
Published in: Journal of Prevention 3/2023

Open Access 16-03-2023 | COVID-19 | Original Paper

Evaluating the Efficacy of the Family Check-Up Online to Improve Parent Mental Health and Family Functioning in Response to the COVID-19 Pandemic: A Randomized Clinical Trial

Authors: Arin M. Connell, Elizabeth A. Stormshak

Published in: Journal of Prevention | Issue 3/2023

Login to get access

Abstract

This study evaluated the effects of an enhanced version of the Family Check-Up Online (FCU-O), adapted to address parent and family functioning in response to the COVID-19 pandemic. In order to increase accessibility, the FCU-O was delivered as a web-based application coupled with online coaching support, a service delivery model that is consistent with pandemic-related limitations for in-person intervention, as well as the limited staffing and resources available in many schools and health care settings despite the increased need for mental health services driven by the pandemic. This registered clinical trial (blinded) tested the effects of the intervention on parental mental health, parenting behaviors, and family functioning from pre-treatment to 2-month follow-up. Families were randomly assigned to receive the FCU-O (N = 74) or to a wait-list control condition (N = 87). Random assignment to the FCU-O was associated with significant improvements in parental well-being, including reduced anxiety, depression, and perceived stress. Further, the FCU-O predicted significant improvements in adaptive parenting skills (e.g. less negative/coercive parenting, greater proactive parenting), and enhancements in family-relational functioning (e.g. improved coparenting). Effect sizes were small to moderate in magnitude (partial eta squared values between 0.03 and 0.11). The results indicate that online delivery of a family-centered intervention may represent a promising approach for addressing pandemic-related impacts on parent and family functioning.
Literature
go back to reference Beatty, L., & Binnion, C. (2016). A systematic review of predictors of, and reasons for, adherence to online psychological interventions. International journal of behavioral medicine, 23, 776–794.CrossRefPubMed Beatty, L., & Binnion, C. (2016). A systematic review of predictors of, and reasons for, adherence to online psychological interventions. International journal of behavioral medicine, 23, 776–794.CrossRefPubMed
go back to reference Breitenstein, S. M., Gross, D., & Christophersen, R. (2014). Digital delivery methods of parenting training interventions: a systematic review. Worldviews on Evidence-Based Nursing, 11, 168–176.CrossRefPubMed Breitenstein, S. M., Gross, D., & Christophersen, R. (2014). Digital delivery methods of parenting training interventions: a systematic review. Worldviews on Evidence-Based Nursing, 11, 168–176.CrossRefPubMed
go back to reference Brennan, L. M., Shelleby, E. C., Shaw, D. S., Gardner, F., Dishion, T. J., & Wilson, M. (2013). Indirect effects of the family check-up on school-age academic achievement through improvements in parenting in early childhood. Journal of educational psychology, 105(3), 762.CrossRef Brennan, L. M., Shelleby, E. C., Shaw, D. S., Gardner, F., Dishion, T. J., & Wilson, M. (2013). Indirect effects of the family check-up on school-age academic achievement through improvements in parenting in early childhood. Journal of educational psychology, 105(3), 762.CrossRef
go back to reference Chang, H., Shaw, D. S., Dishion, T. J., Gardner, F., & Wilson, M. N. (2014). Direct and indirect effects of the family check-up on self-regulation from toddlerhood to early school-age. Journal of abnormal child psychology, 42(7), 1117–1128.CrossRefPubMedPubMedCentral Chang, H., Shaw, D. S., Dishion, T. J., Gardner, F., & Wilson, M. N. (2014). Direct and indirect effects of the family check-up on self-regulation from toddlerhood to early school-age. Journal of abnormal child psychology, 42(7), 1117–1128.CrossRefPubMedPubMedCentral
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioral sciences, 2nd ed. Hillsdale, NJ: Erlbaum. Cohen, J. (1988). Statistical power analysis for the behavioral sciences, 2nd ed. Hillsdale, NJ: Erlbaum.
go back to reference Cohen, S., Kamarck, T., & Mermelstein, R. (1994). Perceived stress scale. Measuring stress: A guide for health and social scientists, 10, 1–2. Cohen, S., Kamarck, T., & Mermelstein, R. (1994). Perceived stress scale. Measuring stress: A guide for health and social scientists, 10, 1–2.
go back to reference Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of consulting and clinical psychology, 75, 568–579.CrossRefPubMed Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of consulting and clinical psychology, 75, 568–579.CrossRefPubMed
go back to reference Connell, A. M., Magee, K., Stormshak, E., Ha, T., Westling, E., Wilson, M., & Shaw, D. (2021). Long-term cross-over effects of the family check-up prevention program on child and adolescent depression: integrative data analysis of three randomized trials. Journal of consulting and clinical psychology, 89(9), 773.CrossRefPubMedPubMedCentral Connell, A. M., Magee, K., Stormshak, E., Ha, T., Westling, E., Wilson, M., & Shaw, D. (2021). Long-term cross-over effects of the family check-up prevention program on child and adolescent depression: integrative data analysis of three randomized trials. Journal of consulting and clinical psychology, 89(9), 773.CrossRefPubMedPubMedCentral
go back to reference Danaher, B. G., Seeley, J. R., Stormshak, E. A., Tyler, M. S., Caruthers, A. S., Moore, K. J., & Cardenas, L. (2018). The Family check-up online program for parents of middle school students: protocol for a randomized controlled trial. JMIR research protocols, 7(7), e11106.CrossRefPubMedPubMedCentral Danaher, B. G., Seeley, J. R., Stormshak, E. A., Tyler, M. S., Caruthers, A. S., Moore, K. J., & Cardenas, L. (2018). The Family check-up online program for parents of middle school students: protocol for a randomized controlled trial. JMIR research protocols, 7(7), e11106.CrossRefPubMedPubMedCentral
go back to reference Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2014). Prevention of problem behavior through annual family check-ups in early childhood: intervention effects from home to early elementary school. Journal of abnormal child psychology, 42, 343–354.CrossRefPubMedPubMedCentral Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2014). Prevention of problem behavior through annual family check-ups in early childhood: intervention effects from home to early elementary school. Journal of abnormal child psychology, 42, 343–354.CrossRefPubMedPubMedCentral
go back to reference Dishion, T. J., Nelson, S. E., & Kavanagh, K. (2003). The family check-up with high-risk young adolescents: preventing early-onset substance use by parent monitoring. Behavior Therapy, 34(4), 553–571.CrossRef Dishion, T. J., Nelson, S. E., & Kavanagh, K. (2003). The family check-up with high-risk young adolescents: preventing early-onset substance use by parent monitoring. Behavior Therapy, 34(4), 553–571.CrossRef
go back to reference Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: an ecological, family-centered approach to mental health care. American Psychological Association. Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: an ecological, family-centered approach to mental health care. American Psychological Association.
go back to reference Dishion, T. J., Stormshak, E. A., & Kavanagh, K. A. (2012). Everyday parenting: a professional’s guide to building family management skills. Research Press. Dishion, T. J., Stormshak, E. A., & Kavanagh, K. A. (2012). Everyday parenting: a professional’s guide to building family management skills. Research Press.
go back to reference Enebrink, P., Högström, J., Forster, M., & Ghaderi, A. (2012). Internet-based parent management training: a randomized controlled study. Behaviour research and therapy, 50(4), 240–249.CrossRefPubMed Enebrink, P., Högström, J., Forster, M., & Ghaderi, A. (2012). Internet-based parent management training: a randomized controlled study. Behaviour research and therapy, 50(4), 240–249.CrossRefPubMed
go back to reference Engzell, P., Frey, A., & Verhagen, M. D. (2021). Learning loss due to school closures during the COVID-19 pandemic. Proceedings of the National Academy of Sciences, 118(17), e2022376118. Engzell, P., Frey, A., & Verhagen, M. D. (2021). Learning loss due to school closures during the COVID-19 pandemic. Proceedings of the National Academy of Sciences, 118(17), e2022376118.
go back to reference Feil, E. G., Baggett, K. M., Davis, B., Sheeber, L., Landry, S., Carta, J. J., & Buzhardt, J. (2008). Expanding the reach of preventive interventions: development of an internet-based training for parents of infants. Child maltreatment, 13(4), 334–346.CrossRefPubMedPubMedCentral Feil, E. G., Baggett, K. M., Davis, B., Sheeber, L., Landry, S., Carta, J. J., & Buzhardt, J. (2008). Expanding the reach of preventive interventions: development of an internet-based training for parents of infants. Child maltreatment, 13(4), 334–346.CrossRefPubMedPubMedCentral
go back to reference Fosco, G. M., Frank, J. L., Stormshak, E. A., & Dishion, T. J. (2013). Opening the “Black Box”: Family Check-Up intervention effects on self-regulation that prevents growth in problem behavior and substance use. Journal of School Psychology, 51(4), 455–468.CrossRefPubMedPubMedCentral Fosco, G. M., Frank, J. L., Stormshak, E. A., & Dishion, T. J. (2013). Opening the “Black Box”: Family Check-Up intervention effects on self-regulation that prevents growth in problem behavior and substance use. Journal of School Psychology, 51(4), 455–468.CrossRefPubMedPubMedCentral
go back to reference Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of psychopathology and behavioral assessment, 26(1), 41–54.CrossRef Gratz, K. L., & Roemer, L. (2004). Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. Journal of psychopathology and behavioral assessment, 26(1), 41–54.CrossRef
go back to reference Hall, C. M., & Bierman, K. L. (2015). Technology-assisted interventions for parents of young children: emerging practices, current research, and future directions. Early childhood research quarterly, 33, 21–32.CrossRefPubMedPubMedCentral Hall, C. M., & Bierman, K. L. (2015). Technology-assisted interventions for parents of young children: emerging practices, current research, and future directions. Early childhood research quarterly, 33, 21–32.CrossRefPubMedPubMedCentral
go back to reference Kaffenberger, M. (2021). Modelling the long-run learning impact of the Covid-19 learning shock: actions to (more than) mitigate loss. International Journal of Educational Development, 81, 102326.CrossRefPubMed Kaffenberger, M. (2021). Modelling the long-run learning impact of the Covid-19 learning shock: actions to (more than) mitigate loss. International Journal of Educational Development, 81, 102326.CrossRefPubMed
go back to reference Karaman, M. A., Eşici, H., Tomar, İ. H., & Aliyev, R. (2021). COVID-19: are school counseling services ready? Students’ psychological symptoms, school counselors’ views, and solutions. Frontiers in Psychology, 12, 647740.CrossRefPubMedPubMedCentral Karaman, M. A., Eşici, H., Tomar, İ. H., & Aliyev, R. (2021). COVID-19: are school counseling services ready? Students’ psychological symptoms, school counselors’ views, and solutions. Frontiers in Psychology, 12, 647740.CrossRefPubMedPubMedCentral
go back to reference Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The difficulties in emotion regulation Scale Short Form (DERS-SF): validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38, 443–455.CrossRef Kaufman, E. A., Xia, M., Fosco, G., Yaptangco, M., Skidmore, C. R., & Crowell, S. E. (2016). The difficulties in emotion regulation Scale Short Form (DERS-SF): validation and replication in adolescent and adult samples. Journal of Psychopathology and Behavioral Assessment, 38, 443–455.CrossRef
go back to reference Kroenke, K., Spitzer, R., Williams, J., Monahan, P., & Löwe, B. (2007). Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection.Annals of Internal Medicine.317–325. Kroenke, K., Spitzer, R., Williams, J., Monahan, P., & Löwe, B. (2007). Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection.Annals of Internal Medicine.317–325.
go back to reference Kroenke, K., Spitzer, R., & Williams, J. (2001). The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine, 16, 606–613.CrossRefPubMedPubMedCentral Kroenke, K., Spitzer, R., & Williams, J. (2001). The PHQ-9: validity of a brief depression severity measure. Journal of general internal medicine, 16, 606–613.CrossRefPubMedPubMedCentral
go back to reference Kroenke, K., Spitzer, R., & Williams, J. (2003). The Patient Health Questionnaire-2: validity of a two-item Depression Screener. Medical Care, 41, 1284–1292.CrossRefPubMed Kroenke, K., Spitzer, R., & Williams, J. (2003). The Patient Health Questionnaire-2: validity of a two-item Depression Screener. Medical Care, 41, 1284–1292.CrossRefPubMed
go back to reference Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American statistical Association, 83, 1198–1202.CrossRef Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American statistical Association, 83, 1198–1202.CrossRef
go back to reference McEachern, A., Dishion, T., Weaver, C., Shaw, D., Wilson, M., & Gardner, F. (2012). Parenting Young Children (PARYC): validation of a self-report parenting measure. Journal of child and family studies, 21, 498–511.CrossRefPubMedPubMedCentral McEachern, A., Dishion, T., Weaver, C., Shaw, D., Wilson, M., & Gardner, F. (2012). Parenting Young Children (PARYC): validation of a self-report parenting measure. Journal of child and family studies, 21, 498–511.CrossRefPubMedPubMedCentral
go back to reference McLean, S. A., Booth, A. T., Schnabel, A., Wright, B. J., Painter, F. L., & McIntosh, J. E. (2021). Exploring the efficacy of telehealth for family therapy through systematic, meta-analytic, and qualitative evidence. Clinical Child and Family Psychology Review, 24(2), 244–266.CrossRefPubMedPubMedCentral McLean, S. A., Booth, A. T., Schnabel, A., Wright, B. J., Painter, F. L., & McIntosh, J. E. (2021). Exploring the efficacy of telehealth for family therapy through systematic, meta-analytic, and qualitative evidence. Clinical Child and Family Psychology Review, 24(2), 244–266.CrossRefPubMedPubMedCentral
go back to reference O’Connell, N. S., Dai, L., Jiang, Y., Speiser, J. L., Ward, R., Wei, W., & Gebregziabher, M. (2017). Methods for analysis of pre-post data in clinical research: a comparison of five common methods. Journal of biometrics & biostatistics, 8(1), 1–8. O’Connell, N. S., Dai, L., Jiang, Y., Speiser, J. L., Ward, R., Wei, W., & Gebregziabher, M. (2017). Methods for analysis of pre-post data in clinical research: a comparison of five common methods. Journal of biometrics & biostatistics, 8(1), 1–8.
go back to reference Sanders, M. R., Baker, S., & Turner, K. M. (2012). A randomized controlled trial evaluating the efficacy of Triple P Online with parents of children with early-onset conduct problems. Behaviour research and therapy, 50(11), 675–684.CrossRefPubMed Sanders, M. R., Baker, S., & Turner, K. M. (2012). A randomized controlled trial evaluating the efficacy of Triple P Online with parents of children with early-onset conduct problems. Behaviour research and therapy, 50(11), 675–684.CrossRefPubMed
go back to reference Seidman, S., Connell, A., Stormshak, E., Westling, E., Ha, T., & Shaw, D. (2023). Disrupting Maternal Transmission of Depression: Using Integrative Data Analysis (IDA) to Examine Indirect Effects of the Family Check-Up (FCU) Across Three Randomized Trials.Prevention Science,1–12. Seidman, S., Connell, A., Stormshak, E., Westling, E., Ha, T., & Shaw, D. (2023). Disrupting Maternal Transmission of Depression: Using Integrative Data Analysis (IDA) to Examine Indirect Effects of the Family Check-Up (FCU) Across Three Randomized Trials.Prevention Science,1–12.
go back to reference Shaw, D. S., Connell, A., Dishion, T. J., Wilson, M. N., & Gardner, F. (2009). Improvements in maternal depression as a mediator of intervention effects on early childhood problem behavior. Development and psychopathology, 21(2), 417–439.CrossRefPubMedPubMedCentral Shaw, D. S., Connell, A., Dishion, T. J., Wilson, M. N., & Gardner, F. (2009). Improvements in maternal depression as a mediator of intervention effects on early childhood problem behavior. Development and psychopathology, 21(2), 417–439.CrossRefPubMedPubMedCentral
go back to reference Shields, W. C., Omaki, E., McDonald, E. M., Rosenberg, R., Aitken, M., Stevens, M. W., & Gielen, A. C. (2018). Cell phone and computer use among parents visiting an urban pediatric emergency department. Pediatric emergency care, 34(12), 878–882.CrossRefPubMedPubMedCentral Shields, W. C., Omaki, E., McDonald, E. M., Rosenberg, R., Aitken, M., Stevens, M. W., & Gielen, A. C. (2018). Cell phone and computer use among parents visiting an urban pediatric emergency department. Pediatric emergency care, 34(12), 878–882.CrossRefPubMedPubMedCentral
go back to reference Smith, J. D., Dishion, T. J., Moore, K. J., Shaw, D. S., & Wilson, M. N. (2013). Effects of video feedback on early coercive parent–child interactions: the intervening role of caregivers’ relational schemas. Journal of Clinical Child & Adolescent Psychology, 42(3), 405–417.CrossRef Smith, J. D., Dishion, T. J., Moore, K. J., Shaw, D. S., & Wilson, M. N. (2013). Effects of video feedback on early coercive parent–child interactions: the intervening role of caregivers’ relational schemas. Journal of Clinical Child & Adolescent Psychology, 42(3), 405–417.CrossRef
go back to reference Stormshak, E. A., Connell, A., & Dishion, T. J. (2009). An adaptive approach to family-centered intervention in schools: linking intervention engagement to academic outcomes in middle and high school. Prevention Science, 10(3), 221–235.CrossRefPubMedPubMedCentral Stormshak, E. A., Connell, A., & Dishion, T. J. (2009). An adaptive approach to family-centered intervention in schools: linking intervention engagement to academic outcomes in middle and high school. Prevention Science, 10(3), 221–235.CrossRefPubMedPubMedCentral
go back to reference Stormshak, E. A., Fosco, G. M., & Dishion, T. J. (2010). Implementing interventions with families in schools to increase youth school engagement: the Family Check-Up model. School Mental Health, 2(2), 82–92.CrossRefPubMedPubMedCentral Stormshak, E. A., Fosco, G. M., & Dishion, T. J. (2010). Implementing interventions with families in schools to increase youth school engagement: the Family Check-Up model. School Mental Health, 2(2), 82–92.CrossRefPubMedPubMedCentral
go back to reference Stormshak, E. A., Matulis, J. M., Nash, W., & Cheng, Y. (2021). The Family Check-Up online: a Telehealth Model for delivery of parenting skills to high-risk families with opioid Use Histories. Frontiers in Psychology, 12, 695967.CrossRefPubMedPubMedCentral Stormshak, E. A., Matulis, J. M., Nash, W., & Cheng, Y. (2021). The Family Check-Up online: a Telehealth Model for delivery of parenting skills to high-risk families with opioid Use Histories. Frontiers in Psychology, 12, 695967.CrossRefPubMedPubMedCentral
go back to reference Stormshak, E. A., Seeley, J. R., Caruthers, A. S., Cardenas, L., Moore, K. J., Tyler, M. S., & Danaher, B. (2019). Evaluating the efficacy of the family Check-Up online: a school-based, eHealth model for the prevention of problem behavior during the middle school years. Development and Psychopathology, 31(5), 1873–1886.CrossRefPubMedPubMedCentral Stormshak, E. A., Seeley, J. R., Caruthers, A. S., Cardenas, L., Moore, K. J., Tyler, M. S., & Danaher, B. (2019). Evaluating the efficacy of the family Check-Up online: a school-based, eHealth model for the prevention of problem behavior during the middle school years. Development and Psychopathology, 31(5), 1873–1886.CrossRefPubMedPubMedCentral
go back to reference Thorisdottir, I. E., Asgeirsdottir, B. B., Kristjansson, A. L., Valdimarsdottir, H. B., Tolgyes, E. M. J., Sigfusson, J., & Halldorsdottir, T. (2021). Depressive symptoms, mental wellbeing, and substance use among adolescents before and during the COVID-19 pandemic in Iceland: a longitudinal, population-based study. The Lancet Psychiatry, 8(8), 663–672.CrossRefPubMed Thorisdottir, I. E., Asgeirsdottir, B. B., Kristjansson, A. L., Valdimarsdottir, H. B., Tolgyes, E. M. J., Sigfusson, J., & Halldorsdottir, T. (2021). Depressive symptoms, mental wellbeing, and substance use among adolescents before and during the COVID-19 pandemic in Iceland: a longitudinal, population-based study. The Lancet Psychiatry, 8(8), 663–672.CrossRefPubMed
go back to reference Van Ryzin, M. J., Stormshak, E. A., & Dishion, T. J. (2012). Engaging parents in the family check-up in middle school: longitudinal effects on family conflict and problem behavior through the high school transition. Journal of Adolescent Health, 50(6), 627–633.CrossRef Van Ryzin, M. J., Stormshak, E. A., & Dishion, T. J. (2012). Engaging parents in the family check-up in middle school: longitudinal effects on family conflict and problem behavior through the high school transition. Journal of Adolescent Health, 50(6), 627–633.CrossRef
go back to reference Waller, R., Powell, T., Rodriguez, Y., Corbett, N., Perlstein, S., White, L. K., & Wagner, N. J. (2021). The impact of the COVID-19 pandemic on children’s conduct problems and callous-unemotional traits. Child Psychiatry & Human Development, 52(6), 1012–1023.CrossRef Waller, R., Powell, T., Rodriguez, Y., Corbett, N., Perlstein, S., White, L. K., & Wagner, N. J. (2021). The impact of the COVID-19 pandemic on children’s conduct problems and callous-unemotional traits. Child Psychiatry & Human Development, 52(6), 1012–1023.CrossRef
Metadata
Title
Evaluating the Efficacy of the Family Check-Up Online to Improve Parent Mental Health and Family Functioning in Response to the COVID-19 Pandemic: A Randomized Clinical Trial
Authors
Arin M. Connell
Elizabeth A. Stormshak
Publication date
16-03-2023
Publisher
Springer US
Keyword
COVID-19
Published in
Journal of Prevention / Issue 3/2023
Print ISSN: 2731-5533
Electronic ISSN: 2731-5541
DOI
https://doi.org/10.1007/s10935-023-00727-1

Other articles of this Issue 3/2023

Journal of Prevention 3/2023 Go to the issue