Top

Published in:

01-08-2018

The Cascading Effects of Multiple Dimensions of Implementation on Program Outcomes: a Test of a Theoretical Model

Authors: Cady Berkel, Anne M. Mauricio, Irwin N. Sandler, Sharlene A. Wolchik, Carlos G. Gallo, C. Hendricks Brown

Published in: Prevention Science | Issue 6/2018

Abstract

This study tests a theoretical cascade model in which multiple dimensions of facilitator delivery predict indicators of participant responsiveness, which in turn lead to improvements in targeted program outcomes. An effectiveness trial of the 10-session New Beginnings Program for divorcing families was implemented in partnership with four county-level family courts. This study included 366 families assigned to the intervention condition who attended at least one session. Independent observers provided ratings of program delivery (i.e., fidelity to the curriculum and process quality). Facilitators reported on parent attendance and parents’ competence in home practice of program skills. At pretest and posttest, children reported on parenting and parents reported child mental health. We hypothesized effects of quality on attendance, fidelity and attendance on home practice, and home practice on improvements in parenting and child mental health. Structural Equation Modeling with mediation and moderation analyses were used to test these associations. Results indicated quality was significantly associated with attendance, and attendance moderated the effect of fidelity on home practice. Home practice was a significant mediator of the links between fidelity and improvements in parent-child relationship quality and child externalizing and internalizing problems. Findings provide support for fidelity to the curriculum, process quality, attendance, and home practice as valid predictors of program outcomes for mothers and fathers. Future directions for assessing implementation in community settings are discussed.

Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the child behavior checklist and revised behavior profile. Stowe: University of Vermont Department of Psychiatry.

Aiken, L. S., & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks: Sage Publications, Inc..

Barnes, H., & Olson, D. H. (1982). Parent-Adolescent Communication Scale. In D. H. Olson, H. I. McCubbin, H. Barnes, A. Larsen, M. Muxen, & M. Wilson (Eds.), Family inventories: Inventories used in a national survey of families across the family life cycle (pp. 33–48). St. Paul: Family Social Science, University of Minnesota.

Barrera, M., Berkel, C., & Castro, F. G. (2017). Directions for the advancement of culturally adapted preventive interventions: Local adaptations, engagement, and sustainability. Prevention Science, 18, 640–648.CrossRefPubMed

Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33.CrossRefPubMedPubMedCentral

Berkel, C., Murry, V. M., Roulston, K. J., & Brody, G. H. (2013). Understanding the art and science of implementation in the SAAF efficacy trial. Health Education, 113, 297–323.CrossRefPubMed

Berkel, C., Sandler, I. N., Wolchik, S. A., Brown, C. H., Gallo, C. G., Chiapa, A., Mauricio, A. M., & Jones, S. (2016). “Home practice is the program:” Parents’ practice of program skills as predictors of outcomes in the new beginnings program effectiveness trial. Prevention Science, online first.

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.CrossRef

Clarke, A. T., Marshall, S. A., Mautone, J. A., Soffer, S. L., Jones, H. A., Costigan, T. E., Patterson, A., Jawad, A. F., & Power, T. J. (2015). Parent attendance and homework adherence predict response to a family–school intervention for children with ADHD. Journal of Clinical Child & Adolescent Psychology, 44, 58–67.CrossRef

Coatsworth, J. D., Duncan, L. G., Pantin, H., & Szapocznik, J. (2006). Retaining ethnic minority parents in a preventive intervention: The quality of group process. Journal of Primary Prevention, 27, 367–389.CrossRefPubMed

Cusack, J., Deane, F. P., Wilson, C. J., & Ciarrochi, J. (2006). Emotional expression, perceptions of therapy, and help-seeking intentions in men attending therapy services. Psychology of Men & Masculinity, 7, 69–82.CrossRef

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.CrossRefPubMed

Durlak, J., & DuPre, E. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMed

Eames, C., Daley, D., Hutchings, J., Hughes, J. C., Jones, K., Martin, P., & Bywater, T. (2008). The leader observation tool: A process skills treatment fidelity measure for the incredible years parenting programme. Child: Care, Health and Development, 34, 391–400.

Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training. Behavior Therapy, 36, 3–13.CrossRefPubMedPubMedCentral

Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18, 233–239.CrossRefPubMedPubMedCentral

Gottfredson, D., Kumpfer, K., Polizzi-Fox, D., Wilson, D., Puryear, V., Beatty, P., & Vilmenay, M. (2006). The strengthening Washington D.C. families project: A randomized effectiveness trial of family-based prevention. Prevention Science, 7, 57–74.CrossRefPubMed

Hogue, A., Liddle, H. A., & Rowe, C. (1996). Treatment adherence process research in family therapy: A rationale and some practical guidelines. Psychotherapy: Theory, Research, Practice, Training, 33, 332–345.CrossRef

Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef

Kazantzis, N., Deane, F. P., & Ronan, K. R. (2004). Assessing compliance with homework assignments: Review and recommendations for clinical practice. Journal of Clinical Psychology, 60, 627–641.CrossRefPubMed

Lochman, J. E., Boxmeyer, C., Powell, N., Qu, L., Wells, K., & Windle, M. (2009). Dissemination of the coping power program: Importance of intensity of counselor training. Journal of Consulting & Clinical Psychology, 77, 397–409.CrossRef

Muthén, B. O., & Muthén, L. K. (2012). Mplus, Version 7.1. Los Angeles: Muthén & Muthén.

NRC/IOM. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, D.C.: NRC/IOM.

Orrell-Valente, J. K., Pinderhughes, E. E., Valente, E., & Laird, R. D. (1999). If it's offered, will they come? Influences on parents’ participation in a community-based conduct problems prevention program. American Journal of Community Psychology, 27, 753–783.CrossRefPubMedPubMedCentral

Riggs, N. R., Elfenbaum, P., & Pentz, M. A. (2006). Parent program component analysis in a drug abuse prevention trial. Journal of Adolescent Health, 39, 66–72.CrossRefPubMed

Ros, R., Hernandez, J., Graziano, P. A., & Bagner, D. M. (2016). Parent training for children with or at risk for developmental delay: The role of parental homework completion. Behavior Therapy, 47, 1–13.CrossRefPubMed

Sandler, I. N., Wolchik, S. A., Berkel, C., Jones, S., Mauricio, A. M., Tein, J.-Y., & Winslow, E. (2016). Effectiveness trial of the new beginnings program (NBP) for divorcing and separating parents: Translation from an experimental prototype to an evidence-based community service. In M. Israelashvili & J. L. Romano (Eds.), Cambridge handbook of international prevention science. Cambridge: Cambridge University Press.

Sandler, I. N., Gunn, H., Mazza, G., Tein, J.-Y., Wolchik, S. A., Berkel, C., Jones, S., & Porter, M. M. (2017). Effects of a program to promote high quality parenting by divorced and separated fathers. Prevention Science, online first, 1-11.

Schaefer, E. S. (1965). Children’s report of parental behavior: An inventory. Child Development, 36, 413–424.CrossRefPubMed

Schoenfelder, E., Sandler, I. N., Millsap, R. E., Wolchik, S. A., Berkel, C., & Ayers, T. S. (2012). Responsiveness to the family bereavement program: What predicts responsiveness? What does responsiveness predict? Prevention Science, 14, 545–556.CrossRef

Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier, S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration & Policy in Mental Health & Mental Health Services Research, 38, 32–43.CrossRef

Soper, D. (2006-2011). Interaction v.1.7. Retrieved from danielsoper.com/Interaction/free.aspx

Stevenson, M. M., Braver, S. L., Ellman, I. M., & Votruba, A. M. (2013). Fathers, divorce, and child custody. In N. J. Cabrera & C. S. Tamis-LeMonda (Eds.), Handbook of father involvement: Multidisciplinary perspectives (2nd ed., pp. 379–396). New York: Routledge/Taylor & Francis.

Tofighi, D., & MacKinnon, D. P. (2011). RMediation: An R package for mediation analysis confidence intervals. Behavior Research Methods, 43, 692–700.CrossRefPubMedPubMedCentral

Triemstra, K. T., Niec, L. N., Peer, S. O., & Christian-Brandt, A. S. (2016). The influence of conventional masculine gender role norms on parental attitudes toward seeking psychological services for children. Psychology of Men & Masculinity.

West, S. G., Aiken, L. S., & Todd, M. (1993). Probing the effects of individual components in multiple component prevention programs. American Journal of Community Psychology, 21, 571–605.CrossRefPubMed

Wolchik, S., Sandler, I., Weiss, L., & Winslow, E. (2007). New beginnings: An empirically-based program to help divorced mothers promote resilience in their children. In J. M. Briesmeister & C. E. Schaefer (Eds.), Handbook of parent training: Helping parents prevent and solve problem behaviors (3rd ed., pp. 25–62). Hoboken: John Wiley.

Title: The Cascading Effects of Multiple Dimensions of Implementation on Program Outcomes: a Test of a Theoretical Model
Authors: Cady Berkel
Anne M. Mauricio
Irwin N. Sandler
Sharlene A. Wolchik
Carlos G. Gallo
C. Hendricks Brown
Publication date: 01-08-2018
Publisher: Springer US
Published in: Prevention Science / Issue 6/2018
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI: https://doi.org/10.1007/s11121-017-0855-4

Keynote webinar | Spotlight on medication adherence

Springer Medicine

The Cascading Effects of Multiple Dimensions of Implementation on Program Outcomes: a Test of a Theoretical Model

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2018

Childhood Trauma and Two Stages of Alcohol Use in African American and European American Women: Findings from a Female Twin Sample

A Cost Analysis of School-Based Lifestyle Interventions

Why Does a Universal Anti-Bullying Program Not Help All Children? Explaining Persistent Victimization During an Intervention

Integrative Data Analysis of Gender and Ethnic Measurement Invariance in Nicotine Dependence Symptoms

Correction to: Predictors of Participation in the Family Check-Up Program: a Randomized Trial of Yearly Services from Age 2 to 10 Years

Impact of Behavioral Drug Abuse Treatment on Sexual Risk Behaviors: An Integrative Data Analysis of Eight Trials Conducted Within the National Drug Abuse Treatment Clinical Trials Network