Top

Published in:

01-06-2012

Effects of a Universal Parenting Program for Highly Adherent Parents: A Propensity Score Matching Approach

Authors: Manuel Eisner, Daniel Nagin, Denis Ribeaud, Tina Malti

Published in: Prevention Science | Issue 3/2012

Abstract

This paper examines the effectiveness of a group-based universal parent training program as a strategy to improve parenting practices and prevent child problem behavior. In a dissemination trial, 56 schools were first selected through a stratified sampling procedure, and then randomly allocated to treatment conditions. 819 parents of year 1 primary school children in 28 schools were offered Triple P. 856 families in 28 schools were allocated to the control condition. Teacher, primary caregiver and child self-report data were collected at baseline, post, and two follow-up assessments. Analyses were constrained to highly adherent parents who completed all four units of the parenting program. A propensity score matching approach was used to compare parents fully exposed to the intervention with parents in the control condition, who were matched on 54 baseline characteristics. Results suggest that the intervention had no consistent effects on either five dimensions of parenting practices or five dimensions of child problem behavior, assessed by three different informants. These findings diverge from findings reported by program developers and distributors. Potential explanations for the discrepancy and implications for future research are discussed.

Available only for authorised users

Achenbach, T. M., & Edelbrock, C. S. (1981). Behavioral problems and competencies reported by parents of normal and disturbed children aged four through sixteen. Monographs of the Society for Research in Child Development, 46, 1–82.PubMedCrossRef

Arpino, B., & Mealli, F. (2011). The specification of the propensity score in multilevel observational studies. Computational Statistics and Data Analysis, 55, 1770–1780.CrossRef

Barlow, J., & Stewart-Brown, S. (2000). Behavior problems and group-based parent education programs. Journal of Developmental and Behavioral Pediatrics, 21, 356–370.PubMedCrossRef

Bauer, N. S., Lozano, P., & Rivara, F. P. (2007). The effectiveness of the Olweus Bullying Prevention Program in public middle schools: A controlled trial. The Journal of Adolescent Health, 40, 266–274.PubMedCrossRef

Becker, S. O., & Ichino, A. (2002). Estimation of average treatment effects based on propensity scores. The Stata Journal, 2, 358–377.

Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Sturmer, T. (2006). Variable selection for propensity score models. American Journal of Epidemiology, 163, 1149–1156.PubMedCrossRef

Caliendo, M., & Kopeinig, S. (2005). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22, 31–72.CrossRef

Capaldi, D. M., Chamberlain, P., & Patterson, G. R. (1997). Ineffective discipline and conduct problems in males: Association, late adolescent outcomes, and prevention. Aggression and Violent Behavior, 2, 343–353.CrossRef

Clerkin, S. M., Marks, D. J., Policaro, K. L., & Halperin, J. M. (2007). Psychometric properties of the Alabama Parenting Questionnaire-preschool revision. Journal of Clinical Child & Adolescent Psychology, 36, 19–28.

D’Agostino, R. B. (1998). Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Statistics in Medicine, 17, 2265–2281.PubMedCrossRef

de Graaf, I., Onrust, S., Haverman, M., & Janssens, J. (2009). Helping families improve: An evaluation of two primary care approaches to parenting support in the Netherlands. Infant and Child Development, 18, 481–501.CrossRef

Dehejia, R. H., & Wahba, S. (2002). Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics, 84, 151–161.CrossRef

Diaz, J. J., & Handa, S. (2006). An assessment of propensity score matching as a nonexperimental impact estimator: Evidence from Mexico’s PROGRESA program. Journal of Human Resources, XLI, 319–345.

Dumas, J. E., Nissley-Tsiopinis, J., & Moreland, A. D. (2007). From intent to enrollment, attendance, and participation in preventive parenting groups. Journal of Child and Family Studies, 16, 1–26.CrossRef

Dumka, L. E., Grarza, C. A., Roosa, M. W., & Stoerzinger, H. D. (1997). Recruitment and retention of high-risk families into a preventive parent training intervention. Journal of Primary Prevention, 18, 25–37.CrossRef

Eisner, M., & Ribeaud, D. (2005). A randomised field experiment to prevent violence: The Zurich intervention and prevention project at schools, ZIPPS. European Journal of Crime, Criminal Law and Criminal Justice, 13, 27–43.CrossRef

Eisner, M., & Ribeaud, D. (2007). Conducting a criminological survey in a culturally diverse context: Lessons from the Zurich project on the social development of children. European Journal of Criminology, 4, 271–288.CrossRef

Eisner, M., Meidert, U., Ribeaud, D., & Malti, T. (2011). From enrollment to utilization – stages of parental engagement in a universal parent training program. Journal of Primary Prevention, 32, 83–93.PubMedCrossRef

Essau, C. A., Sasagawa, S., & Frick, P. J. (2006). Psychometric properties of the Alabama Parenting Questionnaire. Journal of Child and Family Studies, 15, 597–616.CrossRef

Eyberg, S. M., & Ross, A. W. (1978). Assessment of child behavior problems: The validation of a new inventory. Journal of Consulting and Clinical Psychology, 7, 113–116.

Farrington, D. P., & Welsh, B. C. (2007). Saving children from a life of crime; early risk factors and effective interventions. Oxford, UK: Oxford University Press.

Friedman, L. S., & Richter, E. D. (2004). Relationship between conflicts of interest and research results. Journal of General Internal Medicine, 19, 51–56.PubMedCrossRef

Gottfredson, D., Kumpfer, K., Polizzi-Fox, D., Wilson, D., Puryear, V., Beatty, P., & Vilmenay, M. (2006). The Strengthening Washington D.C. Families project: A randomized effectiveness trial of family-based prevention. Prevention Science, 7, 57–74.PubMedCrossRef

Greenberg, M. T., Kusché, C. A., & Mihalic, S. F. (1998). Blueprints for violence prevention, book ten: Promoting Alternative Thinking Strategies (PATHS). Boulder, CO: Center for the Study and Prevention of Violence.

Gross, D., Garvey, C., Julion, W., Fogg, L., Tucker, S., & Mokros, H. (2009). Efficacy of the Chicago Parent Program with low-income African American and Latino parents of young children. Prevention Science, 10, 54–65.PubMedCrossRef

Guo, S., & Fraser, M. W. (2010). Propensity score analysis: Statistical methods and applications. Thousand Oaks, CA: Sage.

Guo, S., Barth, R. P., & Gibbons, C. (2006). Propensity score matching strategies for evaluating substance abuse services for child welfare clients. Children and Youth Services Review, 28, 357–383.CrossRef

Haggerty, K. P., Fleming, C. B., Lonczak, H. S., Oxford, M. L., Harachi, T. W., & Catalano, R. F. (2002). Predictors of participation in parenting workshops. Journal of Primary Prevention, 22, 375–387.CrossRef

Hallfors, D., Cho, H., Sanchez, V., Khatapoush, S., Kim, H. M., & Bauer, D. (2006). Efficacy vs effectiveness trial results of an indicated “model” substance abuse program: Implications for public health. American Journal of Public Health, 96, 2254–2259.PubMedCrossRef

Haviland, A., Nagin, D. S., & Rosenbaum, P. R. (2007). Combining propensity score matching and group-based trajectory analysis in an observational study. Psychological Methods, 12, 247–267.PubMedCrossRef

Heinrichs, N., Bertram, H., Kuschel, A., & Hahlweg, K. (2005). Parent recruitment and retention in a universal prevention program for child behavior and emotional problems: Barriers to research and program participation. Prevention Science, 6, 275–286.PubMedCrossRef

Heinrichs, N., Hahlweg, K., Bertram, H., Kuschel, A., Naumann, S., & Harstick, S. (2006). Die langfristige Wirksamkeit eines Elterntrainings zur universellen Prävention kindlicher Verhaltensstörungen: Ergebnisse aus Sicht der Mütter und Väter. Zeitschrift für klinische Psychologie und Psychotherapie, 35, 82–96.CrossRef

Hiscock, H., Bayer, J. K., Price, A., Ukoumunne, O. C., Rogers, S., & Wake, M. (2008). Universal parenting programme to prevent early childhood behavioural problems: Cluster randomised trial. BMJ, 336, 318–321.PubMedCrossRef

Jenson, J. M., & Dieterich, W. A. (2007). Effects of a skills-based prevention program on bullying and bully victimization among elementary school children. Prevention Science, 8, 285–296.PubMedCrossRef

Lacourse, E., Côté, S., Nagin, D. S., Vitaro, F., Brendgen, M., & Tremblay, R. E. (2002). A longitudinal-experimental approach to testing theories of antisocial behavior development. Development and Psychopathology, 14, 909–924.PubMedCrossRef

Leuven, E., & Sianesi, B. (2003). PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. Retrieved from http://ideas.repec.org/c/boc/bocode/s432001.html.

Loeber, R., & Stouthamer-Loeber, M. (1986). Family factors as correlates and predictors of juvenile conduct problems and delinquency. In M. Tonry & N. Morris (Eds.), Crime and justice ((pp, Vol. 7, pp. 29–149). Chicago, IL: Chicago University Press.

Lösel, F., Beelmann, A., Stemmler, M., & Jaursch, S. (2006). Probleme des Sozialverhaltens im Vorschulalter: Evaluation des Eltern- und Kindertrainings EFFEKT. Zeitschrift für klinische Psychologie und Psychotherapie, 35, 127–139.CrossRef

Lundahl, B., Risser, H. J., & Lovejoy, M. C. (2006). A meta-analysis of parent training: Moderators and follow-up effects. Clinical Psychology Review, 26, 86–104.PubMedCrossRef

Malti, T., Ribeaud, D., & Eisner, M. (2011). The effects of two universal preventive interventions to reduce children’s externalizing behavior: A cluster randomized controlled trial. Journal of Clinical Child and Adolescent Psychology, 40, 677–692. doi:10.1080/15374416.2011.597084.PubMedCrossRef

Maughan, D. R., Christiansen, E., Jenson, W. R., Olympia, D., & Clark, E. (2005). Behavioral parent training as a treatment for externalizing behaviors and disruptive behavior disorders: A meta-analysis. School Psychology Review, 34, 267–286.

McConnell, D., Breitkreuz, R., & Savage, A. (2011). Independent evaluation of the Triple P Positive Parenting Program in family support service settings. Child & Family Social Work. doi:10.1111/j.1365-2206.2011.00771.

McTaggart, P., & Sanders, M. R. (2003). The transition to school project: Results from the classroom. Australian e-Journal for the Advancement of Mental Health, 2, 1–12.

Morawska, A., & Sanders, M. R. (2006). A review of parental engagement in parenting interventions and strategies to promote it. Journal of Children’s Services, 1, 29–40.

Morgan, S. L., & Harding, D. J. (2006). Matching estimators of causal effects: Prospects and pitfalls in theory and practice. Sociological Methods Research, 35, 3–60.CrossRef

Nixon, R. D. V. (2002). Treatment of behavior problems in preschoolers: A review of parent training programs. Clinical Psychology Review, 22, 525–546.PubMedCrossRef

Nowak, C., & Heinrichs, N. (2008). A comprehensive meta-analysis of Triple P-Positive Parenting Program using hierarchical linear modeling: Effectiveness and moderating variables. Clinical Child and Family Psychology Review, 11, 114–144.PubMedCrossRef

Oakes, J. M., & Feldman, H. A. (2001). Statistical power for nonequivalent pretest-posttest designs: The impact of change-score versus ANCOVA models. Evaluation Review, 25, 3–28.PubMedCrossRef

Onur, B. (2006). Too much ado about propensity score models? Comparing methods of propensity score matching. Value in Health, 9, 377–385.CrossRef

Perlis, R. H., Perlis, C. S., Wu, Y., Hwang, C., Joseph, M., & Nierenberg, A. A. (2005). Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry. American Journal of Psychiatry, 162, 1957–1960.PubMedCrossRef

Petrosino, A., & Soydan, H. (2005). The impact of program developers as evaluators on criminal recidivism: Results from meta-analyses of experimental and quasi-experimental research. Journal of Experimental Criminology, 1, 435–450.CrossRef

Piquero, A., Farrington, D. P., Welsh, B. C., Tremblay, R. E., & Jennings, W. (2009). Effects of early family/parent training programs on antisocial behavior and delinquency. Journal of Experimental Criminology, 5, 83–120.CrossRef

Reyno, S. M., & McGrath, P. J. (2006). Predictors of parent training efficacy for child externalizing behavior problems - a meta-analytic review. Journal of Child Psychology and Psychiatry, 47, 99–111.PubMedCrossRef

Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41–55.CrossRef

Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39, 33–38.

Rubin, D. B., & Thomas, N. (1996). Matching using estimated propensity scores: Relating theory to practice. Biometrics, 52, 249–264.PubMedCrossRef

Sanders, M. R. (1999). Triple P-Positive Parenting Program: Towards an empirically validated multilevel parenting and family support strategy for the prevention of behaviour and emotional problems in children. Clinical Child and Family Psychology Review, 2, 71–89.PubMedCrossRef

Sanders, M. R., Turner, K. T., & Markie-Dadds, C. (2002). The development and dissemination of the Triple P—Positive Parenting Program: A multilevel, evidence-based system of parenting and family support. Prevention Science, 3, 173–189.PubMedCrossRef

Sanders, M. R., Markie-Dadds, C., & Turner, K. T. (2003). Theoretical, scientific and clinical foundations of the Triple P Positive Parenting Program: A population approach to the promotion of parenting competence. Parenting Research and Practice Monograph, 1, 1–21.

Serketich, W. J., & Dumas, J. E. (1996). The effectiveness of behavioral parent training to modify antisocial behavior in children: A meta-analysis. Behavior Therapy, 27, 171–186.CrossRef

Shelton, K. K., Frick, P. J., & Wootton, J. (1996). Assessment of parenting practices in families of elementary school-age children. Journal of Clinical Child Psychology, 25, 317–329.CrossRef

Smith, J. A., & Todd, P. E. (2005). Does matching overcome LaLonde’s critique of nonexperimental estimators? Journal of Econometrics, 125, 305–353.CrossRef

Spoth, R. L. (2001). Randomized trial of brief family interventions for general populations: Adolescent substance use outcomes 4 years following baseline. Journal of Consulting and Clinical Psychology, 69, 627.PubMedCrossRef

Spoth, R. L., Redmond, C., & Shin, C. (2000). Modeling factors influencing enrollment in family-focused preventive intervention research. Prevention Science, 1, 213–225.PubMedCrossRef

Spoth, R. L., Kavanagh, K. A., & Dishion, T. J. (2002). Family-centered preventive intervention science: Toward benefits to larger populations of children, youth, and families. Prevention Science, 3, 145–152.PubMedCrossRef

St. Pierre, T. L., Osgood, D. W., Mincemoyer, C. C., Kaltreider, D. L., & Kauh, T. J. (2005). Results of an independent evaluation of project ALERT delivered in schools by cooperative extension. Prevention Science, 6, 305–317.PubMedCrossRef

Tremblay, R. E., Loeber, R., Gagnon, C., Charlebois, P., Larivée, S., & LeBlanc, M. (1991). Disruptive boys with stable and unstable high fighting behavior patterns during junior elementary school. Journal of Abnormal Child Psychology, 19, 285–300.PubMedCrossRef

Vitaro, F., & Tremblay, R. E. (1994). Impact of a prevention program on aggressive children’s friendships and social adjustment. Journal of Abnormal Child Psychology, 22, 457–475.PubMedCrossRef

Webster-Stratton, C., & Taylor, T. (2001). Nipping early risk factors in the bud: Preventing substance abuse, delinquency, and violence in adolescence through interventions targeted at young children (0–8 years). Prevention Science, 2, 165–192.PubMedCrossRef

Title: Effects of a Universal Parenting Program for Highly Adherent Parents: A Propensity Score Matching Approach
Authors: Manuel Eisner
Daniel Nagin
Denis Ribeaud
Tina Malti
Publication date: 01-06-2012
Publisher: Springer US
Published in: Prevention Science / Issue 3/2012
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI: https://doi.org/10.1007/s11121-011-0266-x

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Effects of a Universal Parenting Program for Highly Adherent Parents: A Propensity Score Matching Approach

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2012

Beyond Primary Prevention of Alcohol Use: A Culturally Specific Secondary Prevention Program for Mexican Heritage Adolescents

Selling and Buying Sex: A Longitudinal Study of Risk and Protective Factors in Adolescence

Differential Impact of a Dutch Alcohol Prevention Program Targeting Adolescents and Parents Separately and Simultaneously: Low Self-Control and Lenient Parenting at Baseline Predict Effectiveness

Mixed Methods Analysis of Participant Attrition in the Nurse-Family Partnership

Person Mobility in the Design and Analysis of Cluster-Randomized Cohort Prevention Trials

The Moderating Effects of Parent Antisocial Characteristics on the Effects of Parent Management Training-Oregon (PMTO™)