Skip to main content
Top
Published in: BMC Medicine 1/2013

Open Access 01-12-2013 | Commentary

Triple P-Positive Parenting programs: the folly of basing social policy on underpowered flawed studies

Authors: James C Coyne, Linda Kwakkenbos

Published in: BMC Medicine | Issue 1/2013

Login to get access

Abstract

Wilson et al. provided a valuable systematic and meta-analytic review of the Triple P-Positive Parenting program in which they identified substantial problems in the quality of available evidence. Their review largely escaped unscathed after Sanders et al.'s critical commentary. However, both of these sources overlook the most serious problem with the Triple P literature, namely, the over-reliance on positive but substantially underpowered trials. Such trials are particularly susceptible to risks of bias and investigator manipulation of apparent results. We offer a justification for the criterion of no fewer than 35 participants in either the intervention or control group. Applying this criterion, 19 of the 23 trials identified by Wilson et al. were eliminated. A number of these trials were so small that it would be statistically improbable that they would detect an effect even if it were present. We argued that clinicians and policymakers implementing Triple P programs incorporate evaluations to ensure that goals are being met and resources are not being squandered.
Literature
1.
go back to reference Wilson P, Rush R, Hussey S, Puckering C, Sim F, Allely CS, Doku P, McConnachie A, Gillberg C: How evidence-based is an 'evidence-based parenting program'? A PRISMA systematic review and meta-analysis of Triple P. BMC Med. 2012, 10: 130-10.1186/1741-7015-10-130.CrossRefPubMedPubMedCentral Wilson P, Rush R, Hussey S, Puckering C, Sim F, Allely CS, Doku P, McConnachie A, Gillberg C: How evidence-based is an 'evidence-based parenting program'? A PRISMA systematic review and meta-analysis of Triple P. BMC Med. 2012, 10: 130-10.1186/1741-7015-10-130.CrossRefPubMedPubMedCentral
2.
go back to reference Sanders MR, Pickering JA, Kirby JN, Turner KMT, Morawska A, Mazzucchelli T, Ralph A, Sofronoff K: A commentary on evidence-based parenting programs: redressing misconceptions of the empirical support for Triple P. BMC Med. 2012, 10: 145-10.1186/1741-7015-10-145.CrossRefPubMedPubMedCentral Sanders MR, Pickering JA, Kirby JN, Turner KMT, Morawska A, Mazzucchelli T, Ralph A, Sofronoff K: A commentary on evidence-based parenting programs: redressing misconceptions of the empirical support for Triple P. BMC Med. 2012, 10: 145-10.1186/1741-7015-10-145.CrossRefPubMedPubMedCentral
5.
go back to reference Coyne JC, Thombs BD, Hagedoorn M: Ain't necessarily so: review and critique of recent meta-analyses of behavioral medicine interventions in health psychology. Health Psychol. 2010, 29: 107-116.CrossRefPubMed Coyne JC, Thombs BD, Hagedoorn M: Ain't necessarily so: review and critique of recent meta-analyses of behavioral medicine interventions in health psychology. Health Psychol. 2010, 29: 107-116.CrossRefPubMed
6.
go back to reference Kraemer HC, Gardner C, Brooks JO, Yesavage JA: Advantages of excluding underpowered studies in meta-analysis: inclusionist versus exclusionist viewpoints. Psychol Methods. 1998, 3: 23-31.CrossRef Kraemer HC, Gardner C, Brooks JO, Yesavage JA: Advantages of excluding underpowered studies in meta-analysis: inclusionist versus exclusionist viewpoints. Psychol Methods. 1998, 3: 23-31.CrossRef
7.
go back to reference Connell S, Sanders MR, Markie-Dadds C: Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behav Modif. 1997, 21: 379-408. 10.1177/01454455970214001.CrossRefPubMed Connell S, Sanders MR, Markie-Dadds C: Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behav Modif. 1997, 21: 379-408. 10.1177/01454455970214001.CrossRefPubMed
8.
go back to reference Turner KM, Sanders MR: Help when it's needed first: a controlled evaluation of brief, preventive behavioral family intervention in a primary care setting. Behav Ther. 2006, 37: 131-142. 10.1016/j.beth.2005.05.004.CrossRefPubMed Turner KM, Sanders MR: Help when it's needed first: a controlled evaluation of brief, preventive behavioral family intervention in a primary care setting. Behav Ther. 2006, 37: 131-142. 10.1016/j.beth.2005.05.004.CrossRefPubMed
9.
go back to reference Sterne JA, Gavaghan D, Egger M: Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000, 53: 1119-1129. 10.1016/S0895-4356(00)00242-0.CrossRefPubMed Sterne JA, Gavaghan D, Egger M: Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000, 53: 1119-1129. 10.1016/S0895-4356(00)00242-0.CrossRefPubMed
10.
go back to reference Hahlweg K, Heinrichs N, Kuschel A, Bertram H, Naumann S: Long-term outcome of a randomized controlled universal prevention trial through a positive parenting program: is it worth the effort?. Child Adolesc Psychiatry Ment Health. 2010, 4: 14-10.1186/1753-2000-4-14.CrossRefPubMedPubMedCentral Hahlweg K, Heinrichs N, Kuschel A, Bertram H, Naumann S: Long-term outcome of a randomized controlled universal prevention trial through a positive parenting program: is it worth the effort?. Child Adolesc Psychiatry Ment Health. 2010, 4: 14-10.1186/1753-2000-4-14.CrossRefPubMedPubMedCentral
11.
go back to reference Bodenmann G, Cina A, Ledermann T, Sanders MR: The efficacy of the Triple P-Positive Parenting Program in improving parenting and child behavior: a comparison with two other treatment conditions. Behav Res Ther. 2008, 46: 411-427. 10.1016/j.brat.2008.01.001.CrossRefPubMed Bodenmann G, Cina A, Ledermann T, Sanders MR: The efficacy of the Triple P-Positive Parenting Program in improving parenting and child behavior: a comparison with two other treatment conditions. Behav Res Ther. 2008, 46: 411-427. 10.1016/j.brat.2008.01.001.CrossRefPubMed
12.
go back to reference Morawska A, Sanders MR: Self-administered behavioral family intervention for parents of toddlers: part I. Efficacy. J Consult Clin Psychol. 2006, 74: 10-19.CrossRefPubMed Morawska A, Sanders MR: Self-administered behavioral family intervention for parents of toddlers: part I. Efficacy. J Consult Clin Psychol. 2006, 74: 10-19.CrossRefPubMed
13.
go back to reference Sanders MR, Markie-Dadds C, Tully LA, Bor W: The Triple P-Positive Parenting Program: a comparison of enhanced, standard, and self-directed behavioral family intervention for parents of children with early onset conduct problems. J Consult Clin Psychol. 2000, 68: 624-640.CrossRefPubMed Sanders MR, Markie-Dadds C, Tully LA, Bor W: The Triple P-Positive Parenting Program: a comparison of enhanced, standard, and self-directed behavioral family intervention for parents of children with early onset conduct problems. J Consult Clin Psychol. 2000, 68: 624-640.CrossRefPubMed
14.
go back to reference Bettis RA: The search for asterisks: compromised statistical tests and flawed theories. Strat Mgmt J. 2012, 33: 108-113. 10.1002/smj.975.CrossRef Bettis RA: The search for asterisks: compromised statistical tests and flawed theories. Strat Mgmt J. 2012, 33: 108-113. 10.1002/smj.975.CrossRef
15.
go back to reference Giner-Sorolla R: Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspect Psychol Sci. 2012, 7: 562-571. 10.1177/1745691612457576.CrossRefPubMed Giner-Sorolla R: Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspect Psychol Sci. 2012, 7: 562-571. 10.1177/1745691612457576.CrossRefPubMed
16.
go back to reference Simmons JP, Nelson LD, Simonsohn U: False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011, 22: 1359-1366. 10.1177/0956797611417632.CrossRefPubMed Simmons JP, Nelson LD, Simonsohn U: False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011, 22: 1359-1366. 10.1177/0956797611417632.CrossRefPubMed
17.
go back to reference Ioannidis J: Scientific inbreeding and same-team replication: Type D personality as an example. J Psychosom Res. 2012, 73: 408-410. 10.1016/j.jpsychores.2012.09.014.CrossRefPubMed Ioannidis J: Scientific inbreeding and same-team replication: Type D personality as an example. J Psychosom Res. 2012, 73: 408-410. 10.1016/j.jpsychores.2012.09.014.CrossRefPubMed
Metadata
Title
Triple P-Positive Parenting programs: the folly of basing social policy on underpowered flawed studies
Authors
James C Coyne
Linda Kwakkenbos
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2013
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-11-11

Other articles of this Issue 1/2013

BMC Medicine 1/2013 Go to the issue