Skip to main content
Top
Published in: BMC Medicine 1/2013

Open Access 01-12-2013 | Research article

Which placebo to cure depression? A thought-provoking network meta-analysis

Authors: Florian Naudet, Bruno Millet, Philippe Charlier, Jean Michel Reymann, Anne Solène Maria, Bruno Falissard

Published in: BMC Medicine | Issue 1/2013

Login to get access

Abstract

Background

Antidepressants are often considered to be mere placebos despite the fact that meta-analyses are able to rank them. It follows that it should also be possible to rank different placebos, which are all made of sucrose. To explore this issue, which is rather more epistemological than clinical, we designed an unusual meta-analysis to investigate whether the effects of placebo in one situation are different from the effects of placebo in another situation.

Methods

Published and unpublished studies were searched for by three reviewers on Medline, the Cochrane Library, Embase, clinicaltrials.gov, Current Controlled Trial, in bibliographies, and by mailing key organizations. The following studies in first-line treatment for major depressive disorder were considered to construct an “evidence network”: 1) randomized controlled trials (RCTs) versus placebo on fluoxetine, venlafaxine and 2) fluoxetine versus venlafaxine head-to-head RCTs.
Two network meta-analyses were run to indirectly compare response and remission rates among three different placebos: 1) fluoxetine placebo, 2) venlafaxine placebo, and 3) venlafaxine/fluoxetine placebo (that is, placebo compared to both venlafaxine and fluoxetine). Publication biases were assessed using funnel plots and statistically tested.

Results

The three placebos were not significantly different in terms of response or remission. The antidepressant agents were significantly more efficacious than the placebos, and venlafaxine was more efficacious than fluoxetine. The funnel plots, however, showed a major publication bias.

Conclusion

The presence of significant levels of publication bias indicates that we cannot even be certain of the conclusion that sucrose equals sucrose in trials of major depressive disorder. This result should remind clinicians to step back to take a more objective view when interpreting a scientific result. It is of crucial importance for their practice, far more so than ranking antidepressant efficacy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Benedetti F: Placebo Effects: Understanding the Mechanisms in Health and Disease. 2009, Oxford, UK: Oxford University Press Benedetti F: Placebo Effects: Understanding the Mechanisms in Health and Disease. 2009, Oxford, UK: Oxford University Press
3.
go back to reference Ioannidis JP: Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials?. Philos Ethics Humanit Med. 2008, 3: 14-10.1186/1747-5341-3-14.CrossRefPubMedPubMedCentral Ioannidis JP: Effectiveness of antidepressants: an evidence myth constructed from a thousand randomized trials?. Philos Ethics Humanit Med. 2008, 3: 14-10.1186/1747-5341-3-14.CrossRefPubMedPubMedCentral
4.
go back to reference Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, Johnson BT: Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS Med. 2008, 5: e45-10.1371/journal.pmed.0050045.CrossRefPubMedPubMedCentral Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, Johnson BT: Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS Med. 2008, 5: e45-10.1371/journal.pmed.0050045.CrossRefPubMedPubMedCentral
5.
go back to reference Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, Fawcett J: Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA. 2010, 303: 47-53. 10.1001/jama.2009.1943.CrossRefPubMedPubMedCentral Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, Fawcett J: Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA. 2010, 303: 47-53. 10.1001/jama.2009.1943.CrossRefPubMedPubMedCentral
6.
go back to reference Moncrieff J: The Myth of the Chemical Cure: A Critique of Psychiatric Drug Treatment. Revised Edition. 2009, Basingstoke, UK: Palgrave Macmillan Moncrieff J: The Myth of the Chemical Cure: A Critique of Psychiatric Drug Treatment. Revised Edition. 2009, Basingstoke, UK: Palgrave Macmillan
7.
go back to reference Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, Watanabe N, Nakagawa A, Omori IM, McGuire H, Tansella M, Barbui C: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373: 746-758. 10.1016/S0140-6736(09)60046-5.CrossRefPubMed Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, Watanabe N, Nakagawa A, Omori IM, McGuire H, Tansella M, Barbui C: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373: 746-758. 10.1016/S0140-6736(09)60046-5.CrossRefPubMed
9.
go back to reference Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979, 134: 382-389. 10.1192/bjp.134.4.382.CrossRefPubMed Montgomery SA, Asberg M: A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979, 134: 382-389. 10.1192/bjp.134.4.382.CrossRefPubMed
10.
go back to reference Naudet F, Maria AS, Falissard B: Antidepressant response in major depressive disorder: a meta-regression comparison of randomized controlled trials and observational studies. PLoS One. 2011, 6: e20811-10.1371/journal.pone.0020811.CrossRefPubMedPubMedCentral Naudet F, Maria AS, Falissard B: Antidepressant response in major depressive disorder: a meta-regression comparison of randomized controlled trials and observational studies. PLoS One. 2011, 6: e20811-10.1371/journal.pone.0020811.CrossRefPubMedPubMedCentral
13.
go back to reference Hedges L, Olkin I: Statistical Methods for Meta-analysis. 1985, New York, NY: Academic Press Hedges L, Olkin I: Statistical Methods for Meta-analysis. 1985, New York, NY: Academic Press
14.
go back to reference Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D'Amico R, Bradburn M, Eastwood AJ: Indirect comparisons of competing interventions. Health Technol Assess. 2005, 9: 1-134.CrossRefPubMed Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D'Amico R, Bradburn M, Eastwood AJ: Indirect comparisons of competing interventions. Health Technol Assess. 2005, 9: 1-134.CrossRefPubMed
15.
go back to reference Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC: Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011, 14: 417-428. 10.1016/j.jval.2011.04.002.CrossRefPubMed Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC: Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. Value Health. 2011, 14: 417-428. 10.1016/j.jval.2011.04.002.CrossRefPubMed
16.
go back to reference Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, Boersma C, Thompson D, Larholt KM, Diaz M, Barrett A: Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011, 14: 429-437. 10.1016/j.jval.2011.01.011.CrossRefPubMed Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, Boersma C, Thompson D, Larholt KM, Diaz M, Barrett A: Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. Value Health. 2011, 14: 429-437. 10.1016/j.jval.2011.01.011.CrossRefPubMed
17.
go back to reference Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rucker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP: Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011, 343: d4002-10.1136/bmj.d4002.CrossRefPubMed Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rucker G, Harbord RM, Schmid CH, Tetzlaff J, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP: Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011, 343: d4002-10.1136/bmj.d4002.CrossRefPubMed
18.
go back to reference R Development Core Team: R: A Language and Environment for Statistical Computing. 2009, Vienna, Austria: R Foundation for Statistical Computing R Development Core Team: R: A Language and Environment for Statistical Computing. 2009, Vienna, Austria: R Foundation for Statistical Computing
19.
go back to reference Schwarzer G: meta: Meta-Analysis with R, R Package version 11–8. 2010, Vienna: The Comprehensive R Archive Network Schwarzer G: meta: Meta-Analysis with R, R Package version 11–8. 2010, Vienna: The Comprehensive R Archive Network
20.
go back to reference Lumley T: rmeta: Meta-analysis, R package version 216. 2009, Vienna: The Comprehensive R Archive Network Lumley T: rmeta: Meta-analysis, R package version 216. 2009, Vienna: The Comprehensive R Archive Network
21.
go back to reference Maechler DBM: lme4: Linear Mixed-effects Models Using S4 Classes, R Package Version 0999375–32. 2009, Vienna: The Comprehensive R Archive Network Maechler DBM: lme4: Linear Mixed-effects Models Using S4 Classes, R Package Version 0999375–32. 2009, Vienna: The Comprehensive R Archive Network
22.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009, 6: e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009, 6: e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral
24.
go back to reference Bauer M, Tharmanathan P, Volz HP, Moeller HJ, Freemantle N: The effect of venlafaxine compared with other antidepressants and placebo in the treatment of major depression: a meta-analysis. Eur Arch Psychiatry Clin Neurosci. 2009, 259: 172-185. 10.1007/s00406-008-0849-0.CrossRefPubMed Bauer M, Tharmanathan P, Volz HP, Moeller HJ, Freemantle N: The effect of venlafaxine compared with other antidepressants and placebo in the treatment of major depression: a meta-analysis. Eur Arch Psychiatry Clin Neurosci. 2009, 259: 172-185. 10.1007/s00406-008-0849-0.CrossRefPubMed
25.
go back to reference Alkhafaji AA, Trinquart L, Baron G, Desvarieux M, Ravaud P: Impact of evergreening on patients and health insurance: a meta analysis and reimbursement cost analysis of citalopram/escitalopram antidepressants. BMC Med. 2012, 10: 142-10.1186/1741-7015-10-142.CrossRefPubMedPubMedCentral Alkhafaji AA, Trinquart L, Baron G, Desvarieux M, Ravaud P: Impact of evergreening on patients and health insurance: a meta analysis and reimbursement cost analysis of citalopram/escitalopram antidepressants. BMC Med. 2012, 10: 142-10.1186/1741-7015-10-142.CrossRefPubMedPubMedCentral
26.
go back to reference Song F, Harvey I, Lilford R: Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. J Clin Epidemiol. 2008, 61: 455-463. 10.1016/j.jclinepi.2007.06.006.CrossRefPubMed Song F, Harvey I, Lilford R: Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. J Clin Epidemiol. 2008, 61: 455-463. 10.1016/j.jclinepi.2007.06.006.CrossRefPubMed
27.
go back to reference Jansen JP, Naci H: Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Med. 2013, 11: 159-10.1186/1741-7015-11-159.CrossRefPubMedPubMedCentral Jansen JP, Naci H: Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Med. 2013, 11: 159-10.1186/1741-7015-11-159.CrossRefPubMedPubMedCentral
28.
go back to reference Egger M, Smith GD, Sterne JA: Uses and abuses of meta-analysis. Clin Med. 2001, 1: 478-484. 10.7861/clinmedicine.1-6-478.CrossRef Egger M, Smith GD, Sterne JA: Uses and abuses of meta-analysis. Clin Med. 2001, 1: 478-484. 10.7861/clinmedicine.1-6-478.CrossRef
29.
go back to reference National Collaborating Centre for Mental Health (UK): Depression: The Treatment and Management of Depression in Adults. (Updated Edition). NICE Clinical Guidelines, No. 90. 2010, Leicester, UK: British Psychological Society National Collaborating Centre for Mental Health (UK): Depression: The Treatment and Management of Depression in Adults. (Updated Edition). NICE Clinical Guidelines, No. 90. 2010, Leicester, UK: British Psychological Society
30.
go back to reference Kirsch I: Are drug and placebo effects in depression additive?. Biol Psychiatry. 2000, 47: 733-735. 10.1016/S0006-3223(00)00832-5.CrossRefPubMed Kirsch I: Are drug and placebo effects in depression additive?. Biol Psychiatry. 2000, 47: 733-735. 10.1016/S0006-3223(00)00832-5.CrossRefPubMed
31.
go back to reference Greene JA, Kesselheim AS: Why do the same drugs look different? Pills, trade dress, and public health. N Engl J Med. 2011, 365: 83-89. 10.1056/NEJMhle1101722.CrossRefPubMed Greene JA, Kesselheim AS: Why do the same drugs look different? Pills, trade dress, and public health. N Engl J Med. 2011, 365: 83-89. 10.1056/NEJMhle1101722.CrossRefPubMed
33.
go back to reference Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R: Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008, 358: 252-260. 10.1056/NEJMsa065779.CrossRefPubMed Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R: Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008, 358: 252-260. 10.1056/NEJMsa065779.CrossRefPubMed
34.
go back to reference Eyding D, Lelgemann M, Grouven U, Harter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B: Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010, 341: c4737-10.1136/bmj.c4737.CrossRefPubMedPubMedCentral Eyding D, Lelgemann M, Grouven U, Harter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B: Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010, 341: c4737-10.1136/bmj.c4737.CrossRefPubMedPubMedCentral
35.
go back to reference Trinquart L, Abbe A, Ravaud P: Impact of reporting bias in network meta-analysis of antidepressant placebo-controlled trials. PLoS One. 2012, 7: e35219-10.1371/journal.pone.0035219.CrossRefPubMedPubMedCentral Trinquart L, Abbe A, Ravaud P: Impact of reporting bias in network meta-analysis of antidepressant placebo-controlled trials. PLoS One. 2012, 7: e35219-10.1371/journal.pone.0035219.CrossRefPubMedPubMedCentral
36.
go back to reference Wu T, Li Y, Bian Z, Liu G, Moher D: Randomized trials published in some Chinese journals: how many are randomized?. Trials. 2009, 10: 46-10.1186/1745-6215-10-46.CrossRefPubMedPubMedCentral Wu T, Li Y, Bian Z, Liu G, Moher D: Randomized trials published in some Chinese journals: how many are randomized?. Trials. 2009, 10: 46-10.1186/1745-6215-10-46.CrossRefPubMedPubMedCentral
37.
38.
go back to reference Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral Lexchin J, Bero LA, Djulbegovic B, Clark O: Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003, 326: 1167-1170. 10.1136/bmj.326.7400.1167.CrossRefPubMedPubMedCentral
40.
41.
go back to reference Pescosolido BA, Martin JK, Long JS, Medina TR, Phelan JC, Link BG: “A disease like any other”? A decade of change in public reactions to schizophrenia, depression, and alcohol dependence. Am J Psychiatry. 2010, 167: 1321-1330. 10.1176/appi.ajp.2010.09121743.CrossRefPubMedPubMedCentral Pescosolido BA, Martin JK, Long JS, Medina TR, Phelan JC, Link BG: “A disease like any other”? A decade of change in public reactions to schizophrenia, depression, and alcohol dependence. Am J Psychiatry. 2010, 167: 1321-1330. 10.1176/appi.ajp.2010.09121743.CrossRefPubMedPubMedCentral
43.
go back to reference Lacasse JR, Leo J: Serotonin and depression: a disconnect between the advertisements and the scientific literature. PLoS Med. 2005, 2: e392-10.1371/journal.pmed.0020392.CrossRefPubMedPubMedCentral Lacasse JR, Leo J: Serotonin and depression: a disconnect between the advertisements and the scientific literature. PLoS Med. 2005, 2: e392-10.1371/journal.pmed.0020392.CrossRefPubMedPubMedCentral
45.
46.
go back to reference Seyringer ME, Kasper S: Ranking antidepressants. Lancet. 2009, 373: 1760-1761. author reply 1761–1762CrossRefPubMed Seyringer ME, Kasper S: Ranking antidepressants. Lancet. 2009, 373: 1760-1761. author reply 1761–1762CrossRefPubMed
47.
go back to reference Turner E, Moreno SG, Sutton AJ: Ranking antidepressants. Lancet. 2009, 373: 1760-author reply 1761–1762CrossRefPubMed Turner E, Moreno SG, Sutton AJ: Ranking antidepressants. Lancet. 2009, 373: 1760-author reply 1761–1762CrossRefPubMed
48.
go back to reference Gartlehner G, Gaynes BN, Hansen RA, Thieda P, DeVeaugh-Geiss A, Krebs EE, Moore CG, Morgan L, Lohr KN: Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians. Ann Intern Med. 2008, 149: 734-750. 10.7326/0003-4819-149-10-200811180-00008.CrossRefPubMed Gartlehner G, Gaynes BN, Hansen RA, Thieda P, DeVeaugh-Geiss A, Krebs EE, Moore CG, Morgan L, Lohr KN: Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians. Ann Intern Med. 2008, 149: 734-750. 10.7326/0003-4819-149-10-200811180-00008.CrossRefPubMed
49.
go back to reference Patrick G, Combs G, Gavagan T: Initiating antidepressant therapy? Try these 2 drugs first. J Fam Pract. 2009, 58: 365-369.PubMedPubMedCentral Patrick G, Combs G, Gavagan T: Initiating antidepressant therapy? Try these 2 drugs first. J Fam Pract. 2009, 58: 365-369.PubMedPubMedCentral
50.
go back to reference Lakoff A: The mousetrap: managing the placebo effect in antidepressant trials. Mol Interv. 2002, 2: 72-76. 10.1124/mi.2.2.72.CrossRefPubMed Lakoff A: The mousetrap: managing the placebo effect in antidepressant trials. Mol Interv. 2002, 2: 72-76. 10.1124/mi.2.2.72.CrossRefPubMed
51.
go back to reference Thomas KB: General practice consultations: is there any point in being positive?. Br Med J (Clin Res Ed). 1987, 294: 1200-1202. 10.1136/bmj.294.6581.1200.CrossRef Thomas KB: General practice consultations: is there any point in being positive?. Br Med J (Clin Res Ed). 1987, 294: 1200-1202. 10.1136/bmj.294.6581.1200.CrossRef
52.
go back to reference Handel AE, Patel SV, Pakpoor J, Ebers GC, Goldacre B, Ramagopalan SV: High reprint orders in medical journals and pharmaceutical industry funding: case-control study. BMJ. 2012, 344: e4212-10.1136/bmj.e4212.CrossRefPubMedPubMedCentral Handel AE, Patel SV, Pakpoor J, Ebers GC, Goldacre B, Ramagopalan SV: High reprint orders in medical journals and pharmaceutical industry funding: case-control study. BMJ. 2012, 344: e4212-10.1136/bmj.e4212.CrossRefPubMedPubMedCentral
Metadata
Title
Which placebo to cure depression? A thought-provoking network meta-analysis
Authors
Florian Naudet
Bruno Millet
Philippe Charlier
Jean Michel Reymann
Anne Solène Maria
Bruno Falissard
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2013
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-11-230

Other articles of this Issue 1/2013

BMC Medicine 1/2013 Go to the issue