Skip to main content
Top
Published in: BMC Psychiatry 1/2020

Open Access 01-12-2020 | Antidepressant Drugs | Research article

Comparative efficacy of placebos in short-term antidepressant trials for major depression: a secondary meta-analysis of placebo-controlled trials

Authors: Lisa Holper, Michael P. Hengartner

Published in: BMC Psychiatry | Issue 1/2020

Login to get access

Abstract

Background

The issue of unblinded outcome-assessors and patients has repeatedly been stressed as a flaw in allegedly double-blind antidepressant trials. Unblinding bias can for example result from a drug‘s marked side effects. If such unblinding bias is present for a given drug, then it might be expected that the placebos of that drug are rated significantly less effective than that of other antidepressants.

Methods

To test this hypothesis, the present exploratory analysis conducted a Bayesian network meta-analysis (NMA) comparing the efficacy of 19 different placebos in placebo-controlled trials provided in the dataset by Cipriani et al. (Lancet 2018; 391: 1357–66). Primary outcome was efficacy (continuous) estimated on the standardized mean difference (SMD) scale and defined as the pre-post change on the Hamilton Depression scale (HAMD-17), on which information was available in N = 258 trials.

Results

Comparative placebo ranking suggested mirtazapine-placebo (SMD -2.0 [− 5.0–1.0 95% CrI]) to be the most, and amitriptyline- (SMD 1.2 [− 1.6–3.9 95% CrI]) and trazodone- (SMD 2.1 [− 0.9–5.2 95% CrI]) placebos to be the least effective placebos. Other placebos suggested to be more effective than amitriptyline- and trazodone-placebos (based on 95% CrIs excluding zero) were citalopram, desvenlafaxine, duloxetine, escitalopram, fluoxetine, sertraline, and venlafaxine placebos. These NMA results were corroborated by the observation that the relative efficacy between drug and placebo was considerably larger for amitriptyline and trazodone than for instance mirtazapine, duloxetine, and venlafaxine, supported by a small and insignificant correlation between drug-efficacy and placebo-efficacy (r = − 0.202, p = 0.408).

Discussion

The present exploratory NMA indicates that distinguishable side effects of older drugs may unblind outcome-assessors thus resulting in overestimation of the average drug-placebo difference and underrating bias in placebo-arms, particularly for the older antidepressant drugs amitriptyline and trazodone. If confirmed in prospective studies, these findings suggest that efficacy rankings for antidepressants are susceptible to bias and should be considered unreliable or misleading. The analysis is limited by the focus on the single-comparison placebos (76%, i.e., placebos assessed in two-arm trials), since double-comparison placebos (25%, i.e., placebos assessed in three-arm trials) are hard to interpret and therefore not included in the present interpretation. Another limitation is the problem of multiplicity, which was only approximately accounted for in the Bayesian NMA by modelling treatment effects as exchangeable.
Appendix
Available only for authorised users
Literature
1.
go back to reference Munkholm K, Paludan-Müller AS, Boesen K. Considering the methodological limitations in the evidence base of antidepressants for depression: a reanalysis of a network meta-analysis. BMJ Open. 2019;9(6):e024886.PubMedPubMedCentral Munkholm K, Paludan-Müller AS, Boesen K. Considering the methodological limitations in the evidence base of antidepressants for depression: a reanalysis of a network meta-analysis. BMJ Open. 2019;9(6):e024886.PubMedPubMedCentral
2.
go back to reference Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet. 2018;391(10128):1357–66.PubMedPubMedCentral Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, et al. Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet. 2018;391(10128):1357–66.PubMedPubMedCentral
3.
go back to reference Holper L. Optimal doses of antidepressants in dependence on age: combined covariate actions in Bayesian network meta-analysis. EClinicalMedicine. 2020;18:100219.PubMedPubMedCentral Holper L. Optimal doses of antidepressants in dependence on age: combined covariate actions in Bayesian network meta-analysis. EClinicalMedicine. 2020;18:100219.PubMedPubMedCentral
4.
go back to reference Hengartner MP, Jakobsen JC, Sørensen A, Plöderl M. Efficacy of new-generation antidepressants assessed with the Montgomery-Asberg depression rating scale, the gold standard clinician rating scale: a meta-analysis of randomised placebo-controlled trials. PLoS One. 2020;15(2):e0229381.PubMedPubMedCentral Hengartner MP, Jakobsen JC, Sørensen A, Plöderl M. Efficacy of new-generation antidepressants assessed with the Montgomery-Asberg depression rating scale, the gold standard clinician rating scale: a meta-analysis of randomised placebo-controlled trials. PLoS One. 2020;15(2):e0229381.PubMedPubMedCentral
5.
go back to reference Page MJ, Higgins JPT, Clayton G, Sterne JAC, Hróbjartsson A, Savović J. Empirical evidence of study design biases in randomized trials: systematic review of meta-epidemiological studies. PLoS One. 2016;11(7):e0159267-e. Page MJ, Higgins JPT, Clayton G, Sterne JAC, Hróbjartsson A, Savović J. Empirical evidence of study design biases in randomized trials: systematic review of meta-epidemiological studies. PLoS One. 2016;11(7):e0159267-e.
6.
go back to reference Savovic J, Turner RM, Mawdsley D, Jones HE, Beynon R, Higgins JPT, et al. Association between risk-of-bias assessments and results of randomized trials in Cochrane reviews: the ROBES meta-epidemiologic study. Am J Epidemiol. 2018;187(5):1113–22.PubMed Savovic J, Turner RM, Mawdsley D, Jones HE, Beynon R, Higgins JPT, et al. Association between risk-of-bias assessments and results of randomized trials in Cochrane reviews: the ROBES meta-epidemiologic study. Am J Epidemiol. 2018;187(5):1113–22.PubMed
7.
go back to reference Antonuccio D, Danton W, DeNelsky G, Greenberg R, Gordon J. Raising questions about antidepressants. Psychother Psychosom. 1999;68:3–14.PubMed Antonuccio D, Danton W, DeNelsky G, Greenberg R, Gordon J. Raising questions about antidepressants. Psychother Psychosom. 1999;68:3–14.PubMed
8.
go back to reference Fisher S, Greenberg RP. How sound is the double-blind design for evaluating psychotropic drugs? J Nerv Ment Dis. 1993;181(6):345–50.PubMed Fisher S, Greenberg RP. How sound is the double-blind design for evaluating psychotropic drugs? J Nerv Ment Dis. 1993;181(6):345–50.PubMed
9.
go back to reference Mora MS, Nestoriuc Y, Rief W. Lessons learned from placebo groups in antidepressant trials. Philos Trans R Soc Lond B Biol Sci. 2011;366(1572):1879–88.PubMedPubMedCentral Mora MS, Nestoriuc Y, Rief W. Lessons learned from placebo groups in antidepressant trials. Philos Trans R Soc Lond B Biol Sci. 2011;366(1572):1879–88.PubMedPubMedCentral
10.
go back to reference Baethge C, Assall OP, Baldessarini RJ. Systematic review of blinding assessment in randomized controlled trials in schizophrenia and affective disorders 2000-2010. Psychother Psychosom. 2013;82(3):152–60.PubMed Baethge C, Assall OP, Baldessarini RJ. Systematic review of blinding assessment in randomized controlled trials in schizophrenia and affective disorders 2000-2010. Psychother Psychosom. 2013;82(3):152–60.PubMed
11.
go back to reference Even C, Siobud-Dorocant E, Dardennes RM. Critical approach to antidepressant trials: blindness protection is necessary, feasible and measurable. Br J Psychiatry. 2000;177(1):47–51.PubMed Even C, Siobud-Dorocant E, Dardennes RM. Critical approach to antidepressant trials: blindness protection is necessary, feasible and measurable. Br J Psychiatry. 2000;177(1):47–51.PubMed
12.
go back to reference Leyburn P. A critical look at antidepressant drug trials. Lancet. 1967;290(7526):1135–8. Leyburn P. A critical look at antidepressant drug trials. Lancet. 1967;290(7526):1135–8.
13.
go back to reference Greenberg RP, Bornstein RF, Greenberg MD, Fisher S. A meta-analysis of antidepressant outcome under "blinder" conditions. J Consult Clin Psychol. 1992;60(5):664–9.PubMed Greenberg RP, Bornstein RF, Greenberg MD, Fisher S. A meta-analysis of antidepressant outcome under "blinder" conditions. J Consult Clin Psychol. 1992;60(5):664–9.PubMed
14.
go back to reference Khan A, Faucett J, Lichtenberg P, Kirsch I, Brown WA. A systematic review of comparative efficacy of treatments and controls for depression. PLoS One. 2012;7(7):e41778.PubMedPubMedCentral Khan A, Faucett J, Lichtenberg P, Kirsch I, Brown WA. A systematic review of comparative efficacy of treatments and controls for depression. PLoS One. 2012;7(7):e41778.PubMedPubMedCentral
15.
go back to reference Moncrieff J, Wessely S, Hardy R. Active placebos versus antidepressants for depression. Cochrane Database Syst Rev. 2004;1:CD003012. Moncrieff J, Wessely S, Hardy R. Active placebos versus antidepressants for depression. Cochrane Database Syst Rev. 2004;1:CD003012.
16.
go back to reference Fagiolini A, Comandini A, Catena Dell'Osso M, Kasper S. Rediscovering trazodone for the treatment of major depressive disorder. CNS Drugs. 2012;26(12):1033–49.PubMedPubMedCentral Fagiolini A, Comandini A, Catena Dell'Osso M, Kasper S. Rediscovering trazodone for the treatment of major depressive disorder. CNS Drugs. 2012;26(12):1033–49.PubMedPubMedCentral
17.
go back to reference Haria M, Fitton A, McTavish D. Trazodone. Drugs Aging. 1994;4(4):331–55.PubMed Haria M, Fitton A, McTavish D. Trazodone. Drugs Aging. 1994;4(4):331–55.PubMed
18.
go back to reference Peretti S, Judge R, Hindmarch I. Safety and tolerability considerations: tricyclic antidepressants vs. selective serotonin reuptake inhibitors. Acta Psychiatr Scand. 2000;101(S403):17–25. Peretti S, Judge R, Hindmarch I. Safety and tolerability considerations: tricyclic antidepressants vs. selective serotonin reuptake inhibitors. Acta Psychiatr Scand. 2000;101(S403):17–25.
19.
go back to reference Naudet F, Millet B, Charlier P, Reymann JM, Maria AS, Falissard B. Which placebo to cure depression? A thought-provoking network meta-analysis. BMC Med. 2013;11(1):230.PubMedPubMedCentral Naudet F, Millet B, Charlier P, Reymann JM, Maria AS, Falissard B. Which placebo to cure depression? A thought-provoking network meta-analysis. BMC Med. 2013;11(1):230.PubMedPubMedCentral
20.
go back to reference Furukawa TA, Cipriani A, Atkinson LZ, Leucht S, Ogawa Y, Takeshima N, et al. Placebo response rates in antidepressant trials: a systematic review of published and unpublished double-blind randomised controlled studies. Lancet Psychiatry. 2016;3(11):1059–66.PubMed Furukawa TA, Cipriani A, Atkinson LZ, Leucht S, Ogawa Y, Takeshima N, et al. Placebo response rates in antidepressant trials: a systematic review of published and unpublished double-blind randomised controlled studies. Lancet Psychiatry. 2016;3(11):1059–66.PubMed
22.
go back to reference Dias S, Welton NJ, Sutton AJ, Ades AE. NICE DSU technical support document 2: a generalised linear modelling framework for pairwise and network meta-analysis of randomised controlled trialsNational Institute for health and care excellence (NICE); 2011. Dias S, Welton NJ, Sutton AJ, Ades AE. NICE DSU technical support document 2: a generalised linear modelling framework for pairwise and network meta-analysis of randomised controlled trialsNational Institute for health and care excellence (NICE); 2011.
23.
go back to reference Plummer M. JAGS version 4.3.0 user manual; 2017. Plummer M. JAGS version 4.3.0 user manual; 2017.
24.
go back to reference Spiegelhalter D, Thomas A, Best N, Lunn D. WinBUGS user manual; 2003. Spiegelhalter D, Thomas A, Best N, Lunn D. WinBUGS user manual; 2003.
25.
go back to reference Spiegelhalter DJ, Best NG, Carlin BP, Van Der Linde A. Bayesian measures of model complexity and fit. J R Stat Soc Series B Stat Methodology. 2002;64(4):583–639. Spiegelhalter DJ, Best NG, Carlin BP, Van Der Linde A. Bayesian measures of model complexity and fit. J R Stat Soc Series B Stat Methodology. 2002;64(4):583–639.
26.
go back to reference Efthimiou O, White IR. The dark side of the force: multiplicity issues in network meta-analysis and how to address them. Res Synth Methods. 2020;11(1):105–22.PubMed Efthimiou O, White IR. The dark side of the force: multiplicity issues in network meta-analysis and how to address them. Res Synth Methods. 2020;11(1):105–22.PubMed
27.
go back to reference Béliveau A, Goring S, Platt RW, Gustafson P. Network meta-analysis of disconnected networks: how dangerous are random baseline treatment effects? Res Synth Methods. 2017;8(4):465–74.PubMed Béliveau A, Goring S, Platt RW, Gustafson P. Network meta-analysis of disconnected networks: how dangerous are random baseline treatment effects? Res Synth Methods. 2017;8(4):465–74.PubMed
28.
go back to reference Dias S, Sutton AJ, Welton NJ, Ades AE. NICE DSU technical support document 3: heterogeneity: subgroups, meta-regression, bias and bias-adjustmentNational Institute for health and care excellence (NICE); 2012. Dias S, Sutton AJ, Welton NJ, Ades AE. NICE DSU technical support document 3: heterogeneity: subgroups, meta-regression, bias and bias-adjustmentNational Institute for health and care excellence (NICE); 2012.
29.
go back to reference Khin N, Chen Y-F, Yang Y, Yang P, Laughren T. Exploratory analyses of efficacy data from major depressive disorder trials submitted to the US Food and Drug Administration in support of new drug applications. J Clin Psychiatry. 2011;72:464–72.PubMed Khin N, Chen Y-F, Yang Y, Yang P, Laughren T. Exploratory analyses of efficacy data from major depressive disorder trials submitted to the US Food and Drug Administration in support of new drug applications. J Clin Psychiatry. 2011;72:464–72.PubMed
30.
go back to reference Undurraga J, Baldessarini RJ. Randomized, placebo-controlled trials of antidepressants for acute major depression: thirty-year meta-analytic review. Neuropsychopharmacology. 2012;37(4):851–64.PubMed Undurraga J, Baldessarini RJ. Randomized, placebo-controlled trials of antidepressants for acute major depression: thirty-year meta-analytic review. Neuropsychopharmacology. 2012;37(4):851–64.PubMed
31.
go back to reference Rief W, Nestoriuc Y, Weiss S, Welzel E, Barsky AJ, Hofmann SG. Meta-analysis of the placebo response in antidepressant trials. J Affect Disord. 2009;118(1):1–8.PubMed Rief W, Nestoriuc Y, Weiss S, Welzel E, Barsky AJ, Hofmann SG. Meta-analysis of the placebo response in antidepressant trials. J Affect Disord. 2009;118(1):1–8.PubMed
32.
go back to reference Walsh BT, Seidman SN, Sysko R, Gould M. Placebo response in studies of major DepressionVariable, substantial, and growing. JAMA. 2002;287(14):1840–7.PubMed Walsh BT, Seidman SN, Sysko R, Gould M. Placebo response in studies of major DepressionVariable, substantial, and growing. JAMA. 2002;287(14):1840–7.PubMed
33.
go back to reference Furukawa TA, Cipriani A, Leucht S, Atkinson LZ, Ogawa Y, Takeshima N, et al. Is placebo response in antidepressant trials rising or not? A reanalysis of datasets to conclude this long-lasting controversy. Evid Based Ment Health. 2018;21(1):1.PubMed Furukawa TA, Cipriani A, Leucht S, Atkinson LZ, Ogawa Y, Takeshima N, et al. Is placebo response in antidepressant trials rising or not? A reanalysis of datasets to conclude this long-lasting controversy. Evid Based Ment Health. 2018;21(1):1.PubMed
34.
go back to reference de Boer T. The effects of mirtazapine on central noradrenergic and serotonergic neurotransmission. Int Clin Psychopharmacol. 1995;10:19–23.PubMed de Boer T. The effects of mirtazapine on central noradrenergic and serotonergic neurotransmission. Int Clin Psychopharmacol. 1995;10:19–23.PubMed
35.
go back to reference Kasper S, Praschak-Rieder N, Tauscher J, Wolf R. A risk-benefit assessment of mirtazapine in the treatment of depression. Drug Saf. 1997;17(4):251–64.PubMed Kasper S, Praschak-Rieder N, Tauscher J, Wolf R. A risk-benefit assessment of mirtazapine in the treatment of depression. Drug Saf. 1997;17(4):251–64.PubMed
36.
go back to reference Grasmäder K, PLV K-UK, Frahnert C, Hiemke C, Dragicevic A, von Widdern O, et al. Relationship between mirtazapine dose, plasma concentration, response, and side effects in clinical practice. Pharmacopsychiatry. 2005;38(3):113–7.PubMed Grasmäder K, PLV K-UK, Frahnert C, Hiemke C, Dragicevic A, von Widdern O, et al. Relationship between mirtazapine dose, plasma concentration, response, and side effects in clinical practice. Pharmacopsychiatry. 2005;38(3):113–7.PubMed
37.
go back to reference Dolder CR, Nelson MH, Iler CA. The effects of mirtazapine on sleep in patients with major depressive disorder. Ann Clin Psychiatry. 2012;24(3):215–24.PubMed Dolder CR, Nelson MH, Iler CA. The effects of mirtazapine on sleep in patients with major depressive disorder. Ann Clin Psychiatry. 2012;24(3):215–24.PubMed
38.
go back to reference Haddjeri N, Blier P, de Montigny C. Effects of long-term treatment with the α2-adrenoceptor antagonist mirtazapine on 5-HT neurotransmission. Naunyn Schmiedebergs Arch Pharmacol. 1996;355(1):20–9. Haddjeri N, Blier P, de Montigny C. Effects of long-term treatment with the α2-adrenoceptor antagonist mirtazapine on 5-HT neurotransmission. Naunyn Schmiedebergs Arch Pharmacol. 1996;355(1):20–9.
39.
go back to reference Anttila SA, Leinonen EV. A review of the pharmacological and clinical profile of mirtazapine. CNS Drug Rev. 2001;7(3):249–64.PubMedPubMedCentral Anttila SA, Leinonen EV. A review of the pharmacological and clinical profile of mirtazapine. CNS Drug Rev. 2001;7(3):249–64.PubMedPubMedCentral
40.
go back to reference Alam A, Voronovich Z, Carley JA. A review of therapeutic uses of mirtazapine in psychiatric and medical conditions. Prim Care Companion CNS Disord. 2013;15(5):PCC.13r01525.PubMedPubMedCentral Alam A, Voronovich Z, Carley JA. A review of therapeutic uses of mirtazapine in psychiatric and medical conditions. Prim Care Companion CNS Disord. 2013;15(5):PCC.13r01525.PubMedPubMedCentral
41.
go back to reference Fawcett J, Barkin RL. Review of the results from clinical studies on the efficacy, safety and tolerability of mirtazapine for the treatment of patients with major depression. J Affect Disord. 1998;51(3):267–85.PubMed Fawcett J, Barkin RL. Review of the results from clinical studies on the efficacy, safety and tolerability of mirtazapine for the treatment of patients with major depression. J Affect Disord. 1998;51(3):267–85.PubMed
42.
go back to reference Carvalho AF, Sharma MS, Brunoni AR, Vieta E, Fava GA. The safety, tolerability and risks associated with the use of newer generation antidepressant drugs: a critical review of the literature. Psychother Psychosom. 2016;85(5):270–88.PubMed Carvalho AF, Sharma MS, Brunoni AR, Vieta E, Fava GA. The safety, tolerability and risks associated with the use of newer generation antidepressant drugs: a critical review of the literature. Psychother Psychosom. 2016;85(5):270–88.PubMed
43.
go back to reference Chen JA, Vijapura S, Papakostas GI, Parkin SR, Kim DJH, Cusin C, et al. Association between physician beliefs regarding assigned treatment and clinical response: re-analysis of data from the Hypericum depression trial study group. Asian J Psychiatr. 2015;13:23–9.PubMed Chen JA, Vijapura S, Papakostas GI, Parkin SR, Kim DJH, Cusin C, et al. Association between physician beliefs regarding assigned treatment and clinical response: re-analysis of data from the Hypericum depression trial study group. Asian J Psychiatr. 2015;13:23–9.PubMed
44.
go back to reference Zimmerman M, Clark HL, Multach MD, Walsh E, Rosenstein LK, Gazarian D. Have treatment studies of depression become Even less generalizable? A review of the inclusion and exclusion criteria used in placebo-controlled antidepressant efficacy trials published during the past 20 years. Mayo Clin Proc. 2015;90(9):1180–6.PubMed Zimmerman M, Clark HL, Multach MD, Walsh E, Rosenstein LK, Gazarian D. Have treatment studies of depression become Even less generalizable? A review of the inclusion and exclusion criteria used in placebo-controlled antidepressant efficacy trials published during the past 20 years. Mayo Clin Proc. 2015;90(9):1180–6.PubMed
45.
go back to reference Papakonstantinou T, Nikolakopoulou A, Egger M, Salanti G. In network meta-analysis, most of the information comes from indirect evidence: empirical study. J Clin Epidemiol. 2020;124:42–9.PubMed Papakonstantinou T, Nikolakopoulou A, Egger M, Salanti G. In network meta-analysis, most of the information comes from indirect evidence: empirical study. J Clin Epidemiol. 2020;124:42–9.PubMed
46.
go back to reference Palpacuer C, Hammas K, Duprez R, Laviolle B, Ioannidis JPA, Naudet F. Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis. BMC Med. 2019;17(1):174.PubMedPubMedCentral Palpacuer C, Hammas K, Duprez R, Laviolle B, Ioannidis JPA, Naudet F. Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis. BMC Med. 2019;17(1):174.PubMedPubMedCentral
Metadata
Title
Comparative efficacy of placebos in short-term antidepressant trials for major depression: a secondary meta-analysis of placebo-controlled trials
Authors
Lisa Holper
Michael P. Hengartner
Publication date
01-12-2020

Other articles of this Issue 1/2020

BMC Psychiatry 1/2020 Go to the issue