Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research Article

Dose-response meta-analysis of differences in means

Authors: Alessio Crippa, Nicola Orsini

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Meta-analytical methods are frequently used to combine dose-response findings expressed in terms of relative risks. However, no methodology has been established when results are summarized in terms of differences in means of quantitative outcomes.

Methods

We proposed a two-stage approach. A flexible dose-response model is estimated within each study (first stage) taking into account the covariance of the data points (mean differences, standardized mean differences). Parameters describing the study-specific curves are then combined using a multivariate random-effects model (second stage) to address heterogeneity across studies.

Results

The method is fairly general and can accommodate a variety of parametric functions. Compared to traditional non-linear models (e.g. E max, logistic), spline models do not assume any pre-specified dose-response curve. Spline models allow inclusion of studies with a small number of dose levels, and almost any shape, even non monotonic ones, can be estimated using only two parameters. We illustrated the method using dose-response data arising from five clinical trials on an antipsychotic drug, aripiprazole, and improvement in symptoms in shizoaffective patients. Using the Positive and Negative Syndrome Scale (PANSS), pooled results indicated a non-linear association with the maximum change in mean PANSS score equal to 10.40 (95 % confidence interval 7.48, 13.30) observed for 19.32 mg/day of aripiprazole. No substantial change in PANSS score was observed above this value. An estimated dose of 10.43 mg/day was found to produce 80 % of the maximum predicted response.

Conclusion

The described approach should be adopted to combine correlated differences in means of quantitative outcomes arising from multiple studies. Sensitivity analysis can be a useful tool to assess the robustness of the overall dose-response curve to different modelling strategies. A user-friendly R package has been developed to facilitate applications by practitioners.
Literature
3.
go back to reference Pinheiro JC, Bretz F, Branson M. Analysis of dose–response studies. modeling approaches. In: Dose Finding in Drug Development. New York City: Springer: 2006. p. 146–71. Pinheiro JC, Bretz F, Branson M. Analysis of dose–response studies. modeling approaches. In: Dose Finding in Drug Development. New York City: Springer: 2006. p. 146–71.
4.
5.
go back to reference Chevret S. Statistical methods for dose-finding experiments. New York City: Wiley; 2006.CrossRef Chevret S. Statistical methods for dose-finding experiments. New York City: Wiley; 2006.CrossRef
6.
go back to reference Greenland S, Longnecker MP. Methods for trend estimation from summarized dose-response data, with applications to meta-analysis. Am J Epidemiol. 1992; 135(11):1301–1309.PubMed Greenland S, Longnecker MP. Methods for trend estimation from summarized dose-response data, with applications to meta-analysis. Am J Epidemiol. 1992; 135(11):1301–1309.PubMed
7.
go back to reference Berlin JA, Longnecker MP, Greenland S. Meta-analysis of epidemiologic dose-response data. Epidemiology. 1993; 4(3):218–28.CrossRefPubMed Berlin JA, Longnecker MP, Greenland S. Meta-analysis of epidemiologic dose-response data. Epidemiology. 1993; 4(3):218–28.CrossRefPubMed
9.
go back to reference Bagnardi V, Zambon A, Quatto P, Corrao G. Flexible meta-regression functions for modeling aggregate dose-response data, with an application to alcohol and mortality. Am J Epidemiol. 2004; 159(11):1077–1086. doi:10.1093/aje/kwh142. Accessed 25 Nov 2013CrossRefPubMed Bagnardi V, Zambon A, Quatto P, Corrao G. Flexible meta-regression functions for modeling aggregate dose-response data, with an application to alcohol and mortality. Am J Epidemiol. 2004; 159(11):1077–1086. doi:10.​1093/​aje/​kwh142. Accessed 25 Nov 2013CrossRefPubMed
10.
go back to reference Liu Q, Cook NR, Bergström A, Hsieh CC. A two-stage hierarchical regression model for meta-analysis of epidemiologic nonlinear dose–response data. Comput Stat Data Anal. 2009; 53(12):4157–167.CrossRef Liu Q, Cook NR, Bergström A, Hsieh CC. A two-stage hierarchical regression model for meta-analysis of epidemiologic nonlinear dose–response data. Comput Stat Data Anal. 2009; 53(12):4157–167.CrossRef
11.
go back to reference Orsini N, Bellocco R, Greenland S, et al. Generalized least squares for trend estimation of summarized dose-response data. Stata J. 2006; 6(1):40. Orsini N, Bellocco R, Greenland S, et al. Generalized least squares for trend estimation of summarized dose-response data. Stata J. 2006; 6(1):40.
12.
go back to reference Orsini N, Li R, Wolk A, Khudyakov P, Spiegelman D. Meta-analysis for linear and nonlinear dose-response relations: examples, an evaluation of approximations, and software. Am J Epidemiol. 2012; 175(1):66–73.CrossRefPubMed Orsini N, Li R, Wolk A, Khudyakov P, Spiegelman D. Meta-analysis for linear and nonlinear dose-response relations: examples, an evaluation of approximations, and software. Am J Epidemiol. 2012; 175(1):66–73.CrossRefPubMed
13.
go back to reference Dominici F, Samet JM, Zeger SL. Combining evidence on air pollution and daily mortality from the 20 largest us cities: a hierarchical modelling strategy. J Royal Stat Soc Ser A (Stat Soc). 2000; 163(3):263–302.CrossRef Dominici F, Samet JM, Zeger SL. Combining evidence on air pollution and daily mortality from the 20 largest us cities: a hierarchical modelling strategy. J Royal Stat Soc Ser A (Stat Soc). 2000; 163(3):263–302.CrossRef
14.
go back to reference Simmonds MC, Higginsa JP, Stewartb LA, Tierneyb JF, Clarke MJ, Thompson SG. Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials. 2005; 2(3):209–17.CrossRefPubMed Simmonds MC, Higginsa JP, Stewartb LA, Tierneyb JF, Clarke MJ, Thompson SG. Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials. 2005; 2(3):209–17.CrossRefPubMed
16.
go back to reference Davis JM, Chen N. Dose response and dose equivalence of antipsychotics. J Clin Psychopharmacol. 2004; 24(2):192–208.CrossRefPubMed Davis JM, Chen N. Dose response and dose equivalence of antipsychotics. J Clin Psychopharmacol. 2004; 24(2):192–208.CrossRefPubMed
17.
go back to reference Holford NH, Sheiner LB. Understanding the dose-effect relationship: clinical application of pharmacokinetic-pharmacodynamic models. Clin Pharmacokinet. 1981; 6(6):429–53.CrossRefPubMed Holford NH, Sheiner LB. Understanding the dose-effect relationship: clinical application of pharmacokinetic-pharmacodynamic models. Clin Pharmacokinet. 1981; 6(6):429–53.CrossRefPubMed
19.
go back to reference Geddes J, Freemantle N, Harrison P, Bebbington P. Atypical antipsychotics in the treatment of schizophrenia: systematic overview and meta-regression analysis. BMJ : British Medical Journal. 2000; 321(7273):1371–1376. Accessed 24 Mar 2015.CrossRefPubMedPubMedCentral Geddes J, Freemantle N, Harrison P, Bebbington P. Atypical antipsychotics in the treatment of schizophrenia: systematic overview and meta-regression analysis. BMJ : British Medical Journal. 2000; 321(7273):1371–1376. Accessed 24 Mar 2015.CrossRefPubMedPubMedCentral
20.
go back to reference Macdougall J. Analysis of dose–response studies. emax model. In: Dose Finding in Drug Development. New York City: Springer: 2006. p. 127–45. Macdougall J. Analysis of dose–response studies. emax model. In: Dose Finding in Drug Development. New York City: Springer: 2006. p. 127–45.
22.
go back to reference Desquilbet L, Mariotti F. Dose-response analyses using restricted cubic spline functions in public health research. Stat Med. 2010; 29(9):1037–1057. doi:10.1002/sim.3841. Accessed 25 Nov 2013PubMed Desquilbet L, Mariotti F. Dose-response analyses using restricted cubic spline functions in public health research. Stat Med. 2010; 29(9):1037–1057. doi:10.​1002/​sim.​3841. Accessed 25 Nov 2013PubMed
23.
go back to reference Harrell F.E. Jr, Lee KL, Pollock BG. Regression models in clinical studies: determining relationships between predictors and response. J Natl Cancer Inst. 1988; 80(15):1198–1202.CrossRefPubMed Harrell F.E. Jr, Lee KL, Pollock BG. Regression models in clinical studies: determining relationships between predictors and response. J Natl Cancer Inst. 1988; 80(15):1198–1202.CrossRefPubMed
24.
go back to reference Royston P. A strategy for modelling the effect of a continuous covariate in medicine and epidemiology. Stat Med. 2000; 19(14):1831–1847.CrossRefPubMed Royston P. A strategy for modelling the effect of a continuous covariate in medicine and epidemiology. Stat Med. 2000; 19(14):1831–1847.CrossRefPubMed
25.
27.
go back to reference Ritz J, Demidenko E, Spiegelman D. Multivariate meta-analysis for data consortia, individual patient meta-analysis, and pooling projects. J Stat Plann Infer. 2008; 138(7):1919–1933.CrossRef Ritz J, Demidenko E, Spiegelman D. Multivariate meta-analysis for data consortia, individual patient meta-analysis, and pooling projects. J Stat Plann Infer. 2008; 138(7):1919–1933.CrossRef
28.
go back to reference Cutler AJ, Marcus RN, Hardy SA, O’Donnell A, Carson WH, McQuade RD. The efficacy and safety of lower soses of aripiprazole for the treatment of patients with acute exacerbation of schizophrenia. CNS Spectrums. 2006; 11(09):691–702. doi:10.1017/S1092852900014784. Accessed 06 Feb 2015CrossRefPubMed Cutler AJ, Marcus RN, Hardy SA, O’Donnell A, Carson WH, McQuade RD. The efficacy and safety of lower soses of aripiprazole for the treatment of patients with acute exacerbation of schizophrenia. CNS Spectrums. 2006; 11(09):691–702. doi:10.​1017/​S109285290001478​4. Accessed 06 Feb 2015CrossRefPubMed
29.
go back to reference McEvoy JP, Daniel DG, Carson WH, McQuade RD, Marcus RN. A randomized, double-blind, placebo-controlled, study of the efficacy and safety of aripiprazole 10, 15 or 20 mg/day for the treatment of patients with acute exacerbations of schizophrenia. J Psychiatr Res. 2007; 41(11):895–905. doi:10.1016/j.jpsychires.2007.05.002.CrossRefPubMed McEvoy JP, Daniel DG, Carson WH, McQuade RD, Marcus RN. A randomized, double-blind, placebo-controlled, study of the efficacy and safety of aripiprazole 10, 15 or 20 mg/day for the treatment of patients with acute exacerbations of schizophrenia. J Psychiatr Res. 2007; 41(11):895–905. doi:10.​1016/​j.​jpsychires.​2007.​05.​002.CrossRefPubMed
30.
go back to reference Kane JM, Carson WH, Saha AR, McQuade RD, Ingenito GG, Zimbroff DL, Ali MW. Efficacy and safety of aripiprazole and haloperidol versus placebo in patients with schizophrenia and schizoaffective disorder. J Clin Psychiatry. 2002; 63(9):763–71.CrossRefPubMed Kane JM, Carson WH, Saha AR, McQuade RD, Ingenito GG, Zimbroff DL, Ali MW. Efficacy and safety of aripiprazole and haloperidol versus placebo in patients with schizophrenia and schizoaffective disorder. J Clin Psychiatry. 2002; 63(9):763–71.CrossRefPubMed
31.
go back to reference Potkin SG, Saha AR, Kujawa MJ, Carson WH, Ali M, Stock E, Stringfellow J, Ingenito G, Marder SR. Aripiprazole, an antipsychotic with a novel mechanism of action, and risperidone vs placebo in patients with schizophrenia and schizoaffective disorder. Arch Gen Psychiatr. 2003; 60(7):681–90. doi:10.1001/archpsyc.60.7.681.CrossRefPubMed Potkin SG, Saha AR, Kujawa MJ, Carson WH, Ali M, Stock E, Stringfellow J, Ingenito G, Marder SR. Aripiprazole, an antipsychotic with a novel mechanism of action, and risperidone vs placebo in patients with schizophrenia and schizoaffective disorder. Arch Gen Psychiatr. 2003; 60(7):681–90. doi:10.​1001/​archpsyc.​60.​7.​681.CrossRefPubMed
32.
go back to reference Turner EH, Knoepflmacher D, Shapley L. Publication bias in antipsychotic trials: an analysis of efficacy comparing the published literature to the US Food and Drug Administration Database. PLoS Med. 2012;9(3). doi:10.1371/journal.pmed.1001189. Accessed 30 Mar 2015. Turner EH, Knoepflmacher D, Shapley L. Publication bias in antipsychotic trials: an analysis of efficacy comparing the published literature to the US Food and Drug Administration Database. PLoS Med. 2012;9(3). doi:10.​1371/​journal.​pmed.​1001189. Accessed 30 Mar 2015.
33.
go back to reference Obermeier M, Schennach-Wolff R, Meyer S, Möller HJ, Riedel M, Krause D, Seemüller F. Is the panss used correctly? a systematic review. BMC psychiatry. 2011; 11(1):1.CrossRef Obermeier M, Schennach-Wolff R, Meyer S, Möller HJ, Riedel M, Krause D, Seemüller F. Is the panss used correctly? a systematic review. BMC psychiatry. 2011; 11(1):1.CrossRef
34.
go back to reference Leucht S, Kissling W, Davis JM. The PANSS should be rescaled. Schizophrenia bulletin. 2010; 36:461–462. Leucht S, Kissling W, Davis JM. The PANSS should be rescaled. Schizophrenia bulletin. 2010; 36:461–462.
35.
go back to reference Leucht S, Davis JM, Engel RR, Kane JM, Wagenpfeil S. Defining response in antipsychotic drug trials: recommendations for the use of scale-derived cutoffs. Neuropsychopharmacology. 2007; 32(9):1903–1910.CrossRefPubMed Leucht S, Davis JM, Engel RR, Kane JM, Wagenpfeil S. Defining response in antipsychotic drug trials: recommendations for the use of scale-derived cutoffs. Neuropsychopharmacology. 2007; 32(9):1903–1910.CrossRefPubMed
37.
go back to reference Sauerbrei W, Royston P. A new strategy for meta-analysis of continuous covariates in observational studies. Stat Med. 2011; 30(28):3341–360.CrossRefPubMed Sauerbrei W, Royston P. A new strategy for meta-analysis of continuous covariates in observational studies. Stat Med. 2011; 30(28):3341–360.CrossRefPubMed
38.
go back to reference Greenland S. Invited commentary: a critical look at some popular meta-analytic methods. Am J Epidemiol. 1994; 140(3):290–6.PubMed Greenland S. Invited commentary: a critical look at some popular meta-analytic methods. Am J Epidemiol. 1994; 140(3):290–6.PubMed
39.
go back to reference Crippa A, Orsini N. Multivariate dose-response meta-analysis: the dosresmeta r package. J Stat Softw. 2016. In Press. Crippa A, Orsini N. Multivariate dose-response meta-analysis: the dosresmeta r package. J Stat Softw. 2016. In Press.
Metadata
Title
Dose-response meta-analysis of differences in means
Authors
Alessio Crippa
Nicola Orsini
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0189-0

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue