Skip to main content
Top
Published in: Systematic Reviews 1/2013

Open Access 01-12-2013 | Protocol

Publication bias in animal research: a systematic review protocol

Authors: Matthias Briel, Katharina F Müller, Joerg J Meerpohl, Erik von Elm, Britta Lang, Edith Motschall, Viktoria Gloy, Francois Lamontagne, Guido Schwarzer, Dirk Bassler

Published in: Systematic Reviews | Issue 1/2013

Login to get access

Abstract

Background

Systematic reviews and meta-analyses of pre-clinical studies, in vivo animal experiments in particular, can influence clinical care. Publication bias is one of the major threats of validity in systematic reviews and meta-analyses. Previous empirical studies suggested that systematic reviews and meta-analyses have become more prevalent until 2010 and found evidence for compromised methodological rigor with a trend towards improvement. We aim to comprehensively summarize and update the evidence base on systematic reviews and meta-analyses of animal studies, their methodological quality and assessment of publication bias in particular.

Methods/Design

The objectives of this systematic review are as follows:
  • To investigate the epidemiology of published systematic reviews of animal studies until present.
  • To examine methodological features of systematic reviews and meta-analyses of animal studies with special attention to the assessment of publication bias.
  • To investigate the influence of systematic reviews of animal studies on clinical research by examining citations of the systematic reviews by clinical studies.
Eligible studies for this systematic review constitute systematic reviews and meta-analyses that summarize in vivo animal experiments with the purpose of reviewing animal evidence to inform human health. We will exclude genome-wide association studies and animal experiments with the main purpose to learn more about fundamental biology, physical functioning or behavior.
In addition to the inclusion of systematic reviews and meta-analyses identified by other empirical studies, we will systematically search Ovid Medline, Embase, ToxNet, and ScienceDirect from 2009 to January 2013 for further eligible studies without language restrictions.
Two reviewers working independently will assess titles, abstracts, and full texts for eligibility and extract relevant data from included studies. Data reporting will involve a descriptive summary of meta-analyses and systematic reviews.

Discussion

Results are expected to be publicly available later in 2013 and may form the basis for recommendations to improve the quality of systematic reviews and meta-analyses of animal studies and their use with respect to clinical care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, Reinhart K, Angus DC, Brun-Buisson C, Beale R, Calandra T, Dhainaut JF, Gerlach H, Harvey M, Marini JJ, Marshall J, Ranieri M, Ramsay G, Sevransky J, Thompson BT, Townsend S, Vender JS, Zimmerman JL, Vincent JL, Campai ISS: Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008. Crit Care Med. 2008, 36: 296-327. 10.1097/01.CCM.0000298158.12101.41.CrossRefPubMed Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, Reinhart K, Angus DC, Brun-Buisson C, Beale R, Calandra T, Dhainaut JF, Gerlach H, Harvey M, Marini JJ, Marshall J, Ranieri M, Ramsay G, Sevransky J, Thompson BT, Townsend S, Vender JS, Zimmerman JL, Vincent JL, Campai ISS: Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2008. Crit Care Med. 2008, 36: 296-327. 10.1097/01.CCM.0000298158.12101.41.CrossRefPubMed
2.
go back to reference Lamontagne F, Briel M, Duffett M, Fox-Robichaud A, Cook DJ, Guyatt G, Lesur O, Meade MO: Systematic review of reviews including animal studies addressing therapeutic interventions for sepsis. Crit Care Med. 2010, 38: 2401-2408. 10.1097/CCM.0b013e3181fa0468.CrossRefPubMed Lamontagne F, Briel M, Duffett M, Fox-Robichaud A, Cook DJ, Guyatt G, Lesur O, Meade MO: Systematic review of reviews including animal studies addressing therapeutic interventions for sepsis. Crit Care Med. 2010, 38: 2401-2408. 10.1097/CCM.0b013e3181fa0468.CrossRefPubMed
3.
go back to reference Nordmann AJ, Kasenda B, Briel M: Meta-analyses: what they can and cannot do. Swiss Medical Weekly. 2012, 142: w13518-PubMed Nordmann AJ, Kasenda B, Briel M: Meta-analyses: what they can and cannot do. Swiss Medical Weekly. 2012, 142: w13518-PubMed
4.
go back to reference Mignini LEK, Khan KS: Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research. BMC Med Res Method. 2006, 6: 10-10.1186/1471-2288-6-10.CrossRef Mignini LEK, Khan KS: Methodological quality of systematic reviews of animal studies: a survey of reviews of basic research. BMC Med Res Method. 2006, 6: 10-10.1186/1471-2288-6-10.CrossRef
5.
go back to reference Peters JL, Sutton AJ, Jones DR, Rushton L, Abrams KR: A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting. J Environ Sci Health B. 2006, 41: 1245-1258.CrossRefPubMed Peters JL, Sutton AJ, Jones DR, Rushton L, Abrams KR: A systematic review of systematic reviews and meta-analyses of animal experiments with guidelines for reporting. J Environ Sci Health B. 2006, 41: 1245-1258.CrossRefPubMed
6.
go back to reference Korevaar DA, Hooft L, ter Riet G: Systematic reviews and meta-analyses of preclinical studies: publication bias in laboratory animal experiments. Lab Anim. 2011, 45: 225-230. 10.1258/la.2011.010121.CrossRefPubMed Korevaar DA, Hooft L, ter Riet G: Systematic reviews and meta-analyses of preclinical studies: publication bias in laboratory animal experiments. Lab Anim. 2011, 45: 225-230. 10.1258/la.2011.010121.CrossRefPubMed
7.
go back to reference Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR: Publication bias in clinical research. Lancet. 1991, 337: 867-872. 10.1016/0140-6736(91)90201-Y.CrossRefPubMed Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR: Publication bias in clinical research. Lancet. 1991, 337: 867-872. 10.1016/0140-6736(91)90201-Y.CrossRefPubMed
8.
go back to reference Bennett DA, Latham NK, Stretton C, Anderson CS: Capture-recapture is a potentially useful method for assessing publication bias. J Clin Epidemiol. 2004, 57: 349-357. 10.1016/j.jclinepi.2003.09.015.CrossRefPubMed Bennett DA, Latham NK, Stretton C, Anderson CS: Capture-recapture is a potentially useful method for assessing publication bias. J Clin Epidemiol. 2004, 57: 349-357. 10.1016/j.jclinepi.2003.09.015.CrossRefPubMed
9.
go back to reference Sterne JAC EM, Moher D: Chapter 10:Addressing reporting biases. 10.2.1 Publication bias In Cochrane Handbook of Systematic Reviews of Interventions. [updated March 2011]. The Cochrane Collaboration Version 5.1.0. Edited by: Higgins JPT, Green S. 2011, Available from: http://www.handbook.cochrane.org, Sterne JAC EM, Moher D: Chapter 10:Addressing reporting biases. 10.2.1 Publication bias In Cochrane Handbook of Systematic Reviews of Interventions. [updated March 2011]. The Cochrane Collaboration Version 5.1.0. Edited by: Higgins JPT, Green S. 2011, Available from: http://​www.​handbook.​cochrane.​org,
10.
go back to reference Duval S, Tweedie R: Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56: 455-463. 10.1111/j.0006-341X.2000.00455.x.CrossRefPubMed Duval S, Tweedie R: Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56: 455-463. 10.1111/j.0006-341X.2000.00455.x.CrossRefPubMed
11.
go back to reference Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, Cooper NJ: Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Methodol. 2009, 9: 2-10.1186/1471-2288-9-2.CrossRefPubMedPubMedCentral Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, Cooper NJ: Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Methodol. 2009, 9: 2-10.1186/1471-2288-9-2.CrossRefPubMedPubMedCentral
12.
go back to reference Moreno SG, Sutton AJ, Thompson JR, Ades AE, Abrams KR, Cooper NJ: A generalized weighting regression-derived meta-analysis estimator robust to small-study effects and heterogeneity. Statistics in medicine. 2012, 31: 1407-1417. 10.1002/sim.4488.CrossRefPubMed Moreno SG, Sutton AJ, Thompson JR, Ades AE, Abrams KR, Cooper NJ: A generalized weighting regression-derived meta-analysis estimator robust to small-study effects and heterogeneity. Statistics in medicine. 2012, 31: 1407-1417. 10.1002/sim.4488.CrossRefPubMed
13.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Medicine. 2009, 6 (7): e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Medicine. 2009, 6 (7): e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral
14.
go back to reference Ter Riet G, Korevaar DA, Leenaars M, Sterk PJ, Van Noorden CJF, Bouter LM, Lutter R, Elferink RPO, Hooft L: Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions. PLoS One. 2012, 7 (9): e43404-10.1371/journal.pone.0043404.CrossRefPubMedPubMedCentral Ter Riet G, Korevaar DA, Leenaars M, Sterk PJ, Van Noorden CJF, Bouter LM, Lutter R, Elferink RPO, Hooft L: Publication Bias in Laboratory Animal Research: A Survey on Magnitude, Drivers, Consequences and Potential Solutions. PLoS One. 2012, 7 (9): e43404-10.1371/journal.pone.0043404.CrossRefPubMedPubMedCentral
16.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009, 151: 264-269. W64CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG, Group P: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009, 151: 264-269. W64CrossRefPubMed
Metadata
Title
Publication bias in animal research: a systematic review protocol
Authors
Matthias Briel
Katharina F Müller
Joerg J Meerpohl
Erik von Elm
Britta Lang
Edith Motschall
Viktoria Gloy
Francois Lamontagne
Guido Schwarzer
Dirk Bassler
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2013
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-23

Other articles of this Issue 1/2013

Systematic Reviews 1/2013 Go to the issue