Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2007

Open Access 01-12-2007 | Correspondence

A systematic comparison of software dedicated to meta-analysis of causal studies

Authors: Leon Bax, Ly-Mee Yu, Noriaki Ikeda, Karel GM Moons

Published in: BMC Medical Research Methodology | Issue 1/2007

Login to get access

Abstract

Background

Our objective was to systematically assess the differences in features, results, and usability of currently available meta-analysis programs.

Methods

Systematic review of software. We did an extensive search on the internet (Google, Yahoo, Altavista, and MSN) for specialized meta-analysis software. We included six programs in our review: Comprehensive Meta-analysis (CMA), MetAnalysis, MetaWin, MIX, RevMan, and WEasyMA. Two investigators compared the features of the software and their results. Thirty independent researchers evaluated the programs on their usability while analyzing one data set.

Results

The programs differed substantially in features, ease-of-use, and price. Although most results from the programs were identical, we did find some minor numerical inconsistencies. CMA and MIX scored highest on usability and these programs also have the most complete set of analytical features.

Conclusion

In consideration of differences in numerical results, we believe the user community would benefit from openly available and systematically updated information about the procedures and results of each program's validation. The most suitable program for a meta-analysis will depend on the user's needs and preferences and this report provides an overview that should be helpful in making a substantiated choice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hunt M: Making order of scientific chaos. How Science Takes Stock. 1997, New York , Russel Sage Foundation, 1-19. Hunt M: Making order of scientific chaos. How Science Takes Stock. 1997, New York , Russel Sage Foundation, 1-19.
3.
go back to reference Normand SLT: Meta-analysis software - a comparative review -DSTAT, version 1.10. Am Statistician. 1995, 49: 298-309. 10.2307/2684205. Normand SLT: Meta-analysis software - a comparative review -DSTAT, version 1.10. Am Statistician. 1995, 49: 298-309. 10.2307/2684205.
4.
go back to reference Egger M, Sterne JAC, Smith GD: Meta-analysis software. BMJ. 1998, 316 (7126): Website only: http://bmj.bmjjournals.com/archive/7126/7126ed9.htm- Egger M, Sterne JAC, Smith GD: Meta-analysis software. BMJ. 1998, 316 (7126): Website only: http://​bmj.​bmjjournals.​com/​archive/​7126/​7126ed9.​htm-
5.
go back to reference Sutton AJ, Lambert PC, Hellmich M, Abrams KR, Jones DR: Meta-analysis in practice: A critical review of available software. Meta-Analysis in Medicine and Health Policy. Edited by: Berry DA, Stangl DK. 2000, New York , Marcel Dekker Sutton AJ, Lambert PC, Hellmich M, Abrams KR, Jones DR: Meta-analysis in practice: A critical review of available software. Meta-Analysis in Medicine and Health Policy. Edited by: Berry DA, Stangl DK. 2000, New York , Marcel Dekker
6.
go back to reference Sutton AJ, Lambert PC, Hellmich M, Abrams KR, Jones DR: Meta-analysis software. Systematic Reviews in Health Care: Meta-Analysis in Context. Edited by: Egger M, Davey Smith G, Altman DG. 2001, London: BMJ Books, 2nd Sutton AJ, Lambert PC, Hellmich M, Abrams KR, Jones DR: Meta-analysis software. Systematic Reviews in Health Care: Meta-Analysis in Context. Edited by: Egger M, Davey Smith G, Altman DG. 2001, London: BMJ Books, 2nd
7.
go back to reference Arthur W, Bennett W, Huffcutt A: Choice of software and programs in meta-analysis research: Does it make a difference?. Educ Psychol Measurement. 1994, 54: 776-787. 10.1177/0013164494054003024.CrossRef Arthur W, Bennett W, Huffcutt A: Choice of software and programs in meta-analysis research: Does it make a difference?. Educ Psychol Measurement. 1994, 54: 776-787. 10.1177/0013164494054003024.CrossRef
8.
go back to reference Teo KK, Yusuf S, Collins R, Held PH, Peto R: Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials. Bmj. 1991, 303 (6816): 1499-1503.CrossRefPubMedPubMedCentral Teo KK, Yusuf S, Collins R, Held PH, Peto R: Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials. Bmj. 1991, 303 (6816): 1499-1503.CrossRefPubMedPubMedCentral
9.
go back to reference Wahlbeck K, Cheine M, Essali MA: Clozapine versus typical neuroleptic medication for schizophrenia. Cochrane Database Syst Rev. 2000, CD000059- Wahlbeck K, Cheine M, Essali MA: Clozapine versus typical neuroleptic medication for schizophrenia. Cochrane Database Syst Rev. 2000, CD000059-
10.
go back to reference Pagliaro L, D'Amico G, Sorensen TI, Lebrec D, Burroughs AK, Morabito A, Tine F, Politi F, Traina M: Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment. Ann Intern Med. 1992, 117 (1): 59-70.CrossRefPubMed Pagliaro L, D'Amico G, Sorensen TI, Lebrec D, Burroughs AK, Morabito A, Tine F, Politi F, Traina M: Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment. Ann Intern Med. 1992, 117 (1): 59-70.CrossRefPubMed
11.
go back to reference Egger M, Davey Smith G, Altman DG: Systematic reviews in health care: meta-analysis in context. 2001, London , BMJ Publishing GroupCrossRef Egger M, Davey Smith G, Altman DG: Systematic reviews in health care: meta-analysis in context. 2001, London , BMJ Publishing GroupCrossRef
12.
go back to reference Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F: Methods for meta-analysis in medical research. 2000, Chichester , Wiley Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F: Methods for meta-analysis in medical research. 2000, Chichester , Wiley
13.
go back to reference Glasziou P, Irwig L, Bain C, Colditz G: Systematic Reviews in Health Care: A Practical Guide. 2001, Cambridge , Cambridge University PressCrossRef Glasziou P, Irwig L, Bain C, Colditz G: Systematic Reviews in Health Care: A Practical Guide. 2001, Cambridge , Cambridge University PressCrossRef
14.
go back to reference Bradburn MJ, Deeks JJ, Altman DG: Metan - an alternative meta-analysis command (Metan 1.81). Stata Technical Bulletin. 2003, STB 44 (sbe24): 4-15. Bradburn MJ, Deeks JJ, Altman DG: Metan - an alternative meta-analysis command (Metan 1.81). Stata Technical Bulletin. 2003, STB 44 (sbe24): 4-15.
15.
go back to reference Steichen TJ: Tests for publication bias in meta-analysis (Metabias 1.2.4). Stata Journal. 2003, SJ3-4 (sbe19_5): 11- Steichen TJ: Tests for publication bias in meta-analysis (Metabias 1.2.4). Stata Journal. 2003, SJ3-4 (sbe19_5): 11-
16.
go back to reference Steichen TJ: Nonparametric trim and fill analysis of publication bias in meta-analysis (Metatrim 1.0.5). Stata Technical Bulletin. 2003, STB61 (sbe39.2): 11- Steichen TJ: Nonparametric trim and fill analysis of publication bias in meta-analysis (Metatrim 1.0.5). Stata Technical Bulletin. 2003, STB61 (sbe39.2): 11-
17.
go back to reference StataCorp: Stata statistical software, Release 9. 2005, College Station, TX , StataCorp LP StataCorp: Stata statistical software, Release 9. 2005, College Station, TX , StataCorp LP
18.
go back to reference Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-Analysis Version 2. 2005, Engelwood, NJ , Biostat Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-Analysis Version 2. 2005, Engelwood, NJ , Biostat
19.
go back to reference Leandro G: Meta-analysis in Medical research. 2005, Blackwell Publishing, BMJ BooksCrossRef Leandro G: Meta-analysis in Medical research. 2005, Blackwell Publishing, BMJ BooksCrossRef
20.
go back to reference Rosenberg MS, Adams DC, Gurevitch J: MetaWin: Statistical Software for Meta-Analysis Version 2. 2000, Sunderland, Massachusetts , Sinauer Associates Rosenberg MS, Adams DC, Gurevitch J: MetaWin: Statistical Software for Meta-Analysis Version 2. 2000, Sunderland, Massachusetts , Sinauer Associates
21.
go back to reference Bax L, Yu LM, Ikeda N, Tsuruta N, Moons KGM: MIX: Comprehensive Free Software for Meta-analysis of Causal Research Data - Version 1.5. 2006 Bax L, Yu LM, Ikeda N, Tsuruta N, Moons KGM: MIX: Comprehensive Free Software for Meta-analysis of Causal Research Data - Version 1.5. 2006
22.
go back to reference The Nordic Cochrane Centre: Review Manager (RevMan). Version 4.2 for Windows. 2003, Copenhagen , The Cochrane Collaboration The Nordic Cochrane Centre: Review Manager (RevMan). Version 4.2 for Windows. 2003, Copenhagen , The Cochrane Collaboration
23.
go back to reference Chevarier P, Cucherat M, Freiburger T, Maupas J, Visele N, Bugnard F, Bazog P: WeasyMA. 2000, Lyon , ClinInfo Chevarier P, Cucherat M, Freiburger T, Maupas J, Visele N, Bugnard F, Bazog P: WeasyMA. 2000, Lyon , ClinInfo
24.
go back to reference Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KGM: Conference proceeding: Validation of a freely available and comprehensive meta-analysis add-in for excel. Eur J Epidemiol. 2006, European Journal of Epidemiology, 21(supplement): 58- Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KGM: Conference proceeding: Validation of a freely available and comprehensive meta-analysis add-in for excel. Eur J Epidemiol. 2006, European Journal of Epidemiology, 21(supplement): 58-
25.
go back to reference Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KG: Development and validation of MIX: comprehensive free software for meta-analysis of causal research data. BMC Med Res Methodol. 2006, 6 (1): 50-10.1186/1471-2288-6-50.CrossRefPubMedPubMedCentral Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KG: Development and validation of MIX: comprehensive free software for meta-analysis of causal research data. BMC Med Res Methodol. 2006, 6 (1): 50-10.1186/1471-2288-6-50.CrossRefPubMedPubMedCentral
26.
go back to reference Deeks JJ: Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Stat Med. 2002, 21 (11): 1575-1600. 10.1002/sim.1188.CrossRefPubMed Deeks JJ: Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Stat Med. 2002, 21 (11): 1575-1600. 10.1002/sim.1188.CrossRefPubMed
Metadata
Title
A systematic comparison of software dedicated to meta-analysis of causal studies
Authors
Leon Bax
Ly-Mee Yu
Noriaki Ikeda
Karel GM Moons
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2007
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-7-40

Other articles of this Issue 1/2007

BMC Medical Research Methodology 1/2007 Go to the issue