Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2006

Open Access 01-12-2006 | Software

Development and validation of MIX: comprehensive free software for meta-analysis of causal research data

Authors: Leon Bax, Ly-Mee Yu, Noriaki Ikeda, Harukazu Tsuruta, Karel GM Moons

Published in: BMC Medical Research Methodology | Issue 1/2006

Login to get access

Abstract

Background

Meta-analysis has become a well-known method for synthesis of quantitative data from previously conducted research in applied health sciences. So far, meta-analysis has been particularly useful in evaluating and comparing therapies and in assessing causes of disease. Consequently, the number of software packages that can perform meta-analysis has increased over the years. Unfortunately, it can take a substantial amount of time to get acquainted with some of these programs and most contain little or no interactive educational material. We set out to create and validate an easy-to-use and comprehensive meta-analysis package that would be simple enough programming-wise to remain available as a free download. We specifically aimed at students and researchers who are new to meta-analysis, with important parts of the development oriented towards creating internal interactive tutoring tools and designing features that would facilitate usage of the software as a companion to existing books on meta-analysis.

Results

We took an unconventional approach and created a program that uses Excel as a calculation and programming platform. The main programming language was Visual Basic, as implemented in Visual Basic 6 and Visual Basic for Applications in Excel 2000 and higher. The development took approximately two years and resulted in the 'MIX' program, which can be downloaded from the program's website free of charge. Next, we set out to validate the MIX output with two major software packages as reference standards, namely STATA (metan, metabias, and metatrim) and Comprehensive Meta-Analysis Version 2. Eight meta-analyses that had been published in major journals were used as data sources. All numerical and graphical results from analyses with MIX were identical to their counterparts in STATA and CMA. The MIX program distinguishes itself from most other programs by the extensive graphical output, the click-and-go (Excel) interface, and the educational features.

Conclusion

The MIX program is a valid tool for performing meta-analysis and may be particularly useful in educational environments. It can be downloaded free of charge via http://​www.​mix-for-meta-analysis.​info or http://​sourceforge.​net/​projects/​meta-analysis.
Appendix
Available only for authorised users
Literature
2.
go back to reference Yusuf S, Cairns J, Camm A, Fallen E, Gersh B: Evidence-Based Cardiology. 1998, London: BMJ Publishing Group Yusuf S, Cairns J, Camm A, Fallen E, Gersh B: Evidence-Based Cardiology. 1998, London: BMJ Publishing Group
3.
go back to reference Yusuf S, Zucker D, Peduzzi P, Fisher L, Takaro T, Kennedy J, Davis K, Killip T, Passamani E, Norris R, et al: Effect of coronary artery bypass graft surgery on survival: overview of 10-year results from randomised trials by the Coronary Artery Bypass Graft Surgery Trialists Collaboration. Lancet. 1994, 344 (8922): 563-70. 10.1016/S0140-6736(94)91963-1.CrossRefPubMed Yusuf S, Zucker D, Peduzzi P, Fisher L, Takaro T, Kennedy J, Davis K, Killip T, Passamani E, Norris R, et al: Effect of coronary artery bypass graft surgery on survival: overview of 10-year results from randomised trials by the Coronary Artery Bypass Graft Surgery Trialists Collaboration. Lancet. 1994, 344 (8922): 563-70. 10.1016/S0140-6736(94)91963-1.CrossRefPubMed
4.
go back to reference Lau J, Antman E, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers T: Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992, 327 (4): 248-54.CrossRefPubMed Lau J, Antman E, Jimenez-Silva J, Kupelnick B, Mosteller F, Chalmers T: Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992, 327 (4): 248-54.CrossRefPubMed
6.
go back to reference Egger M, Davey Smith G, Altman D: Systematic Reviews in Health Care: Meta-Analysis in Context. 2001, London: BMJ Publishing GroupCrossRef Egger M, Davey Smith G, Altman D: Systematic Reviews in Health Care: Meta-Analysis in Context. 2001, London: BMJ Publishing GroupCrossRef
7.
go back to reference Glasziou P, Irwig L, Bain C, Colditz G: Systematic Reviews in Health Care: A Practical Guide. 2001, Cambridge: Cambridge University PressCrossRef Glasziou P, Irwig L, Bain C, Colditz G: Systematic Reviews in Health Care: A Practical Guide. 2001, Cambridge: Cambridge University PressCrossRef
8.
go back to reference Petitti D: Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis: Methods for Quantitative Synthesis in Medicine. 2000, Oxford: Oxford University Press, second Petitti D: Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis: Methods for Quantitative Synthesis in Medicine. 2000, Oxford: Oxford University Press, second
9.
go back to reference Stangle D, Berry D: Meta-analysis in Medicine and Health Policy. 2000, New York: Marcel DekkerCrossRef Stangle D, Berry D: Meta-analysis in Medicine and Health Policy. 2000, New York: Marcel DekkerCrossRef
10.
go back to reference Sutton A, Abrams K, Jones D, Sheldon T, Song F: Methods for Meta-Analysis in Medical Research. 2000, Chichester: Wiley Sutton A, Abrams K, Jones D, Sheldon T, Song F: Methods for Meta-Analysis in Medical Research. 2000, Chichester: Wiley
11.
go back to reference Whitehead A: Meta-Analysis of Controlled Clinical Trials. 2002, Chichester: WileyCrossRef Whitehead A: Meta-Analysis of Controlled Clinical Trials. 2002, Chichester: WileyCrossRef
13.
go back to reference Normand S: Meta-analysis software – a comparative review – DSTAT, version 1.10. Am Statistician. 1995, 49: 298-309. 10.2307/2684205. Normand S: Meta-analysis software – a comparative review – DSTAT, version 1.10. Am Statistician. 1995, 49: 298-309. 10.2307/2684205.
14.
go back to reference Sterne J, Egger M, Sutton A: Meta-analysis software. Systematic Reviews in Health Care: Meta-Analysis in Context. Edited by: Egger M, Davey Smith G, Altman D. 2001, London: BMJ Books, 2 Sterne J, Egger M, Sutton A: Meta-analysis software. Systematic Reviews in Health Care: Meta-Analysis in Context. Edited by: Egger M, Davey Smith G, Altman D. 2001, London: BMJ Books, 2
15.
go back to reference Sutton A, Lambert P, Hellmich M, Abrams K, Jones D: Meta-analysis in practice: A critical review of available software. Meta-Analysis in Medicine and Health Policy. Edited by: Berry D, Stangl D. 2000, New York: Marcel Dekker Sutton A, Lambert P, Hellmich M, Abrams K, Jones D: Meta-analysis in practice: A critical review of available software. Meta-Analysis in Medicine and Health Policy. Edited by: Berry D, Stangl D. 2000, New York: Marcel Dekker
16.
go back to reference Bax L, Ikeda N, Shirataka M, Takeuchi A: Explaining common meta-analytic statistics in Japan with a simple Excel add-in. The 24th Joint Conference on Medical Informatics. 2004, Nagoya, Japan Bax L, Ikeda N, Shirataka M, Takeuchi A: Explaining common meta-analytic statistics in Japan with a simple Excel add-in. The 24th Joint Conference on Medical Informatics. 2004, Nagoya, Japan
17.
go back to reference Bax L, Ikeda N: Explaining and performing common meta-analytic procedures in Japan: development of bilingual interactive software. The 12th Cochrane Colloquium. 2004, Ottawa, Canada Bax L, Ikeda N: Explaining and performing common meta-analytic procedures in Japan: development of bilingual interactive software. The 12th Cochrane Colloquium. 2004, Ottawa, Canada
18.
go back to reference Bax L, Tsuruta H, Ikeda N, Takeuchi A, Shirataka M: The MIX program, free software for learning, teaching, and exploring meta-analysis with Excel. The 13th Cochrane Colloquium, Melbourne, Australia. 2005 Bax L, Tsuruta H, Ikeda N, Takeuchi A, Shirataka M: The MIX program, free software for learning, teaching, and exploring meta-analysis with Excel. The 13th Cochrane Colloquium, Melbourne, Australia. 2005
19.
go back to reference Bax L, Tsuruta H, Shirataka M, Takeuchi A, Ikeda N: The MIX program, an active way of learning about meta-analysis with Excel. International Symposium: Systematic Review and Meta-Analysis, Wako, Japan. 2005 Bax L, Tsuruta H, Shirataka M, Takeuchi A, Ikeda N: The MIX program, an active way of learning about meta-analysis with Excel. International Symposium: Systematic Review and Meta-Analysis, Wako, Japan. 2005
21.
go back to reference Knusel L: On the accuracy of statistical distributions in Microsoft Excel 2003. Comput Statist Data Anal. 2005, 48 (3): 445-449. 10.1016/j.csda.2004.02.008.CrossRef Knusel L: On the accuracy of statistical distributions in Microsoft Excel 2003. Comput Statist Data Anal. 2005, 48 (3): 445-449. 10.1016/j.csda.2004.02.008.CrossRef
22.
go back to reference McCullough B, Wilson B: On the accuracy of statistical procedures in Microsoft Excel 2000 and Excel XP. Comput Statist Data Anal. 2002, 40: 713-721. 10.1016/S0167-9473(02)00095-6.CrossRef McCullough B, Wilson B: On the accuracy of statistical procedures in Microsoft Excel 2000 and Excel XP. Comput Statist Data Anal. 2002, 40: 713-721. 10.1016/S0167-9473(02)00095-6.CrossRef
23.
go back to reference McCullough B, Wilson B: On the accuracy of statistical procedures in Microsoft Excel 2003. Comput Statist Data Anal. 2005, 49 (4): 1244-1252. 10.1016/j.csda.2004.06.016.CrossRef McCullough B, Wilson B: On the accuracy of statistical procedures in Microsoft Excel 2003. Comput Statist Data Anal. 2005, 49 (4): 1244-1252. 10.1016/j.csda.2004.06.016.CrossRef
24.
go back to reference StataCorp: Stata Statistical Software, Release 9. 2005, College Station, TX: StataCorp LP StataCorp: Stata Statistical Software, Release 9. 2005, College Station, TX: StataCorp LP
25.
go back to reference Bradburn M, Deeks J, Altman D: Metan – an alternative meta-analysis command (Metan 1.81). Stata Technical Bulletin. 2003, STB 44 (sbe24): 4-15. Bradburn M, Deeks J, Altman D: Metan – an alternative meta-analysis command (Metan 1.81). Stata Technical Bulletin. 2003, STB 44 (sbe24): 4-15.
26.
go back to reference Steichen T: Tests for publication bias in meta-analysis (Metabias 1.2.4). Stata Journal. 2003, SJ3-4 (sbe19_5): 11- Steichen T: Tests for publication bias in meta-analysis (Metabias 1.2.4). Stata Journal. 2003, SJ3-4 (sbe19_5): 11-
27.
go back to reference Steichen T: Nonparametric trim and fill analysis of publication bias in meta-analysis (Metatrim 1.0.5). Stata Technical Bulletin. 2003, STB61 (sbe39.2): 11- Steichen T: Nonparametric trim and fill analysis of publication bias in meta-analysis (Metatrim 1.0.5). Stata Technical Bulletin. 2003, STB61 (sbe39.2): 11-
28.
go back to reference Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-Analysis Version 2. 2005, Engelwood, NJ: Biostat Borenstein M, Hedges L, Higgins J, Rothstein H: Comprehensive Meta-Analysis Version 2. 2005, Engelwood, NJ: Biostat
29.
go back to reference Hodnett E: Caregiver support for women during childbirth. Cochrane Database Syst Rev. 2000, CD000199-2 Hodnett E: Caregiver support for women during childbirth. Cochrane Database Syst Rev. 2000, CD000199-2
30.
go back to reference Teo K, Yusuf S, Collins R, Held P, Peto R: Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials. Bmj. 1991, 303 (6816): 1499-503.CrossRefPubMedPubMedCentral Teo K, Yusuf S, Collins R, Held P, Peto R: Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials. Bmj. 1991, 303 (6816): 1499-503.CrossRefPubMedPubMedCentral
31.
go back to reference Crowley P: Interventions for preventing or improving the outcome of delivery at or beyond term. Cochrane Database Syst Rev. 2000, CD000170-2 Crowley P: Interventions for preventing or improving the outcome of delivery at or beyond term. Cochrane Database Syst Rev. 2000, CD000170-2
32.
go back to reference Lightowler J, Wedzicha J, Elliott M, Ram F: Non-invasive positive pressure ventilation to treat respiratory failure resulting from exacerbations of chronic obstructive pulmonary disease: Cochrane systematic review and meta-analysis. Bmj. 2003, 326 (7382): 185-10.1136/bmj.326.7382.185.CrossRefPubMedPubMedCentral Lightowler J, Wedzicha J, Elliott M, Ram F: Non-invasive positive pressure ventilation to treat respiratory failure resulting from exacerbations of chronic obstructive pulmonary disease: Cochrane systematic review and meta-analysis. Bmj. 2003, 326 (7382): 185-10.1136/bmj.326.7382.185.CrossRefPubMedPubMedCentral
33.
go back to reference Wahlbeck K, Cheine M, Essali M: Clozapine versus typical neuroleptic medication for schizophrenia. Cochrane Database Syst Rev. 2000, CD000059-2 Wahlbeck K, Cheine M, Essali M: Clozapine versus typical neuroleptic medication for schizophrenia. Cochrane Database Syst Rev. 2000, CD000059-2
34.
go back to reference Pagliaro L, D'Amico G, Sorensen T, Lebrec D, Burroughs A, Morabito A, Tine F, Politi F, Traina M: Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment. Ann Intern Med. 1992, 117: 59-70.CrossRefPubMed Pagliaro L, D'Amico G, Sorensen T, Lebrec D, Burroughs A, Morabito A, Tine F, Politi F, Traina M: Prevention of first bleeding in cirrhosis. A meta-analysis of randomized trials of nonsurgical treatment. Ann Intern Med. 1992, 117: 59-70.CrossRefPubMed
35.
go back to reference Law M, Wald N, Thompson S: By how much and how quickly does reduction in serum cholesterol concentration lower risk of ischaemic heart disease?. Bmj. 1994, 308 (6925): 367-72.CrossRefPubMedPubMedCentral Law M, Wald N, Thompson S: By how much and how quickly does reduction in serum cholesterol concentration lower risk of ischaemic heart disease?. Bmj. 1994, 308 (6925): 367-72.CrossRefPubMedPubMedCentral
36.
go back to reference Macaskill P, Walter S, Irwig L: A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001, 20 (4): 641-54. 10.1002/sim.698.CrossRefPubMed Macaskill P, Walter S, Irwig L: A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001, 20 (4): 641-54. 10.1002/sim.698.CrossRefPubMed
37.
go back to reference Duval S, Tweedie R: Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56 (2): 455-63. 10.1111/j.0006-341X.2000.00455.x.CrossRefPubMed Duval S, Tweedie R: Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000, 56 (2): 455-63. 10.1111/j.0006-341X.2000.00455.x.CrossRefPubMed
38.
go back to reference Rosenberg M, Adams D, Gurevitch J: MetaWin: Statistical Software for Meta-Analysis Version 2. 2000, Sunderland, Massachusetts: Sinauer Associates Rosenberg M, Adams D, Gurevitch J: MetaWin: Statistical Software for Meta-Analysis Version 2. 2000, Sunderland, Massachusetts: Sinauer Associates
39.
go back to reference The Nordic Cochrane Centre: Review Manager (RevMan) Version 4.2 for Windows. 2003, Copenhagen: The Cochrane Collaboration The Nordic Cochrane Centre: Review Manager (RevMan) Version 4.2 for Windows. 2003, Copenhagen: The Cochrane Collaboration
40.
go back to reference Chevarier P, Cucherat M, Freiburger T, Maupas J, Visele N, Bugnard F, Bazog P: WeasyMA. 2000, Lyon: ClinInfo Chevarier P, Cucherat M, Freiburger T, Maupas J, Visele N, Bugnard F, Bazog P: WeasyMA. 2000, Lyon: ClinInfo
Metadata
Title
Development and validation of MIX: comprehensive free software for meta-analysis of causal research data
Authors
Leon Bax
Ly-Mee Yu
Noriaki Ikeda
Harukazu Tsuruta
Karel GM Moons
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2006
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-6-50

Other articles of this Issue 1/2006

BMC Medical Research Methodology 1/2006 Go to the issue