Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2006

Open Access 01-12-2006 | Software

Meta-DiSc: a software for meta-analysis of test accuracy data

Authors: Javier Zamora, Victor Abraira, Alfonso Muriel, Khalid Khan, Arri Coomarasamy

Published in: BMC Medical Research Methodology | Issue 1/2006

Login to get access

Abstract

Background

Systematic reviews and meta-analyses of test accuracy studies are increasingly being recognised as central in guiding clinical practice. However, there is currently no dedicated and comprehensive software for meta-analysis of diagnostic data. In this article, we present Meta-DiSc, a Windows-based, user-friendly, freely available (for academic use) software that we have developed, piloted, and validated to perform diagnostic meta-analysis.

Results

Meta-DiSc a) allows exploration of heterogeneity, with a variety of statistics including chi-square, I-squared and Spearman correlation tests, b) implements meta-regression techniques to explore the relationships between study characteristics and accuracy estimates, c) performs statistical pooling of sensitivities, specificities, likelihood ratios and diagnostic odds ratios using fixed and random effects models, both overall and in subgroups and d) produces high quality figures, including forest plots and summary receiver operating characteristic curves that can be exported for use in manuscripts for publication. All computational algorithms have been validated through comparison with different statistical tools and published meta-analyses. Meta-DiSc has a Graphical User Interface with roll-down menus, dialog boxes, and online help facilities.

Conclusion

Meta-DiSc is a comprehensive and dedicated test accuracy meta-analysis software. It has already been used and cited in several meta-analyses published in high-ranking journals. The software is publicly available at http://​www.​hrc.​es/​investigacion/​metadisc_​en.​htm.
Appendix
Available only for authorised users
Literature
1.
go back to reference Thomson R, McElroy H, Sudlow M: Guidelines on anticoagulant treatment in atrial fibrillation in Great Britain: variation in content and implications for treatment. BMJ. 1998, 316: 509-513.CrossRefPubMedPubMedCentral Thomson R, McElroy H, Sudlow M: Guidelines on anticoagulant treatment in atrial fibrillation in Great Britain: variation in content and implications for treatment. BMJ. 1998, 316: 509-513.CrossRefPubMedPubMedCentral
2.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC: Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Radiology. 2003, 226: 24-28.CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC: Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Radiology. 2003, 226: 24-28.CrossRefPubMed
4.
go back to reference Lau J: Meta-Test. 1997, Boston: New England Medical Center Lau J: Meta-Test. 1997, Boston: New England Medical Center
5.
go back to reference The NAG C Library, Mark 6. 2004, Oxford: Numerical Algorithms Group The NAG C Library, Mark 6. 2004, Oxford: Numerical Algorithms Group
7.
go back to reference Irwig L, Tosteson ANA, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for Metaanalyses Evaluating Diagnostic-Tests. Annals of Internal Medicine. 1994, 120: 667-676.CrossRefPubMed Irwig L, Tosteson ANA, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for Metaanalyses Evaluating Diagnostic-Tests. Annals of Internal Medicine. 1994, 120: 667-676.CrossRefPubMed
8.
go back to reference Moses LE, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993, 12: 1293-1316.CrossRefPubMed Moses LE, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993, 12: 1293-1316.CrossRefPubMed
9.
go back to reference Deville WL, Buntinx F, Bouter LM, Montori VM, de Vet HC, van der Windt DA, Bezemer PD: Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol. 2002, 2: 9-10.1186/1471-2288-2-9.CrossRefPubMedPubMedCentral Deville WL, Buntinx F, Bouter LM, Montori VM, de Vet HC, van der Windt DA, Bezemer PD: Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol. 2002, 2: 9-10.1186/1471-2288-2-9.CrossRefPubMedPubMedCentral
10.
go back to reference Deeks JJ: Systematic reviews of evaluations of diagnostic and screening tests studies. Systematic reviews in health care: meta-analysis in context. Edited by: Egger M, Davey SG and Altman DG. 2001, BMJ Books, 2nd Edition Deeks JJ: Systematic reviews of evaluations of diagnostic and screening tests studies. Systematic reviews in health care: meta-analysis in context. Edited by: Egger M, Davey SG and Altman DG. 2001, BMJ Books, 2nd Edition
11.
go back to reference Honest H, Khan KS: Reporting of measures of accuracy in systematic reviews of diagnostic literature. Bmc Health Services Research. 2002, 2: Honest H, Khan KS: Reporting of measures of accuracy in systematic reviews of diagnostic literature. Bmc Health Services Research. 2002, 2:
12.
go back to reference Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM: The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003, 56: 1129-1135. 10.1016/S0895-4356(03)00177-X.CrossRefPubMed Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM: The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003, 56: 1129-1135. 10.1016/S0895-4356(03)00177-X.CrossRefPubMed
13.
go back to reference Lijmer JG, Bossuyt PM, Heisterkamp SH: Exploring sources of heterogeneity in systematic reviews of diagnostic tests. Stat Med. 2002, 21: 1525-1537. 10.1002/sim.1185.CrossRefPubMed Lijmer JG, Bossuyt PM, Heisterkamp SH: Exploring sources of heterogeneity in systematic reviews of diagnostic tests. Stat Med. 2002, 21: 1525-1537. 10.1002/sim.1185.CrossRefPubMed
14.
go back to reference Dinnes J, Deeks J, Kirby J, Roderick P: A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess. 2005, 9: 1-113.CrossRef Dinnes J, Deeks J, Kirby J, Roderick P: A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess. 2005, 9: 1-113.CrossRef
15.
go back to reference Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.CrossRefPubMed Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.CrossRefPubMed
16.
go back to reference Thompson SG, Sharp SJ: Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999, 18: 2693-2708. 10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V.CrossRefPubMed Thompson SG, Sharp SJ: Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999, 18: 2693-2708. 10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V.CrossRefPubMed
17.
go back to reference Rutter CM, Gatsonis CA: A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001, 20: 2865-2884. 10.1002/sim.942.CrossRefPubMed Rutter CM, Gatsonis CA: A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001, 20: 2865-2884. 10.1002/sim.942.CrossRefPubMed
18.
go back to reference Reitsma JB, Glas AS, Rutjes AWS, Scholten RJPM, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.CrossRefPubMed Reitsma JB, Glas AS, Rutjes AWS, Scholten RJPM, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. Journal of Clinical Epidemiology. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.CrossRefPubMed
19.
go back to reference Walter SD: Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat Med. 2002, 21: 1237-1256. 10.1002/sim.1099.CrossRefPubMed Walter SD: Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat Med. 2002, 21: 1237-1256. 10.1002/sim.1099.CrossRefPubMed
20.
go back to reference DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.CrossRefPubMed DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials. 1986, 7: 177-188. 10.1016/0197-2456(86)90046-2.CrossRefPubMed
21.
go back to reference Gupta JK, Chien PF, Voit D, Clark TJ, Khan KS: Ultrasonographic endometrial thickness for diagnosing endometrial pathology in women with postmenopausal bleeding: a meta-analysis. Acta Obstet Gynecol Scand. 2002, 81: 799-816. 10.1034/j.1600-0412.2001.810902.x.CrossRefPubMed Gupta JK, Chien PF, Voit D, Clark TJ, Khan KS: Ultrasonographic endometrial thickness for diagnosing endometrial pathology in women with postmenopausal bleeding: a meta-analysis. Acta Obstet Gynecol Scand. 2002, 81: 799-816. 10.1034/j.1600-0412.2001.810902.x.CrossRefPubMed
22.
go back to reference Khan KS, Kunz R, Kleijnen J, Antes G: Case study 4: Reviewing evidence on test accuracy. Systematic Review to Support Evidence-based Medicine. 2003, London, The Royal Society of Medicine, 109-119. 2003 Khan KS, Kunz R, Kleijnen J, Antes G: Case study 4: Reviewing evidence on test accuracy. Systematic Review to Support Evidence-based Medicine. 2003, London, The Royal Society of Medicine, 109-119. 2003
23.
go back to reference Morgan M, Kalantri S, Flores L, Pai M: A commercial line probe assay for the rapid detection of rifampicin resistance in Mycobacterium tuberculosis: a systematic review and meta-analysis. BMC Infectious Diseases. 2005, 5: 62-10.1186/1471-2334-5-62.CrossRefPubMedPubMedCentral Morgan M, Kalantri S, Flores L, Pai M: A commercial line probe assay for the rapid detection of rifampicin resistance in Mycobacterium tuberculosis: a systematic review and meta-analysis. BMC Infectious Diseases. 2005, 5: 62-10.1186/1471-2334-5-62.CrossRefPubMedPubMedCentral
24.
go back to reference Flores L, Pai M, Colford JM, Riley LW: In-house nucleic acid amplification tests for the detection of Mycobacterium tuberculosis in sputum specimens: meta-analysis and meta-regression. BMC Microbiol. 2005, 5: 55-10.1186/1471-2180-5-55.CrossRefPubMedPubMedCentral Flores L, Pai M, Colford JM, Riley LW: In-house nucleic acid amplification tests for the detection of Mycobacterium tuberculosis in sputum specimens: meta-analysis and meta-regression. BMC Microbiol. 2005, 5: 55-10.1186/1471-2180-5-55.CrossRefPubMedPubMedCentral
25.
go back to reference Gisbert J, Abraira V: Accuracy of Helicobacter pylori Diagnostic Tests in Patients with Bleeding Peptic Ulcer: A Systematic Review and Meta-analysis. The American Journal of Gastroenterology. 2006, 101: 848-863. 10.1111/j.1572-0241.2006.00528.x.CrossRefPubMed Gisbert J, Abraira V: Accuracy of Helicobacter pylori Diagnostic Tests in Patients with Bleeding Peptic Ulcer: A Systematic Review and Meta-analysis. The American Journal of Gastroenterology. 2006, 101: 848-863. 10.1111/j.1572-0241.2006.00528.x.CrossRefPubMed
26.
go back to reference Shiga T, Wajima Z, Inoue T, Sakamoto A: Predicting difficult intubation in apparently normal patients: a meta-analysis of bedside screening test performance. Anesthesiology. 2005, 103: 429-437. 10.1097/00000542-200508000-00027.CrossRefPubMed Shiga T, Wajima Z, Inoue T, Sakamoto A: Predicting difficult intubation in apparently normal patients: a meta-analysis of bedside screening test performance. Anesthesiology. 2005, 103: 429-437. 10.1097/00000542-200508000-00027.CrossRefPubMed
27.
go back to reference Zijlstra JM, van der Werf G, Hoekstra OS, Hooft L, Huijgens PC: F-fluoro-deoxyglucose positron emission tomography for post-treatment evaluation of malignant lymphoma: a systematic review. Haematologica. 2006, 91: 522-9.PubMed Zijlstra JM, van der Werf G, Hoekstra OS, Hooft L, Huijgens PC: F-fluoro-deoxyglucose positron emission tomography for post-treatment evaluation of malignant lymphoma: a systematic review. Haematologica. 2006, 91: 522-9.PubMed
28.
go back to reference Goodacre S, Sutton AJ, Sampson FC: Meta-Analysis: The Value of Clinical Assessment in the Diagnosis of Deep Venous Thrombosis. Annals of Internal Medicine. 2005, 143: 129-139.CrossRefPubMed Goodacre S, Sutton AJ, Sampson FC: Meta-Analysis: The Value of Clinical Assessment in the Diagnosis of Deep Venous Thrombosis. Annals of Internal Medicine. 2005, 143: 129-139.CrossRefPubMed
Metadata
Title
Meta-DiSc: a software for meta-analysis of test accuracy data
Authors
Javier Zamora
Victor Abraira
Alfonso Muriel
Khalid Khan
Arri Coomarasamy
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2006
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-6-31

Other articles of this Issue 1/2006

BMC Medical Research Methodology 1/2006 Go to the issue