Skip to main content
Top
Published in: Systematic Reviews 1/2013

Open Access 01-12-2013 | Research

Cochrane diagnostic test accuracy reviews

Authors: Mariska MG Leeflang, Jonathan J Deeks, Yemisi Takwoingi, Petra Macaskill

Published in: Systematic Reviews | Issue 1/2013

Login to get access

Abstract

In 1996, shortly after the founding of The Cochrane Collaboration, leading figures in test evaluation research established a Methods Group to focus on the relatively new and rapidly evolving methods for the systematic review of studies of diagnostic tests. Seven years later, the Collaboration decided it was time to develop a publication format and methodology for Diagnostic Test Accuracy (DTA) reviews, as well as the software needed to implement these reviews in The Cochrane Library. A meeting hosted by the German Cochrane Centre in 2004 brought together key methodologists in the area, many of whom became closely involved in the subsequent development of the methodological framework for DTA reviews. DTA reviews first appeared in The Cochrane Library in 2008 and are now an integral part of the work of the Collaboration.
Appendix
Available only for authorised users
Literature
1.
go back to reference Feinstein AR: Misguided efforts and future challenges for research on “diagnostic tests”. J Epidemiol Comm Health. 2002, 56: 330-332. 10.1136/jech.56.5.330.CrossRef Feinstein AR: Misguided efforts and future challenges for research on “diagnostic tests”. J Epidemiol Comm Health. 2002, 56: 330-332. 10.1136/jech.56.5.330.CrossRef
2.
go back to reference Mulherin SA, Miller WC: Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002, 137: 598-602. 10.7326/0003-4819-137-7-200210010-00011.CrossRefPubMed Mulherin SA, Miller WC: Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002, 137: 598-602. 10.7326/0003-4819-137-7-200210010-00011.CrossRefPubMed
3.
go back to reference Whiting PF, Rutjes AW, Westwood ME, Mallett S, QUADAS-2 Steering Group: A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. J Clin Epidemiol. 2013, 66: 1093-1104. 10.1016/j.jclinepi.2013.05.014.CrossRefPubMed Whiting PF, Rutjes AW, Westwood ME, Mallett S, QUADAS-2 Steering Group: A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. J Clin Epidemiol. 2013, 66: 1093-1104. 10.1016/j.jclinepi.2013.05.014.CrossRefPubMed
4.
go back to reference Lord SJ, Irwig L, Simes RJ: When is measuring sensitivity and specificity sufficient to evaluate a diagnostic test, and when do we need randomized trials?. Ann Intern Med. 2006, 144: 850-855. 10.7326/0003-4819-144-11-200606060-00011.CrossRefPubMed Lord SJ, Irwig L, Simes RJ: When is measuring sensitivity and specificity sufficient to evaluate a diagnostic test, and when do we need randomized trials?. Ann Intern Med. 2006, 144: 850-855. 10.7326/0003-4819-144-11-200606060-00011.CrossRefPubMed
5.
go back to reference Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med. 1994, 120: 667-676. 10.7326/0003-4819-120-8-199404150-00008.CrossRefPubMed Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med. 1994, 120: 667-676. 10.7326/0003-4819-120-8-199404150-00008.CrossRefPubMed
6.
go back to reference Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM, Cochrane Diagnostic Test Accuracy Working Group: Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008, 149: 889-897. 10.7326/0003-4819-149-12-200812160-00008.CrossRefPubMedPubMedCentral Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM, Cochrane Diagnostic Test Accuracy Working Group: Systematic reviews of diagnostic test accuracy. Ann Intern Med. 2008, 149: 889-897. 10.7326/0003-4819-149-12-200812160-00008.CrossRefPubMedPubMedCentral
7.
go back to reference Leeflang MMG, Debets-Ossenkopp YJ, Visser CE, Scholten RJ, Hooft L, Bijlmer HA, Reitsma JB, Bossuyt PMM, Vandenbroucke-Grauls CM: Galactomannan detection for invasive aspergillosis in immunocompromized patients. Cochrane Database Syst Rev. 2008, 4: CD007394-PubMed Leeflang MMG, Debets-Ossenkopp YJ, Visser CE, Scholten RJ, Hooft L, Bijlmer HA, Reitsma JB, Bossuyt PMM, Vandenbroucke-Grauls CM: Galactomannan detection for invasive aspergillosis in immunocompromized patients. Cochrane Database Syst Rev. 2008, 4: CD007394-PubMed
9.
go back to reference Gianrossi R, Detrano R, Mulvihill D, Lehmann K, Dubach P, Colombo A, McArthur D, Froelicher V: Exercise-induced ST depression in the diagnosis of coronary artery disease. A meta-analysis. Circulation. 1989, 80: 87-98. 10.1161/01.CIR.80.1.87.CrossRefPubMed Gianrossi R, Detrano R, Mulvihill D, Lehmann K, Dubach P, Colombo A, McArthur D, Froelicher V: Exercise-induced ST depression in the diagnosis of coronary artery disease. A meta-analysis. Circulation. 1989, 80: 87-98. 10.1161/01.CIR.80.1.87.CrossRefPubMed
10.
go back to reference Kardaun JW, Kardaun OJ: Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Methods Inf Med. 1990, 29: 12-22.PubMed Kardaun JW, Kardaun OJ: Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Methods Inf Med. 1990, 29: 12-22.PubMed
11.
go back to reference McClish D: Combining and combining area estimates across studies or strata. Med Decis Making. 1992, 12: 274-279. 10.1177/0272989X9201200405.CrossRefPubMed McClish D: Combining and combining area estimates across studies or strata. Med Decis Making. 1992, 12: 274-279. 10.1177/0272989X9201200405.CrossRefPubMed
12.
go back to reference Littenberg B, Moses LE: Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making. 1993, 13: 313-321. 10.1177/0272989X9301300408.CrossRefPubMed Littenberg B, Moses LE: Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making. 1993, 13: 313-321. 10.1177/0272989X9301300408.CrossRefPubMed
13.
go back to reference Moses L, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: Data-analytic approaches and some additional considerations. Stat Med. 1993, 12: 1293-1316. 10.1002/sim.4780121403.CrossRefPubMed Moses L, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: Data-analytic approaches and some additional considerations. Stat Med. 1993, 12: 1293-1316. 10.1002/sim.4780121403.CrossRefPubMed
14.
go back to reference Irwig L, Macaskill P, Glasziou P, Fahey M: Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol. 1995, 48: 119-130. 10.1016/0895-4356(94)00099-C.CrossRefPubMed Irwig L, Macaskill P, Glasziou P, Fahey M: Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol. 1995, 48: 119-130. 10.1016/0895-4356(94)00099-C.CrossRefPubMed
16.
go back to reference De-Vet HC, van der Weijden T, Muris JW, Heyrman J, Buntinx F, Knottnerus JA: Systematic reviews of diagnostic research. Considerations about assessment and incorporation of methodological quality. Eur J Epidemiol. 2001, 17: 301-306. 10.1023/A:1012751326462.CrossRefPubMed De-Vet HC, van der Weijden T, Muris JW, Heyrman J, Buntinx F, Knottnerus JA: Systematic reviews of diagnostic research. Considerations about assessment and incorporation of methodological quality. Eur J Epidemiol. 2001, 17: 301-306. 10.1023/A:1012751326462.CrossRefPubMed
17.
go back to reference Bossuyt PM, Irwig L, Craig J, Glasziou P: Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ. 2006, 332: 1089-1092. 10.1136/bmj.332.7549.1089.CrossRefPubMedPubMedCentral Bossuyt PM, Irwig L, Craig J, Glasziou P: Comparative accuracy: assessing new tests against existing diagnostic pathways. BMJ. 2006, 332: 1089-1092. 10.1136/bmj.332.7549.1089.CrossRefPubMedPubMedCentral
18.
go back to reference Leeflang MM, Scholten RJ, Rutjes AW, Reitsma JB, Bossuyt PM: Use of methodological search filters to identify diagnostic accuracy studies can lead to the omission of relevant studies. J Clin Epidemiol. 2006, 59: 234-240. 10.1016/j.jclinepi.2005.07.014.CrossRefPubMed Leeflang MM, Scholten RJ, Rutjes AW, Reitsma JB, Bossuyt PM: Use of methodological search filters to identify diagnostic accuracy studies can lead to the omission of relevant studies. J Clin Epidemiol. 2006, 59: 234-240. 10.1016/j.jclinepi.2005.07.014.CrossRefPubMed
19.
go back to reference Whiting P, Westwood M, Beynon R, Burke M, Sterne JA, Glanville J: Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies. J Clin Epidemiol. 2011, 64: 602-607. 10.1016/j.jclinepi.2010.07.006.CrossRefPubMed Whiting P, Westwood M, Beynon R, Burke M, Sterne JA, Glanville J: Inclusion of methodological filters in searches for diagnostic test accuracy studies misses relevant studies. J Clin Epidemiol. 2011, 64: 602-607. 10.1016/j.jclinepi.2010.07.006.CrossRefPubMed
20.
go back to reference Lijmer JG, Bossuyt PM, Heisterkamp SH: Exploring sources of heterogeneity in systematic reviews of diagnostic tests. Stat Med. 2002, 21: 1525-1537. 10.1002/sim.1185.CrossRefPubMed Lijmer JG, Bossuyt PM, Heisterkamp SH: Exploring sources of heterogeneity in systematic reviews of diagnostic tests. Stat Med. 2002, 21: 1525-1537. 10.1002/sim.1185.CrossRefPubMed
21.
go back to reference Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J: Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med. 2004, 140: 189-202. 10.7326/0003-4819-140-3-200402030-00010.CrossRefPubMed Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J: Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med. 2004, 140: 189-202. 10.7326/0003-4819-140-3-200402030-00010.CrossRefPubMed
22.
go back to reference Whiting P, Rutjes AWS, Reitsma JB, Bossuyt PMM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Method. 2003, 3: 25-10.1186/1471-2288-3-25.CrossRef Whiting P, Rutjes AWS, Reitsma JB, Bossuyt PMM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Method. 2003, 3: 25-10.1186/1471-2288-3-25.CrossRef
23.
go back to reference Reitsma JB, Rutjes AWS, Whiting P, Vlassov VV, Leeflang MMG, Deeks JJ: Chapter 9: Assessing methodological quality. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy. Edited by: Deeks JJ, Bossuyt PM, Gatsonis C. 2009, The Cochrane Collaboration [http://srdta.cochrane.org/] Reitsma JB, Rutjes AWS, Whiting P, Vlassov VV, Leeflang MMG, Deeks JJ: Chapter 9: Assessing methodological quality. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy. Edited by: Deeks JJ, Bossuyt PM, Gatsonis C. 2009, The Cochrane Collaboration [http://​srdta.​cochrane.​org/​]
24.
go back to reference Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, The QUADAS-2 Group: QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011, 155: 529-536. 10.7326/0003-4819-155-8-201110180-00009.CrossRefPubMed Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MM, Sterne JA, Bossuyt PM, The QUADAS-2 Group: QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011, 155: 529-536. 10.7326/0003-4819-155-8-201110180-00009.CrossRefPubMed
25.
go back to reference Rutter CM, Gatsonis CA: Regression methods for meta-analysis of diagnostic test data. Acad Radiol. 1995, 2 (Suppl 1): S48-56.PubMed Rutter CM, Gatsonis CA: Regression methods for meta-analysis of diagnostic test data. Acad Radiol. 1995, 2 (Suppl 1): S48-56.PubMed
26.
go back to reference Van-Houwelingen HC, Zwinderman AH, Stijnen T: A bivariate approach to meta-analysis. Stat Med. 1993, 12: 2273-2284. 10.1002/sim.4780122405.CrossRefPubMed Van-Houwelingen HC, Zwinderman AH, Stijnen T: A bivariate approach to meta-analysis. Stat Med. 1993, 12: 2273-2284. 10.1002/sim.4780122405.CrossRefPubMed
27.
go back to reference Rutter CM, Gatsonis CA: A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001, 20: 2865-2884. 10.1002/sim.942.CrossRefPubMed Rutter CM, Gatsonis CA: A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001, 20: 2865-2884. 10.1002/sim.942.CrossRefPubMed
28.
go back to reference Macaskill P: Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. J Clin Epidemiol. 2004, 57: 925-932. 10.1016/j.jclinepi.2003.12.019.CrossRefPubMed Macaskill P: Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. J Clin Epidemiol. 2004, 57: 925-932. 10.1016/j.jclinepi.2003.12.019.CrossRefPubMed
29.
go back to reference Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.CrossRefPubMed Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH: Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005, 58: 982-990. 10.1016/j.jclinepi.2005.02.022.CrossRefPubMed
30.
go back to reference Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, Bachmann LM: An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol. 2008, 61: 1095-1103. 10.1016/j.jclinepi.2007.09.013.CrossRefPubMed Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, Bachmann LM: An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol. 2008, 61: 1095-1103. 10.1016/j.jclinepi.2007.09.013.CrossRefPubMed
31.
go back to reference Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA: A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007, 8: 239-251. 10.1093/biostatistics/kxl004.CrossRefPubMed Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA: A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007, 8: 239-251. 10.1093/biostatistics/kxl004.CrossRefPubMed
32.
go back to reference Glas AS, Roos D, Deutekom M, Zwinderman AH, Bossuyt PM, Kurth KH: Tumor markers in the diagnosis of primary bladder cancer. A systematic review. J Urol. 2003, 169: 1975-1982. 10.1097/01.ju.0000067461.30468.6d.CrossRefPubMed Glas AS, Roos D, Deutekom M, Zwinderman AH, Bossuyt PM, Kurth KH: Tumor markers in the diagnosis of primary bladder cancer. A systematic review. J Urol. 2003, 169: 1975-1982. 10.1097/01.ju.0000067461.30468.6d.CrossRefPubMed
33.
go back to reference Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y: Chapter 10: Analysing and Presenting Results. Handbook for Systematic Reviews of Diagnostic Test Accuracy. Edited by: Deeks JJ, Bossuyt PM, Gatsonis C. 2010, The Cochrane Collaboration. [http://srdta.cochrane.org/] Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y: Chapter 10: Analysing and Presenting Results. Handbook for Systematic Reviews of Diagnostic Test Accuracy. Edited by: Deeks JJ, Bossuyt PM, Gatsonis C. 2010, The Cochrane Collaboration. [http://​srdta.​cochrane.​org/​]
34.
go back to reference Song F, Khan KS, Dinnes J, Sutton AJ: Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002, 31: 88-95. 10.1093/ije/31.1.88.CrossRefPubMed Song F, Khan KS, Dinnes J, Sutton AJ: Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002, 31: 88-95. 10.1093/ije/31.1.88.CrossRefPubMed
35.
go back to reference Deeks JJ, Macaskill P, Irwig L: The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005, 58: 882-893. 10.1016/j.jclinepi.2005.01.016.CrossRefPubMed Deeks JJ, Macaskill P, Irwig L: The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005, 58: 882-893. 10.1016/j.jclinepi.2005.01.016.CrossRefPubMed
36.
go back to reference Takwoingi Y, Leeflang MM, Deeks JJ: Empirical evidence of the importance of comparative studies of diagnostic test accuracy. Ann Intern Med. 2013, 158: 544-554. 10.7326/0003-4819-158-7-201304020-00006.CrossRefPubMed Takwoingi Y, Leeflang MM, Deeks JJ: Empirical evidence of the importance of comparative studies of diagnostic test accuracy. Ann Intern Med. 2013, 158: 544-554. 10.7326/0003-4819-158-7-201304020-00006.CrossRefPubMed
37.
go back to reference Hamza TH, Arends LR, Van-Houwelingen HC, Stijnen T: Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Med Res Methodol. 2009, 9: 73-10.1186/1471-2288-9-73.CrossRefPubMedPubMedCentral Hamza TH, Arends LR, Van-Houwelingen HC, Stijnen T: Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Med Res Methodol. 2009, 9: 73-10.1186/1471-2288-9-73.CrossRefPubMedPubMedCentral
38.
go back to reference Ferrante di-Ruffano L, Hyde CJ, McCaffery KJ, Bossuyt PM, Deeks JJ: Assessing the value of diagnostic tests: a framework for designing and evaluating trials. BMJ. 2012, 344: e686-10.1136/bmj.e686.CrossRefPubMed Ferrante di-Ruffano L, Hyde CJ, McCaffery KJ, Bossuyt PM, Deeks JJ: Assessing the value of diagnostic tests: a framework for designing and evaluating trials. BMJ. 2012, 344: e686-10.1136/bmj.e686.CrossRefPubMed
39.
go back to reference Schünemann HJ, Oxman AD, Brozek J, Glasziou P, Jaeschke R, Vist GE, Williams JW, Kunz R, Craig J, Montori VM, Bossuyt PM, Guyatt GH, The GRADE Working Group: Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. BMJ. 2008, 336: 1106-1110. 10.1136/bmj.39500.677199.AE.CrossRefPubMedPubMedCentral Schünemann HJ, Oxman AD, Brozek J, Glasziou P, Jaeschke R, Vist GE, Williams JW, Kunz R, Craig J, Montori VM, Bossuyt PM, Guyatt GH, The GRADE Working Group: Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. BMJ. 2008, 336: 1106-1110. 10.1136/bmj.39500.677199.AE.CrossRefPubMedPubMedCentral
Metadata
Title
Cochrane diagnostic test accuracy reviews
Authors
Mariska MG Leeflang
Jonathan J Deeks
Yemisi Takwoingi
Petra Macaskill
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2013
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-82

Other articles of this Issue 1/2013

Systematic Reviews 1/2013 Go to the issue