Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Evidence at a glance: error matrix approach for overviewing available evidence

Authors: Frederik Keus, Jørn Wetterslev, Christian Gluud, Cornelis JHM van Laarhoven

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Clinical evidence continues to expand and is increasingly difficult to overview. We aimed at conceptualizing a visual assessment tool, i.e., a matrix for overviewing studies and their data in order to assess the clinical evidence at a glance.

Methods

A four-step matrix was constructed using the three dimensions of systematic error, random error, and design error. Matrix step I ranks the identified studies according to the dimensions of systematic errors and random errors. Matrix step II orders the studies according to the design errors. Matrix step III assesses the three dimensions of errors in studies. Matrix step IV assesses the size and direction of the intervention effect.

Results

The application of this four-step matrix is illustrated with two examples: peri-operative beta-blockade initialized in relation to surgery versus placebo for major non-cardiac surgery, and antiarrhythmics for maintaining sinus rhythm after cardioversion of atrial fibrillation. When clinical evidence is deemed both internally and externally valid, the size of the intervention effect is to be assessed.

Conclusion

The error matrix provides an overview of the validity of the available evidence at a glance, and may assist in deciding which interventions to use in clinical practice.
Appendix
Available only for authorised users
Literature
1.
go back to reference Evidence-Based Medicine Working Group: Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-5. 10.1001/jama.268.17.2420.CrossRef Evidence-Based Medicine Working Group: Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-5. 10.1001/jama.268.17.2420.CrossRef
2.
go back to reference Sutton AJ, Higgins JPT: Recent developments in meta-analysis. Stat Med. 2008, 27: 625-50. 10.1002/sim.2934.CrossRefPubMed Sutton AJ, Higgins JPT: Recent developments in meta-analysis. Stat Med. 2008, 27: 625-50. 10.1002/sim.2934.CrossRefPubMed
3.
go back to reference Straus SE, Richardson WS, Glasziou P, Haynes RB: Evidence-based medicine. How to practice and teach EBM. 2005, Edinburgh, UK: Churchill Livingstone Straus SE, Richardson WS, Glasziou P, Haynes RB: Evidence-based medicine. How to practice and teach EBM. 2005, Edinburgh, UK: Churchill Livingstone
4.
go back to reference Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. 2008, The Cochrane CollaborationCrossRef Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. 2008, The Cochrane CollaborationCrossRef
5.
go back to reference Popper KR: Logik der Forschung. 1959, Vienna: Springer Popper KR: Logik der Forschung. 1959, Vienna: Springer
6.
go back to reference Kuhn T: The Structure of Scientific Revolutions. 1962, Chicago: The University of Chicago Press Kuhn T: The Structure of Scientific Revolutions. 1962, Chicago: The University of Chicago Press
7.
8.
go back to reference Quine WV: From a logical point of view. 1953, Cambridge: Harvard University Press Quine WV: From a logical point of view. 1953, Cambridge: Harvard University Press
9.
go back to reference Gluud C: The culture of designing hepato-biliary randomised trials. J Hepatol. 2006, 44: 607-15. 10.1016/j.jhep.2005.12.006.CrossRefPubMed Gluud C: The culture of designing hepato-biliary randomised trials. J Hepatol. 2006, 44: 607-15. 10.1016/j.jhep.2005.12.006.CrossRefPubMed
10.
go back to reference Atkins D, Eccles M, Flottorp S, Guyatt GH, Henry D, Hill S, Liberati A, O'Connell D, Oxman AD, Phillips B, Schünemann H, Edejer TT, Vist GE, Williams JW, GRADE Working Group: Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches. The GRADE Working Group. BMC Health Serv Res. 2004, 4: 38-10.1186/1472-6963-4-38.CrossRefPubMedPubMedCentral Atkins D, Eccles M, Flottorp S, Guyatt GH, Henry D, Hill S, Liberati A, O'Connell D, Oxman AD, Phillips B, Schünemann H, Edejer TT, Vist GE, Williams JW, GRADE Working Group: Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches. The GRADE Working Group. BMC Health Serv Res. 2004, 4: 38-10.1186/1472-6963-4-38.CrossRefPubMedPubMedCentral
11.
go back to reference Atkins D, Briss PA, Eccles M, Flottorp S, Guyatt GH, Harbour RT, Hill S, Jaeschke R, Liberati A, Magrini N, Mason J, O'Connell D, Oxman AD, Phillips B, Schünemann H, Edejer TT, Vist GE, Williams JW, GRADE Working Group: Systems for grading the quality of evidence and the strength of recommendations II: pilot study of a new system. BMC Health Serv Res. 2005, 5: 25-10.1186/1472-6963-5-25.CrossRefPubMedPubMedCentral Atkins D, Briss PA, Eccles M, Flottorp S, Guyatt GH, Harbour RT, Hill S, Jaeschke R, Liberati A, Magrini N, Mason J, O'Connell D, Oxman AD, Phillips B, Schünemann H, Edejer TT, Vist GE, Williams JW, GRADE Working Group: Systems for grading the quality of evidence and the strength of recommendations II: pilot study of a new system. BMC Health Serv Res. 2005, 5: 25-10.1186/1472-6963-5-25.CrossRefPubMedPubMedCentral
12.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, GRADE Working Group: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336: 924-6. 10.1136/bmj.39489.470347.AD.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ, GRADE Working Group: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336: 924-6. 10.1136/bmj.39489.470347.AD.CrossRefPubMedPubMedCentral
13.
go back to reference Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, GRADE Working Group: What is "quality of evidence" and why is it important to clinicians?. BMJ. 2008, 336: 995-8. 10.1136/bmj.39490.551019.BE.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, GRADE Working Group: What is "quality of evidence" and why is it important to clinicians?. BMJ. 2008, 336: 995-8. 10.1136/bmj.39490.551019.BE.CrossRefPubMedPubMedCentral
14.
go back to reference Grimes DA, Schulz KF: An overview of clinical research: the lay of the land. Lancet. 2002, 359: 57-61. 10.1016/S0140-6736(02)07283-5.CrossRefPubMed Grimes DA, Schulz KF: An overview of clinical research: the lay of the land. Lancet. 2002, 359: 57-61. 10.1016/S0140-6736(02)07283-5.CrossRefPubMed
15.
go back to reference Kjaergard LL, Villumsen J, Gluud C: Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001, 135: 982-9.CrossRefPubMed Kjaergard LL, Villumsen J, Gluud C: Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001, 135: 982-9.CrossRefPubMed
16.
go back to reference Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273: 408-12. 10.1001/jama.273.5.408.CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273: 408-12. 10.1001/jama.273.5.408.CrossRefPubMed
19.
go back to reference Kunz R, Vist G, Oxman AD: Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Methodology Reviews. 2002, 4 Kunz R, Vist G, Oxman AD: Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Methodology Reviews. 2002, 4
20.
go back to reference Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin RM, Wood AJ, Sterne JA: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336: 601-5. 10.1136/bmj.39465.451748.AD.CrossRefPubMedPubMedCentral Wood L, Egger M, Gluud LL, Schulz KF, Jüni P, Altman DG, Gluud C, Martin RM, Wood AJ, Sterne JA: Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. BMJ. 2008, 336: 601-5. 10.1136/bmj.39465.451748.AD.CrossRefPubMedPubMedCentral
21.
go back to reference Grimes DA, Schulz KF: Bias and causal associations in observational research. Lancet. 2002, 359: 248-52. 10.1016/S0140-6736(02)07451-2.CrossRefPubMed Grimes DA, Schulz KF: Bias and causal associations in observational research. Lancet. 2002, 359: 248-52. 10.1016/S0140-6736(02)07451-2.CrossRefPubMed
22.
go back to reference Grimes DA, Schulz KF: Cohort studies: marching towards outcomes. Lancet. 2002, 359: 341-5. 10.1016/S0140-6736(02)07500-1.CrossRefPubMed Grimes DA, Schulz KF: Cohort studies: marching towards outcomes. Lancet. 2002, 359: 341-5. 10.1016/S0140-6736(02)07500-1.CrossRefPubMed
23.
go back to reference Grimes DA, Schulz KF: Descriptive studies: what they can and cannot do. Lancet. 2002, 359: 145-9. 10.1016/S0140-6736(02)07373-7.CrossRefPubMed Grimes DA, Schulz KF: Descriptive studies: what they can and cannot do. Lancet. 2002, 359: 145-9. 10.1016/S0140-6736(02)07373-7.CrossRefPubMed
24.
go back to reference Schulz KF, Grimes DA: Generation of allocation sequences in randomised trials: chance, not choice. Lancet. 2002, 359: 515-9. 10.1016/S0140-6736(02)07683-3.CrossRefPubMed Schulz KF, Grimes DA: Generation of allocation sequences in randomised trials: chance, not choice. Lancet. 2002, 359: 515-9. 10.1016/S0140-6736(02)07683-3.CrossRefPubMed
25.
go back to reference Schulz KF, Grimes DA: Allocation concealment in randomised trials: defending against deciphering. Lancet. 2002, 359: 614-8. 10.1016/S0140-6736(02)07750-4.CrossRefPubMed Schulz KF, Grimes DA: Allocation concealment in randomised trials: defending against deciphering. Lancet. 2002, 359: 614-8. 10.1016/S0140-6736(02)07750-4.CrossRefPubMed
26.
go back to reference Schulz KF, Grimes DA: Blinding in randomised trials: hiding who got what. Lancet. 2002, 359: 696-700. 10.1016/S0140-6736(02)07816-9.CrossRefPubMed Schulz KF, Grimes DA: Blinding in randomised trials: hiding who got what. Lancet. 2002, 359: 696-700. 10.1016/S0140-6736(02)07816-9.CrossRefPubMed
27.
go back to reference Moher D, Jadad AR, Tugwell P: Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996, 12: 195-208. 10.1017/S0266462300009570.CrossRefPubMed Moher D, Jadad AR, Tugwell P: Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996, 12: 195-208. 10.1017/S0266462300009570.CrossRefPubMed
28.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed
29.
go back to reference Gluud LL: Bias in clinical intervention research. Am J Epidemiol. 2006, 163: 493-501. 10.1093/aje/kwj069.CrossRefPubMed Gluud LL: Bias in clinical intervention research. Am J Epidemiol. 2006, 163: 493-501. 10.1093/aje/kwj069.CrossRefPubMed
30.
go back to reference Mueller PS, Montori VM, Bassler D, Koenig BA, Guyatt GH: Ethical issues in stopping randomized trials early because of apparent benefit. Ann Intern Med. 2007, 146: 878-81.CrossRefPubMed Mueller PS, Montori VM, Bassler D, Koenig BA, Guyatt GH: Ethical issues in stopping randomized trials early because of apparent benefit. Ann Intern Med. 2007, 146: 878-81.CrossRefPubMed
31.
go back to reference Goodman SN: Stopping at nothing? Some dilemmas of data monitoring in clinical trials. Ann Intern Med. 2007, 146: 882-7.CrossRefPubMed Goodman SN: Stopping at nothing? Some dilemmas of data monitoring in clinical trials. Ann Intern Med. 2007, 146: 882-7.CrossRefPubMed
32.
go back to reference Montori VM, Devereaux PJ, Adhikari NK, Burns KE, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM, Bucher HC, Schünemann HJ, Meade MO, Cook DJ, Erwin PJ, Sood A, Sood R, Lo B, Thompson CA, Zhou Q, Mills E, Guyatt GH: Randomized trials stopped early for benefit: a systematic review. JAMA. 2005, 294: 2203-9. 10.1001/jama.294.17.2203.CrossRefPubMed Montori VM, Devereaux PJ, Adhikari NK, Burns KE, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM, Bucher HC, Schünemann HJ, Meade MO, Cook DJ, Erwin PJ, Sood A, Sood R, Lo B, Thompson CA, Zhou Q, Mills E, Guyatt GH: Randomized trials stopped early for benefit: a systematic review. JAMA. 2005, 294: 2203-9. 10.1001/jama.294.17.2203.CrossRefPubMed
33.
go back to reference Jüni P, Altman DG, Egger M: Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001, 323: 42-6. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral Jüni P, Altman DG, Egger M: Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001, 323: 42-6. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral
34.
go back to reference Bassler D, Ferreira-Gonzalez I, Briel M, Cook DJ, Devereaux PJ, Heels-Ansdell D, Kirpalani H, Meade MO, Montori VM, Rozenberg A, Schünemann HJ, Guyatt GH: Systematic reviewers neglect bias that results from trials stopped early for benefit. J Clin Epidemiol. 2007, 60: 869-73. 10.1016/j.jclinepi.2006.12.006.CrossRefPubMed Bassler D, Ferreira-Gonzalez I, Briel M, Cook DJ, Devereaux PJ, Heels-Ansdell D, Kirpalani H, Meade MO, Montori VM, Rozenberg A, Schünemann HJ, Guyatt GH: Systematic reviewers neglect bias that results from trials stopped early for benefit. J Clin Epidemiol. 2007, 60: 869-73. 10.1016/j.jclinepi.2006.12.006.CrossRefPubMed
35.
go back to reference Bassler D, Montori VM, Briel M, Glasziou P, Guyatt GH: Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol. 2008, 61: 241-6. 10.1016/j.jclinepi.2007.07.016.CrossRefPubMed Bassler D, Montori VM, Briel M, Glasziou P, Guyatt GH: Early stopping of randomized clinical trials for overt efficacy is problematic. J Clin Epidemiol. 2008, 61: 241-6. 10.1016/j.jclinepi.2007.07.016.CrossRefPubMed
36.
go back to reference Wetterslev J, Thorlund K, Brok J, Gluud C: Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol. 2008, 61: 64-75. 10.1016/j.jclinepi.2007.03.013.CrossRefPubMed Wetterslev J, Thorlund K, Brok J, Gluud C: Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol. 2008, 61: 64-75. 10.1016/j.jclinepi.2007.03.013.CrossRefPubMed
37.
go back to reference Goodman SN: Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med. 1999, 130: 995-1004.CrossRefPubMed Goodman SN: Toward evidence-based medical statistics. 1: The P value fallacy. Ann Intern Med. 1999, 130: 995-1004.CrossRefPubMed
39.
go back to reference Vickers AJ: Underpowering in randomized trials reporting a sample size calculation. J Clin Epidemiol. 2003, 56: 717-20. 10.1016/S0895-4356(03)00141-0.CrossRefPubMed Vickers AJ: Underpowering in randomized trials reporting a sample size calculation. J Clin Epidemiol. 2003, 56: 717-20. 10.1016/S0895-4356(03)00141-0.CrossRefPubMed
40.
go back to reference Schulz KF, Grimes DA: Multiplicity in randomised trials II: subgroup and interim analyses. Lancet. 2005, 365: 1657-61. 10.1016/S0140-6736(05)66516-6.CrossRefPubMed Schulz KF, Grimes DA: Multiplicity in randomised trials II: subgroup and interim analyses. Lancet. 2005, 365: 1657-61. 10.1016/S0140-6736(05)66516-6.CrossRefPubMed
41.
go back to reference Pogue JM, Yusuf S: Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials. 1997, 18: 580-93. 10.1016/S0197-2456(97)00051-2.CrossRefPubMed Pogue JM, Yusuf S: Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials. 1997, 18: 580-93. 10.1016/S0197-2456(97)00051-2.CrossRefPubMed
42.
go back to reference Brok J, Thorlund K, Gluud C, Wetterslev J: Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008, 61: 763-9. 10.1016/j.jclinepi.2007.10.007.CrossRefPubMed Brok J, Thorlund K, Gluud C, Wetterslev J: Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol. 2008, 61: 763-9. 10.1016/j.jclinepi.2007.10.007.CrossRefPubMed
43.
go back to reference Thorlund K, Devereaux PJ, Wetterslev J, Guyatt GH, Ioannidis JP, Thabane L, Gluud LL, Als-Nielsen B, Gluud C: Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?. Int J Epidemiol. 2009, 38: 276-86. 10.1093/ije/dyn179.CrossRefPubMed Thorlund K, Devereaux PJ, Wetterslev J, Guyatt GH, Ioannidis JP, Thabane L, Gluud LL, Als-Nielsen B, Gluud C: Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?. Int J Epidemiol. 2009, 38: 276-86. 10.1093/ije/dyn179.CrossRefPubMed
44.
go back to reference Brok J, Thorlund K, Wetterslev J, Gluud C: Apparently conclusive meta-analyses may be inconclusive - Trial sequential analysis adjustment of random error risk due to repetetive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol. 2009, 38: 287-98. 10.1093/ije/dyn188.CrossRefPubMed Brok J, Thorlund K, Wetterslev J, Gluud C: Apparently conclusive meta-analyses may be inconclusive - Trial sequential analysis adjustment of random error risk due to repetetive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol. 2009, 38: 287-98. 10.1093/ije/dyn188.CrossRefPubMed
45.
go back to reference Berkey CS, Mosteller F, Lau J, Antman EM: Uncertainty of the time of first significance in random effects cumulative meta-analysis. Control Clin Trials. 1996, 17: 357-71. 10.1016/S0197-2456(96)00014-1.CrossRefPubMed Berkey CS, Mosteller F, Lau J, Antman EM: Uncertainty of the time of first significance in random effects cumulative meta-analysis. Control Clin Trials. 1996, 17: 357-71. 10.1016/S0197-2456(96)00014-1.CrossRefPubMed
46.
go back to reference Lau J, Schmid CH, Chalmers TC: Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Clin Epidemiol. 1995, 48: 45-57. 10.1016/0895-4356(94)00106-Z.CrossRefPubMed Lau J, Schmid CH, Chalmers TC: Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Clin Epidemiol. 1995, 48: 45-57. 10.1016/0895-4356(94)00106-Z.CrossRefPubMed
47.
go back to reference O'Neill RT: Secondary endpoints cannot be validly analyzed if the primary endpoint does not demonstrate clear statistical significance. Control Clin Trials. 1997, 18: 550-6. 10.1016/S0197-2456(97)00075-5.CrossRefPubMed O'Neill RT: Secondary endpoints cannot be validly analyzed if the primary endpoint does not demonstrate clear statistical significance. Control Clin Trials. 1997, 18: 550-6. 10.1016/S0197-2456(97)00075-5.CrossRefPubMed
48.
go back to reference Schulz KF, Grimes DA: Multiplicity in randomised trials I: endpoints and treatments. Lancet. 2005, 365: 1591-5. 10.1016/S0140-6736(05)66461-6.CrossRefPubMed Schulz KF, Grimes DA: Multiplicity in randomised trials I: endpoints and treatments. Lancet. 2005, 365: 1591-5. 10.1016/S0140-6736(05)66461-6.CrossRefPubMed
49.
go back to reference Friedman LM, Furberg CD, Demets DL: Fundamentals of clinical trials. 1998, New York: Springer VerlagCrossRef Friedman LM, Furberg CD, Demets DL: Fundamentals of clinical trials. 1998, New York: Springer VerlagCrossRef
50.
go back to reference Bangalore S, Wetterslev J, Pranesh S, Sawhney S, Gluud C, Messerli FH: Peri-operative beta-blockers in patients undergoing non-cardiac surgery. A meta-analysis and trial sequential analysis of 12,306 patients from randomised trials. Lancet. 2008, 372: 1962-76. 10.1016/S0140-6736(08)61560-3.CrossRefPubMed Bangalore S, Wetterslev J, Pranesh S, Sawhney S, Gluud C, Messerli FH: Peri-operative beta-blockers in patients undergoing non-cardiac surgery. A meta-analysis and trial sequential analysis of 12,306 patients from randomised trials. Lancet. 2008, 372: 1962-76. 10.1016/S0140-6736(08)61560-3.CrossRefPubMed
51.
go back to reference POISE Study Group, Devereaux PJ, Yang H, Yusuf S, Guyatt G, Leslie K, Villar JC, Xavier D, Chrolavicius S, Greenspan L, Pogue J, Pais P, Liu L, Xu S, Málaga G, Avezum A, Chan M, Montori VM, Jacka M, Choi P: Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. Lancet. 2008, 371: 1839-47. 10.1016/S0140-6736(08)60601-7.CrossRef POISE Study Group, Devereaux PJ, Yang H, Yusuf S, Guyatt G, Leslie K, Villar JC, Xavier D, Chrolavicius S, Greenspan L, Pogue J, Pais P, Liu L, Xu S, Málaga G, Avezum A, Chan M, Montori VM, Jacka M, Choi P: Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. Lancet. 2008, 371: 1839-47. 10.1016/S0140-6736(08)60601-7.CrossRef
52.
go back to reference Yang H, Raymer K, Butler R, Parlow J, Roberts R: The effects of perioperative beta-blockade: results of the Metoprolol after Vascular Surgery (MaVS) study, a randomized controlled trial. Am Heart J. 2006, 152: 983-90. 10.1016/j.ahj.2006.07.024.CrossRefPubMed Yang H, Raymer K, Butler R, Parlow J, Roberts R: The effects of perioperative beta-blockade: results of the Metoprolol after Vascular Surgery (MaVS) study, a randomized controlled trial. Am Heart J. 2006, 152: 983-90. 10.1016/j.ahj.2006.07.024.CrossRefPubMed
53.
go back to reference Juul AB, Wetterslev J, Gluud C, Kofoed-Enevoldsen A, Jensen G, Callesen T, Nørgaard P, Fruergaard K, Bestle M, Vedelsdal R, Miran A, Jacobsen J, Roed J, Mortensen MB, Jørgensen L, Jørgensen J, Rovsing ML, Petersen PL, Pott F, Haas M, Albret R, Nielsen LL, Johansson G, Stjernholm P, Mølgaard Y, Foss NB, Elkjaer J, Dehlie B, Boysen K, Zaric D, DIPOM Trial Group, et al: Effect of perioperative beta blockade in patients with diabetes undergoing major non-cardiac surgery: randomised placebo controlled, blinded multicentre trial. BMJ. 2006, 332: 1482-10.1136/bmj.332.7556.1482.CrossRefPubMedPubMedCentral Juul AB, Wetterslev J, Gluud C, Kofoed-Enevoldsen A, Jensen G, Callesen T, Nørgaard P, Fruergaard K, Bestle M, Vedelsdal R, Miran A, Jacobsen J, Roed J, Mortensen MB, Jørgensen L, Jørgensen J, Rovsing ML, Petersen PL, Pott F, Haas M, Albret R, Nielsen LL, Johansson G, Stjernholm P, Mølgaard Y, Foss NB, Elkjaer J, Dehlie B, Boysen K, Zaric D, DIPOM Trial Group, et al: Effect of perioperative beta blockade in patients with diabetes undergoing major non-cardiac surgery: randomised placebo controlled, blinded multicentre trial. BMJ. 2006, 332: 1482-10.1136/bmj.332.7556.1482.CrossRefPubMedPubMedCentral
54.
go back to reference Mangano DT, Layug EL, Wallace A, Tateo I: Effect of atenolol on mortality and cardiovascular morbidity after noncardiac surgery. Multicenter Study of Perioperative Ischemia Research Group. N Engl J Med. 1996, 335: 1713-20. 10.1056/NEJM199612053352301.CrossRefPubMed Mangano DT, Layug EL, Wallace A, Tateo I: Effect of atenolol on mortality and cardiovascular morbidity after noncardiac surgery. Multicenter Study of Perioperative Ischemia Research Group. N Engl J Med. 1996, 335: 1713-20. 10.1056/NEJM199612053352301.CrossRefPubMed
55.
go back to reference Wetterslev J, Juul AB: Benefit and harms of perioperative b-blockade. Best Pract Res Clin Anaesthesiol. 2006, 20: 285-302. 10.1016/j.bpa.2005.10.006.CrossRefPubMed Wetterslev J, Juul AB: Benefit and harms of perioperative b-blockade. Best Pract Res Clin Anaesthesiol. 2006, 20: 285-302. 10.1016/j.bpa.2005.10.006.CrossRefPubMed
56.
go back to reference Poldermans D, Boersma E, Bax JJ, Thomson IR, van de Ven LL, Blankensteijn JD, Baars HF, Yo TI, Trocino G, Vigna C, Roelandt JR, van Urk H: The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery. Dutch Echocardiographic Cardiac Risk Evaluation Applying Stress Echocardiography Study Group. N Engl J Med. 1999, 341: 1789-94. 10.1056/NEJM199912093412402.CrossRefPubMed Poldermans D, Boersma E, Bax JJ, Thomson IR, van de Ven LL, Blankensteijn JD, Baars HF, Yo TI, Trocino G, Vigna C, Roelandt JR, van Urk H: The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery. Dutch Echocardiographic Cardiac Risk Evaluation Applying Stress Echocardiography Study Group. N Engl J Med. 1999, 341: 1789-94. 10.1056/NEJM199912093412402.CrossRefPubMed
57.
go back to reference Lindenauer PK, Pekow P, Wang K, Mamidi DK, Gutierrez B, Benjamin EM: Perioperative beta-blocker therapy and mortality after major noncardiac surgery. N Engl J Med. 2005, 353: 349-61. 10.1056/NEJMoa041895.CrossRefPubMed Lindenauer PK, Pekow P, Wang K, Mamidi DK, Gutierrez B, Benjamin EM: Perioperative beta-blocker therapy and mortality after major noncardiac surgery. N Engl J Med. 2005, 353: 349-61. 10.1056/NEJMoa041895.CrossRefPubMed
58.
go back to reference Fleisher LA, Beckman JA, Brown KA, Calkins H, Chaikof EL, Fleischmann KE, Freeman WK, Froehlich JB, Kasper EK, Kersten JR, Riegel B, Robb JF, Smith SC, Jacobs AK, Adams CD, Anderson JL, Antman EM, Buller CE, Creager MA, Ettinger SM, Faxon DP, Fuster V, Halperin JL, Hiratzka LF, Hunt SA, Lytle BW, Nishimura R, Ornato JP, Page RL, Riegel B, et al: ACC/AHA 2007 Guidelines on Perioperative Cardiovascular Evaluation and Care for Noncardiac Surgery: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery) Developed in Collaboration With the American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society of Cardiovascular Anesthesiologists, Society for Cardiovascular Angiography and Interventions, Society for Vascular Medicine and Biology, and Society for Vascular Surgery. J Am Coll Cardiol. 2007, 50: 1707-32. 10.1016/j.jacc.2007.09.001.CrossRefPubMed Fleisher LA, Beckman JA, Brown KA, Calkins H, Chaikof EL, Fleischmann KE, Freeman WK, Froehlich JB, Kasper EK, Kersten JR, Riegel B, Robb JF, Smith SC, Jacobs AK, Adams CD, Anderson JL, Antman EM, Buller CE, Creager MA, Ettinger SM, Faxon DP, Fuster V, Halperin JL, Hiratzka LF, Hunt SA, Lytle BW, Nishimura R, Ornato JP, Page RL, Riegel B, et al: ACC/AHA 2007 Guidelines on Perioperative Cardiovascular Evaluation and Care for Noncardiac Surgery: Executive Summary: A Report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery) Developed in Collaboration With the American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society of Cardiovascular Anesthesiologists, Society for Cardiovascular Angiography and Interventions, Society for Vascular Medicine and Biology, and Society for Vascular Surgery. J Am Coll Cardiol. 2007, 50: 1707-32. 10.1016/j.jacc.2007.09.001.CrossRefPubMed
59.
go back to reference Lafuente-Lafuente C, Mouly S, Longas-Tejero MA, Bergmann JF: Antiarrhythmics for maintaining sinus rhythm after cardioversion of atrial fibrillation. Cochrane Database Syst Rev. 2007, CD005049-4 Lafuente-Lafuente C, Mouly S, Longas-Tejero MA, Bergmann JF: Antiarrhythmics for maintaining sinus rhythm after cardioversion of atrial fibrillation. Cochrane Database Syst Rev. 2007, CD005049-4
60.
go back to reference Byrne-Quinn E, Wing AJ: Maintenance of sinus rhythm after DC reversion of atrial fibrilllation. A double-blind controlled trial of long-acting quinidine bisulphate. Br Heart J. 1970, 32: 370-6. 10.1136/hrt.32.3.370.CrossRefPubMedPubMedCentral Byrne-Quinn E, Wing AJ: Maintenance of sinus rhythm after DC reversion of atrial fibrilllation. A double-blind controlled trial of long-acting quinidine bisulphate. Br Heart J. 1970, 32: 370-6. 10.1136/hrt.32.3.370.CrossRefPubMedPubMedCentral
61.
go back to reference Hillestad L, Bjerkelund C, Dale J, Maltau J, Storstein O: Quinidine in maintenance of sinus rhythm after electroconversion of chronic atrial fibrillation. A controlled clinical study. Br Heart J. 1971, 33: 518-21. 10.1136/hrt.33.4.518.CrossRefPubMedPubMedCentral Hillestad L, Bjerkelund C, Dale J, Maltau J, Storstein O: Quinidine in maintenance of sinus rhythm after electroconversion of chronic atrial fibrillation. A controlled clinical study. Br Heart J. 1971, 33: 518-21. 10.1136/hrt.33.4.518.CrossRefPubMedPubMedCentral
62.
go back to reference Karlson BW, Torstensson I, Abjorn C, Jansson SO, Peterson LE: Disopyramide in the maintenance of sinus rhythm after electroconversion of atrial fibrillation. A placebo-controlled one year follow-up study. Eur Heart J. 1988, 9: 284-90.PubMed Karlson BW, Torstensson I, Abjorn C, Jansson SO, Peterson LE: Disopyramide in the maintenance of sinus rhythm after electroconversion of atrial fibrillation. A placebo-controlled one year follow-up study. Eur Heart J. 1988, 9: 284-90.PubMed
63.
go back to reference Lloyd EA, Gersh BJ, Forman R: The efficacy of quinidine and disopyramide in the maintenance of sinus rhythm after electroconversion from atrial fibrillation. A double-blind study comparing quinidine, disopyramide and placebo. S Afr Med J. 1984, 65: 367-9.PubMed Lloyd EA, Gersh BJ, Forman R: The efficacy of quinidine and disopyramide in the maintenance of sinus rhythm after electroconversion from atrial fibrillation. A double-blind study comparing quinidine, disopyramide and placebo. S Afr Med J. 1984, 65: 367-9.PubMed
64.
go back to reference Fetsch T, Bauer P, Engberding R, Koch HP, Lukl J, Meinertz T, Oeff M, Seipel L, Trappe HJ, Treese N, Breithardt G, Prevention of Atrial Fibrillation after Cardioversion Investigators: Prevention of atrial fibrillation after cardioversion: results of the PAFAC trial. Eur Heart J. 2004, 25: 1385-94. 10.1016/j.ehj.2004.04.015.CrossRefPubMed Fetsch T, Bauer P, Engberding R, Koch HP, Lukl J, Meinertz T, Oeff M, Seipel L, Trappe HJ, Treese N, Breithardt G, Prevention of Atrial Fibrillation after Cardioversion Investigators: Prevention of atrial fibrillation after cardioversion: results of the PAFAC trial. Eur Heart J. 2004, 25: 1385-94. 10.1016/j.ehj.2004.04.015.CrossRefPubMed
65.
go back to reference Södermark T, Jonsson B, Olsson A, Orö L, Wallin H, Edhag O, Sjögren A, Danielsson M, Rosenhamer G: Effect of quinidine on maintaining sinus rhythm after conversion of atrial fibrillation or flutter. A multicentre study from Stockholm. Br Heart J. 1975, 37: 486-92. 10.1136/hrt.37.5.486.CrossRefPubMedPubMedCentral Södermark T, Jonsson B, Olsson A, Orö L, Wallin H, Edhag O, Sjögren A, Danielsson M, Rosenhamer G: Effect of quinidine on maintaining sinus rhythm after conversion of atrial fibrillation or flutter. A multicentre study from Stockholm. Br Heart J. 1975, 37: 486-92. 10.1136/hrt.37.5.486.CrossRefPubMedPubMedCentral
66.
go back to reference Patten M, Maas R, Bauer P, Lüderitz B, Sonntag F, Dluzniewski M, Hatala R, Opolski G, Müller HW, Meinertz T, SOPAT Investigators: Suppression of paroxysmal atrial tachyarrhythmias-results of the SOPAT trial. Eur Heart J. 2004, 25: 1395-404. 10.1016/j.ehj.2004.06.014.CrossRefPubMed Patten M, Maas R, Bauer P, Lüderitz B, Sonntag F, Dluzniewski M, Hatala R, Opolski G, Müller HW, Meinertz T, SOPAT Investigators: Suppression of paroxysmal atrial tachyarrhythmias-results of the SOPAT trial. Eur Heart J. 2004, 25: 1395-404. 10.1016/j.ehj.2004.06.014.CrossRefPubMed
67.
go back to reference Steinbeck G, Doliwa R, Bach P: Therapy of paroxysmal atrial fibrillation. Cardiac glycosides alone or combined with antiarrhythmia agents?. Dtsch Med Wochenschr. 1988, 113: 1867-71. 10.1055/s-2008-1067903.CrossRefPubMed Steinbeck G, Doliwa R, Bach P: Therapy of paroxysmal atrial fibrillation. Cardiac glycosides alone or combined with antiarrhythmia agents?. Dtsch Med Wochenschr. 1988, 113: 1867-71. 10.1055/s-2008-1067903.CrossRefPubMed
68.
go back to reference Goodman SN: Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med. 1999, 130: 1005-13.CrossRefPubMed Goodman SN: Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med. 1999, 130: 1005-13.CrossRefPubMed
69.
go back to reference Wakefield J: Bayes factors for genome-wide association studies: comparison with P-values. Genet Epidemiol. 2008, 33: 79-86. 10.1002/gepi.20359.CrossRef Wakefield J: Bayes factors for genome-wide association studies: comparison with P-values. Genet Epidemiol. 2008, 33: 79-86. 10.1002/gepi.20359.CrossRef
70.
go back to reference Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG, International Stroke Trial Collaborative Group; European Carotid Surgery Trial Collaborative Group: Evaluating non-randomised intervention studies. Health Technol Assess. 2003, 7: iii-x,1-173. Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG, International Stroke Trial Collaborative Group; European Carotid Surgery Trial Collaborative Group: Evaluating non-randomised intervention studies. Health Technol Assess. 2003, 7: iii-x,1-173.
71.
go back to reference Jüni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, Egger M: Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. Lancet. 2004, 364: 2021-9. 10.1016/S0140-6736(04)17514-4.CrossRefPubMed Jüni P, Nartey L, Reichenbach S, Sterchi R, Dieppe PA, Egger M: Risk of cardiovascular events and rofecoxib: cumulative meta-analysis. Lancet. 2004, 364: 2021-9. 10.1016/S0140-6736(04)17514-4.CrossRefPubMed
72.
go back to reference Devereaux PJ, Choi PT, El Dika S, Bhandari M, Montori VM, Schünemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH: An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004, 57: 1232-6. 10.1016/j.jclinepi.2004.03.017.CrossRefPubMed Devereaux PJ, Choi PT, El Dika S, Bhandari M, Montori VM, Schünemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH: An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004, 57: 1232-6. 10.1016/j.jclinepi.2004.03.017.CrossRefPubMed
75.
go back to reference Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology: a proposal for reporting. JAMA. 2000, 283: 2008-12. 10.1001/jama.283.15.2008.CrossRefPubMed Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology: a proposal for reporting. JAMA. 2000, 283: 2008-12. 10.1001/jama.283.15.2008.CrossRefPubMed
76.
go back to reference Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-58. 10.1002/sim.1186.CrossRefPubMed Higgins JP, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-58. 10.1002/sim.1186.CrossRefPubMed
77.
go back to reference Wetterslev J, Thorlund K, Brok J, Gluud C: Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol. 2009, 9: 86-10.1186/1471-2288-9-86.CrossRefPubMedPubMedCentral Wetterslev J, Thorlund K, Brok J, Gluud C: Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol. 2009, 9: 86-10.1186/1471-2288-9-86.CrossRefPubMedPubMedCentral
Metadata
Title
Evidence at a glance: error matrix approach for overviewing available evidence
Authors
Frederik Keus
Jørn Wetterslev
Christian Gluud
Cornelis JHM van Laarhoven
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-90

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue