Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Correspondence

Systematic reviews, systematic error and the acquisition of clinical knowledge

Author: Steffen Mickenautsch

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Since its inception, evidence-based medicine and its application through systematic reviews, has been widely accepted. However, it has also been strongly criticised and resisted by some academic groups and clinicians. One of the main criticisms of evidence-based medicine is that it appears to claim to have unique access to absolute scientific truth and thus devalues and replaces other types of knowledge sources.

Discussion

The various types of clinical knowledge sources are categorised on the basis of Kant's categories of knowledge acquisition, as being either 'analytic' or 'synthetic'. It is shown that these categories do not act in opposition but rather, depend upon each other. The unity of analysis and synthesis in knowledge acquisition is demonstrated during the process of systematic reviewing of clinical trials. Systematic reviews constitute comprehensive synthesis of clinical knowledge but depend upon plausible, analytical hypothesis development for the trials reviewed. The dangers of systematic error regarding the internal validity of acquired knowledge are highlighted on the basis of empirical evidence. It has been shown that the systematic review process reduces systematic error, thus ensuring high internal validity. It is argued that this process does not exclude other types of knowledge sources. Instead, amongst these other types it functions as an integrated element during the acquisition of clinical knowledge.

Conclusions

The acquisition of clinical knowledge is based on interaction between analysis and synthesis. Systematic reviews provide the highest form of synthetic knowledge acquisition in terms of achieving internal validity of results. In that capacity it informs the analytic knowledge of the clinician but does not replace it.
Appendix
Available only for authorised users
Literature
1.
go back to reference Altmann DG: What randomized trials and systematic reviews can offer decision makers. Horm Res. 1999, 51: 36-43. 10.1159/000053134.CrossRef Altmann DG: What randomized trials and systematic reviews can offer decision makers. Horm Res. 1999, 51: 36-43. 10.1159/000053134.CrossRef
2.
go back to reference Higgins JPT, Green S, (Eds): Cochrane handbook for systematic reviews of interventions 4.2.6 [updated October 2007]. 2006, Chichester, UK: John Wiley & Sons, Ltd Higgins JPT, Green S, (Eds): Cochrane handbook for systematic reviews of interventions 4.2.6 [updated October 2007]. 2006, Chichester, UK: John Wiley & Sons, Ltd
3.
go back to reference Milrow CD, Cook DJ, Davidoff F: Systematic reviews: critical links in the great chain of evidence. Ann Intern Med. 1997, 126: 389-391.CrossRef Milrow CD, Cook DJ, Davidoff F: Systematic reviews: critical links in the great chain of evidence. Ann Intern Med. 1997, 126: 389-391.CrossRef
4.
go back to reference Lavis JN, Posada FB, Haines A, Osei E: Use of research to inform public policymaking. Lancet. 2004, 364: 1615-1621. 10.1016/S0140-6736(04)17317-0.CrossRefPubMed Lavis JN, Posada FB, Haines A, Osei E: Use of research to inform public policymaking. Lancet. 2004, 364: 1615-1621. 10.1016/S0140-6736(04)17317-0.CrossRefPubMed
5.
go back to reference Bero LA, Jadad AR: How consumers and policymakers can use systematic reviews fro decision making. Ann Intern Med. 1997, 127: 37-42.CrossRefPubMed Bero LA, Jadad AR: How consumers and policymakers can use systematic reviews fro decision making. Ann Intern Med. 1997, 127: 37-42.CrossRefPubMed
6.
go back to reference Bhandari M, Montori VM, Devereaux PJ, Wilczynski NL, Morgan D, Haynes RB, The Hedges Team: Doubling the impact: publication of systematic review articles in orthopaedic journals. J Bone Joint Surg Am. 2004, 86-A: 1012-1016.PubMed Bhandari M, Montori VM, Devereaux PJ, Wilczynski NL, Morgan D, Haynes RB, The Hedges Team: Doubling the impact: publication of systematic review articles in orthopaedic journals. J Bone Joint Surg Am. 2004, 86-A: 1012-1016.PubMed
7.
go back to reference Montori VM, Wilczynski NL, Morgan D, Haynes RB, Hedges Team: Systematic reviews: a cross-sectional study of location and citation counts. BMC Med. 2003, 1: 2-10.1186/1741-7015-1-2.CrossRefPubMedPubMedCentral Montori VM, Wilczynski NL, Morgan D, Haynes RB, Hedges Team: Systematic reviews: a cross-sectional study of location and citation counts. BMC Med. 2003, 1: 2-10.1186/1741-7015-1-2.CrossRefPubMedPubMedCentral
8.
go back to reference Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 12. Finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.CrossRefPubMedPubMedCentral Oxman AD, Fretheim A, Lavis JN, Lewin S: SUPPORT Tools for evidence-informed health Policymaking (STP). 12. Finding and using research evidence about resource use and costs. Health Res Policy Syst. 2009, 7 (Suppl 1): S12-10.1186/1478-4505-7-S1-S12.CrossRefPubMedPubMedCentral
9.
go back to reference Renfrew MJ, Craig D, Dyson L, McCormick F, Rice S, King SE, Misso K, Stenhouse E, Williams AF: Breastfeeding promotion for infants in neonatal units: a systematic review and economic analysis. Health Technol Assess. 2009, 13: 1-iv.CrossRefPubMed Renfrew MJ, Craig D, Dyson L, McCormick F, Rice S, King SE, Misso K, Stenhouse E, Williams AF: Breastfeeding promotion for infants in neonatal units: a systematic review and economic analysis. Health Technol Assess. 2009, 13: 1-iv.CrossRefPubMed
10.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, et al: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-72.CrossRefPubMed Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, et al: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-72.CrossRefPubMed
11.
go back to reference Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (Suppl 1): 6-20. 10.1258/1355819054308576.CrossRefPubMed Mays N, Pope C, Popay J: Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. J Health Serv Res Policy. 2005, 10 (Suppl 1): 6-20. 10.1258/1355819054308576.CrossRefPubMed
12.
go back to reference Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't: It's about integrating individual clinical expertise and the best external evidence. BMJ. 1996, 312: 71-72.CrossRefPubMedPubMedCentral Sackett DL, Rosenberg WMC, Gray JAM, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't: It's about integrating individual clinical expertise and the best external evidence. BMJ. 1996, 312: 71-72.CrossRefPubMedPubMedCentral
13.
go back to reference Buetow S: Beyond evidence-based medicine: bridge-building a medicine of meaning. J Evaluation Clin Pract. 2002, 8: 103-108. 10.1046/j.1365-2753.2002.00340.x.CrossRef Buetow S: Beyond evidence-based medicine: bridge-building a medicine of meaning. J Evaluation Clin Pract. 2002, 8: 103-108. 10.1046/j.1365-2753.2002.00340.x.CrossRef
14.
go back to reference Sehon SR, Stanley DE: A philosophical analysis of the evidence-based medicine debate. BMC Health Services Res. 2003, 3: 14-10.1186/1472-6963-3-14.CrossRef Sehon SR, Stanley DE: A philosophical analysis of the evidence-based medicine debate. BMC Health Services Res. 2003, 3: 14-10.1186/1472-6963-3-14.CrossRef
15.
go back to reference Parker M: False dichotomies: EBM, clinical freedom, and the art of medicine. Med Humanities. 2005, 31: 23-30. 10.1136/jmh.2004.000195.CrossRef Parker M: False dichotomies: EBM, clinical freedom, and the art of medicine. Med Humanities. 2005, 31: 23-30. 10.1136/jmh.2004.000195.CrossRef
16.
go back to reference Williams DDR, Garner J: The case against 'the evidence': a different perspective on evidence-based medicine. Br J Psychiatry. 2002, 180: 8-12. 10.1192/bjp.180.1.8.CrossRefPubMed Williams DDR, Garner J: The case against 'the evidence': a different perspective on evidence-based medicine. Br J Psychiatry. 2002, 180: 8-12. 10.1192/bjp.180.1.8.CrossRefPubMed
18.
go back to reference Echt DS, Liebson PR, Mitchell LB, Peters RW, Obias-Manno D, Barker AH, Arensberg D, Baker A, Friedman L, Greene HL, et al: Mortality and morbidity in patients receiving encainide, flecainide, or placebo. The Cardiac Arrhythmia Suppression Trial. N Engl J Med. 1991, 324: 781-788.CrossRefPubMed Echt DS, Liebson PR, Mitchell LB, Peters RW, Obias-Manno D, Barker AH, Arensberg D, Baker A, Friedman L, Greene HL, et al: Mortality and morbidity in patients receiving encainide, flecainide, or placebo. The Cardiac Arrhythmia Suppression Trial. N Engl J Med. 1991, 324: 781-788.CrossRefPubMed
19.
go back to reference Reilly BM, Hart A, Evans AT: Part II. Evidence-based medicine: a passing fancy or the future of primary care?. Dis Mon. 1998, 44: 370-399. 10.1016/S0011-5029(98)90006-2.CrossRefPubMed Reilly BM, Hart A, Evans AT: Part II. Evidence-based medicine: a passing fancy or the future of primary care?. Dis Mon. 1998, 44: 370-399. 10.1016/S0011-5029(98)90006-2.CrossRefPubMed
20.
go back to reference Attia JR, Nair BR, Sibbritt DW, Ewald BD, Paget NS, Wellard RF, Patterson L, Heller RF: Generating pre-test probabilities: a neglected area in clinical decision making. Med J Aust. 2004, 180: 449-454.PubMed Attia JR, Nair BR, Sibbritt DW, Ewald BD, Paget NS, Wellard RF, Patterson L, Heller RF: Generating pre-test probabilities: a neglected area in clinical decision making. Med J Aust. 2004, 180: 449-454.PubMed
21.
go back to reference Song F, Landes DP, Glenny AM, Sheldon TA: Prophylactic removal of impacted third molars: an assessment of published reviews. Br Dent J. 1997, 182: 339-346.CrossRefPubMed Song F, Landes DP, Glenny AM, Sheldon TA: Prophylactic removal of impacted third molars: an assessment of published reviews. Br Dent J. 1997, 182: 339-346.CrossRefPubMed
22.
go back to reference Parker M: Whither our art? Clinical wisdom and evidence based medicine. Med Health Care Philos. 2002, 5: 275-276. 10.1023/A:1021116516342.CrossRef Parker M: Whither our art? Clinical wisdom and evidence based medicine. Med Health Care Philos. 2002, 5: 275-276. 10.1023/A:1021116516342.CrossRef
23.
go back to reference Kant I: The critique of pure reason. Trans. by P. Guyer and A.W. Wood 1781. 1998, Cambridge University Press Kant I: The critique of pure reason. Trans. by P. Guyer and A.W. Wood 1781. 1998, Cambridge University Press
24.
go back to reference Palmquist S: Kant's System of Perspectives: An architectonic interpretation of the Critical philosophy. 1993, University Press of America Palmquist S: Kant's System of Perspectives: An architectonic interpretation of the Critical philosophy. 1993, University Press of America
25.
go back to reference Ritchey T: Analysis and Synthesis. On Scientific Method - Based on a Study by Bernhard Riemann. Systems Res. 1991, 8: 21-41.CrossRef Ritchey T: Analysis and Synthesis. On Scientific Method - Based on a Study by Bernhard Riemann. Systems Res. 1991, 8: 21-41.CrossRef
26.
go back to reference Leipnitz GW: Philosophical Papers and Letters. Edited by: Loemker L. 1956, Chicago, USA: University Press Leipnitz GW: Philosophical Papers and Letters. Edited by: Loemker L. 1956, Chicago, USA: University Press
27.
go back to reference Djulbegovic B, Guyatt GH, Ashcroft RE: Epistemologic inquiries in evidence-based medicine. Cancer Control. 2009, 16: 158-168.PubMed Djulbegovic B, Guyatt GH, Ashcroft RE: Epistemologic inquiries in evidence-based medicine. Cancer Control. 2009, 16: 158-168.PubMed
28.
go back to reference Fichte JG: Attempt at a critique of all revelations. Trans. by G. Green 1792/793. 1978, Cambridge University Press Fichte JG: Attempt at a critique of all revelations. Trans. by G. Green 1792/793. 1978, Cambridge University Press
29.
go back to reference Black GV: A work on operative dentistry: The technical procedures in filling teeth. 1917, Chicago. Medico- Dental Publishing Company Black GV: A work on operative dentistry: The technical procedures in filling teeth. 1917, Chicago. Medico- Dental Publishing Company
30.
go back to reference Mertz-Fairhurst EJ, Schuster GS, Williams JE, Fairhurst CW: Clinical progress of sealed and unsealed caries. Part II: Standardized radiographs and clinical observations. J Prosthet Dent. 1979, 42: 633-637. 10.1016/0022-3913(79)90193-8.CrossRefPubMed Mertz-Fairhurst EJ, Schuster GS, Williams JE, Fairhurst CW: Clinical progress of sealed and unsealed caries. Part II: Standardized radiographs and clinical observations. J Prosthet Dent. 1979, 42: 633-637. 10.1016/0022-3913(79)90193-8.CrossRefPubMed
31.
go back to reference Frencken JE, Pilot T, Songpaisan Y, Phantumvanit P: Atraumatic restorative treatment (ART): rationale, technique, and development. J Public Health Dent. 1996, 56: 135-140. 10.1111/j.1752-7325.1996.tb02423.x.CrossRefPubMed Frencken JE, Pilot T, Songpaisan Y, Phantumvanit P: Atraumatic restorative treatment (ART): rationale, technique, and development. J Public Health Dent. 1996, 56: 135-140. 10.1111/j.1752-7325.1996.tb02423.x.CrossRefPubMed
32.
go back to reference Mickenautsch S, Yengopal V, Banerjee A: Clinical application of GIC: Atraumatic restorative treatment versus amalgam restoration longevity: a systematic review. Clin Oral Investig. 2009, DOI 10.1007/s00784-009-0335-8 Mickenautsch S, Yengopal V, Banerjee A: Clinical application of GIC: Atraumatic restorative treatment versus amalgam restoration longevity: a systematic review. Clin Oral Investig. 2009, DOI 10.1007/s00784-009-0335-8
33.
go back to reference Murphy EA: The logic of medicine. 1976, Baltimore: John Hopkins University Press Murphy EA: The logic of medicine. 1976, Baltimore: John Hopkins University Press
34.
go back to reference Jüni P, Altman DG, Egger M: Systematic reviews in health care. Assessing the quality of controlled clinical trials. BMJ. 2001, 323: 42-46. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral Jüni P, Altman DG, Egger M: Systematic reviews in health care. Assessing the quality of controlled clinical trials. BMJ. 2001, 323: 42-46. 10.1136/bmj.323.7303.42.CrossRefPubMedPubMedCentral
35.
go back to reference Stewart LA, Parmar MK: Meta-analysis of the literature or of individual patient data: is there a difference?. Lancet. 1993, 341: 418-422. 10.1016/0140-6736(93)93004-K.CrossRefPubMed Stewart LA, Parmar MK: Meta-analysis of the literature or of individual patient data: is there a difference?. Lancet. 1993, 341: 418-422. 10.1016/0140-6736(93)93004-K.CrossRefPubMed
36.
go back to reference Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment. 2003, 7: 1-PubMed Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment. 2003, 7: 1-PubMed
37.
go back to reference Sutherland SE: Evidence-based dentistry: Part IV. Research design and level of evidence. J Can Dent Assoc. 2001, 67: 375-378.PubMed Sutherland SE: Evidence-based dentistry: Part IV. Research design and level of evidence. J Can Dent Assoc. 2001, 67: 375-378.PubMed
40.
go back to reference Pearson M, Coomber R: The challenge of external validity in policy-relevant systematic reviews: a case study from the field of substance misuse. Addiction. 2010, 105: 136-145. 10.1111/j.1360-0443.2009.02713.x.CrossRefPubMed Pearson M, Coomber R: The challenge of external validity in policy-relevant systematic reviews: a case study from the field of substance misuse. Addiction. 2010, 105: 136-145. 10.1111/j.1360-0443.2009.02713.x.CrossRefPubMed
41.
go back to reference Mickenautsch S, Rudolph MJ, Ogunbodede EO, Frencken JE: The impact of the ART approach on the treatment profile in a mobile dental system (MDS) in South Africa. Int Dent J. 1999, 49: 132-138.CrossRefPubMed Mickenautsch S, Rudolph MJ, Ogunbodede EO, Frencken JE: The impact of the ART approach on the treatment profile in a mobile dental system (MDS) in South Africa. Int Dent J. 1999, 49: 132-138.CrossRefPubMed
42.
go back to reference Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV, Jonas WB: Are the clinical effects of homeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet. 1997, 350: 834-843. 10.1016/S0140-6736(97)02293-9.CrossRefPubMed Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV, Jonas WB: Are the clinical effects of homeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet. 1997, 350: 834-843. 10.1016/S0140-6736(97)02293-9.CrossRefPubMed
43.
go back to reference Systemic treatment of early breast cancer by hormonal, cytotoxic, or immune therapy. 133 randomised trials involving 31,000 recurrences and 24,000 deaths among 75,000 women. Early Breast Cancer Trialists' Collaborative Group. Lancet. 1992, 339: 71-85. Systemic treatment of early breast cancer by hormonal, cytotoxic, or immune therapy. 133 randomised trials involving 31,000 recurrences and 24,000 deaths among 75,000 women. Early Breast Cancer Trialists' Collaborative Group. Lancet. 1992, 339: 71-85.
Metadata
Title
Systematic reviews, systematic error and the acquisition of clinical knowledge
Author
Steffen Mickenautsch
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-53

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue