Skip to main content
Top
Published in: World Journal of Surgery 8/2012

01-08-2012

Evidence-Based Surgery: Barriers, Solutions, and the Role of Evidence Synthesis

Authors: George Garas, Amel Ibrahim, Hutan Ashrafian, Kamran Ahmed, Vanash Patel, Koji Okabayashi, Petros Skapinakis, Ara Darzi, Thanos Athanasiou

Published in: World Journal of Surgery | Issue 8/2012

Login to get access

Abstract

Background

Surgery is a rapidly evolving field, making the rigorous testing of emerging innovations vital. However, most surgical research fails to employ randomized controlled trials (RCTs) and has particularly been based on low-quality study designs. Subsequently, the analysis of data through meta-analysis and evidence synthesis is particularly difficult.

Methods

Through a systematic review of the literature, this article explores the barriers to achieving a strong evidence base in surgery and offers potential solutions to overcome the barriers.

Results

Many barriers exist to evidence-based surgical research. They include enabling factors, such as funding, time, infrastructure, patient preference, ethical issues, and additionally barriers associated with specific attributes related to researchers, methodologies, or interventions. Novel evidence synthesis techniques in surgery are discussed, including graphics synthesis, treatment networks, and network meta-analyses that help overcome many of the limitations associated with existing techniques. They offer the opportunity to assess gaps and quantitatively present inconsistencies within the existing evidence of RCTs.

Conclusions

Poorly or inadequately performed RCTs and meta-analyses can give rise to incorrect results and thus fail to inform clinical practice or revise policy. The above barriers can be overcome by providing academic leadership and good organizational support to ensure that adequate personnel, resources, and funding are allocated to the researcher. Training in research methodology and data interpretation can ensure that trials are conducted correctly and evidence is adequately synthesized and disseminated. The ultimate goal of overcoming the barriers to evidence-based surgery includes the improved quality of patient care in addition to enhanced patient outcomes.
Literature
1.
go back to reference Centre for Evidence Based Medicine (2011) Levels of evidence. University of Oxford, Oxford Centre for Evidence Based Medicine (2011) Levels of evidence. University of Oxford, Oxford
2.
go back to reference Solomon MJ, McLeod RS (1993) Clinical studies in surgical journals–have we improved? Dis Colon Rectum 36:43–48PubMedCrossRef Solomon MJ, McLeod RS (1993) Clinical studies in surgical journals–have we improved? Dis Colon Rectum 36:43–48PubMedCrossRef
3.
go back to reference Ng TT, McGory ML, Ko CY et al (2006) Meta-analysis in surgery: methods and limitations. Arch Surg 141:1125–1130PubMedCrossRef Ng TT, McGory ML, Ko CY et al (2006) Meta-analysis in surgery: methods and limitations. Arch Surg 141:1125–1130PubMedCrossRef
4.
go back to reference Solomon MJ, McLeod RS (1995) Should we be performing more randomized controlled trials evaluating surgical operations? Surgery 118:459–467PubMedCrossRef Solomon MJ, McLeod RS (1995) Should we be performing more randomized controlled trials evaluating surgical operations? Surgery 118:459–467PubMedCrossRef
5.
go back to reference Ashrafian H, Darzi A, Athanasiou T (2011) Evidence synthesis: evolving methodologies to optimise patient care and enhance policy decisions. In: Evidence synthesis in healthcare, Springer, London, pp 1–46 Ashrafian H, Darzi A, Athanasiou T (2011) Evidence synthesis: evolving methodologies to optimise patient care and enhance policy decisions. In: Evidence synthesis in healthcare, Springer, London, pp 1–46
6.
go back to reference Jansen JP, Crawford B, Bergman G et al (2008) Bayesian meta-analysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. Value Health 11:956–964PubMedCrossRef Jansen JP, Crawford B, Bergman G et al (2008) Bayesian meta-analysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. Value Health 11:956–964PubMedCrossRef
7.
go back to reference Voils C, Hassselblad V, Crandell J et al (2009) A Bayesian method for the synthesis of evidence from qualitative and quantitative reports: the example of antiretroviral medication adherence. J Health Serv Res Policy 14:226–233PubMedCrossRef Voils C, Hassselblad V, Crandell J et al (2009) A Bayesian method for the synthesis of evidence from qualitative and quantitative reports: the example of antiretroviral medication adherence. J Health Serv Res Policy 14:226–233PubMedCrossRef
8.
go back to reference Ashrafian H, Sevdalis N, Athanasiou T (2010) Evidence-based surgery. In: Key topics in surgical research and methodology. Springer, London, pp 9–26 Ashrafian H, Sevdalis N, Athanasiou T (2010) Evidence-based surgery. In: Key topics in surgical research and methodology. Springer, London, pp 9–26
9.
go back to reference Altman DG (1996) Better reporting of randomised controlled trials: the CONSORT statement. BMJ 313:570–571PubMedCrossRef Altman DG (1996) Better reporting of randomised controlled trials: the CONSORT statement. BMJ 313:570–571PubMedCrossRef
10.
go back to reference Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535PubMedCrossRef Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 339:b2535PubMedCrossRef
11.
go back to reference Atkins D, Best D, Briss P et al (2004) Grading quality of evidence and strength of recommendations. BMJ 328:1490PubMedCrossRef Atkins D, Best D, Briss P et al (2004) Grading quality of evidence and strength of recommendations. BMJ 328:1490PubMedCrossRef
12.
go back to reference Atkins D, Briss PA, Eccles M et al (2005) Systems for grading the quality of evidence and the strength of recommendations. II. Pilot study of a new system. BMC Health Serv Res 5:25PubMedCrossRef Atkins D, Briss PA, Eccles M et al (2005) Systems for grading the quality of evidence and the strength of recommendations. II. Pilot study of a new system. BMC Health Serv Res 5:25PubMedCrossRef
13.
go back to reference Rebitzer JB, Rege M, Shepard C (2008) Influence, information overload, and information technology in health care. Adv Health Econ Health Serv Res 19:43–69PubMedCrossRef Rebitzer JB, Rege M, Shepard C (2008) Influence, information overload, and information technology in health care. Adv Health Econ Health Serv Res 19:43–69PubMedCrossRef
14.
go back to reference Revere D, Turner AM, Madhavan A et al (2007) Understanding the information needs of public health practitioners: a literature review to inform design of an interactive digital knowledge management system. J Biomed Inform 40:410–421PubMedCrossRef Revere D, Turner AM, Madhavan A et al (2007) Understanding the information needs of public health practitioners: a literature review to inform design of an interactive digital knowledge management system. J Biomed Inform 40:410–421PubMedCrossRef
15.
go back to reference Darzi A (2008) Quality care for all: NHS next stage review final report. Department of Health, London Darzi A (2008) Quality care for all: NHS next stage review final report. Department of Health, London
16.
go back to reference Walker E, Hernandez AV, Kattan MW (2008) Meta-analysis: its strengths and limitations. Clevel Clin J Med 75:431–439CrossRef Walker E, Hernandez AV, Kattan MW (2008) Meta-analysis: its strengths and limitations. Clevel Clin J Med 75:431–439CrossRef
17.
go back to reference Jadad AR, Moore RA, Carroll D et al (1996) Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 17:1–12PubMedCrossRef Jadad AR, Moore RA, Carroll D et al (1996) Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 17:1–12PubMedCrossRef
18.
go back to reference Murtuza B, Pepper JR, Jones C et al (2010) Does stentless aortic valve implantation increase perioperative risk? A critical appraisal of the literature and risk of bias analysis. Eur J Cardiothorac Surg 39:643–652PubMedCrossRef Murtuza B, Pepper JR, Jones C et al (2010) Does stentless aortic valve implantation increase perioperative risk? A critical appraisal of the literature and risk of bias analysis. Eur J Cardiothorac Surg 39:643–652PubMedCrossRef
19.
go back to reference Ioannidis JP (2009) Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. CMAJ 181:488–493PubMedCrossRef Ioannidis JP (2009) Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. CMAJ 181:488–493PubMedCrossRef
20.
go back to reference Ioannidis JP (2006) Indirect comparisons: the mesh and mess of clinical trials. Lancet 368:1470–1472PubMedCrossRef Ioannidis JP (2006) Indirect comparisons: the mesh and mess of clinical trials. Lancet 368:1470–1472PubMedCrossRef
21.
go back to reference Salanti G, Higgins JP, Ades AE et al (2008) Evaluation of networks of randomized trials. Stat Methods Med Res 17:279–301PubMedCrossRef Salanti G, Higgins JP, Ades AE et al (2008) Evaluation of networks of randomized trials. Stat Methods Med Res 17:279–301PubMedCrossRef
22.
go back to reference Song F, Loke YK, Walsh T et al (2009) Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ 338:b1147PubMedCrossRef Song F, Loke YK, Walsh T et al (2009) Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ 338:b1147PubMedCrossRef
23.
go back to reference Mauri D, Polyzos NP, Salanti G et al (2008) Multiple-treatments meta-analysis of chemotherapy and targeted therapies in advanced breast cancer. J Natl Cancer Inst 100:1780–1791PubMedCrossRef Mauri D, Polyzos NP, Salanti G et al (2008) Multiple-treatments meta-analysis of chemotherapy and targeted therapies in advanced breast cancer. J Natl Cancer Inst 100:1780–1791PubMedCrossRef
24.
go back to reference Caldwell DM, Ades AE, Higgins JP (2005) Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 331:897–900PubMedCrossRef Caldwell DM, Ades AE, Higgins JP (2005) Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 331:897–900PubMedCrossRef
25.
go back to reference Salanti G, Dias S, Welton NJ et al (2010) Evaluating novel agent effects in multiple-treatments meta-regression. Stat Med 29:2369–2383PubMed Salanti G, Dias S, Welton NJ et al (2010) Evaluating novel agent effects in multiple-treatments meta-regression. Stat Med 29:2369–2383PubMed
26.
go back to reference Diener MK, Simon T, Buchler MW et al (2011) Surgical evaluation and knowledge transfer-methods of clinical research in surgery. Langenbecks Arch Surg. doi:10.1007/s00423-011-0775-x Diener MK, Simon T, Buchler MW et al (2011) Surgical evaluation and knowledge transfer-methods of clinical research in surgery. Langenbecks Arch Surg. doi:10.​1007/​s00423-011-0775-x
27.
go back to reference Beger HG, Schwarz A (1998) Clinical research in surgery: questions but few answers. Langenbecks Arch Surg 383:300–305PubMedCrossRef Beger HG, Schwarz A (1998) Clinical research in surgery: questions but few answers. Langenbecks Arch Surg 383:300–305PubMedCrossRef
28.
go back to reference Concato J, Shah N, Horwitz RI (2000) Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 342:1887–1892PubMedCrossRef Concato J, Shah N, Horwitz RI (2000) Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 342:1887–1892PubMedCrossRef
29.
go back to reference Cook JA (2009) The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials 10:9PubMedCrossRef Cook JA (2009) The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials 10:9PubMedCrossRef
30.
go back to reference McCulloch P, Taylor I, Sasako M et al (2002) Randomised trials in surgery: problems and possible solutions. BMJ 324:1448–1451PubMedCrossRef McCulloch P, Taylor I, Sasako M et al (2002) Randomised trials in surgery: problems and possible solutions. BMJ 324:1448–1451PubMedCrossRef
32.
go back to reference Prescott RJ, Counsell CE, Gillespie WJ et al (1999) Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess 3:1–143PubMed Prescott RJ, Counsell CE, Gillespie WJ et al (1999) Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess 3:1–143PubMed
33.
go back to reference Lowrance WT, Tarin TV, Shariat SF (2010) Evidence-based comparison of robotic and open radical prostatectomy. Sci World J 10:2228–2237CrossRef Lowrance WT, Tarin TV, Shariat SF (2010) Evidence-based comparison of robotic and open radical prostatectomy. Sci World J 10:2228–2237CrossRef
35.
go back to reference Binder J, Kramer W (2001) Robotically-assisted laparoscopic radical prostatectomy. BJU Int 87:408–410PubMedCrossRef Binder J, Kramer W (2001) Robotically-assisted laparoscopic radical prostatectomy. BJU Int 87:408–410PubMedCrossRef
36.
go back to reference Menon M, Shrivastava A, Tewari A et al (2002) Laparoscopic and robot assisted radical prostatectomy: establishment of a structured program and preliminary analysis of outcomes. J Urol 168:945–999PubMedCrossRef Menon M, Shrivastava A, Tewari A et al (2002) Laparoscopic and robot assisted radical prostatectomy: establishment of a structured program and preliminary analysis of outcomes. J Urol 168:945–999PubMedCrossRef
37.
go back to reference Skolarus TA, Zhang Y, Hollenbeck BK (2010) Robotic surgery in urologic oncology: gathering the evidence. Expert Rev Pharmacoecon Outcomes Res 10:421–432PubMedCrossRef Skolarus TA, Zhang Y, Hollenbeck BK (2010) Robotic surgery in urologic oncology: gathering the evidence. Expert Rev Pharmacoecon Outcomes Res 10:421–432PubMedCrossRef
38.
go back to reference Steinberg PL, Ghavamian R (2011) Searching robotic prostatectomy online: what information is available? Urology 77:941–945PubMedCrossRef Steinberg PL, Ghavamian R (2011) Searching robotic prostatectomy online: what information is available? Urology 77:941–945PubMedCrossRef
39.
go back to reference Alkhateeb S, Lawrentschuk N (2011) Consumerism and its impact on robotic-assisted radical prostatectomy. BJU Int 108:1874–1878PubMedCrossRef Alkhateeb S, Lawrentschuk N (2011) Consumerism and its impact on robotic-assisted radical prostatectomy. BJU Int 108:1874–1878PubMedCrossRef
40.
go back to reference Brandina R, Berger A, Kamoi K et al (2009) Critical appraisal of robotic-assisted radical prostatectomy. Curr Opin Urol 19:290–296PubMedCrossRef Brandina R, Berger A, Kamoi K et al (2009) Critical appraisal of robotic-assisted radical prostatectomy. Curr Opin Urol 19:290–296PubMedCrossRef
41.
go back to reference Lotan Y, Cadeddu JA, Gettman MT (2004) The new economics of radical prostatectomy: cost comparison of open, laparoscopic and robot assisted techniques. J Urol 172:1431–1435PubMedCrossRef Lotan Y, Cadeddu JA, Gettman MT (2004) The new economics of radical prostatectomy: cost comparison of open, laparoscopic and robot assisted techniques. J Urol 172:1431–1435PubMedCrossRef
Metadata
Title
Evidence-Based Surgery: Barriers, Solutions, and the Role of Evidence Synthesis
Authors
George Garas
Amel Ibrahim
Hutan Ashrafian
Kamran Ahmed
Vanash Patel
Koji Okabayashi
Petros Skapinakis
Ara Darzi
Thanos Athanasiou
Publication date
01-08-2012
Publisher
Springer-Verlag
Published in
World Journal of Surgery / Issue 8/2012
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-012-1597-x

Other articles of this Issue 8/2012

World Journal of Surgery 8/2012 Go to the issue