Skip to main content
Top
Published in: BMC Surgery 1/2019

Open Access 01-12-2019 | Debate

Challenges and potential solutions to the evaluation, monitoring, and regulation of surgical innovations

Authors: Derek J. Roberts, David A. Zygun, Chad G. Ball, Andrew W. Kirkpatrick, Peter D. Faris, Matthew T. James, Kelly J. Mrklas, Brenda D. Hemmelgarn, Braden Manns, Henry T. Stelfox

Published in: BMC Surgery | Issue 1/2019

Login to get access

Abstract

Background

As it may be argued that many surgical interventions provide obvious patient benefits, formal, staged assessment of the efficacy and safety of surgical procedures has historically been and remains uncommon. The majority of innovative surgical procedures have therefore often been developed based on anatomical and pathophysiological principles in an attempt to better manage clinical problems.

Main Body

In this manuscript, we sought to review and contrast the models for pharmaceutical and surgical innovation in North America, including their stages of development and methods of evaluation, monitoring, and regulation. We also aimed to review the present structure of academic surgery, the role of methodological experts and funding in conducting surgical research, and the current system of regulation of innovative surgical procedures. Finally, we highlight the influence that evidence and surgical history, education, training, and culture have on elective and emergency surgical decision-making. The above discussion is used to support the argument that the model used for assessment of innovative pharmaceuticals cannot be applied to that for evaluating surgical innovations. It is also used to support our position that although the evaluation and monitoring of innovative surgical procedures requires a rigorous, fit-for-purpose, and formal system of assessment to protect patient safety and prevent unexpected adverse health outcomes, it will only succeed if it is supported and championed by surgical practice leaders and respects surgical history, education, training, and culture.

Conclusion

We conclude the above debate by providing a recommended approach to the evaluation, monitoring, and regulation of surgical innovations, which we hope may be used as a guide for all stakeholders involved in interpreting and/or conducting future surgical research.
Literature
1.
go back to reference Barkun JS, Aronson JK, Feldman LS, Maddern GJ, Strasberg SM, Altman DG, Barkun JS, Blazeby JM, Boutron IC, Campbell WB, et al. Evaluation and stages of surgical innovations. Lancet. 2009;374(9695):1089–96.CrossRef Barkun JS, Aronson JK, Feldman LS, Maddern GJ, Strasberg SM, Altman DG, Barkun JS, Blazeby JM, Boutron IC, Campbell WB, et al. Evaluation and stages of surgical innovations. Lancet. 2009;374(9695):1089–96.CrossRef
2.
go back to reference Roberts DJ, Ball CG, Feliciano DV, Moore EE, Ivatury RR, Lucas CE, Fabian TC, Zygun DA, Kirkpatrick AW, Stelfox HT. History of the innovation of damage control for management of trauma patients: 1902-2016. Ann Surg. 2017;(5):1034–44.CrossRef Roberts DJ, Ball CG, Feliciano DV, Moore EE, Ivatury RR, Lucas CE, Fabian TC, Zygun DA, Kirkpatrick AW, Stelfox HT. History of the innovation of damage control for management of trauma patients: 1902-2016. Ann Surg. 2017;(5):1034–44.CrossRef
3.
go back to reference Roberts DJ, Bobrovitz N, Zygun DA, Ball CG, Kirkpatrick AW, Faris PD, Stelfox HT. Indications for use of damage control surgery and damage control interventions in civilian trauma patients: a scoping review. J Trauma Acute Care Surg. 2015;78(6):1187–96.CrossRef Roberts DJ, Bobrovitz N, Zygun DA, Ball CG, Kirkpatrick AW, Faris PD, Stelfox HT. Indications for use of damage control surgery and damage control interventions in civilian trauma patients: a scoping review. J Trauma Acute Care Surg. 2015;78(6):1187–96.CrossRef
4.
go back to reference Roberts DJ, Bobrovitz N, Zygun DA, Ball CG, Kirkpatrick AW, Faris PD, Brohi K, D'Amours S, Fabian TC, Inaba K, et al. Indications for use of damage control surgery in civilian trauma patients: a content analysis and expert appropriateness rating study. Ann Surg. 2015;263(5):1018–27.CrossRef Roberts DJ, Bobrovitz N, Zygun DA, Ball CG, Kirkpatrick AW, Faris PD, Brohi K, D'Amours S, Fabian TC, Inaba K, et al. Indications for use of damage control surgery in civilian trauma patients: a content analysis and expert appropriateness rating study. Ann Surg. 2015;263(5):1018–27.CrossRef
5.
go back to reference Sweet BV, Schwemm AK, Parsons DM. Review of the processes for FDA oversight of drugs, medical devices, and combination products. J Manag Care Pharm. 2011;17(1):40–50.PubMed Sweet BV, Schwemm AK, Parsons DM. Review of the processes for FDA oversight of drugs, medical devices, and combination products. J Manag Care Pharm. 2011;17(1):40–50.PubMed
6.
go back to reference Ergina PL, Cook JA, Blazeby JM, Boutron I, Clavien PA, Reeves BC, Seiler CM, Altman DG, Aronson JK, Barkun JS, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374(9695):1097–104.CrossRef Ergina PL, Cook JA, Blazeby JM, Boutron I, Clavien PA, Reeves BC, Seiler CM, Altman DG, Aronson JK, Barkun JS, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374(9695):1097–104.CrossRef
7.
go back to reference McCulloch P, Altman DG, Campbell WB, Flum DR, Glasziou P, Marshall JC, Nicholl J, Aronson JK, Barkun JS, Blazeby JM, et al. No surgical innovation without evaluation: the IDEAL recommendations. Lancet. 2009;374(9695):1105–12.CrossRef McCulloch P, Altman DG, Campbell WB, Flum DR, Glasziou P, Marshall JC, Nicholl J, Aronson JK, Barkun JS, Blazeby JM, et al. No surgical innovation without evaluation: the IDEAL recommendations. Lancet. 2009;374(9695):1105–12.CrossRef
8.
go back to reference Solomon MJ, Laxamana A, Devore L, McLeod RS. Randomized controlled trials in surgery. Surgery. 1994;115(6):707–12.PubMed Solomon MJ, Laxamana A, Devore L, McLeod RS. Randomized controlled trials in surgery. Surgery. 1994;115(6):707–12.PubMed
9.
go back to reference Shawhan RR, Hatch QM, Bingham JR, Nelson DW, Fitzpatrick EB, McLeod R, Johnson EK, Maykel JA, Steele SR. Have we progressed in the surgical literature? Thirty-year trends in clinical studies in 3 surgical journals. Dis Colon Rectum. 2015;58(1):115–21.CrossRef Shawhan RR, Hatch QM, Bingham JR, Nelson DW, Fitzpatrick EB, McLeod R, Johnson EK, Maykel JA, Steele SR. Have we progressed in the surgical literature? Thirty-year trends in clinical studies in 3 surgical journals. Dis Colon Rectum. 2015;58(1):115–21.CrossRef
10.
go back to reference McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D. Randomised trials in surgery: problems and possible solutions. BMJ. 2002;324(7351):1448–51.CrossRef McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D. Randomised trials in surgery: problems and possible solutions. BMJ. 2002;324(7351):1448–51.CrossRef
11.
go back to reference Mastroianni AC. Liability, regulation and policy in surgical innovation: the cutting edge of research and therapy. Health Matrix Clevel. 2006;16(2):351–442.PubMed Mastroianni AC. Liability, regulation and policy in surgical innovation: the cutting edge of research and therapy. Health Matrix Clevel. 2006;16(2):351–442.PubMed
12.
go back to reference Powell JT, Sweeting MJ, Ulug P, Blankensteijn JD, Lederle FA, Becquemin JP, Greenhalgh RM. Meta-analysis of individual-patient data from EVAR-1, DREAM, OVER and ACE trials comparing outcomes of endovascular or open repair for abdominal aortic aneurysm over 5 years. Br J Surg. 2017;104(3):166–78.CrossRef Powell JT, Sweeting MJ, Ulug P, Blankensteijn JD, Lederle FA, Becquemin JP, Greenhalgh RM. Meta-analysis of individual-patient data from EVAR-1, DREAM, OVER and ACE trials comparing outcomes of endovascular or open repair for abdominal aortic aneurysm over 5 years. Br J Surg. 2017;104(3):166–78.CrossRef
13.
14.
go back to reference Yu J, Li X, Li Y, Sun X. Quality of reporting in surgical randomized clinical trials. Br J Surg. 2017;104(3):296–303.CrossRef Yu J, Li X, Li Y, Sun X. Quality of reporting in surgical randomized clinical trials. Br J Surg. 2017;104(3):296–303.CrossRef
15.
go back to reference Marshall JC. Surgical decision-making: integrating evidence, inference, and experience. Surg Clin N Am. 2006;86(1):201–15 xii.CrossRef Marshall JC. Surgical decision-making: integrating evidence, inference, and experience. Surg Clin N Am. 2006;86(1):201–15 xii.CrossRef
16.
go back to reference Kaafarani HM, Hawn MT, Itani KM. Individual surgical decision-making and comparative effectiveness research. Surgery. 2012;152(5):787–9.CrossRef Kaafarani HM, Hawn MT, Itani KM. Individual surgical decision-making and comparative effectiveness research. Surgery. 2012;152(5):787–9.CrossRef
17.
go back to reference Marko NF, Weil RJ. An introduction to comparative effectiveness research. Neurosurgery. 2012;70(2):425–34 discussion 434.CrossRef Marko NF, Weil RJ. An introduction to comparative effectiveness research. Neurosurgery. 2012;70(2):425–34 discussion 434.CrossRef
18.
go back to reference Sox HC, Goodman SN. The methods of comparative effectiveness research. Annu Rev Public Health. 2012;33:425–45.CrossRef Sox HC, Goodman SN. The methods of comparative effectiveness research. Annu Rev Public Health. 2012;33:425–45.CrossRef
19.
go back to reference Sauerland S, Walgenbach M, Habermalz B, Seiler CM, Miserez M. Laparoscopic versus open surgical techniques for ventral or incisional hernia repair. Cochrane Database Syst Rev. 2011;(3):CD007781. Sauerland S, Walgenbach M, Habermalz B, Seiler CM, Miserez M. Laparoscopic versus open surgical techniques for ventral or incisional hernia repair. Cochrane Database Syst Rev. 2011;(3):CD007781.
20.
go back to reference Flin R, Youngson G, Yule S. How do surgeons make intraoperative decisions? Qual Saf Health Care. 2007;16(3):235–9.CrossRef Flin R, Youngson G, Yule S. How do surgeons make intraoperative decisions? Qual Saf Health Care. 2007;16(3):235–9.CrossRef
21.
go back to reference Szatmary P, Arora S, Sevdalis N. To operate or not to operate? A multi-method analysis of decision-making in emergency surgery. Am J Surg. 2010;200(2):298–304.CrossRef Szatmary P, Arora S, Sevdalis N. To operate or not to operate? A multi-method analysis of decision-making in emergency surgery. Am J Surg. 2010;200(2):298–304.CrossRef
22.
go back to reference Roberts DJ, Zygun DA, Faris PD, Ball CG, Kirkpatrick AW, Stelfox HT. Opinions of practicing surgeons on the appropriateness of published indications for use of damage control surgery in trauma patients: an international cross-sectional survey. J Am Coll Surg. 2016;223(3):515–29.CrossRef Roberts DJ, Zygun DA, Faris PD, Ball CG, Kirkpatrick AW, Stelfox HT. Opinions of practicing surgeons on the appropriateness of published indications for use of damage control surgery in trauma patients: an international cross-sectional survey. J Am Coll Surg. 2016;223(3):515–29.CrossRef
23.
go back to reference Gurusamy KS, Koti R, Davidson BR. Routine abdominal drainage versus no abdominal drainage for uncomplicated laparoscopic cholecystectomy. Cochrane Database Syst Rev. 2013;(9):CD006004. Gurusamy KS, Koti R, Davidson BR. Routine abdominal drainage versus no abdominal drainage for uncomplicated laparoscopic cholecystectomy. Cochrane Database Syst Rev. 2013;(9):CD006004.
24.
go back to reference Thoma A, Haines T, Veltri K, Goldsmith CH, O'Brien BJ, Quartly C. A methodological guide to performing a cost-utility study comparing surgical techniques. Can J Plast Surg. 2004;12(4):179–87.CrossRef Thoma A, Haines T, Veltri K, Goldsmith CH, O'Brien BJ, Quartly C. A methodological guide to performing a cost-utility study comparing surgical techniques. Can J Plast Surg. 2004;12(4):179–87.CrossRef
25.
26.
go back to reference Sevdalis N, McCulloch P. Teaching evidence-based decision-making. Surg Clin N Am. 2006;86(1):59–70 viii.CrossRef Sevdalis N, McCulloch P. Teaching evidence-based decision-making. Surg Clin N Am. 2006;86(1):59–70 viii.CrossRef
27.
go back to reference Urschel JD, Goldsmith CH, Tandan VR, Miller JD. Users’ guide to evidence-based surgery: how to use an article evaluating surgical interventions. Evidence-based surgery working group. Can J Surg. 2001;44(2):95–100.PubMedPubMedCentral Urschel JD, Goldsmith CH, Tandan VR, Miller JD. Users’ guide to evidence-based surgery: how to use an article evaluating surgical interventions. Evidence-based surgery working group. Can J Surg. 2001;44(2):95–100.PubMedPubMedCentral
28.
go back to reference Hong D, Tandan VR, Goldsmith CH, Simunovic M. Users’ guide to the surgical literature: how to use an article reporting population-based volume-outcome relationships in surgery. Can J Surg. 2002;45(2):109–15.PubMedPubMedCentral Hong D, Tandan VR, Goldsmith CH, Simunovic M. Users’ guide to the surgical literature: how to use an article reporting population-based volume-outcome relationships in surgery. Can J Surg. 2002;45(2):109–15.PubMedPubMedCentral
29.
go back to reference Thoma A, Sprague S, Tandan V. Users' guide to the surgical literature: how to use an article on economic analysis. Can J Surg. 2001;44(5):347–54.PubMedPubMedCentral Thoma A, Sprague S, Tandan V. Users' guide to the surgical literature: how to use an article on economic analysis. Can J Surg. 2001;44(5):347–54.PubMedPubMedCentral
30.
go back to reference Archibald S, Bhandari M, Thoma A. Users' guides to the surgical literature: how to use an article about a diagnostic test. Evidence-based surgery working group. Can J Surg. 2001;44(1):17–23.PubMedPubMedCentral Archibald S, Bhandari M, Thoma A. Users' guides to the surgical literature: how to use an article about a diagnostic test. Evidence-based surgery working group. Can J Surg. 2001;44(1):17–23.PubMedPubMedCentral
31.
go back to reference Simera I, Altman DG. ACP journal Club. Editorial: writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Ann Intern Med. 2009;151(4):JC2-2, JC2-3.CrossRef Simera I, Altman DG. ACP journal Club. Editorial: writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Ann Intern Med. 2009;151(4):JC2-2, JC2-3.CrossRef
Metadata
Title
Challenges and potential solutions to the evaluation, monitoring, and regulation of surgical innovations
Authors
Derek J. Roberts
David A. Zygun
Chad G. Ball
Andrew W. Kirkpatrick
Peter D. Faris
Matthew T. James
Kelly J. Mrklas
Brenda D. Hemmelgarn
Braden Manns
Henry T. Stelfox
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Surgery / Issue 1/2019
Electronic ISSN: 1471-2482
DOI
https://doi.org/10.1186/s12893-019-0586-5

Other articles of this Issue 1/2019

BMC Surgery 1/2019 Go to the issue