Skip to main content
Top
Published in: World Journal of Surgery 1/2017

01-01-2017 | Original Scientific Report

An Online Tool for Global Benchmarking of Risk-Adjusted Surgical Outcomes

Authors: Richard T. Spence, David C. Chang, Kathryn Chu, Eugenio Panieri, Jessica L. Mueller, Matthew M. Hutter

Published in: World Journal of Surgery | Issue 1/2017

Login to get access

Abstract

Background

Increasing evidence demonstrates significant variation in adverse outcomes following surgery between countries. In order to better quantify these variations, we hypothesize that freely available online risk calculators can be used as a tool to generate global benchmarking of risk-adjusted surgical outcomes.

Methods

This is a prospective cohort study conducted at an academic teaching hospital in South Africa (GSH). Consecutive adult patients undergoing major general or vascular surgery who met the ACS-NSQIP inclusion criteria for a 3-month period were included. Data variables required by the ACS risk calculator were prospectively collected, and patients were followed for 30 days post-surgery for the occurrence of endpoints. Calculating observed-to-expected ratios for ten outcome measures of interest generated risk-adjusted outcomes benchmarked against the ACS-NSQIP consortium.

Results

A total of 373 major general and vascular surgery procedures met the inclusion criteria. The GSH operative cohort varied significantly compared to the 2012 ACS-NSQIP database. The risk-adjusted O/E ratios were significant for any complication O/E 1.91 (95 % CI 1.57–2.31), surgical site infections O/E 4.76 (95 % CI 3.71–6.01), renal failure O/E 3.29 (95 % CI 1.50–6.24), death O/E 3.43 (95 % CI 2.19–5.11), and total length of stay (LOS) O/E 3.43 (95 % CI 2.19–5.11).

Conclusion

Freely available online risk calculators can be utilized as tools for global benchmarking of risk-adjusted surgical outcomes.
Literature
1.
go back to reference Ingraham AM, Richards KE, Hall BL et al (2010) Quality improvement in surgery: the American College of Surgeons National Surgical Quality Improvement Program approach. Adv Surg 44:251–267CrossRefPubMed Ingraham AM, Richards KE, Hall BL et al (2010) Quality improvement in surgery: the American College of Surgeons National Surgical Quality Improvement Program approach. Adv Surg 44:251–267CrossRefPubMed
2.
go back to reference Birkmeyer JD, Shahian DM, Dimick JB et al (2008) Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg 207(5):777–782CrossRefPubMed Birkmeyer JD, Shahian DM, Dimick JB et al (2008) Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg 207(5):777–782CrossRefPubMed
3.
go back to reference Cohen ME, Liu Y, Ko CY et al (2015) Improved surgical outcomes for ACS NSQIP hospitals over time: evaluation of hospital cohorts with up to 8 years of participation. Ann Surg 263(2):267–273CrossRef Cohen ME, Liu Y, Ko CY et al (2015) Improved surgical outcomes for ACS NSQIP hospitals over time: evaluation of hospital cohorts with up to 8 years of participation. Ann Surg 263(2):267–273CrossRef
4.
go back to reference Dimick JB, Osborne NH, Hall BL et al (2010) Risk adjustment for comparing hospital quality with surgery: how many variables are needed? J Am Coll Surg 210(4):503–508CrossRefPubMedPubMedCentral Dimick JB, Osborne NH, Hall BL et al (2010) Risk adjustment for comparing hospital quality with surgery: how many variables are needed? J Am Coll Surg 210(4):503–508CrossRefPubMedPubMedCentral
5.
go back to reference Hall BL, Hamilton BH, Richards K et al (2009) Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg 250(3):363–376PubMed Hall BL, Hamilton BH, Richards K et al (2009) Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg 250(3):363–376PubMed
7.
go back to reference Haider AH, Saleem T, Leow JJ et al (2012) Influence of the National Trauma Data Bank on the study of trauma outcomes: is it time to set research best practices to further enhance its impact? J Am Coll Surg 214(5):756–768CrossRefPubMedPubMedCentral Haider AH, Saleem T, Leow JJ et al (2012) Influence of the National Trauma Data Bank on the study of trauma outcomes: is it time to set research best practices to further enhance its impact? J Am Coll Surg 214(5):756–768CrossRefPubMedPubMedCentral
8.
go back to reference Birkmeyer JD, Dimick JB, Birkmeyer NJ (2004) Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg 198(4):626–632CrossRefPubMed Birkmeyer JD, Dimick JB, Birkmeyer NJ (2004) Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg 198(4):626–632CrossRefPubMed
9.
go back to reference Farmer DL (2012) NSQIP lite: a potential tool for global comparative effectiveness evaluations. Arch Surg 147(9):803–804CrossRefPubMed Farmer DL (2012) NSQIP lite: a potential tool for global comparative effectiveness evaluations. Arch Surg 147(9):803–804CrossRefPubMed
10.
go back to reference Cohen ME, Bilimoria KY, Ko CY et al (2009) Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. J Am Coll Surg 208(6):1009–1016CrossRefPubMed Cohen ME, Bilimoria KY, Ko CY et al (2009) Development of an American College of Surgeons National Surgery Quality Improvement Program: morbidity and mortality risk calculator for colorectal surgery. J Am Coll Surg 208(6):1009–1016CrossRefPubMed
11.
go back to reference Paruch JL, Ko CY, Bilimoria KY (2014) An opportunity to improve informed consent and shared decision making: the role of the ACS NSQIP surgical risk calculator in oncology. Ann Surg Oncol 21(1):5–7CrossRefPubMed Paruch JL, Ko CY, Bilimoria KY (2014) An opportunity to improve informed consent and shared decision making: the role of the ACS NSQIP surgical risk calculator in oncology. Ann Surg Oncol 21(1):5–7CrossRefPubMed
12.
go back to reference Parikh P, Shiloach M, Cohen ME et al (2010) Pancreatectomy risk calculator: an ACS-NSQIP resource. HPB (Oxford) 12(7):488–497CrossRef Parikh P, Shiloach M, Cohen ME et al (2010) Pancreatectomy risk calculator: an ACS-NSQIP resource. HPB (Oxford) 12(7):488–497CrossRef
13.
go back to reference Khavanin N, Kim JY, Davila AA et al (2014) Abstract 46: the BRA score: creating a general risk calculator for breast reconstruction outcomes. Plast Reconstr Surg 133(3 Suppl):56–57PubMed Khavanin N, Kim JY, Davila AA et al (2014) Abstract 46: the BRA score: creating a general risk calculator for breast reconstruction outcomes. Plast Reconstr Surg 133(3 Suppl):56–57PubMed
14.
go back to reference Bilimoria KY, Liu Y, Paruch JL et al (2013) Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 217(5):833–842CrossRefPubMedPubMedCentral Bilimoria KY, Liu Y, Paruch JL et al (2013) Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 217(5):833–842CrossRefPubMedPubMedCentral
15.
go back to reference Khuri SF, Henderson WG, Daley J et al (2008) Successful implementation of the department of veterans affairs’ national surgical quality improvement program in the private sector: the patient safety in surgery study. Ann Surg 248(2):329–336CrossRefPubMed Khuri SF, Henderson WG, Daley J et al (2008) Successful implementation of the department of veterans affairs’ national surgical quality improvement program in the private sector: the patient safety in surgery study. Ann Surg 248(2):329–336CrossRefPubMed
17.
go back to reference Meara JG, Leather AJ, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet 386(9993):569–624CrossRefPubMed Meara JG, Leather AJ, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet 386(9993):569–624CrossRefPubMed
19.
go back to reference Rose J, Weiser TG, Hider P et al (2015) Estimated need for surgery worldwide based on prevalence of diseases: a modelling strategy for the WHO Global Health Estimate. Lancet Glob Health 27(3 Suppl 2):S13–S20CrossRef Rose J, Weiser TG, Hider P et al (2015) Estimated need for surgery worldwide based on prevalence of diseases: a modelling strategy for the WHO Global Health Estimate. Lancet Glob Health 27(3 Suppl 2):S13–S20CrossRef
20.
go back to reference Meara JG, Greenberg SL (2015) Global surgery as an equal partner in health: no longer the neglected stepchild. Lancet Glob Health 27(3 Suppl 2):S1–S2CrossRef Meara JG, Greenberg SL (2015) Global surgery as an equal partner in health: no longer the neglected stepchild. Lancet Glob Health 27(3 Suppl 2):S1–S2CrossRef
22.
go back to reference Meara JG, Leather AJ, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Surgery 386(9993):569–624 Meara JG, Leather AJ, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Surgery 386(9993):569–624
23.
go back to reference Ariyaratnam R, Palmqvist CL, Hider P et al (2015) Toward a standard approach to measurement and reporting of perioperative mortality rate as a global indicator for surgery. Surgery 158(1):17–26CrossRefPubMed Ariyaratnam R, Palmqvist CL, Hider P et al (2015) Toward a standard approach to measurement and reporting of perioperative mortality rate as a global indicator for surgery. Surgery 158(1):17–26CrossRefPubMed
25.
go back to reference Andersen J, Lassiter R, Bickler S et al (2012) Brief tool to measure risk-adjusted surgical outcomes in resource-limited hospitals. Arch Surg 147(9):798–803CrossRef Andersen J, Lassiter R, Bickler S et al (2012) Brief tool to measure risk-adjusted surgical outcomes in resource-limited hospitals. Arch Surg 147(9):798–803CrossRef
26.
go back to reference Haynes SR, Lawler PG (1995) An assessment of the consistency of ASA physical status classification allocation. Anaesthesia 50(3):195–199CrossRefPubMed Haynes SR, Lawler PG (1995) An assessment of the consistency of ASA physical status classification allocation. Anaesthesia 50(3):195–199CrossRefPubMed
27.
go back to reference Hoffmann M, Lefering R, Rueger JM et al (2012) Pupil evaluation in addition to glasgow coma scale components in prediction of traumatic brain injury and mortality. Br J Surg 99(Suppl 1):122–130CrossRefPubMed Hoffmann M, Lefering R, Rueger JM et al (2012) Pupil evaluation in addition to glasgow coma scale components in prediction of traumatic brain injury and mortality. Br J Surg 99(Suppl 1):122–130CrossRefPubMed
28.
29.
go back to reference Cohen ME, Bilimoria KY, Ko CY et al (2009) Effect of subjective preoperative variables on risk-adjusted assessment of hospital morbidity and mortality. Ann Surg 249(4):682–689CrossRefPubMed Cohen ME, Bilimoria KY, Ko CY et al (2009) Effect of subjective preoperative variables on risk-adjusted assessment of hospital morbidity and mortality. Ann Surg 249(4):682–689CrossRefPubMed
Metadata
Title
An Online Tool for Global Benchmarking of Risk-Adjusted Surgical Outcomes
Authors
Richard T. Spence
David C. Chang
Kathryn Chu
Eugenio Panieri
Jessica L. Mueller
Matthew M. Hutter
Publication date
01-01-2017
Publisher
Springer International Publishing
Published in
World Journal of Surgery / Issue 1/2017
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-016-3668-x

Other articles of this Issue 1/2017

World Journal of Surgery 1/2017 Go to the issue