Skip to main content
Top
Published in: Perioperative Medicine 1/2017

Open Access 01-12-2017 | Research

Impact of ASA score misclassification on NSQIP predicted mortality: a retrospective analysis

Authors: Alex Helkin, Sumeet V. Jain, Angelika Gruessner, Maureen Fleming, Leslie Kohman, Michael Costanza, Robert N. Cooney

Published in: Perioperative Medicine | Issue 1/2017

Login to get access

Abstract

Background

The ASA physical classification score has a major impact on the observed/expected (O/E) mortality ratio in the NSQIP General Vascular Mortality Model. The difference in predicted mortality is greatest between ASAs 3 and 4. We hypothesized under-classified ASA scores significantly affect the O/E mortality.

Methods

We conducted a retrospective review of NSQIP essential surgery cases from January 2014 to December 2014 (n = 1264) with mortality sub-analysis (n = 33) at our institution. We recorded transfer and emergency status and independently calculated the ASA score for mortalities using published definitions. A random sample of 50 survivors and 10 emergency survivors were reviewed and ASA recalculated. We performed statistical modeling to simulate the effects of ASA misclassifications. Statistical analysis was performed using JMP 10 and SAS 9.4.

Results

ASA was under-classified in 18.2% of mortalities, most commonly ASAs 3 and 4. Sixteen percent of ASA 3 survivors were misclassified, including 60% in the emergency subgroup (p < 0.05 vs. elective cases). Patients transferred from other institutions were more likely to be emergency cases than non-transferred patients (43.5 vs. 7.84%, p < 0.05). Transferred patients had a higher proportion of ASAs 3–5 vs. ASAs 1–2 compared with non-transfers (84.38 vs. 49.76%, p < 0.05) Simulation data showed ASA misclassification underestimated predicted mortality by 2.5 deaths on average.

Conclusion

ASA misclassification significantly impacts O/E mortality. With accurate ASA classification, observed mortality would not have exceeded expected mortality in our institution. Education regarding the impact of ASA scoring is critical to ensure accurate O/E mortality data at hospitals using NSQIP to assess surgical quality.
Literature
go back to reference Davenport DL, Bowe EA, Henderson WG, Khuri SF, Mentzer RM Jr. National Surgical Quality Improvement Program (NSQIP) risk factors can be used to validate American Society of Anesthesiologists Physical Status Classification (ASA PS) levels. Ann Surg. 2006;243(5):636–41. discussion 641-634CrossRefPubMedPubMedCentral Davenport DL, Bowe EA, Henderson WG, Khuri SF, Mentzer RM Jr. National Surgical Quality Improvement Program (NSQIP) risk factors can be used to validate American Society of Anesthesiologists Physical Status Classification (ASA PS) levels. Ann Surg. 2006;243(5):636–41. discussion 641-634CrossRefPubMedPubMedCentral
go back to reference Davenport DL, Henderson WG, Khuri SF, Mentzer RM Jr. Preoperative risk factors and surgical complexity are more predictive of costs than postoperative complications: a case study using the National Surgical Quality Improvement Program (NSQIP) database. Ann Surg. 2005;242(4):463–8. discussion 468-471PubMedPubMedCentral Davenport DL, Henderson WG, Khuri SF, Mentzer RM Jr. Preoperative risk factors and surgical complexity are more predictive of costs than postoperative complications: a case study using the National Surgical Quality Improvement Program (NSQIP) database. Ann Surg. 2005;242(4):463–8. discussion 468-471PubMedPubMedCentral
go back to reference Fink AS, Campbell DA Jr, Mentzer RM Jr, et al. The National Surgical Quality Improvement Program in non-veterans administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53. discussion 353-344CrossRefPubMedPubMedCentral Fink AS, Campbell DA Jr, Mentzer RM Jr, et al. The National Surgical Quality Improvement Program in non-veterans administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53. discussion 353-344CrossRefPubMedPubMedCentral
go back to reference Gawande AA, Zinner MJ, Studdert DM, Brennan TA. Analysis of errors reported by surgeons at three teaching hospitals. Surgery. 2003;133(6):614–21.CrossRefPubMed Gawande AA, Zinner MJ, Studdert DM, Brennan TA. Analysis of errors reported by surgeons at three teaching hospitals. Surgery. 2003;133(6):614–21.CrossRefPubMed
go back to reference Hyder JA, Reznor G, Wakeam E, Nguyen LL, Lipsitz SR, Havens JM. Risk prediction accuracy differs for emergency versus elective cases in the ACS-NSQIP. Ann Surg. 2015;264(6):959-65. Hyder JA, Reznor G, Wakeam E, Nguyen LL, Lipsitz SR, Havens JM. Risk prediction accuracy differs for emergency versus elective cases in the ACS-NSQIP. Ann Surg. 2015;264(6):959-65.
go back to reference Schilling PL, Dimick JB, Birkmeyer JD. Prioritizing quality improvement in general surgery. J Am Coll Surg. 2008;207(5):698–704.CrossRefPubMed Schilling PL, Dimick JB, Birkmeyer JD. Prioritizing quality improvement in general surgery. J Am Coll Surg. 2008;207(5):698–704.CrossRefPubMed
go back to reference Shiloach M, Frencher SK Jr, Steeger JE, et al. Toward robust information: data quality and inter-rater reliability in the American College of Surgeons National Surgical Quality Improvement Program. J Am Coll Surg. 2010;210(1):6–16.CrossRefPubMed Shiloach M, Frencher SK Jr, Steeger JE, et al. Toward robust information: data quality and inter-rater reliability in the American College of Surgeons National Surgical Quality Improvement Program. J Am Coll Surg. 2010;210(1):6–16.CrossRefPubMed
go back to reference Steinberg SM, Popa MR, Michalek JA, Bethel MJ, Ellison EC. Comparison of risk adjustment methodologies in surgical quality improvement. Surgery. 2008;144(4):662–7. discussion 662-667CrossRefPubMed Steinberg SM, Popa MR, Michalek JA, Bethel MJ, Ellison EC. Comparison of risk adjustment methodologies in surgical quality improvement. Surgery. 2008;144(4):662–7. discussion 662-667CrossRefPubMed
Metadata
Title
Impact of ASA score misclassification on NSQIP predicted mortality: a retrospective analysis
Authors
Alex Helkin
Sumeet V. Jain
Angelika Gruessner
Maureen Fleming
Leslie Kohman
Michael Costanza
Robert N. Cooney
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Perioperative Medicine / Issue 1/2017
Electronic ISSN: 2047-0525
DOI
https://doi.org/10.1186/s13741-017-0076-1

Other articles of this Issue 1/2017

Perioperative Medicine 1/2017 Go to the issue