Skip to main content
Top
Published in: Annals of Surgical Oncology 9/2010

01-09-2010 | Healthcare Policy and Outcomes

Assessment of ACS NSQIP’s Predictive Ability for Adverse Events After Major Cancer Surgery

Authors: Daniel Borja-Cacho, MD, Helen M. Parsons, MPH, Elizabeth B. Habermann, MPH, PhD, David A. Rothenberger, MD, FACS, William G. Henderson, MPH, PhD, Waddah B. Al-Refaie, MD, FACS

Published in: Annals of Surgical Oncology | Issue 9/2010

Login to get access

Abstract

Background

The American College of Surgeons National Surgery Quality Improvement Program (ACS NSQIP) has improved operative outcomes in the USA. However, its applicability to oncologic resections at ACS NSQIP hospitals has not been fully explored. We assessed the ability of factors currently collected by ACS NSQIP to predict adverse operative events after major cancer surgery.

Methods

Using pre- and intraoperative factors gathered by the 2005–2008 ACS NSQIP, we constructed logistic regression models to determine their ability to predict 30-day mortality, prolonged length of stay (LOS), major complications or increased number of complications in 15,709 patients who underwent major cancer surgery at 211 hospitals. We assessed each model’s predictive ability using the c-index.

Results

While the mortality rate was relatively low (2.5%), nearly 24% of patients experienced major adverse events. However, up to 43% of patients with prolonged LOS did not have any major complication captured by NSQIP. Furthermore, our model predicting complications showed poor overall predictive ability compared with those predicting mortality and LOS (c-index <0.67 versus 0.80 and 0.73, respectively). When stratified by procedure, the complication model’s predictive ability remained less accurate than models predicting 30-day mortality or prolonged LOS. These results remain unchanged after additional sensitivity analyses.

Conclusions

Current ACS NSQIP variables show low predictive ability for major complications after major oncologic resections. Addition of some disease- and operation-specific variables may be an important consideration in the further evolution of the NSQIP to allow for more accurate predictions of adverse outcomes for major oncologic resections.
Literature
1.
go back to reference Daley J, Khuri SF, Henderson W, et al. Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. 1997;185(4):328–40.PubMed Daley J, Khuri SF, Henderson W, et al. Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. 1997;185(4):328–40.PubMed
2.
go back to reference Henderson WG, Daley J. Design and statistical methodology of the National Surgical Quality Improvement Program: why is it what it is? Am J Surg. 2009;198(5 Suppl):S19–27.CrossRefPubMed Henderson WG, Daley J. Design and statistical methodology of the National Surgical Quality Improvement Program: why is it what it is? Am J Surg. 2009;198(5 Suppl):S19–27.CrossRefPubMed
3.
go back to reference Khuri SF, Daley J, Henderson W, et al. The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg. 1995;180(5):519–31.PubMed Khuri SF, Daley J, Henderson W, et al. The National Veterans Administration Surgical Risk Study: risk adjustment for the comparative assessment of the quality of surgical care. J Am Coll Surg. 1995;180(5):519–31.PubMed
4.
go back to reference Khuri SF, Daley J, Henderson W, et al. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998;228(4):491–507.CrossRefPubMed Khuri SF, Daley J, Henderson W, et al. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998;228(4):491–507.CrossRefPubMed
5.
go back to reference Khuri SF, Daley J, Henderson W, et al. Risk adjustment of the postoperative mortality rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. 1997;185(4):315–27.PubMed Khuri SF, Daley J, Henderson W, et al. Risk adjustment of the postoperative mortality rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study. J Am Coll Surg. 1997;185(4):315–27.PubMed
6.
go back to reference Khuri SF, Daley J, Henderson WG. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg. 2002;137(1):20–7.CrossRefPubMed Khuri SF, Daley J, Henderson WG. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg. 2002;137(1):20–7.CrossRefPubMed
7.
go back to reference Birkmeyer JD, Shahian DM, Dimick JB, et al. Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg. 2008;207(5):777–82.CrossRefPubMed Birkmeyer JD, Shahian DM, Dimick JB, et al. Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg. 2008;207(5):777–82.CrossRefPubMed
8.
go back to reference Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346(15):1128–37.CrossRefPubMed Birkmeyer JD, Siewers AE, Finlayson EV, et al. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002;346(15):1128–37.CrossRefPubMed
9.
go back to reference Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL. Surgeon volume and operative mortality in the United States. N Engl J Med. 2003;349(22):2117–27.CrossRefPubMed Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL. Surgeon volume and operative mortality in the United States. N Engl J Med. 2003;349(22):2117–27.CrossRefPubMed
10.
go back to reference Ghaferi AA, Birkmeyer JD, Dimick JB. Complications, failure to rescue, and mortality with major inpatient surgery in medicare patients. Ann Surg. 2009;250(6):1029–34.CrossRefPubMed Ghaferi AA, Birkmeyer JD, Dimick JB. Complications, failure to rescue, and mortality with major inpatient surgery in medicare patients. Ann Surg. 2009;250(6):1029–34.CrossRefPubMed
11.
go back to reference Ghaferi AA, Birkmeyer JD, Dimick JB. Variation in hospital mortality associated with inpatient surgery. N Engl J Med. 2009;361(14):1368–75.CrossRefPubMed Ghaferi AA, Birkmeyer JD, Dimick JB. Variation in hospital mortality associated with inpatient surgery. N Engl J Med. 2009;361(14):1368–75.CrossRefPubMed
12.
go back to reference Turrini O, Viret F, Moureau-Zabotto L, et al. Neoadjuvant chemoradiation and pancreaticoduodenectomy for initially locally advanced head pancreatic adenocarcinoma. Eur J Surg Oncol. 2009;35(12):1306–11.PubMed Turrini O, Viret F, Moureau-Zabotto L, et al. Neoadjuvant chemoradiation and pancreaticoduodenectomy for initially locally advanced head pancreatic adenocarcinoma. Eur J Surg Oncol. 2009;35(12):1306–11.PubMed
13.
go back to reference Sabel MS, Smith JL, Nava HR, Mollen K, Douglass HO, Gibbs JF. Esophageal resection for carcinoma in patients older than 70 years. Ann Surg Oncol. 2002;9(2):210–4.CrossRefPubMed Sabel MS, Smith JL, Nava HR, Mollen K, Douglass HO, Gibbs JF. Esophageal resection for carcinoma in patients older than 70 years. Ann Surg Oncol. 2002;9(2):210–4.CrossRefPubMed
14.
go back to reference Sohn TA, Yeo CJ, Cameron JL, et al. Should pancreaticoduodenectomy be performed in octogenarians? J Gastrointest Surg. 1998;2(3):207–16.CrossRefPubMed Sohn TA, Yeo CJ, Cameron JL, et al. Should pancreaticoduodenectomy be performed in octogenarians? J Gastrointest Surg. 1998;2(3):207–16.CrossRefPubMed
15.
go back to reference Fink AS, Campbell DA, Jr., Mentzer RM, Jr., et al. The National Surgical Quality Improvement Program in non-Veterans Administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53 (discussion 353-4).CrossRefPubMed Fink AS, Campbell DA, Jr., Mentzer RM, Jr., et al. The National Surgical Quality Improvement Program in non-Veterans Administration hospitals: initial demonstration of feasibility. Ann Surg. 2002;236(3):344–53 (discussion 353-4).CrossRefPubMed
16.
go back to reference Al-Refaie WB, Parsons HM, Henderson WG, et al. Major cancer surgery in the elderly: results from the American College of Surgeons National Surgical Quality Improvement Program. Ann Surg. 2010;251(2):311–8.CrossRefPubMed Al-Refaie WB, Parsons HM, Henderson WG, et al. Major cancer surgery in the elderly: results from the American College of Surgeons National Surgical Quality Improvement Program. Ann Surg. 2010;251(2):311–8.CrossRefPubMed
17.
go back to reference Collins TC, Daley J, Henderson WH, Khuri SF. Risk factors for prolonged length of stay after major elective surgery. Ann Surg. 1999;230(2):251–9.CrossRefPubMed Collins TC, Daley J, Henderson WH, Khuri SF. Risk factors for prolonged length of stay after major elective surgery. Ann Surg. 1999;230(2):251–9.CrossRefPubMed
18.
go back to reference Wright CD, Gaissert HA, Grab JD, O’Brien SM, Peterson ED, Allen MS. Predictors of prolonged length of stay after lobectomy for lung cancer: a Society of Thoracic Surgeons General Thoracic Surgery Database risk-adjustment model. Ann Thorac Surg. 2008; 5(6):1857–65 (discussion 1865).CrossRefPubMed Wright CD, Gaissert HA, Grab JD, O’Brien SM, Peterson ED, Allen MS. Predictors of prolonged length of stay after lobectomy for lung cancer: a Society of Thoracic Surgeons General Thoracic Surgery Database risk-adjustment model. Ann Thorac Surg. 2008; 5(6):1857–65 (discussion 1865).CrossRefPubMed
19.
go back to reference Itani KM. Fifteen years of the National Surgical Quality Improvement Program in review. Am J Surg. 2009;198(5 Suppl):S9–18.CrossRefPubMed Itani KM. Fifteen years of the National Surgical Quality Improvement Program in review. Am J Surg. 2009;198(5 Suppl):S9–18.CrossRefPubMed
20.
go back to reference Khuri SF, Henderson WG, Daley J, et al. Successful implementation of the Department of Veterans Affairs’ National Surgical Quality Improvement Program in the private sector: the Patient Safety in Surgery study. Ann Surg. 2008;248(2):329–36.CrossRefPubMed Khuri SF, Henderson WG, Daley J, et al. Successful implementation of the Department of Veterans Affairs’ National Surgical Quality Improvement Program in the private sector: the Patient Safety in Surgery study. Ann Surg. 2008;248(2):329–36.CrossRefPubMed
21.
go back to reference Cameron JL, Riall TS, Coleman J, Belcher KA. One thousand consecutive pancreaticoduodenectomies. Ann Surg. 2006;244(1):10–5.CrossRefPubMed Cameron JL, Riall TS, Coleman J, Belcher KA. One thousand consecutive pancreaticoduodenectomies. Ann Surg. 2006;244(1):10–5.CrossRefPubMed
22.
go back to reference Ferrone CR, Warshaw AL, Rattner DW, et al. Pancreatic fistula rates after 462 distal pancreatectomies: staplers do not decrease fistula rates. J Gastrointest Surg. 2008;12(10):1691–7 (discussion 1697-8).CrossRefPubMed Ferrone CR, Warshaw AL, Rattner DW, et al. Pancreatic fistula rates after 462 distal pancreatectomies: staplers do not decrease fistula rates. J Gastrointest Surg. 2008;12(10):1691–7 (discussion 1697-8).CrossRefPubMed
23.
go back to reference Yeh JJ, Gonen M, Tomlinson JS, Idrees K, Brennan MF, Fong Y. Effect of blood transfusion on outcome after pancreaticoduodenectomy for exocrine tumour of the pancreas. Br J Surg. 2007;94(4):466–72.CrossRefPubMed Yeh JJ, Gonen M, Tomlinson JS, Idrees K, Brennan MF, Fong Y. Effect of blood transfusion on outcome after pancreaticoduodenectomy for exocrine tumour of the pancreas. Br J Surg. 2007;94(4):466–72.CrossRefPubMed
24.
go back to reference Khuri SF, Daley J, Henderson W, et al. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg. 1999;230(3):414–29 (discussion 429-32).CrossRefPubMed Khuri SF, Daley J, Henderson W, et al. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg. 1999;230(3):414–29 (discussion 429-32).CrossRefPubMed
25.
go back to reference Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg. 2009;250(3):363–76.PubMed Hall BL, Hamilton BH, Richards K, Bilimoria KY, Cohen ME, Ko CY. Does surgical quality improve in the American College of Surgeons National Surgical Quality Improvement Program: an evaluation of all participating hospitals. Ann Surg. 2009;250(3):363–76.PubMed
Metadata
Title
Assessment of ACS NSQIP’s Predictive Ability for Adverse Events After Major Cancer Surgery
Authors
Daniel Borja-Cacho, MD
Helen M. Parsons, MPH
Elizabeth B. Habermann, MPH, PhD
David A. Rothenberger, MD, FACS
William G. Henderson, MPH, PhD
Waddah B. Al-Refaie, MD, FACS
Publication date
01-09-2010
Publisher
Springer-Verlag
Published in
Annals of Surgical Oncology / Issue 9/2010
Print ISSN: 1068-9265
Electronic ISSN: 1534-4681
DOI
https://doi.org/10.1245/s10434-010-1176-z

Other articles of this Issue 9/2010

Annals of Surgical Oncology 9/2010 Go to the issue