Skip to main content
Top
Published in: Journal of Cardiothoracic Surgery 1/2011

Open Access 01-12-2011 | Research article

A comparative study of four intensive care outcome prediction models in cardiac surgery patients

Authors: Fabian Doerr, Akmal MA Badreldin, Matthias B Heldwein, Torsten Bossert, Markus Richter, Thomas Lehmann, Ole Bayer, Khosro Hekmat

Published in: Journal of Cardiothoracic Surgery | Issue 1/2011

Login to get access

Abstract

Background

Outcome prediction scoring systems are increasingly used in intensive care medicine, but most were not developed for use in cardiac surgery patients. We compared the performance of four intensive care outcome prediction scoring systems (Acute Physiology and Chronic Health Evaluation II [APACHE II], Simplified Acute Physiology Score II [SAPS II], Sequential Organ Failure Assessment [SOFA], and Cardiac Surgery Score [CASUS]) in patients after open heart surgery.

Methods

We prospectively included all consecutive adult patients who underwent open heart surgery and were admitted to the intensive care unit (ICU) between January 1st 2007 and December 31st 2008. Scores were calculated daily from ICU admission until discharge. The outcome measure was ICU mortality. The performance of the four scores was assessed by calibration and discrimination statistics. Derived variables (Mean- and Max- scores) were also evaluated.

Results

During the study period, 2801 patients (29.6% female) were included. Mean age was 66.9 ± 10.7 years and the ICU mortality rate was 5.2%. Calibration tests for SOFA and CASUS were reliable throughout (p-value not < 0.05), but there were significant differences between predicted and observed outcome for SAPS II (days 1, 2, 3 and 5) and APACHE II (days 2 and 3). CASUS, and its mean- and maximum-derivatives, discriminated better between survivors and non-survivors than the other scores throughout the study (area under curve ≥ 0.90). In order of best discrimination, CASUS was followed by SOFA, then SAPS II, and finally APACHE II. SAPS II and APACHE II derivatives had discrimination results that were superior to those of the SOFA derivatives.

Conclusions

CASUS and SOFA are reliable ICU mortality risk stratification models for cardiac surgery patients. SAPS II and APACHE II did not perform well in terms of calibration and discrimination statistics.
Appendix
Available only for authorised users
Literature
1.
go back to reference Knaus W, Draper E, Wagner D, Zimmerman J: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed Knaus W, Draper E, Wagner D, Zimmerman J: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed
2.
go back to reference Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993, 270: 2957-2963. 10.1001/jama.270.24.2957.CrossRefPubMed Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993, 270: 2957-2963. 10.1001/jama.270.24.2957.CrossRefPubMed
3.
go back to reference Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, Reinhart K, Suter PM, Thijs LG: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996, 22: 707-710. 10.1007/BF01709751.CrossRefPubMed Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, Reinhart K, Suter PM, Thijs LG: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996, 22: 707-710. 10.1007/BF01709751.CrossRefPubMed
4.
go back to reference Hekmat K, Kroener A, Stuetzer H, Schwinger RH, Kampe S, Bennink GB, Mehlhorn U: Daily assessment of organ dysfunction and survival in intensive care unit cardiac surgical patients. Ann Thorac Surg. 2005, 79: 1555-1562. 10.1016/j.athoracsur.2004.10.017.CrossRefPubMed Hekmat K, Kroener A, Stuetzer H, Schwinger RH, Kampe S, Bennink GB, Mehlhorn U: Daily assessment of organ dysfunction and survival in intensive care unit cardiac surgical patients. Ann Thorac Surg. 2005, 79: 1555-1562. 10.1016/j.athoracsur.2004.10.017.CrossRefPubMed
5.
go back to reference Ryan TA, Rady MY, Bashour CA, Leventhal M, Lytle B, Starr NJ: Predictors of outcome in cardiac surgical patients with prolonged intensive care stay. Chest. 1997, 112: 1035-1042. 10.1378/chest.112.4.1035.CrossRefPubMed Ryan TA, Rady MY, Bashour CA, Leventhal M, Lytle B, Starr NJ: Predictors of outcome in cardiac surgical patients with prolonged intensive care stay. Chest. 1997, 112: 1035-1042. 10.1378/chest.112.4.1035.CrossRefPubMed
6.
go back to reference Turner JS, Morgan CJ, Thakrar B, Pepper JR: Difficulties in predicting outcome in cardiac surgery patients. Crit Care Med. 1995, 23: 1843-1850. 10.1097/00003246-199511000-00010.CrossRefPubMed Turner JS, Morgan CJ, Thakrar B, Pepper JR: Difficulties in predicting outcome in cardiac surgery patients. Crit Care Med. 1995, 23: 1843-1850. 10.1097/00003246-199511000-00010.CrossRefPubMed
7.
go back to reference Weiss YG, Merin G, Koganov E, Ribo A, Oppenheim-Eden A, Medalion B, Peruanski M, Reider E, Bar-Ziv J, Hanson WC, Pizov R: Postcardiopulmonary bypass hypoxemia: a prospective study on incidence, risk factors, and clinical significance. J Cardiothorac Vasc Anesth. 2000, 14: 506-513. 10.1053/jcan.2000.9488.CrossRefPubMed Weiss YG, Merin G, Koganov E, Ribo A, Oppenheim-Eden A, Medalion B, Peruanski M, Reider E, Bar-Ziv J, Hanson WC, Pizov R: Postcardiopulmonary bypass hypoxemia: a prospective study on incidence, risk factors, and clinical significance. J Cardiothorac Vasc Anesth. 2000, 14: 506-513. 10.1053/jcan.2000.9488.CrossRefPubMed
8.
go back to reference Kollef MH, Wragge T, Pasque C: Determinants of mortality and multiorgan dysfunction in cardiac surgery patients requiring prolonged mechanical ventilation. Chest. 1995, 107: 1395-1401. 10.1378/chest.107.5.1395.CrossRefPubMed Kollef MH, Wragge T, Pasque C: Determinants of mortality and multiorgan dysfunction in cardiac surgery patients requiring prolonged mechanical ventilation. Chest. 1995, 107: 1395-1401. 10.1378/chest.107.5.1395.CrossRefPubMed
9.
go back to reference Rady MY, Ryan T, Starr NJ: Perioperative determinants of morbidity and mortality in elderly patients undergoing cardiac surgery. Crit Care Med. 1998, 26: 225-235. 10.1097/00003246-199802000-00016.CrossRefPubMed Rady MY, Ryan T, Starr NJ: Perioperative determinants of morbidity and mortality in elderly patients undergoing cardiac surgery. Crit Care Med. 1998, 26: 225-235. 10.1097/00003246-199802000-00016.CrossRefPubMed
10.
go back to reference Marik PE, Varon J: Severity scoring and outcome assessment. Computerized predictive models and scoring systems. Crit Care Clin. 1999, 15: 633-646. 10.1016/S0749-0704(05)70076-2.CrossRefPubMed Marik PE, Varon J: Severity scoring and outcome assessment. Computerized predictive models and scoring systems. Crit Care Clin. 1999, 15: 633-646. 10.1016/S0749-0704(05)70076-2.CrossRefPubMed
11.
go back to reference Higgins TL, Estafanous FG, Loop FD, Beck GJ, Lee JC, Starr NJ, Knaus WA, Cosgrove DM: ICU admission score for predicting morbidity and mortality risk after coronary artery bypass grafting. Ann Thorac Surg. 1997, 64: 1050-1058. 10.1016/S0003-4975(97)00553-5.CrossRefPubMed Higgins TL, Estafanous FG, Loop FD, Beck GJ, Lee JC, Starr NJ, Knaus WA, Cosgrove DM: ICU admission score for predicting morbidity and mortality risk after coronary artery bypass grafting. Ann Thorac Surg. 1997, 64: 1050-1058. 10.1016/S0003-4975(97)00553-5.CrossRefPubMed
12.
go back to reference Strand K, Flaatten H: Severity scoring in the ICU: a review. Acta Anaesthesiol Scand. 2008, 52: 467-478. 10.1111/j.1399-6576.2008.01586.x.CrossRefPubMed Strand K, Flaatten H: Severity scoring in the ICU: a review. Acta Anaesthesiol Scand. 2008, 52: 467-478. 10.1111/j.1399-6576.2008.01586.x.CrossRefPubMed
13.
go back to reference Badreldin AM, Kroener A, Heldwein MB, Doerr F, Vogt H, Ismail MM, Bossert T, Hekmat K: Prognostic value of daily cardiac surgery score (CASUS) and its derivatives in cardiac surgery patients. Thorac Cardiovasc Surg. 2010, 58: 1-6. 10.1055/s-0030-1250080.CrossRef Badreldin AM, Kroener A, Heldwein MB, Doerr F, Vogt H, Ismail MM, Bossert T, Hekmat K: Prognostic value of daily cardiac surgery score (CASUS) and its derivatives in cardiac surgery patients. Thorac Cardiovasc Surg. 2010, 58: 1-6. 10.1055/s-0030-1250080.CrossRef
14.
go back to reference Ceriani R, Mazzoni M, Bortone F, Gandini S, Solinas C, Susini G, Parodi O: Application of the sequential organ failure assessment score to cardiac surgical patients. Chest. 2003, 123: 1229-1239. 10.1378/chest.123.4.1229.CrossRefPubMed Ceriani R, Mazzoni M, Bortone F, Gandini S, Solinas C, Susini G, Parodi O: Application of the sequential organ failure assessment score to cardiac surgical patients. Chest. 2003, 123: 1229-1239. 10.1378/chest.123.4.1229.CrossRefPubMed
15.
go back to reference Harrison DA, Brady AR, Parry GJ: Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med. 2006, 34: 1378-1388. 10.1097/01.CCM.0000216702.94014.75.CrossRefPubMed Harrison DA, Brady AR, Parry GJ: Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med. 2006, 34: 1378-1388. 10.1097/01.CCM.0000216702.94014.75.CrossRefPubMed
16.
go back to reference Aegerter P, Boumendil A, Retbi A: SAPS II revisited. Intensive Care Med. 2005, 31: 416-423. 10.1007/s00134-005-2557-9.CrossRefPubMed Aegerter P, Boumendil A, Retbi A: SAPS II revisited. Intensive Care Med. 2005, 31: 416-423. 10.1007/s00134-005-2557-9.CrossRefPubMed
17.
go back to reference Moreno RP, Metnitz PG, Almeida E: SAPS 3 Investigators. SAPS 3 - from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 2005, 31: 1345-1355. 10.1007/s00134-005-2763-5.CrossRefPubMedPubMedCentral Moreno RP, Metnitz PG, Almeida E: SAPS 3 Investigators. SAPS 3 - from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 2005, 31: 1345-1355. 10.1007/s00134-005-2763-5.CrossRefPubMedPubMedCentral
18.
go back to reference 2nd European Consensus Conference in Intensive Care Medicine: Predicting outcome in ICU patients. Intensive Care Med. 1994, 20: 390-397. 10.1007/BF01720917. 2nd European Consensus Conference in Intensive Care Medicine: Predicting outcome in ICU patients. Intensive Care Med. 1994, 20: 390-397. 10.1007/BF01720917.
19.
go back to reference Sakr Y, Krauss C, Amaral A, Réa-Neto A, Specht M, Reinhart K, Marx G: Comparison of the performance of SAPS II, SAPS 3, APACHE II, and their customized prognostic models in a surgical intensive care unit. Br J Anaesth. 2008, 101: 798-803. 10.1093/bja/aen291.CrossRefPubMed Sakr Y, Krauss C, Amaral A, Réa-Neto A, Specht M, Reinhart K, Marx G: Comparison of the performance of SAPS II, SAPS 3, APACHE II, and their customized prognostic models in a surgical intensive care unit. Br J Anaesth. 2008, 101: 798-803. 10.1093/bja/aen291.CrossRefPubMed
20.
go back to reference Kramer AA, Zimmerman JE: Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited. Crit Care Med. 2007, 35: 2212-2213. 10.1097/01.CCM.0000281522.70992.EF.CrossRef Kramer AA, Zimmerman JE: Assessing the calibration of mortality benchmarks in critical care: The Hosmer-Lemeshow test revisited. Crit Care Med. 2007, 35: 2212-2213. 10.1097/01.CCM.0000281522.70992.EF.CrossRef
21.
go back to reference Vincent JL, Ferreira F, Moreno R: Scoring systems for assessing organ dysfunction and survival. Crit Care Clin. 2000, 16: 353-366. 10.1016/S0749-0704(05)70114-7.CrossRefPubMed Vincent JL, Ferreira F, Moreno R: Scoring systems for assessing organ dysfunction and survival. Crit Care Clin. 2000, 16: 353-366. 10.1016/S0749-0704(05)70114-7.CrossRefPubMed
22.
go back to reference Marshall JC, Cook DJ, Christou NV, Bernard GR, Sprung CL, Sibbald WJ: Multiple organ dysfunction score: a reliable descriptor of a complex clinical outcome. Crit Care Med. 1995, 23: 1638-1652. 10.1097/00003246-199510000-00007.CrossRefPubMed Marshall JC, Cook DJ, Christou NV, Bernard GR, Sprung CL, Sibbald WJ: Multiple organ dysfunction score: a reliable descriptor of a complex clinical outcome. Crit Care Med. 1995, 23: 1638-1652. 10.1097/00003246-199510000-00007.CrossRefPubMed
23.
go back to reference Moreno R, Vincent JL, Matos R, Mendonca A, Cantraine F, Thijs L, Takala J, Sprung C, Antonelli M, Bruining H, Willatts S: The use ofmaximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis Related Problems of the ESICM. Intensive Care Med. 1999, 25: 686-696. 10.1007/s001340050931.CrossRefPubMed Moreno R, Vincent JL, Matos R, Mendonca A, Cantraine F, Thijs L, Takala J, Sprung C, Antonelli M, Bruining H, Willatts S: The use ofmaximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis Related Problems of the ESICM. Intensive Care Med. 1999, 25: 686-696. 10.1007/s001340050931.CrossRefPubMed
24.
go back to reference Ferreira FL, Bota DP, Bross A, Melot C, Vincent JL: Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001, 286: 1754-1758. 10.1001/jama.286.14.1754.CrossRefPubMed Ferreira FL, Bota DP, Bross A, Melot C, Vincent JL: Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001, 286: 1754-1758. 10.1001/jama.286.14.1754.CrossRefPubMed
25.
go back to reference Chung DA, Sharples LD, Nashef SAM: A case-control analysis of readmissions to the cardiac surgical intensive care unit. Eur J Cardiothorac Surg. 2002, 22: 282-286. 10.1016/S1010-7940(02)00303-2.CrossRefPubMed Chung DA, Sharples LD, Nashef SAM: A case-control analysis of readmissions to the cardiac surgical intensive care unit. Eur J Cardiothorac Surg. 2002, 22: 282-286. 10.1016/S1010-7940(02)00303-2.CrossRefPubMed
26.
go back to reference Michalopoulos A, Stavridis G, Geroulanos S: Severe sepsis in cardiac surgical patients. Eur J Surg. 1998, 164: 217-222. 10.1080/110241598750004670.CrossRefPubMed Michalopoulos A, Stavridis G, Geroulanos S: Severe sepsis in cardiac surgical patients. Eur J Surg. 1998, 164: 217-222. 10.1080/110241598750004670.CrossRefPubMed
27.
go back to reference Hutchinson C, Craig S, Ridley S: Sequential organ scoring as a measure of effectiveness of critical care. Anaesthesia. 2000, 55: 1149-1154. 10.1046/j.1365-2044.2000.01608.x.CrossRefPubMed Hutchinson C, Craig S, Ridley S: Sequential organ scoring as a measure of effectiveness of critical care. Anaesthesia. 2000, 55: 1149-1154. 10.1046/j.1365-2044.2000.01608.x.CrossRefPubMed
28.
go back to reference Pintor PP, Colangelo S, Bobbio M: Evolution of case-mix in heart surgery: from mortality risk to complication risk. Eur J Cardiothorac Surg. 2002, 22: 927-933. 10.1016/S1010-7940(02)00566-3.CrossRefPubMed Pintor PP, Colangelo S, Bobbio M: Evolution of case-mix in heart surgery: from mortality risk to complication risk. Eur J Cardiothorac Surg. 2002, 22: 927-933. 10.1016/S1010-7940(02)00566-3.CrossRefPubMed
29.
go back to reference Heijmans JH, Maessen JG, Roekaerts PMHJ: Risk stratification for adverse outcome in cardiac surgery. Eur J Anaesthesiol. 2003, 20: 515-527. 10.1097/00003643-200307000-00002.CrossRefPubMed Heijmans JH, Maessen JG, Roekaerts PMHJ: Risk stratification for adverse outcome in cardiac surgery. Eur J Anaesthesiol. 2003, 20: 515-527. 10.1097/00003643-200307000-00002.CrossRefPubMed
Metadata
Title
A comparative study of four intensive care outcome prediction models in cardiac surgery patients
Authors
Fabian Doerr
Akmal MA Badreldin
Matthias B Heldwein
Torsten Bossert
Markus Richter
Thomas Lehmann
Ole Bayer
Khosro Hekmat
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Journal of Cardiothoracic Surgery / Issue 1/2011
Electronic ISSN: 1749-8090
DOI
https://doi.org/10.1186/1749-8090-6-21

Other articles of this Issue 1/2011

Journal of Cardiothoracic Surgery 1/2011 Go to the issue