Skip to main content
Top
Published in: Intensive Care Medicine 9/2011

01-09-2011 | Original

Predicting prolonged intensive care unit stays in older cardiac surgery patients: a validation study

Authors: Roelof G. A. Ettema, Linda M. Peelen, Cor J. Kalkman, Arno P. Nierich, Karel G. M. Moons, Marieke J. Schuurmans

Published in: Intensive Care Medicine | Issue 9/2011

Login to get access

Abstract

Purpose

In cardiac surgery prediction models identifying patients at risk of prolonged stay at the Intensive Care Unit (ICU) are used to optimize treatment and use of ICU resources. A recent systematic validation study of 14 of these models identified three models with a good predictive performance across patients of all ages. It is however unclear how these models perform in older patients, who nowadays form a considerable part of this patient population. The current study specifically validates the performance of these three models in older cardiac surgery patients and quantifies how their performance changes with increasing age of patients.

Methods

The Parsonnet model, the EuroSCORE, and a model by Huijskes and colleagues were validated using prospectively collected data of 11,395 cardiac surgery patients. Performance of the models was described by discrimination (area under the ROC curve, AUC) and calibration.

Results

For the Parsonnet model, the EuroSCORE and the Huijskes model discrimination clearly decreased with increasing age (AUCs of 0.76, 0.71 and 0.72 for ages 70–75 and 0.72, 0.70 and 0.72, respectively, for ages 75–80 and 0.68, 0.64 and 0.69, respectively, above 80 years). The models showed poor calibration in patients aged >70 (p values for fit of the models <0.006).

Conclusions

To optimize treatment and ICU resources, risk prediction for prolonged ICU stay after cardiac surgery using the existing models should be done with great care for older patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Litovski DS, Dacey LJ, Baribeau YR, Leavitt BJ, Clough R, Cochran RP, Quinn R, Sisto DA, Charlesworth DC, Malenka DJ, MacKenzie TA, Olmstead EM, Ross CS, O’Connor GT (2008) Long-term survival of the very elderly undergoing coronary artery bypass grafting. Ann Thorac Surg 85:1233–1238CrossRef Litovski DS, Dacey LJ, Baribeau YR, Leavitt BJ, Clough R, Cochran RP, Quinn R, Sisto DA, Charlesworth DC, Malenka DJ, MacKenzie TA, Olmstead EM, Ross CS, O’Connor GT (2008) Long-term survival of the very elderly undergoing coronary artery bypass grafting. Ann Thorac Surg 85:1233–1238CrossRef
2.
go back to reference Northrup WF, Emery RW, Nicoloff DM, Lillehei TJ, Holter AR, Blake DP (2004) Opposite trends in coronary artery and valve surgery in a large multisurgeon practice, 1979–1999. Ann Thorac Surg 77:488–495PubMedCrossRef Northrup WF, Emery RW, Nicoloff DM, Lillehei TJ, Holter AR, Blake DP (2004) Opposite trends in coronary artery and valve surgery in a large multisurgeon practice, 1979–1999. Ann Thorac Surg 77:488–495PubMedCrossRef
3.
go back to reference Kilger E, Weis FC, Goetz AE, Frey L, Kesel K, Schütz A, Lamm P, Uberfuhr P, Knoll A, Felbinger TW, Peter K (2001) Intensive care after minimally invasive and conventional coronary surgery: a prospective comparison. Intensive Care Med 27:534–539PubMedCrossRef Kilger E, Weis FC, Goetz AE, Frey L, Kesel K, Schütz A, Lamm P, Uberfuhr P, Knoll A, Felbinger TW, Peter K (2001) Intensive care after minimally invasive and conventional coronary surgery: a prospective comparison. Intensive Care Med 27:534–539PubMedCrossRef
4.
go back to reference Zangrillo A, Sparicio D, Crivellari M, Aletti G, Bove T, Mamo D, Bignami E, Marino G, Landoni G (2004) Low perioperative mortality for cardiac surgery in octogenarians. Minerva Anestesiol 70:717–726PubMed Zangrillo A, Sparicio D, Crivellari M, Aletti G, Bove T, Mamo D, Bignami E, Marino G, Landoni G (2004) Low perioperative mortality for cardiac surgery in octogenarians. Minerva Anestesiol 70:717–726PubMed
5.
go back to reference Norkiene I, Ringaitiene D, Misiuriene I, Samalavicius R, Bubulis R, Baublys A, Uzdavinys G (2007) Incidence and precipitating factors of delirium after coronary artery bypass grafting. Scand Cardiovasc J 41:180–185PubMedCrossRef Norkiene I, Ringaitiene D, Misiuriene I, Samalavicius R, Bubulis R, Baublys A, Uzdavinys G (2007) Incidence and precipitating factors of delirium after coronary artery bypass grafting. Scand Cardiovasc J 41:180–185PubMedCrossRef
6.
go back to reference Scott BH, Seifert FC, Grimson R, Glass PSA (2005) Octogenarians undergoing coronary artery bypass graft surgery: resource utilization, postoperative mortality, and morbidity. J Cardiothorac Vasc Anesth 19:583–588PubMedCrossRef Scott BH, Seifert FC, Grimson R, Glass PSA (2005) Octogenarians undergoing coronary artery bypass graft surgery: resource utilization, postoperative mortality, and morbidity. J Cardiothorac Vasc Anesth 19:583–588PubMedCrossRef
7.
go back to reference Jacquet L, Vancaenegem O, Rubay J, Laarbaui F, Goffinet C, Lovat R, Noirhomme P, El Khoury G (2007) Intensive care outcome of adult patients operated on for congenital heart disease. Intensive Care Med 33:524–528PubMedCrossRef Jacquet L, Vancaenegem O, Rubay J, Laarbaui F, Goffinet C, Lovat R, Noirhomme P, El Khoury G (2007) Intensive care outcome of adult patients operated on for congenital heart disease. Intensive Care Med 33:524–528PubMedCrossRef
8.
go back to reference Ghotkar SV, Grayson AD, Fabri BM, Dihmis WC, Pullan DM (2006) Preoperative calculation of risk for prolonged intensive care unit stay following coronary artery bypass grafting. J Cardiothorac Surg 31:1–14 Ghotkar SV, Grayson AD, Fabri BM, Dihmis WC, Pullan DM (2006) Preoperative calculation of risk for prolonged intensive care unit stay following coronary artery bypass grafting. J Cardiothorac Surg 31:1–14
9.
go back to reference Van Klei WA, Moons KG, Rutten CL, Schuurhuis A, Knape JT, Kalkman CJ, Grobbee DE (2002) The effect of outpatient preoperative evaluation of hospital inpatients on cancellation of surgery and length of hospital stay. Anesth Analg 94:644–649PubMedCrossRef Van Klei WA, Moons KG, Rutten CL, Schuurhuis A, Knape JT, Kalkman CJ, Grobbee DE (2002) The effect of outpatient preoperative evaluation of hospital inpatients on cancellation of surgery and length of hospital stay. Anesth Analg 94:644–649PubMedCrossRef
10.
go back to reference Bucerius J, Gummert JF, Walther T, Doll N, Falk V, Schmitt DV, Mohr FW (2004) Predictors of prolonged ICU stay after on-pump versus off-pump coronary artery bypass grafting. Intensive Care Med 30:88–95PubMedCrossRef Bucerius J, Gummert JF, Walther T, Doll N, Falk V, Schmitt DV, Mohr FW (2004) Predictors of prolonged ICU stay after on-pump versus off-pump coronary artery bypass grafting. Intensive Care Med 30:88–95PubMedCrossRef
11.
go back to reference Pinna Pintor P, Bobbio M, Colangelo S, Veglia F, Marras R, Diena M (2003) Can EuroSCORE predict direct costs of cardiac surgery? Eur J Cardiothorac Surg 23:595–598PubMedCrossRef Pinna Pintor P, Bobbio M, Colangelo S, Veglia F, Marras R, Diena M (2003) Can EuroSCORE predict direct costs of cardiac surgery? Eur J Cardiothorac Surg 23:595–598PubMedCrossRef
12.
go back to reference Messaoudi N, De Cocker J, Stockman B, Bossaert LL, Rodrigus IER (2009) Prediction of prolonged length of stay in the intensive care unit after cardiac surgery: the need for a multi-institutional risk scoring system. J Card Surg 24:127–133PubMedCrossRef Messaoudi N, De Cocker J, Stockman B, Bossaert LL, Rodrigus IER (2009) Prediction of prolonged length of stay in the intensive care unit after cardiac surgery: the need for a multi-institutional risk scoring system. J Card Surg 24:127–133PubMedCrossRef
13.
go back to reference Atoui R, Ma F, Langlois Y, Morin JF (2008) Risk factors for prolonged stay in the intensive care unit and on the ward after cardiac surgery. J Card Surg 23:99–106PubMedCrossRef Atoui R, Ma F, Langlois Y, Morin JF (2008) Risk factors for prolonged stay in the intensive care unit and on the ward after cardiac surgery. J Card Surg 23:99–106PubMedCrossRef
14.
go back to reference Hsieh CH, Peng SK, Tsai TC, Shih YR, Peng SY (2007) Prediction for major adverse outcomes in cardiac surgery: comparison of three prediction models. J Formos Med Assoc 106:759–767PubMedCrossRef Hsieh CH, Peng SK, Tsai TC, Shih YR, Peng SY (2007) Prediction for major adverse outcomes in cardiac surgery: comparison of three prediction models. J Formos Med Assoc 106:759–767PubMedCrossRef
15.
go back to reference Nilsson J, Algotsson L, Höglund P, Lührs C, Brandt J (2004) EuroSCORE predicts intensive care unit stay and costs of open heart surgery. Ann Thorac Surg 78:1528–1535PubMedCrossRef Nilsson J, Algotsson L, Höglund P, Lührs C, Brandt J (2004) EuroSCORE predicts intensive care unit stay and costs of open heart surgery. Ann Thorac Surg 78:1528–1535PubMedCrossRef
16.
go back to reference Dupuis JY (2005) Clinical predictions and decisions to perform cardiac surgery on high-risk patients. Semin Cardiothorac Vasc Anesth 9:179–186PubMedCrossRef Dupuis JY (2005) Clinical predictions and decisions to perform cardiac surgery on high-risk patients. Semin Cardiothorac Vasc Anesth 9:179–186PubMedCrossRef
17.
go back to reference Foot DK, Lewis RP, Pearson TA, Beller GA (2000) Demographics and Cardiology, 1950–2050. J Am Coll Cardiol 35:1067–1081PubMedCrossRef Foot DK, Lewis RP, Pearson TA, Beller GA (2000) Demographics and Cardiology, 1950–2050. J Am Coll Cardiol 35:1067–1081PubMedCrossRef
18.
go back to reference Ettema RGA, Peelen LM, Schuurmans MJ, Nierich AP, Moons KGM (2010) Prediction models for prolonged intensive care unit stay after cardiac surgery: systematic review and validation study. Circulation 122:682–689PubMedCrossRef Ettema RGA, Peelen LM, Schuurmans MJ, Nierich AP, Moons KGM (2010) Prediction models for prolonged intensive care unit stay after cardiac surgery: systematic review and validation study. Circulation 122:682–689PubMedCrossRef
19.
go back to reference Parsonnet V, Dean D, Bernstein AD (1989) A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 79(suppl 1):I 3–I 12 Parsonnet V, Dean D, Bernstein AD (1989) A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation 79(suppl 1):I 3–I 12
20.
go back to reference Roques F, Nashef SAM, Michel P, Gauducheau E, de Vincentiis C, Baudet E, Cortina J, David M, Faichney A, Gabrielle F, Gams E, Harjula A, Jones MT, Pinna Pintor P, Salamon R, Thulin L (1999) Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg 15:816–823PubMedCrossRef Roques F, Nashef SAM, Michel P, Gauducheau E, de Vincentiis C, Baudet E, Cortina J, David M, Faichney A, Gabrielle F, Gams E, Harjula A, Jones MT, Pinna Pintor P, Salamon R, Thulin L (1999) Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg 15:816–823PubMedCrossRef
21.
go back to reference Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R (1999) European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg 16:9–13PubMedCrossRef Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R (1999) European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg 16:9–13PubMedCrossRef
22.
go back to reference Huijskes RV, Rosseel PM, Tijssen JG (2003) Outcome prediction in coronary artery bypass grafting and valve surgery in The Netherlands: development of the Amphiascore and its comparison with the EuroSCORE. Eur J Cardiothorac Surg 24:741–749PubMedCrossRef Huijskes RV, Rosseel PM, Tijssen JG (2003) Outcome prediction in coronary artery bypass grafting and valve surgery in The Netherlands: development of the Amphiascore and its comparison with the EuroSCORE. Eur J Cardiothorac Surg 24:741–749PubMedCrossRef
23.
go back to reference Lawrence DR, Valencia O, Smith EEJ, Murday A, Treasure T (2000) Parsonnet score is a good predictor of the duration of intensive care unit stay following cardiac surgery. Heart 83:429–432PubMedCrossRef Lawrence DR, Valencia O, Smith EEJ, Murday A, Treasure T (2000) Parsonnet score is a good predictor of the duration of intensive care unit stay following cardiac surgery. Heart 83:429–432PubMedCrossRef
24.
go back to reference Pitkänen O, Niskanen M, Rehnberg S, Hippeläinen M, Hynynen M (2000) Intra-institutional prediction of outcome after cardiac surgery: comparison between a locally derived model and the EuroSCORE. Eur J Cardiothorac Surg 18:703–710PubMedCrossRef Pitkänen O, Niskanen M, Rehnberg S, Hippeläinen M, Hynynen M (2000) Intra-institutional prediction of outcome after cardiac surgery: comparison between a locally derived model and the EuroSCORE. Eur J Cardiothorac Surg 18:703–710PubMedCrossRef
25.
go back to reference Ivanov J, Tu JV, Naylor DC (1999) Ready-made, recalibrated, or remodeled?: issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation 99:2098–2104PubMed Ivanov J, Tu JV, Naylor DC (1999) Ready-made, recalibrated, or remodeled?: issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation 99:2098–2104PubMed
26.
go back to reference Michalopoulos A, Tzelepis G, Pavlides G, Kriaras J, Dafni U, Geroulanos S (1996) Determinants of duration of ICU stay after coronary artery bypass graft surgery. Br J Anaesth 77:208–212PubMed Michalopoulos A, Tzelepis G, Pavlides G, Kriaras J, Dafni U, Geroulanos S (1996) Determinants of duration of ICU stay after coronary artery bypass graft surgery. Br J Anaesth 77:208–212PubMed
27.
go back to reference Tu JV, Mazer CD, Levinton C, Armstrong PW, Naylor CD (1994) A predictive index for length of stay in the intensive care unit following cardiac surgery. CMAJ 151:177–185PubMed Tu JV, Mazer CD, Levinton C, Armstrong PW, Naylor CD (1994) A predictive index for length of stay in the intensive care unit following cardiac surgery. CMAJ 151:177–185PubMed
28.
go back to reference Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115:928–935PubMedCrossRef Cook NR (2007) Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115:928–935PubMedCrossRef
29.
go back to reference Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36PubMed Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36PubMed
30.
go back to reference Janssen KJM, Moons KGM, Kalkman CJ, Grobbee DE, Vergouwe Y (2008) Updating a clinical prediction model improved the performance in new patients. J Clin Epidemiol 61:76–86PubMedCrossRef Janssen KJM, Moons KGM, Kalkman CJ, Grobbee DE, Vergouwe Y (2008) Updating a clinical prediction model improved the performance in new patients. J Clin Epidemiol 61:76–86PubMedCrossRef
31.
go back to reference Moons KG, Altman DG, Vergouwe Y, Royston P (2009) Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338:b606PubMedCrossRef Moons KG, Altman DG, Vergouwe Y, Royston P (2009) Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338:b606PubMedCrossRef
32.
go back to reference Spiegelhalter DJ (1986) Probabilistic prediction in patient management and clinical trails. Stat Med 5:421–433PubMedCrossRef Spiegelhalter DJ (1986) Probabilistic prediction in patient management and clinical trails. Stat Med 5:421–433PubMedCrossRef
33.
go back to reference Steyerberg EW (2009) Clinical prediction models. a practical approach to development, validation and updating, 1st edn. Springer, New York Steyerberg EW (2009) Clinical prediction models. a practical approach to development, validation and updating, 1st edn. Springer, New York
34.
go back to reference Janssen KJ, Donders AR, Harrell FE Jr, Vergouwe Y, Chen Q, Grobbee DE, Moons KG (2010) Missing covariate data in medical research: to impute is better than to ignore. J Clin Epidemiol 63:721–727PubMedCrossRef Janssen KJ, Donders AR, Harrell FE Jr, Vergouwe Y, Chen Q, Grobbee DE, Moons KG (2010) Missing covariate data in medical research: to impute is better than to ignore. J Clin Epidemiol 63:721–727PubMedCrossRef
35.
go back to reference Donders AR, van der Heijden GJ, Stijnen T, Moons KG (2006) Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 59:1087–1091PubMedCrossRef Donders AR, van der Heijden GJ, Stijnen T, Moons KG (2006) Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 59:1087–1091PubMedCrossRef
36.
go back to reference Rubin DB (1987) Multiple imputation for non response in surveys. Wiley, New YorkCrossRef Rubin DB (1987) Multiple imputation for non response in surveys. Wiley, New YorkCrossRef
37.
go back to reference Harrell FE Jr (2001) Regression modelling strategies. Springer, New York Harrell FE Jr (2001) Regression modelling strategies. Springer, New York
38.
go back to reference Altman DG, Vergouwe Y, Royston P, Moons KG (2009) Prognosis and prognostic research: validating a prognostic model. BMJ 338:b605PubMedCrossRef Altman DG, Vergouwe Y, Royston P, Moons KG (2009) Prognosis and prognostic research: validating a prognostic model. BMJ 338:b605PubMedCrossRef
Metadata
Title
Predicting prolonged intensive care unit stays in older cardiac surgery patients: a validation study
Authors
Roelof G. A. Ettema
Linda M. Peelen
Cor J. Kalkman
Arno P. Nierich
Karel G. M. Moons
Marieke J. Schuurmans
Publication date
01-09-2011
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 9/2011
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-011-2314-1

Other articles of this Issue 9/2011

Intensive Care Medicine 9/2011 Go to the issue