Skip to main content
Top
Published in: Intensive Care Medicine 10/2005

Open Access 01-10-2005 | Original

SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission

Authors: Rui P. Moreno, Philipp G. H. Metnitz, Eduardo Almeida, Barbara Jordan, Peter Bauer, Ricardo Abizanda Campos, Gaetano Iapichino, David Edbrooke, Maurizia Capuzzo, Jean-Roger Le Gall, on behalf of the SAPS 3 Investigators

Published in: Intensive Care Medicine | Issue 10/2005

Login to get access

Abstract

Objective

To develop a model to assess severity of illness and predict vital status at hospital discharge based on ICU admission data.

Design

Prospective multicentre, multinational cohort study.

Patients and setting

A total of 16,784 patients consecutively admitted to 303 intensive care units from 14 October to 15 December 2002.

Measurements and results

ICU admission data (recorded within ±1 h) were used, describing: prior chronic conditions and diseases; circumstances related to and physiologic derangement at ICU admission. Selection of variables for inclusion into the model used different complementary strategies. For cross-validation, the model-building procedure was run five times, using randomly selected four fifths of the sample as a development- and the remaining fifth as validation-set. Logistic regression methods were then used to reduce complexity of the model. Final estimates of regression coefficients were determined by use of multilevel logistic regression. Variables selection and weighting were further checked by bootstraping (at patient level and at ICU level). Twenty variables were selected for the final model, which exhibited good discrimination (aROC curve 0.848), without major differences across patient typologies. Calibration was also satisfactory (Hosmer-Lemeshow goodness-of-fit test Ĥ=10.56, p=0.39, Ĉ=14.29, p=0.16). Customised equations for major areas of the world were computed and demonstrate a good overall goodness-of-fit.

Conclusions

The SAPS 3 admission score is able to predict vital status at hospital discharge with use of data recorded at ICU admission. Furthermore, SAPS 3 conceptually dissociates evaluation of the individual patient from evaluation of the ICU and thus allows them to be assessed at their respective reference levels.
Appendix
Available only for authorised users
Literature
1.
go back to reference Le Gall JR, Lemeshow S, Saulnier F (1993) A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 270:2957–2963PubMed Le Gall JR, Lemeshow S, Saulnier F (1993) A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 270:2957–2963PubMed
2.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J (1993) Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 270:2478–2486CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J (1993) Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 270:2478–2486CrossRefPubMed
3.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMed
4.
go back to reference Knaus WA, Wagner DP, Draper EA et al (1991) The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100:1619–1636PubMed Knaus WA, Wagner DP, Draper EA et al (1991) The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100:1619–1636PubMed
5.
go back to reference Goldstein H (1995) Multilevel statistical models. Arnold, London Goldstein H (1995) Multilevel statistical models. Arnold, London
6.
go back to reference Goldstein H, Spiegelhalter DJ (1996) League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc A 159:385–443 Goldstein H, Spiegelhalter DJ (1996) League tables and their limitations: statistical issues in comparisons of institutional performance. J R Stat Soc A 159:385–443
7.
go back to reference Teres D, Lemeshow S (1993) Using severity measures to describe high performance intensive care units. Crit Care Clin 9:543–554PubMed Teres D, Lemeshow S (1993) Using severity measures to describe high performance intensive care units. Crit Care Clin 9:543–554PubMed
8.
go back to reference Reis Miranda D, Ryan DW, Schaufeli WB, Fidler V (1997) Organization and management of intensive care: a prospective study in 12 European countries. Springer, Berlin Heidelberg New York Reis Miranda D, Ryan DW, Schaufeli WB, Fidler V (1997) Organization and management of intensive care: a prospective study in 12 European countries. Springer, Berlin Heidelberg New York
9.
go back to reference Cleveland WS (1981) LOWESS: a program for smoothing scatterplots by robust locally weighted regression. Am Stat 35:54 Cleveland WS (1981) LOWESS: a program for smoothing scatterplots by robust locally weighted regression. Am Stat 35:54
10.
go back to reference Ridgeway G (1999) The state of boosting. Comput Sci Stat 31:172–181 Ridgeway G (1999) The state of boosting. Comput Sci Stat 31:172–181
11.
go back to reference Hastie T, Tibshirani R, Friedman J (eds) (2001) The elements of statistical learning: data mining, inference, and prediction. Springer, Berlin Heidelberg New York Hastie T, Tibshirani R, Friedman J (eds) (2001) The elements of statistical learning: data mining, inference, and prediction. Springer, Berlin Heidelberg New York
12.
go back to reference Bauer P, Pötscher BM, Hackl P (1988) Model selection by multiple test procedures. Statistics 19:39–44 Bauer P, Pötscher BM, Hackl P (1988) Model selection by multiple test procedures. Statistics 19:39–44
13.
go back to reference Lemeshow S, Hosmer DW (1982) A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed Lemeshow S, Hosmer DW (1982) A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed
14.
go back to reference Hanley J, McNeil B (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36PubMed Hanley J, McNeil B (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36PubMed
15.
go back to reference Zweig MH, Campbell G (1993) Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 39:561–77 (published erratum 39:1589) Zweig MH, Campbell G (1993) Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 39:561–77 (published erratum 39:1589)
16.
go back to reference Moreno R, Apolone G, Reis Miranda D (1998) Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24:40–47CrossRefPubMed Moreno R, Apolone G, Reis Miranda D (1998) Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24:40–47CrossRefPubMed
17.
go back to reference Zimmerman JE, Wagner DP, Draper EA, Wright L, Alzola C, Knaus WA (1998) Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med 26:1317–1326CrossRefPubMed Zimmerman JE, Wagner DP, Draper EA, Wright L, Alzola C, Knaus WA (1998) Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med 26:1317–1326CrossRefPubMed
18.
go back to reference Popovich MJ (2002) If most intensive care units are graduating with honors, is it genuine quality or grade inflation? Crit Care Med 30:2145–2146CrossRefPubMed Popovich MJ (2002) If most intensive care units are graduating with honors, is it genuine quality or grade inflation? Crit Care Med 30:2145–2146CrossRefPubMed
19.
go back to reference Bastos PG, Knaus WA, Zimmerman JE, Magalhães Jr A, Wagner DP, the Brazil APACHE III Study Group (1996) The importance of technology for achieving superior outcomes from intensive care. Intensive Care Med 22:664–669PubMed Bastos PG, Knaus WA, Zimmerman JE, Magalhães Jr A, Wagner DP, the Brazil APACHE III Study Group (1996) The importance of technology for achieving superior outcomes from intensive care. Intensive Care Med 22:664–669PubMed
20.
go back to reference Engoren M, Moreno R, Reis Miranda D (1999) A genetic algorithm to predict hospital mortality in an ICU population. Crit Care Med 27:A52CrossRef Engoren M, Moreno R, Reis Miranda D (1999) A genetic algorithm to predict hospital mortality in an ICU population. Crit Care Med 27:A52CrossRef
21.
go back to reference Nimgaonkar A, Karnad DR, Sudarshan S, Oho-Machado L, Kohane I (2004) Prediction of mortality in an indian intensive care medicine. Comparison between APACHE II and artificial neural networks. Intensive Care Med 30:248–253CrossRefPubMed Nimgaonkar A, Karnad DR, Sudarshan S, Oho-Machado L, Kohane I (2004) Prediction of mortality in an indian intensive care medicine. Comparison between APACHE II and artificial neural networks. Intensive Care Med 30:248–253CrossRefPubMed
22.
go back to reference Clermont G, Kaplan V, Moreno R et al (2004) Dynamic microsimulation to model multiple outcomes in cohorts of critically ill patients. Intensive Care Med 30:2237–2244CrossRefPubMed Clermont G, Kaplan V, Moreno R et al (2004) Dynamic microsimulation to model multiple outcomes in cohorts of critically ill patients. Intensive Care Med 30:2237–2244CrossRefPubMed
23.
go back to reference Moreno R, Apolone G (1997) The impact of different customization strategies in the performance of a general severity score. Crit Care Med 25:2001–2008CrossRefPubMed Moreno R, Apolone G (1997) The impact of different customization strategies in the performance of a general severity score. Crit Care Med 25:2001–2008CrossRefPubMed
24.
go back to reference Metnitz PG, Valentin A, Vesely H et al (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197CrossRefPubMed Metnitz PG, Valentin A, Vesely H et al (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197CrossRefPubMed
25.
go back to reference Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B (2005) SAPS II revisited. Intensive Care Med 31:416–423CrossRefPubMed Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B (2005) SAPS II revisited. Intensive Care Med 31:416–423CrossRefPubMed
26.
go back to reference Rowan KM, Kerr JH, Major E, McPherson K, Short A, Vessey MP (1993) Intensive Care Society’s APACHE II study in Britain and Ireland. II. Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. BMJ 307:977–981PubMed Rowan KM, Kerr JH, Major E, McPherson K, Short A, Vessey MP (1993) Intensive Care Society’s APACHE II study in Britain and Ireland. II. Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. BMJ 307:977–981PubMed
27.
go back to reference Moreno R, Matos R (2001) Outcome prediction in intensive care. Solving the paradox. Intensive Care Med 27:962–964CrossRefPubMed Moreno R, Matos R (2001) Outcome prediction in intensive care. Solving the paradox. Intensive Care Med 27:962–964CrossRefPubMed
28.
go back to reference Bosman RJ, Oudemane van Straaten HM, Zandstra DF (1998) The use of intensive care information systems alters outcome prediction. Intensive Care Med 24:953–958CrossRefPubMed Bosman RJ, Oudemane van Straaten HM, Zandstra DF (1998) The use of intensive care information systems alters outcome prediction. Intensive Care Med 24:953–958CrossRefPubMed
29.
go back to reference Suistomaa M, Kari A, Ruokonen E, Takala J (2000) Sampling rate causes bias in APACHE II and SAPS II scores. Intensive Care Med 26:1773–1778CrossRefPubMed Suistomaa M, Kari A, Ruokonen E, Takala J (2000) Sampling rate causes bias in APACHE II and SAPS II scores. Intensive Care Med 26:1773–1778CrossRefPubMed
30.
go back to reference Boyd O, Grounds M (1994) Can standardized mortality ratio be used to compare quality of intensive care unit performance?. Crit Care Med 22:1706–1708PubMed Boyd O, Grounds M (1994) Can standardized mortality ratio be used to compare quality of intensive care unit performance?. Crit Care Med 22:1706–1708PubMed
31.
go back to reference Rowan K (1996) The reliability of case mix measurements in intensive care. Curr Opin Crit Care 2:209–213 Rowan K (1996) The reliability of case mix measurements in intensive care. Curr Opin Crit Care 2:209–213
Metadata
Title
SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission
Authors
Rui P. Moreno
Philipp G. H. Metnitz
Eduardo Almeida
Barbara Jordan
Peter Bauer
Ricardo Abizanda Campos
Gaetano Iapichino
David Edbrooke
Maurizia Capuzzo
Jean-Roger Le Gall
on behalf of the SAPS 3 Investigators
Publication date
01-10-2005
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 10/2005
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-005-2763-5

Other articles of this Issue 10/2005

Intensive Care Medicine 10/2005 Go to the issue