Skip to main content
Top
Published in: Intensive Care Medicine 10/2005

Open Access 01-10-2005 | Original

SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description

Authors: Philipp G. H. Metnitz, Rui P. Moreno, Eduardo Almeida, Barbara Jordan, Peter Bauer, Ricardo Abizanda Campos, Gaetano Iapichino, David Edbrooke, Maurizia Capuzzo, Jean-Roger Le Gall, on behalf of the SAPS 3 Investigators

Published in: Intensive Care Medicine | Issue 10/2005

Login to get access

Abstract

Objective

Risk adjustment systems now in use were developed more than a decade ago and lack prognostic performance. Objective of the SAPS 3 study was to collect data about risk factors and outcomes in a heterogeneous cohort of intensive care unit (ICU) patients, in order to develop a new, improved model for risk adjustment.

Design

Prospective multicentre, multinational cohort study.

Patients and setting

A total of 19,577 patients consecutively admitted to 307 ICUs from 14 October to 15 December 2002.

Measurements and results

Data were collected at ICU admission, on days 1, 2 and 3, and the last day of the ICU stay. Data included sociodemographics, chronic conditions, diagnostic information, physiological derangement at ICU admission, number and severity of organ dysfunctions, length of ICU and hospital stay, and vital status at ICU and hospital discharge. Data reliability was tested with use of kappa statistics and intraclass-correlation coefficients, which were >0.85 for the majority of variables. Completeness of the data was also satisfactory, with 1 [0–3] SAPS II parameter missing per patient. Prognostic performance of the SAPS II was poor, with significant differences between observed and expected mortality rates for the overall cohort and four (of seven) defined regions, and poor calibration for most tested subgroups.

Conclusions

The SAPS 3 study was able to provide a high-quality multinational database, reflecting heterogeneity of current ICU case-mix and typology. The poor performance of SAPS II in this cohort underscores the need for development of a new risk adjustment system for critically ill patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE. (1981) APACHE—acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med 9:591–597PubMed Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE. (1981) APACHE—acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med 9:591–597PubMed
2.
go back to reference Le Gall J-R, Loirat P, Alperovitch A. (1983) Simplified acute physiological score for intensive care patients. Lancet ii:741 Le Gall J-R, Loirat P, Alperovitch A. (1983) Simplified acute physiological score for intensive care patients. Lancet ii:741
3.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE. (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE. (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829PubMed
4.
go back to reference Knaus WA, Wagner DP, Draper EA et al. (1991) The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100:1619–1636PubMed Knaus WA, Wagner DP, Draper EA et al. (1991) The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 100:1619–1636PubMed
5.
go back to reference Le Gall JR, Lemeshow S, Saulnier F. (1993) A new simplified acute physiology score (SAPS II) based on a European / North American multicenter study. JAMA 270:2957–2963PubMed Le Gall JR, Lemeshow S, Saulnier F. (1993) A new simplified acute physiology score (SAPS II) based on a European / North American multicenter study. JAMA 270:2957–2963PubMed
6.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J. (1993) Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 270:2478–2486CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J. (1993) Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA 270:2478–2486CrossRefPubMed
7.
go back to reference Castella X, Artigas A, Bion J, Kari A, The European / North American Severity Study Group. (1995) A comparison of severity of illness scoring systems for intensive care unit patients: results of a multicenter, multinational study. Crit Care Med 23:1327–1335CrossRefPubMed Castella X, Artigas A, Bion J, Kari A, The European / North American Severity Study Group. (1995) A comparison of severity of illness scoring systems for intensive care unit patients: results of a multicenter, multinational study. Crit Care Med 23:1327–1335CrossRefPubMed
8.
go back to reference Bertolini G, D’Amico R, Apolone G et al. Predicting outcome in the intensive care unit using scoring systems: is new better? (1998) A comparison of SAPS and SAPS II in a cohort of 1.393 patients. Med Care 36:1371–1382CrossRefPubMed Bertolini G, D’Amico R, Apolone G et al. Predicting outcome in the intensive care unit using scoring systems: is new better? (1998) A comparison of SAPS and SAPS II in a cohort of 1.393 patients. Med Care 36:1371–1382CrossRefPubMed
9.
go back to reference Organization and management of Intensive Care: a prospective study in 12 European countries. Berlin Heidelberg: Springer-Verlag, 1997 (Reis Miranda D, Ryan DW, Schaufeli WB, Fidler V, eds. vol 29) Organization and management of Intensive Care: a prospective study in 12 European countries. Berlin Heidelberg: Springer-Verlag, 1997 (Reis Miranda D, Ryan DW, Schaufeli WB, Fidler V, eds. vol 29)
10.
go back to reference Moreno R, Miranda DR, Matos R, Fevereiro T. (2001) Mortality after discharge from intensive care: the impact of organ system failure and nursing workload use at discharge. Intensive Care Med 27:999–1004CrossRefPubMed Moreno R, Miranda DR, Matos R, Fevereiro T. (2001) Mortality after discharge from intensive care: the impact of organ system failure and nursing workload use at discharge. Intensive Care Med 27:999–1004CrossRefPubMed
11.
go back to reference Apolone G, D’Amico R, Bertolini G et al. (1996) The performance of SAPS II in a cohort of patients admitted in 99 Italian ICUs: results from the GiViTI. Intensive Care Med 22:1368–1378PubMed Apolone G, D’Amico R, Bertolini G et al. (1996) The performance of SAPS II in a cohort of patients admitted in 99 Italian ICUs: results from the GiViTI. Intensive Care Med 22:1368–1378PubMed
12.
go back to reference Moreno R, Morais P. (1997) Outcome prediction in intensive care: results of a prospective, multicentre, Portuguese study. Intensive Care Med 23:177–186CrossRefPubMed Moreno R, Morais P. (1997) Outcome prediction in intensive care: results of a prospective, multicentre, Portuguese study. Intensive Care Med 23:177–186CrossRefPubMed
13.
go back to reference Moreno R, Reis Miranda D, Fidler V, Van Schilfgaarde R. (1983) Evaluation of two outcome predictors on an independent database. Crit Care Med 1998;26:50–61 Moreno R, Reis Miranda D, Fidler V, Van Schilfgaarde R. (1983) Evaluation of two outcome predictors on an independent database. Crit Care Med 1998;26:50–61
14.
go back to reference Metnitz PG, Valentin A, Vesely H et al. (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197CrossRefPubMed Metnitz PG, Valentin A, Vesely H et al. (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197CrossRefPubMed
15.
go back to reference K Rowan KM, Kerr JH, Major E, McPherson K, Short A, Vessey MP. (1993) Intensive Care Society’s APACHE II study in Britain and Ireland—II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. Br Med J 307:977–981 K Rowan KM, Kerr JH, Major E, McPherson K, Short A, Vessey MP. (1993) Intensive Care Society’s APACHE II study in Britain and Ireland—II: Outcome comparisons of intensive care units after adjustment for case mix by the American APACHE II method. Br Med J 307:977–981
16.
go back to reference Bastos PG, Sun X, Wagner DP, Knaus WA, Zimmerman JE, The Brazil APACHE III Study Group. (1996) Application of the APACHE III prognostic system in Brazilian intensive care units: a prospective multicenter study. Intensive Care Med 22:564–570PubMed Bastos PG, Sun X, Wagner DP, Knaus WA, Zimmerman JE, The Brazil APACHE III Study Group. (1996) Application of the APACHE III prognostic system in Brazilian intensive care units: a prospective multicenter study. Intensive Care Med 22:564–570PubMed
17.
go back to reference Rivera-Fernandez R, Vazquez-Mata G, Bravo M et al. (1998) The Apache III prognostic system: customized mortality predictions for Spanish ICU patients. Intensive Care Med 24:574–581CrossRefPubMed Rivera-Fernandez R, Vazquez-Mata G, Bravo M et al. (1998) The Apache III prognostic system: customized mortality predictions for Spanish ICU patients. Intensive Care Med 24:574–581CrossRefPubMed
18.
go back to reference Zimmerman JE, Wagner DP, Draper EA, Wright L, Alzola C, Knaus WA. (1998) Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med 26:1317–1326CrossRefPubMed Zimmerman JE, Wagner DP, Draper EA, Wright L, Alzola C, Knaus WA. (1998) Evaluation of acute physiology and chronic health evaluation III predictions of hospital mortality in an independent database. Crit Care Med 26:1317–1326CrossRefPubMed
19.
go back to reference Popovich MJ. (2002) If most intensive care units are graduating with honors, is it genuine quality or grade inflation? Crit Care Med 30:2145–2146CrossRefPubMed Popovich MJ. (2002) If most intensive care units are graduating with honors, is it genuine quality or grade inflation? Crit Care Med 30:2145–2146CrossRefPubMed
20.
go back to reference Rowan K. The reliability of case mix measurements in intensive care. (1996) Curr Opin Crit Care 2:209–213 Rowan K. The reliability of case mix measurements in intensive care. (1996) Curr Opin Crit Care 2:209–213
21.
go back to reference Fery-Lemmonier E, Landais P, Kleinknecht D, Brivet F. (1995) Evaluation of severity scoring systems in the ICUs: translation, conversion and definitions ambiguities as a source of inter-observer variability in APACHE II, SAPS, and OSF. Intensive Care Med 21:356–360CrossRefPubMed Fery-Lemmonier E, Landais P, Kleinknecht D, Brivet F. (1995) Evaluation of severity scoring systems in the ICUs: translation, conversion and definitions ambiguities as a source of inter-observer variability in APACHE II, SAPS, and OSF. Intensive Care Med 21:356–360CrossRefPubMed
22.
go back to reference Zhu B-P, Lemeshow S, Hosmer DW, Klarm J, Avrunin J, Teres D. (1996) Factors affecting the performance of the models in the mortality probability model and strategies of customization: a simulation study. Crit Care Med 24:57–63CrossRefPubMed Zhu B-P, Lemeshow S, Hosmer DW, Klarm J, Avrunin J, Teres D. (1996) Factors affecting the performance of the models in the mortality probability model and strategies of customization: a simulation study. Crit Care Med 24:57–63CrossRefPubMed
23.
go back to reference Knaus WA, Sun X, Nystrom PO, Wagner DP. (1992) Evaluation of definitions for sepsis. Chest 101:656–662PubMed Knaus WA, Sun X, Nystrom PO, Wagner DP. (1992) Evaluation of definitions for sepsis. Chest 101:656–662PubMed
24.
go back to reference Alberti C, Brun-Buisson C, Burchardi H, Martin C, Goodman S, Artigas A, Sicignano A, Palazzo M, Moreno R, Boulme R, Lepage E, Le Gall R. (2002) Epidemiology of sepsis and infection in ICU patients from an international multicentre cohort study. Intensive Care Med; 28:108–121 Alberti C, Brun-Buisson C, Burchardi H, Martin C, Goodman S, Artigas A, Sicignano A, Palazzo M, Moreno R, Boulme R, Lepage E, Le Gall R. (2002) Epidemiology of sepsis and infection in ICU patients from an international multicentre cohort study. Intensive Care Med; 28:108–121
25.
go back to reference Azoulay E, Alberti C, Legendre I, Buisson CB, Le Gall JR. (2005) Post-ICU mortality in critically ill infected patients: an international study. Intensive Care Med; 31 (1):56–63 Azoulay E, Alberti C, Legendre I, Buisson CB, Le Gall JR. (2005) Post-ICU mortality in critically ill infected patients: an international study. Intensive Care Med; 31 (1):56–63
26.
go back to reference Fagon J-Y, Chastre J, Novara A, Medioni P, Gilbert C. (1993) Characterization of intensive care unit patients using a model based on the presence or absence of organ dysfunctions and/or infection: the ODIN model. Intensive Care Med 19:137–44CrossRefPubMed Fagon J-Y, Chastre J, Novara A, Medioni P, Gilbert C. (1993) Characterization of intensive care unit patients using a model based on the presence or absence of organ dysfunctions and/or infection: the ODIN model. Intensive Care Med 19:137–44CrossRefPubMed
27.
go back to reference Pollack MM, Alexander SR, Clarke N et al. (1990) Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities. Crit Care Med 19:150–159 Pollack MM, Alexander SR, Clarke N et al. (1990) Improved outcomes from tertiary center pediatric intensive care: a statewide comparison of tertiary and nontertiary care facilities. Crit Care Med 19:150–159
28.
go back to reference Vincent JL, de Mendonca A, Cantraine F et al. (1983) Use of the SOFA score to assess the incidence of organ dysfunction/ failure in intensive care units: results of a multicentric, prospective study. Crit Care Med 1998 26:1793–1800 Vincent JL, de Mendonca A, Cantraine F et al. (1983) Use of the SOFA score to assess the incidence of organ dysfunction/ failure in intensive care units: results of a multicentric, prospective study. Crit Care Med 1998 26:1793–1800
29.
go back to reference Hosmer DW, Lemeshow S. (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Statistics in Medicine 14:2161–2172PubMed Hosmer DW, Lemeshow S. (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Statistics in Medicine 14:2161–2172PubMed
30.
go back to reference Lemeshow S, Hosmer DW (1982) A review of Goodness-of-fit Statistics for Use in the development of logistic regression models. American-J-Epidemiology 115:92–106 Lemeshow S, Hosmer DW (1982) A review of Goodness-of-fit Statistics for Use in the development of logistic regression models. American-J-Epidemiology 115:92–106
31.
go back to reference Hanley JA, McNeil BJ (1981) The Meaning and Use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36 Hanley JA, McNeil BJ (1981) The Meaning and Use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36
32.
go back to reference Miranda DR, Ryan DW, Schaufeli WB, Fidler V (Eds.) Organization and Management of Intensive Care. In: Vincent JL (Ed.) Update in Intensive Care Medicine, Vol. 29. Springer-Verlag Berlin-Heidelberg 1998 Miranda DR, Ryan DW, Schaufeli WB, Fidler V (Eds.) Organization and Management of Intensive Care. In: Vincent JL (Ed.) Update in Intensive Care Medicine, Vol. 29. Springer-Verlag Berlin-Heidelberg 1998
33.
go back to reference Vincent JL. (1999) Forgoing life support in western European intensive care units: the results of an ethical questionnaire. Crit Care Med. 27:1626–33 Vincent JL. (1999) Forgoing life support in western European intensive care units: the results of an ethical questionnaire. Crit Care Med. 27:1626–33
34.
go back to reference Metnitz PhGH, Kopp A, Jordan B, Lang Th. (2004) More interventions do not necessarily improve outcome in critically ill patients. Intensive Care Med 30:1586–1593CrossRefPubMed Metnitz PhGH, Kopp A, Jordan B, Lang Th. (2004) More interventions do not necessarily improve outcome in critically ill patients. Intensive Care Med 30:1586–1593CrossRefPubMed
35.
go back to reference Harrison DA, Lertsithichai P, Brady AR, Carpenter JR, Rowan K. (2004) Winter excess mortality in intensive care in the UK: an analysis of outcome adjusted for patient case mix and unit workload. Intensive Care Med 30:1900–1907CrossRefPubMed Harrison DA, Lertsithichai P, Brady AR, Carpenter JR, Rowan K. (2004) Winter excess mortality in intensive care in the UK: an analysis of outcome adjusted for patient case mix and unit workload. Intensive Care Med 30:1900–1907CrossRefPubMed
36.
go back to reference Bastos PG, Knaus WA, Zimmerman JE, Magalhaes A Jr, Sun X, Wagner DP. (1996) The importance of technology for achieving superior outcomes from intensive care. Brazil APACHE III Study Group. Intensive Care Med 22:664–669PubMed Bastos PG, Knaus WA, Zimmerman JE, Magalhaes A Jr, Sun X, Wagner DP. (1996) The importance of technology for achieving superior outcomes from intensive care. Brazil APACHE III Study Group. Intensive Care Med 22:664–669PubMed
37.
go back to reference Damiano AM, Bergner M, Draper EA, Knaus WA, Wagner DP. (1992) Reliability of a measure of severity of illness: acute physiology and chronic health evaluation. II. J Clin Epidemiol 45:93–101CrossRefPubMed Damiano AM, Bergner M, Draper EA, Knaus WA, Wagner DP. (1992) Reliability of a measure of severity of illness: acute physiology and chronic health evaluation. II. J Clin Epidemiol 45:93–101CrossRefPubMed
38.
go back to reference Chen LM, Martin CM, Morrison TL, Sibbald WJ. (1999) Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med. 27:1999–2004 Chen LM, Martin CM, Morrison TL, Sibbald WJ. (1999) Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med. 27:1999–2004
Metadata
Title
SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description
Authors
Philipp G. H. Metnitz
Rui P. Moreno
Eduardo Almeida
Barbara Jordan
Peter Bauer
Ricardo Abizanda Campos
Gaetano Iapichino
David Edbrooke
Maurizia Capuzzo
Jean-Roger Le Gall
on behalf of the SAPS 3 Investigators
Publication date
01-10-2005
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 10/2005
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-005-2762-6

Other articles of this Issue 10/2005

Intensive Care Medicine 10/2005 Go to the issue