Skip to main content
Top
Published in: Intensive Care Medicine 4/2009

01-04-2009 | Original

Austrian validation and customization of the SAPS 3 Admission Score

Authors: Barbara Metnitz, Eva Schaden, Rui Moreno, Jean-Roger Le Gall, Peter Bauer, Philipp G. H. Metnitz, on behalf of the ASDI Study Group

Published in: Intensive Care Medicine | Issue 4/2009

Login to get access

Abstract

Objective

To test the prognostic performance of the SAPS 3 Admission Score in a regional cohort and to empirically test the need and feasibility of regional customization.

Design

Prospective multicenter cohort study.

Patients and setting

Data on a total of 2,060 patients consecutively admitted to 22 intensive care units in Austria from October 2, 2006 to February 28, 2007.

Measurements and results

The database includes basic variables, SAPS 3, length-of-stay and outcome data. The original SAPS 3 Admission Score overestimated hospital mortality in Austrian intensive care patients through all strata of the severity-of-illness. This was true for both available equations, the General and the Central and Western Europe equation. For this reason a customized country-specific model was developed, using cross-validation techniques. This model showed excellent calibration and discrimination in the whole cohort (Hosmer–Lemeshow goodness-of-fit: Ĥ = 4.50, P = 0.922; Ĉ = 5.61, P = 0.847, aROC, 0.82) as well as in the various tested subgroups.

Conclusions

The SAPS 3 Admission Score’s general equation can be seen as a framework for addressing the problem of outcome prediction in the general population of adult ICU patients. For benchmarking purposes, region-specific or country-specific equations seem to be necessary in order to compare ICUs on a similar level.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moreno RP, Metnitz PhGH (2007) Severity of illness scoring systems. Tools for the evaluation of patients and ICUs. In: Parrillo JE, Dellinger RP (eds) Critical care medicine: principles of diagnosis and management in the adult, 3rd edn. Elsevier, Amsterdam Moreno RP, Metnitz PhGH (2007) Severity of illness scoring systems. Tools for the evaluation of patients and ICUs. In: Parrillo JE, Dellinger RP (eds) Critical care medicine: principles of diagnosis and management in the adult, 3rd edn. Elsevier, Amsterdam
2.
go back to reference Moreno R, Morais P (1997) Outcome prediction in intensive care: results of a prospective, multicentre, Portuguese study. Intensive Care Med 23:177–186PubMedCrossRef Moreno R, Morais P (1997) Outcome prediction in intensive care: results of a prospective, multicentre, Portuguese study. Intensive Care Med 23:177–186PubMedCrossRef
3.
go back to reference Metnitz PG, Valentin A, Vesely H, Alberti C, Lang T, Lenz K, Steltzer H, Hiesmayr M (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197PubMedCrossRef Metnitz PG, Valentin A, Vesely H, Alberti C, Lang T, Lenz K, Steltzer H, Hiesmayr M (1999) Prognostic performance and customization of the SAPS II: results of a multicenter Austrian study. Intensive Care Med 25:192–197PubMedCrossRef
4.
go back to reference Metnitz PhGH, Moreno RP, Almeida E, Jordan B, Bauer P, Abizanda-Campos R, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, on behalf of the SAPS 3 investigators (2005) SAPS 3—from evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 31:1336–1344PubMedCrossRef Metnitz PhGH, Moreno RP, Almeida E, Jordan B, Bauer P, Abizanda-Campos R, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, on behalf of the SAPS 3 investigators (2005) SAPS 3—from evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 31:1336–1344PubMedCrossRef
5.
go back to reference Moreno RP, Metnitz PhGH, Almeida E, Jordan B, Bauer P, Abizanda-Campos R, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, on behalf of the SAPS 3 Investigators (2005) SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355PubMedCrossRef Moreno RP, Metnitz PhGH, Almeida E, Jordan B, Bauer P, Abizanda-Campos R, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR, on behalf of the SAPS 3 Investigators (2005) SAPS 3—From evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355PubMedCrossRef
6.
go back to reference Metnitz B, Metnitz PhGH, Bauer P, Valentin A on behalf of the ASDI Study Group (2008) Patient volume affects outcome in critically Ill patients. Wien Klin Wochenschr 120 (in press) Metnitz B, Metnitz PhGH, Bauer P, Valentin A on behalf of the ASDI Study Group (2008) Patient volume affects outcome in critically Ill patients. Wien Klin Wochenschr 120 (in press)
8.
go back to reference Metnitz PhGH, Steltzer H, Popow C, Valentin A, Lenz K, Neumark J, Sagmüller G, Schwameis F, Urschitz M, Hiesmayr M (1997) Definition and evaluation of a documentation standard for intensive care medicine: the ASDI pilot project. Wien Klin Wochenschr 109:132–138PubMed Metnitz PhGH, Steltzer H, Popow C, Valentin A, Lenz K, Neumark J, Sagmüller G, Schwameis F, Urschitz M, Hiesmayr M (1997) Definition and evaluation of a documentation standard for intensive care medicine: the ASDI pilot project. Wien Klin Wochenschr 109:132–138PubMed
9.
go back to reference Miranda DR, De Rijk A, Schaufeli W (1996) Simplified therapeutic interventions scoring system: the TISS-28 items—results from a multicenter study. Crit Care Med 24:64–73PubMedCrossRef Miranda DR, De Rijk A, Schaufeli W (1996) Simplified therapeutic interventions scoring system: the TISS-28 items—results from a multicenter study. Crit Care Med 24:64–73PubMedCrossRef
10.
go back to reference Hosmer DW, Lemeshow S (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Stat Med 14:2161–2172PubMedCrossRef Hosmer DW, Lemeshow S (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Stat Med 14:2161–2172PubMedCrossRef
11.
go back to reference Lemeshow S, Hosmer DW (1982) A review of goodness-of-fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed Lemeshow S, Hosmer DW (1982) A review of goodness-of-fit statistics for use in the development of logistic regression models. Am J Epidemiol 115:92–106PubMed
12.
go back to reference Hanley JA, McNeil BJ (1981) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36 Hanley JA, McNeil BJ (1981) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36
13.
go back to reference Moreno R, Apolone G (1997) The impact of different customization strategies in the performance of a general severity score. Crit Care Med 25:2001–2008PubMedCrossRef Moreno R, Apolone G (1997) The impact of different customization strategies in the performance of a general severity score. Crit Care Med 25:2001–2008PubMedCrossRef
15.
go back to reference Miranda DR, Ryan DW, Schaufeli WB, Fidler V (1998) Organization and management of intensive care. In: Vincent JL (ed) Update in intensive care medicine, vol 29. Springer, Berlin Miranda DR, Ryan DW, Schaufeli WB, Fidler V (1998) Organization and management of intensive care. In: Vincent JL (ed) Update in intensive care medicine, vol 29. Springer, Berlin
16.
go back to reference Metnitz PhGH, Kopp A, Jordan B, Lang Th (2004) More interventions do not necessarily improve outcome in critically ill patients. Intensive Care Med 30:1586–1593PubMedCrossRef Metnitz PhGH, Kopp A, Jordan B, Lang Th (2004) More interventions do not necessarily improve outcome in critically ill patients. Intensive Care Med 30:1586–1593PubMedCrossRef
17.
go back to reference Azoulay E, Jordan B, Sprung C, Timsit JF, Lemaire F, Schlemmer B, Moreno R, Metnitz P (2007) End-of-life practices in intensive care units: worldwide data from the SAPS 3 database. Intensive Care Med 33(Suppl 1):A779 Azoulay E, Jordan B, Sprung C, Timsit JF, Lemaire F, Schlemmer B, Moreno R, Metnitz P (2007) End-of-life practices in intensive care units: worldwide data from the SAPS 3 database. Intensive Care Med 33(Suppl 1):A779
18.
go back to reference Vincent JL (1999) Forgoing life support in western European intensive care units: the results of an ethical questionnaire. Crit Care Med 27:1626–1633PubMedCrossRef Vincent JL (1999) Forgoing life support in western European intensive care units: the results of an ethical questionnaire. Crit Care Med 27:1626–1633PubMedCrossRef
19.
go back to reference Yende S, Kammerer CM, Angus DC (2006) Genetics and proteomics: deciphering gene association studies in critical illness. Crit Care 10:227PubMedCrossRef Yende S, Kammerer CM, Angus DC (2006) Genetics and proteomics: deciphering gene association studies in critical illness. Crit Care 10:227PubMedCrossRef
20.
go back to reference Kellum JA, Angus DC (2003) Genetic variation and risk of sepsis. Minerva Anestesiol 69:245–253PubMed Kellum JA, Angus DC (2003) Genetic variation and risk of sepsis. Minerva Anestesiol 69:245–253PubMed
21.
go back to reference Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839–1844PubMedCrossRef Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839–1844PubMedCrossRef
22.
go back to reference Ledoux, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34 (in press) Ledoux, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34 (in press)
23.
go back to reference Zhu B-P, Lemeshow S, Hosmer DW, Klarm J, Avrunin J, Teres D (1996) Factors affecting the performance of the models in the mortality probability model and strategies of customization: a simulation study. Crit Care Med 24:57–63PubMedCrossRef Zhu B-P, Lemeshow S, Hosmer DW, Klarm J, Avrunin J, Teres D (1996) Factors affecting the performance of the models in the mortality probability model and strategies of customization: a simulation study. Crit Care Med 24:57–63PubMedCrossRef
24.
go back to reference Metnitz PhGH, Vesely H, Valentin A, Lang T, Le Gall JR (2000) Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26:1466–1472PubMedCrossRef Metnitz PhGH, Vesely H, Valentin A, Lang T, Le Gall JR (2000) Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26:1466–1472PubMedCrossRef
Metadata
Title
Austrian validation and customization of the SAPS 3 Admission Score
Authors
Barbara Metnitz
Eva Schaden
Rui Moreno
Jean-Roger Le Gall
Peter Bauer
Philipp G. H. Metnitz
on behalf of the ASDI Study Group
Publication date
01-04-2009
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 4/2009
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-008-1286-2

Other articles of this Issue 4/2009

Intensive Care Medicine 4/2009 Go to the issue