Top

Published in:

01-11-2009 | Original

External validation of the Simplified Acute Physiology Score (SAPS) 3 in a cohort of 28,357 patients from 147 Italian intensive care units

Authors: Daniele Poole, Carlotta Rossi, Abramo Anghileri, Michele Giardino, Nicola Latronico, Danilo Radrizzani, Martin Langer, Guido Bertolini

Published in: Intensive Care Medicine | Issue 11/2009

Abstract

Objective

To evaluate the SAPS 3 score predictive ability of hospital mortality in a large external validation cohort.

Design

Prospective observational study.

Setting and patients

A total of 28,357 patients from 147 Italian ICUs joining the Project Margherita national database of the Gruppo italiano per la Valutazione degli interventi in Terapia Intensiva (GiViTI).

Interventions

None.

Measurement

Evaluation of discrimination through ROC analysis and of overall goodness-of-fit through the Cox calibration test.

Main results

Although discrimination was good, calibration turned out to be poor. The general and the South-Europe Mediterranean countries equations overestimated hospital mortality overall (SMR values 0.73 with 95% CI 0.72–0.75 for both equations) and homogeneously across risk classes. Overprediction was confirmed among important subgroups, with SMR values ranging between 0.47 and 0.82.

Conclusions

The result strictly supported by our data is that the SAPS 3 score calibrates inadequately in a large sample of Italian ICU patients and thus should not be used for benchmarking, at least in Italian settings.

Available only for authorised users

Altman DG, Royston P (2000) What do we mean by validating a prognostic model? Stat Med 19:453–473CrossRefPubMed

Hadorn D, Keeler EB, Rogers WH, Brook HB (1993) Assessing the Performance of Mortality Prediction Models. Final report for HCFA severity project. RAND corporation 2008. http://www.rand.org/pubs/monograph_reports/MR2181/. Accessed on June 2009

Metnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 1: Objectives, methods and cohort description. Intensive Care Med 31:1336–1344CrossRefPubMed

Ledoux D, Canivet JL, Preiser JC, Lefrancq J, Damas P (2008) SAPS 3 admission score: an external validation in a general intensive care population. Intensive Care Med 34:1873–1877CrossRefPubMed

Soares M, Salluh JI (2006) Validation of the SAPS 3 admission prognostic model in patients with cancer in need of intensive care. Intensive Care Med 32:1839–1844CrossRefPubMed

Krauss C, Sakr Y, Amaral A, Rea-Neto A, Specht M, Reinhart K, Marx G (2008) Assessment of the performance of the SAPS 3, SAPS II, and APACHE II prognostic models in a surgical ICU. Crit Care 12(Suppl 2):P502

Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR (2005) SAPS 3–from evaluation of the patient to evaluation of the intensive care unit. Part 2: Development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 31:1345–1355CrossRefPubMed

Moreno R, Apolone G, Miranda DR (1998) Evaluation of the uniformity of fit of general outcome prediction models. Intensive Care Med 24:40–47CrossRefPubMed

Hosmer DW, Lemeshow S (1995) Confidence interval estimates of an index of quality performance based on logistic regression models. Stat Med 14:2161–2172CrossRefPubMed

10.

Kramer AA, Zimmerman JE (2007) Assessing the calibration of mortality benchmarks in critical care: the Hosmer–Lemeshow test revisited. Crit Care Med 35:2052–2056CrossRefPubMed

11.

Bertolini G, D’Amico R, Nardi D, Tinazzi A, Apolone G (2000) One model, several results: the paradox of the Hosmer-Lemeshow goodness-of-fit test for the logistic regression model. J Epidemiol Biostat 5:251–253PubMed

12.

Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K (2006) Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med 34:1378–1388CrossRefPubMed

13.

Hyam JA, Welch CA, Harrison DA, Menon DK (2006) Case mix, outcomes and comparison of risk prediction models for admissions to adult, general and specialist critical care units for head injury: a secondary analysis of the ICNARC Case Mix Programme Database. Crit Care 10(Suppl 2):S2CrossRefPubMed

14.

Seillier-Moiseiwitsch F (1996) Predictive diagnostics for logistic models. Stat Med 15:2149–2160CrossRefPubMed

15.

Cox D (1958) Two further applications of a model for a method of binary regression. Biometrika 45:562–565

16.

Miller ME, Hui SL, Tierney WM (1991) Validation techniques for logistic regression models. Stat Med 10:1213–1226CrossRefPubMed

17.

Boffelli S, Rossi C, Bertolini G (2008) Progetto Margherita—Promuovere la ricerca e la valutazione in Terapia Intensiva. Rapporto 2007. Edizioni Sestante, Bergamo

18.

Zimmerman JE, Kramer AA, McNair DS, Malila FM (2006) Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Crit Care Med 34:1297–1310CrossRefPubMed

19.

Black N (1997) Developing high quality clinical databases. BMJ 315:381–382PubMed

20.

Beck DH, Smith GB, Pappachan JV, Millar B (2003) External validation of the SAPS II, APACHE II and APACHE III prognostic models in South England: a multicentre study. Intensive Care Med 29:249–256PubMed

21.

Aegerter P, Boumendil A, Retbi A, Minvielle E, Dervaux B, Guidet B (2005) SAPS II revisited. Intensive Care Med 31:416–423CrossRefPubMed

22.

Metnitz PG, Lang T, Vesely H, Valentin A, Le Gall JR (2000) Ratios of observed to expected mortality are affected by differences in case mix and quality of care. Intensive Care Med 26:1466–1472CrossRefPubMed

Title: External validation of the Simplified Acute Physiology Score (SAPS) 3 in a cohort of 28,357 patients from 147 Italian intensive care units
Authors: Daniele Poole
Carlotta Rossi
Abramo Anghileri
Michele Giardino
Nicola Latronico
Danilo Radrizzani
Martin Langer
Guido Bertolini
Publication date: 01-11-2009
Publisher: Springer-Verlag
Published in: Intensive Care Medicine / Issue 11/2009
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI: https://doi.org/10.1007/s00134-009-1615-0

Keynote webinar | Spotlight on medication adherence

Springer Medicine

External validation of the Simplified Acute Physiology Score (SAPS) 3 in a cohort of 28,357 patients from 147 Italian intensive care units

Abstract

Objective

Design

Setting and patients

Interventions

Measurement

Main results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Objective

Design

Setting and patients

Interventions

Measurement

Main results

Conclusions

Please log in to get access to this content

Other articles of this Issue 11/2009

Human protein C zymogen concentrate in patients with severe sepsis and multiple organ failure after adult cardiac surgery

Impact of acute hypercapnia and augmented positive end-expiratory pressure on right ventricle function in severe acute respiratory distress syndrome

Bacteraemia following single-stage percutaneous dilatational tracheostomy

Determinants of regional ventilation and blood flow in the lung

The effects of etomidate on adrenal responsiveness and mortality in patients with septic shock

Diagnostic considerations regarding pediatric delirium: a review and a proposal for an algorithm for pediatric intensive care units