Skip to main content
Top
Published in: Critical Care 5/2003

Open Access 01-10-2003 | Research

Assessment of six mortality prediction models in patients admitted with severe sepsis and septic shock to the intensive care unit: a prospective cohort study

Authors: Yaseen Arabi, Nehad Al Shirawi, Ziad Memish, Srinivas Venkatesh, Abdullah Al-Shimemeri

Published in: Critical Care | Issue 5/2003

Login to get access

Abstract

Introduction

We conducted the present study to assess the validity of mortality prediction systems in patients admitted to the intensive care unit (ICU) with severe sepsis and septic shock. We included Acute Physiology and Health Evaluation (APACHE) II, Simplified Acute Physiology Score (SAPS) II, Mortality Probability Model (MPM) II0 and MPM II24 in our evaluation. In addition, SAPS II and MPM II24 were customized for septic patients in a previous study, and the customized versions were included in this evaluation.

Materials and method

This cohort, prospective, observational study was conducted in a tertiary care medical/surgical ICU. Consecutive patients meeting the diagnostic criteria for severe sepsis and septic shock during the first 24 hours of ICU admission between March 1999 and August 2001 were included. The data necessary for mortality prediction were collected prospectively as part of the ongoing ICU database. Predicted and actual mortality rates, and standardized mortality ratio were calculated. Calibration was assessed using Lemeshow–Hosmer goodness of fit C-statistic. Discrimination was assessed using receiver operating characteristic curves.

Results

The overall mortality prediction was adequate for all six systems because none of the standardized mortality ratios differed significantly from 1. Calibration was inadequate for APACHE II, SAPS II, MPM II0 and MPM II24. However, the customized version of SAPS II exhibited significantly improved calibration (C-statistic for SAPS II 23.6 [P = 0.003] and for customized SAPS II 11.5 [P = 0.18]). Discrimination was best for customized MPM II24 (area under the receiver operating characteristic curve 0.826), followed by MPM II24 and customized SAPS II.

Conclusion

Although general ICU mortality system models had accurate overall mortality prediction, they had poor calibration. Customization of SAPS II and, to a lesser extent, MPM II24 improved calibration. The customized model may be a useful tool when evaluating outcomes in patients with sepsis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rangel-Frausto MS: The epidemiology of bacterial sepsis. Infect Dis Clin North Am. 1999, 13: 299-312.CrossRefPubMed Rangel-Frausto MS: The epidemiology of bacterial sepsis. Infect Dis Clin North Am. 1999, 13: 299-312.CrossRefPubMed
2.
go back to reference Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.CrossRefPubMed Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.CrossRefPubMed
3.
go back to reference Angus DC, Wax RS: Epidemiology of sepsis: an update. Crit Care Med. 2001, suppl: S109-S116. 10.1097/00003246-200107001-00035.CrossRef Angus DC, Wax RS: Epidemiology of sepsis: an update. Crit Care Med. 2001, suppl: S109-S116. 10.1097/00003246-200107001-00035.CrossRef
6.
go back to reference Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ: American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference: definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest. 1992, 101: 1644-1655.CrossRefPubMed Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, Schein RM, Sibbald WJ: American College of Chest Physicians/Society of Critical Care Medicine Consensus Conference: definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest. 1992, 101: 1644-1655.CrossRefPubMed
7.
go back to reference Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G: 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003, 31: 1250-1256. 10.1097/01.CCM.0000050454.01978.3B.CrossRefPubMed Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G: 2001 SCCM/ESICM/ACCP/ATS/SIS International Sepsis Definitions Conference. Crit Care Med. 2003, 31: 1250-1256. 10.1097/01.CCM.0000050454.01978.3B.CrossRefPubMed
8.
go back to reference Friedman G, Silva E, Vincent JL: Has the mortality of septic shock changed with time?. Crit Care Med. 1998, 26: 2078-2086. 10.1097/00003246-199812000-00045.CrossRefPubMed Friedman G, Silva E, Vincent JL: Has the mortality of septic shock changed with time?. Crit Care Med. 1998, 26: 2078-2086. 10.1097/00003246-199812000-00045.CrossRefPubMed
9.
go back to reference Lemeshow S, Le Gall Jr: Modeling the severity of illness of ICU patients. JAMA. 1994, 272: 1049-1055. 10.1001/jama.272.13.1049.CrossRefPubMed Lemeshow S, Le Gall Jr: Modeling the severity of illness of ICU patients. JAMA. 1994, 272: 1049-1055. 10.1001/jama.272.13.1049.CrossRefPubMed
10.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II. A severity of disease classification system. Crit Care Med. 1985, 13: 818-829.CrossRefPubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II. A severity of disease classification system. Crit Care Med. 1985, 13: 818-829.CrossRefPubMed
11.
go back to reference Le Gall J-R, Lemeshow S, Saulnier F: A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multi center study. JAMA. 1993, 270: 2957-2962. 10.1001/jama.270.24.2957.CrossRefPubMed Le Gall J-R, Lemeshow S, Saulnier F: A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multi center study. JAMA. 1993, 270: 2957-2962. 10.1001/jama.270.24.2957.CrossRefPubMed
12.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPM II) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed
13.
go back to reference Suistomaa M, Niskanen M, Kari A, Hynynen M, Takala J: Customized prediction models based on APACHE II and SAPS II scores in patients with prolonged length of stay in the ICU. Intensive Care Med. 2002, 28: 479-485. 10.1007/s00134-002-1214-9.CrossRefPubMed Suistomaa M, Niskanen M, Kari A, Hynynen M, Takala J: Customized prediction models based on APACHE II and SAPS II scores in patients with prolonged length of stay in the ICU. Intensive Care Med. 2002, 28: 479-485. 10.1007/s00134-002-1214-9.CrossRefPubMed
14.
go back to reference Angus DC, Clermont G, Kramer DJ, Linde-Zwirble WT, Pinsky MR: Short-term and long-term outcome prediction with the Acute Physiology and Chronic Health Evaluation II in System after orthotopic liver transplantation. Crit Care Med. 2000, 28: 150-156. 10.1097/00003246-200001000-00025.CrossRefPubMed Angus DC, Clermont G, Kramer DJ, Linde-Zwirble WT, Pinsky MR: Short-term and long-term outcome prediction with the Acute Physiology and Chronic Health Evaluation II in System after orthotopic liver transplantation. Crit Care Med. 2000, 28: 150-156. 10.1097/00003246-200001000-00025.CrossRefPubMed
15.
go back to reference LeGall JR, Lemeshow S, Leleug , Klar J, Huillard J, Rui M, Teres D, Artigas A: Customized probability models for early severe sepsis in adult intensive care patients. JAMA. 1995, 273: 644-650.CrossRef LeGall JR, Lemeshow S, Leleug , Klar J, Huillard J, Rui M, Teres D, Artigas A: Customized probability models for early severe sepsis in adult intensive care patients. JAMA. 1995, 273: 644-650.CrossRef
16.
go back to reference Goldhill DR, Sumner A: Outcome of intensive care patients in a group of British intensive care units. Crit Care Med. 1998, 26: 1337-1345. 10.1097/00003246-199808000-00017.CrossRefPubMed Goldhill DR, Sumner A: Outcome of intensive care patients in a group of British intensive care units. Crit Care Med. 1998, 26: 1337-1345. 10.1097/00003246-199808000-00017.CrossRefPubMed
17.
go back to reference Lemeshow S, Hosmer DW: A Review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982, 115: 92-106.PubMed Lemeshow S, Hosmer DW: A Review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982, 115: 92-106.PubMed
19.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed
20.
go back to reference Barriere SL, Lowry SF: An overview of mortality risk prediction in sepsis. Crit Care Med. 1995, 23: 376-393. 10.1097/00003246-199502000-00026.CrossRefPubMed Barriere SL, Lowry SF: An overview of mortality risk prediction in sepsis. Crit Care Med. 1995, 23: 376-393. 10.1097/00003246-199502000-00026.CrossRefPubMed
21.
go back to reference Bernard GR, Vincent JL, Laterre PF, LaRosa SP, Dhainaut JF, Lopez-Rodriguez A, Steingrub JS, Garber GE, Helterbrand JD, Ely EW, Fisher CJ: Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group. Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med. 2001, 344: 699-709. 10.1056/NEJM200103083441001.CrossRefPubMed Bernard GR, Vincent JL, Laterre PF, LaRosa SP, Dhainaut JF, Lopez-Rodriguez A, Steingrub JS, Garber GE, Helterbrand JD, Ely EW, Fisher CJ: Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group. Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med. 2001, 344: 699-709. 10.1056/NEJM200103083441001.CrossRefPubMed
22.
go back to reference Warren HS, Suffredini AF, Eichacker PQ, Munford RS: Risks and benefits of activated protein C treatment for severe sepsis. N Eng J Med. 2002, 347: 1027-1030. 10.1056/NEJMsb020574.CrossRef Warren HS, Suffredini AF, Eichacker PQ, Munford RS: Risks and benefits of activated protein C treatment for severe sepsis. N Eng J Med. 2002, 347: 1027-1030. 10.1056/NEJMsb020574.CrossRef
23.
go back to reference Brun-Buisson C, Doyon F, Carlet J, Dellamonica P, Gouin F, Lep-outre A, Mercier JC, Offenstadt G, Regnier B: Incidence, risk factors, and outcome of severe sepsis and septic shock in adults. A multicenter prospective study in intensive care units. French ICU Group for Severe Sepsis. JAMA. 1995, 274: 968-974. 10.1001/jama.274.12.968.CrossRefPubMed Brun-Buisson C, Doyon F, Carlet J, Dellamonica P, Gouin F, Lep-outre A, Mercier JC, Offenstadt G, Regnier B: Incidence, risk factors, and outcome of severe sepsis and septic shock in adults. A multicenter prospective study in intensive care units. French ICU Group for Severe Sepsis. JAMA. 1995, 274: 968-974. 10.1001/jama.274.12.968.CrossRefPubMed
24.
go back to reference Salvo I, de Cian W, Musicco M, Langer M, Piadena R, Wolfler A, Montani C, Magni E: The Italian SEPSIS study: preliminary results on the incidence and evolution of SIRS, sepsis, severe sepsis and septic shock. Intensive Care Med. 1995, suppl 2: S244-S249.CrossRef Salvo I, de Cian W, Musicco M, Langer M, Piadena R, Wolfler A, Montani C, Magni E: The Italian SEPSIS study: preliminary results on the incidence and evolution of SIRS, sepsis, severe sepsis and septic shock. Intensive Care Med. 1995, suppl 2: S244-S249.CrossRef
25.
go back to reference Edbrooke DL, Hibbert CL, Kingsley JM, Smith S, Bright NM, Quinn JM: The patient-related costs of care for sepsis patients in a United Kingdom adult general intensive care unit. Crit Care Med. 1999, 27: 1760-1767. 10.1097/00003246-199909000-00010.CrossRefPubMed Edbrooke DL, Hibbert CL, Kingsley JM, Smith S, Bright NM, Quinn JM: The patient-related costs of care for sepsis patients in a United Kingdom adult general intensive care unit. Crit Care Med. 1999, 27: 1760-1767. 10.1097/00003246-199909000-00010.CrossRefPubMed
Metadata
Title
Assessment of six mortality prediction models in patients admitted with severe sepsis and septic shock to the intensive care unit: a prospective cohort study
Authors
Yaseen Arabi
Nehad Al Shirawi
Ziad Memish
Srinivas Venkatesh
Abdullah Al-Shimemeri
Publication date
01-10-2003
Publisher
BioMed Central
Published in
Critical Care / Issue 5/2003
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc2373

Other articles of this Issue 5/2003

Critical Care 5/2003 Go to the issue