Skip to main content
Top
Published in: Critical Care 4/2004

Open Access 01-08-2004 | Research

Performance of six severity-of-illness scores in cancer patients requiring admission to the intensive care unit: a prospective observational study

Authors: Márcio Soares, Flávia Fontes, Joana Dantas, Daniela Gadelha, Paloma Cariello, Flávia Nardes, César Amorim, Luisa Toscano, José R Rocco

Published in: Critical Care | Issue 4/2004

Login to get access

Abstract

Introduction

The aim of this study was to evaluate the performance of five general severity-of-illness scores (Acute Physiology and Chronic Health Evaluation II and III-J, the Simplified Acute Physiology Score II, and the Mortality Probability Models at admission and at 24 hours of intensive care unit [ICU] stay), and to validate a specific score – the ICU Cancer Mortality Model (CMM) – in cancer patients requiring admission to the ICU.

Methods

A prospective observational cohort study was performed in an oncological medical/surgical ICU in a Brazilian cancer centre. Data were collected over the first 24 hours of ICU stay. Discrimination was assessed by area under the receiver operating characteristic curves and calibration was done using Hosmer–Lemeshow goodness-of-fit H-tests.

Results

A total of 1257 consecutive patients were included over a 39-month period, and 715 (56.9%) were scheduled surgical patients. The observed hospital mortality was 28.6%. Two performance analyses were carried out: in the first analysis all patients were studied; and in the second, scheduled surgical patients were excluded in order to better compare CMM and general prognostic scores. The results of the two analyses were similar. Discrimination was good for all of the six studied models and best for Simplified Acute Physiology Score II and Acute Physiology and Chronic Health Evaluation III-J. However, calibration was uniformly insufficient (P < 0.001). General scores significantly underestimated mortality (in comparison with the observed mortality); this was in contrast to the CMM, which tended to overestimate mortality.

Conclusion

None of the model scores accurately predicted outcome in the present group of critically ill cancer patients. In addition, there was no advantage of CMM over the other general models.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schapira DV, Studinicki J, Bradham DD, Wolff P, Jarrett A: Intensive care, survival, and expense of treating critically ill cancer patients. JAMA 1993, 269: 783-786. 10.1001/jama.269.6.783CrossRefPubMed Schapira DV, Studinicki J, Bradham DD, Wolff P, Jarrett A: Intensive care, survival, and expense of treating critically ill cancer patients. JAMA 1993, 269: 783-786. 10.1001/jama.269.6.783CrossRefPubMed
3.
go back to reference Azoulay E, Pochard F, Chevret S, Vinsonneau C, Garrouste M, Cohen Y, Thuong M, Paugam C, Apperre C, De Cagny B, Brun F, Bornstain C, Parrot A, Thamion F, Lacherade JC, Bouffard Y, Le Gall J-R, Herve C, Grassin M, Zittoun R, Schlemmer B, Dhainaut JF, for the PROTOCETIC Group: Compliance with triage to intensive care recommendations. Crit Care Med 2001, 29: 2132-2136. 10.1097/00003246-200111000-00014CrossRefPubMed Azoulay E, Pochard F, Chevret S, Vinsonneau C, Garrouste M, Cohen Y, Thuong M, Paugam C, Apperre C, De Cagny B, Brun F, Bornstain C, Parrot A, Thamion F, Lacherade JC, Bouffard Y, Le Gall J-R, Herve C, Grassin M, Zittoun R, Schlemmer B, Dhainaut JF, for the PROTOCETIC Group: Compliance with triage to intensive care recommendations. Crit Care Med 2001, 29: 2132-2136. 10.1097/00003246-200111000-00014CrossRefPubMed
4.
go back to reference Benoit DD, Wandewoude KH, Decruyenaere JM, Hoste EA, Colardyn FA: Outcome and early prognostic indicators in patients with a hematologic malignancy admitted to the intensive care unit for a life-threatening complication. Crit Care Med 2003, 31: 104-112. 10.1097/00003246-200301000-00017CrossRefPubMed Benoit DD, Wandewoude KH, Decruyenaere JM, Hoste EA, Colardyn FA: Outcome and early prognostic indicators in patients with a hematologic malignancy admitted to the intensive care unit for a life-threatening complication. Crit Care Med 2003, 31: 104-112. 10.1097/00003246-200301000-00017CrossRefPubMed
5.
go back to reference Staudinger T, Stoiser B, Mullner M, Locker GJ, Laczika K, Knapp S, Burgmann H, Wilfing A, Kofler J, Thalhammer F, Frass M: Outcome and prognostic factors in critically ill cancer patients admitted to the intensive care unit. Crit Care Med 2000, 28: 1322-1328. 10.1097/00003246-200005000-00011CrossRefPubMed Staudinger T, Stoiser B, Mullner M, Locker GJ, Laczika K, Knapp S, Burgmann H, Wilfing A, Kofler J, Thalhammer F, Frass M: Outcome and prognostic factors in critically ill cancer patients admitted to the intensive care unit. Crit Care Med 2000, 28: 1322-1328. 10.1097/00003246-200005000-00011CrossRefPubMed
6.
go back to reference Watcher RM, Luce JM, Hearst N, Lo B: Decisions about resuscitation: inequities among patients with different diseases but similar prognoses. Ann Intern Med 1989, 111: 525-532.CrossRef Watcher RM, Luce JM, Hearst N, Lo B: Decisions about resuscitation: inequities among patients with different diseases but similar prognoses. Ann Intern Med 1989, 111: 525-532.CrossRef
7.
go back to reference Tanvetyanon T, Leighton JC: Life-sustaining treatments in patients who died of chronic congestive heart failure compared with metastatic cancer. Crit Care Med 2003, 31: 60-64. 10.1097/00003246-200301000-00009CrossRefPubMed Tanvetyanon T, Leighton JC: Life-sustaining treatments in patients who died of chronic congestive heart failure compared with metastatic cancer. Crit Care Med 2003, 31: 60-64. 10.1097/00003246-200301000-00009CrossRefPubMed
8.
go back to reference Kress JP, Christenson J, Pohlman AS, Linkin DR, Hall JB: Outcomes of critically ill cancer patients in a university hospital setting. Am J Respir Crit Care Med 1999, 160: 1957-1961.CrossRefPubMed Kress JP, Christenson J, Pohlman AS, Linkin DR, Hall JB: Outcomes of critically ill cancer patients in a university hospital setting. Am J Respir Crit Care Med 1999, 160: 1957-1961.CrossRefPubMed
9.
go back to reference Groeger JS, Lemeshow S, Price K, Nierman DM, White P, Klar J, Granovsky S, Horak D, Kish SK: Multicenter outcome study of cancer patients admitted to the intensive care unit: a probability of mortality model. J Clin Oncol 1998, 16: 761-770.PubMed Groeger JS, Lemeshow S, Price K, Nierman DM, White P, Klar J, Granovsky S, Horak D, Kish SK: Multicenter outcome study of cancer patients admitted to the intensive care unit: a probability of mortality model. J Clin Oncol 1998, 16: 761-770.PubMed
10.
go back to reference Azoulay E, Moreau D, Aberti C, Leleu G, Adrie C, Barboteu M, Cottu P, Levy V, Le Gall J-R, Schlemmer B: Predictors of short-term mortality in critically ill patients with solid malignancies. Intensive Care Med 2000, 26: 1817-1823. 10.1007/s001340051350CrossRefPubMed Azoulay E, Moreau D, Aberti C, Leleu G, Adrie C, Barboteu M, Cottu P, Levy V, Le Gall J-R, Schlemmer B: Predictors of short-term mortality in critically ill patients with solid malignancies. Intensive Care Med 2000, 26: 1817-1823. 10.1007/s001340051350CrossRefPubMed
11.
go back to reference Maschmeyer G, Bertschat FL, Moesta KT, Häusler E, Held TK, Nolte M, Osterziel K-J, Papstein V, Peters M, Reich G, Schmutzler M, Sezer O, Stula M, Wauer H, Wörtz T, Wischnewsky M, Hohenberger P: Outcome analysis of 189 consecutive cancer patients referred to the intensive care unit as emergencies during a 2-year period. Eur J Cancer 2003, 39: 783-792. 10.1016/S0959-8049(03)00004-2CrossRefPubMed Maschmeyer G, Bertschat FL, Moesta KT, Häusler E, Held TK, Nolte M, Osterziel K-J, Papstein V, Peters M, Reich G, Schmutzler M, Sezer O, Stula M, Wauer H, Wörtz T, Wischnewsky M, Hohenberger P: Outcome analysis of 189 consecutive cancer patients referred to the intensive care unit as emergencies during a 2-year period. Eur J Cancer 2003, 39: 783-792. 10.1016/S0959-8049(03)00004-2CrossRefPubMed
12.
go back to reference Lemeshow S, Klar J, Teres D: Outcome prediction for individual intensive care patients: useful, misused, or abused. Intensive Care Med 1995, 21: 770-776.CrossRefPubMed Lemeshow S, Klar J, Teres D: Outcome prediction for individual intensive care patients: useful, misused, or abused. Intensive Care Med 1995, 21: 770-776.CrossRefPubMed
13.
go back to reference Knaus WA, Wagner DP, Zimmerman JE, Draper EA: Variations of mortality and length of stay in intensive care units. Ann Intern Med 1993, 118: 753-761.CrossRefPubMed Knaus WA, Wagner DP, Zimmerman JE, Draper EA: Variations of mortality and length of stay in intensive care units. Ann Intern Med 1993, 118: 753-761.CrossRefPubMed
14.
go back to reference Zhu B-P, Lemeshow S, Hosmer DW, Klar J, Avrunin J, Teres D: Factors affecting the performance of the models in the Mortality Probability Model II system and strategies of customization. A simulation study. Crit Care Med 1996, 24: 57-63. 10.1097/00003246-199601000-00011CrossRefPubMed Zhu B-P, Lemeshow S, Hosmer DW, Klar J, Avrunin J, Teres D: Factors affecting the performance of the models in the Mortality Probability Model II system and strategies of customization. A simulation study. Crit Care Med 1996, 24: 57-63. 10.1097/00003246-199601000-00011CrossRefPubMed
15.
go back to reference Guiguet M, Blot F, Escudier B, Antoun S, Leclercq B, Nitenberg G: Severity-of-illness scores for neutropenic cancer patients in an intensive care unit. Which is the best predictor? Do multiple assessment times improve the predictive value? Crit Care Med 1998, 26: 488-493. 10.1097/00003246-199803000-00020CrossRefPubMed Guiguet M, Blot F, Escudier B, Antoun S, Leclercq B, Nitenberg G: Severity-of-illness scores for neutropenic cancer patients in an intensive care unit. Which is the best predictor? Do multiple assessment times improve the predictive value? Crit Care Med 1998, 26: 488-493. 10.1097/00003246-199803000-00020CrossRefPubMed
16.
go back to reference Sculier J-P, Paesmans M, Markiewicz E, Berghmans T: Scoring systems in cancer patients admitted for an acute complication in a medical intensive care unit. Crit Care Med 2000, 28: 2786-2792. 10.1097/00003246-200008000-00018CrossRefPubMed Sculier J-P, Paesmans M, Markiewicz E, Berghmans T: Scoring systems in cancer patients admitted for an acute complication in a medical intensive care unit. Crit Care Med 2000, 28: 2786-2792. 10.1097/00003246-200008000-00018CrossRefPubMed
17.
go back to reference Schellongowski P, Benesch M, Lang T, Traunmüller F, Zauner C, Laczika K, Locker GJ, Frass M, Staudinger T: Comparison of three severity scores for critically ill cancer patients. Intensive Care Med 2004, 30: 430-436. 10.1007/s00134-003-2043-1CrossRefPubMed Schellongowski P, Benesch M, Lang T, Traunmüller F, Zauner C, Laczika K, Locker GJ, Frass M, Staudinger T: Comparison of three severity scores for critically ill cancer patients. Intensive Care Med 2004, 30: 430-436. 10.1007/s00134-003-2043-1CrossRefPubMed
18.
go back to reference Bastos PG, Sun X, Wagner DP, Wu AW, Knaus WA: Glasgow Coma Scale in the evaluation of outcome in the intensive care unit: findings from the Acute Physiology and Chronic Health Evaluation III study. Crit Care Med 1993, 21: 1459-1465.CrossRefPubMed Bastos PG, Sun X, Wagner DP, Wu AW, Knaus WA: Glasgow Coma Scale in the evaluation of outcome in the intensive care unit: findings from the Acute Physiology and Chronic Health Evaluation III study. Crit Care Med 1993, 21: 1459-1465.CrossRefPubMed
19.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985, 13: 818-829.CrossRefPubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985, 13: 818-829.CrossRefPubMed
20.
go back to reference Zubrod CG, Schneiderman M, Frei III E, Brindley C, Gold GL, Shnider B, Oviedo R, Gorman J, Jones R Jr, Jonsson U, Colsky J, Chalmers T, Ferguson B, Dederick M, Holland J, Selawry O, Regelson W, Lasagna L, Owens AH Jr: Appraisal of methods for the study of chemotherapy of cancer in man: comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramide. J Chron Dis 1960, 11: 7-33.CrossRef Zubrod CG, Schneiderman M, Frei III E, Brindley C, Gold GL, Shnider B, Oviedo R, Gorman J, Jones R Jr, Jonsson U, Colsky J, Chalmers T, Ferguson B, Dederick M, Holland J, Selawry O, Regelson W, Lasagna L, Owens AH Jr: Appraisal of methods for the study of chemotherapy of cancer in man: comparative therapeutic trial of nitrogen mustard and triethylene thiophosphoramide. J Chron Dis 1960, 11: 7-33.CrossRef
21.
go back to reference Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart CK, Suter PM, Thijs LG: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 1996, 22: 707-710. 10.1007/s001340050156CrossRefPubMed Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart CK, Suter PM, Thijs LG: The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 1996, 22: 707-710. 10.1007/s001340050156CrossRefPubMed
22.
go back to reference Le Gall J-R, Lemeshow S, Saulnier F: A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270: 2957-2963. 10.1001/jama.270.24.2957CrossRefPubMed Le Gall J-R, Lemeshow S, Saulnier F: A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA 1993, 270: 2957-2963. 10.1001/jama.270.24.2957CrossRefPubMed
23.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality probability models (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993, 270: 2478-2486. 10.1001/jama.270.20.2478CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality probability models (MPM II) based on an international cohort of intensive care unit patients. JAMA 1993, 270: 2478-2486. 10.1001/jama.270.20.2478CrossRefPubMed
24.
go back to reference Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A, Harrel FE: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100: 1619-1636.CrossRefPubMed Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A, Harrel FE: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991, 100: 1619-1636.CrossRefPubMed
25.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under receiver operating characteristic (ROC) curve. Radiology 1982, 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under receiver operating characteristic (ROC) curve. Radiology 1982, 143: 29-36.CrossRefPubMed
26.
go back to reference Lemeshow S, Hosmer DW: A review of goodness of fit statistics for use in the development of logistic regression model. Am J Epidemiol 1982, 115: 92-106.PubMed Lemeshow S, Hosmer DW: A review of goodness of fit statistics for use in the development of logistic regression model. Am J Epidemiol 1982, 115: 92-106.PubMed
27.
go back to reference Moreno R, Matos R: The 'new' scores: what problems have been fixed, and what remain? Curr Opin Crit Care 2000, 6: 158-165. 10.1097/00075198-200006000-00003CrossRef Moreno R, Matos R: The 'new' scores: what problems have been fixed, and what remain? Curr Opin Crit Care 2000, 6: 158-165. 10.1097/00075198-200006000-00003CrossRef
28.
go back to reference Lloyd-Thomas AR, Wright I, Lister TA, Hinds CJ: Prognosis of patients receiving intensive care for lifethreatening medical complications of haematological malignancy. BMJ 1988, 296: 1025-1029.PubMedCentralCrossRefPubMed Lloyd-Thomas AR, Wright I, Lister TA, Hinds CJ: Prognosis of patients receiving intensive care for lifethreatening medical complications of haematological malignancy. BMJ 1988, 296: 1025-1029.PubMedCentralCrossRefPubMed
29.
go back to reference Giangiuliani G, Gui D, Bonatti P, Tozzi P, Caracciolo F: APACHE II in surgical lung carcinoma patients. Chest 1990, 98: 627-630.CrossRefPubMed Giangiuliani G, Gui D, Bonatti P, Tozzi P, Caracciolo F: APACHE II in surgical lung carcinoma patients. Chest 1990, 98: 627-630.CrossRefPubMed
30.
go back to reference Abbott RR, Setter M, Chan S, Choi K: APACHE II: prediction of outcome of 451 ICU oncology admissions in a community hospital. Ann Oncol 1991, 2: 571-574.PubMed Abbott RR, Setter M, Chan S, Choi K: APACHE II: prediction of outcome of 451 ICU oncology admissions in a community hospital. Ann Oncol 1991, 2: 571-574.PubMed
31.
go back to reference Headley J, Theriault R, Smith TL: Independent validation of APACHE II severity of illness score for predicting mortality in patients with breast cancer admitted to the intensive care unit. Cancer 1992, 70: 497-503.CrossRefPubMed Headley J, Theriault R, Smith TL: Independent validation of APACHE II severity of illness score for predicting mortality in patients with breast cancer admitted to the intensive care unit. Cancer 1992, 70: 497-503.CrossRefPubMed
32.
go back to reference Van le L, Fakhry S, Walton LA, Moore DH, Fowler WC, Rutledge R: Use of the APACHE II scoring system to determine mortality of gynecologic oncology patients in the intensive care unit. Obstet Gynecol 1995, 85: 53-56. 10.1016/0029-7844(94)00308-ZCrossRefPubMed Van le L, Fakhry S, Walton LA, Moore DH, Fowler WC, Rutledge R: Use of the APACHE II scoring system to determine mortality of gynecologic oncology patients in the intensive care unit. Obstet Gynecol 1995, 85: 53-56. 10.1016/0029-7844(94)00308-ZCrossRefPubMed
33.
go back to reference Groeger JS, White P Jr, Nierman DM, Glassman J, Shi W, Horak D, Price K: Outcome for cancer patients requiring mechanical ventilation. J Clin Oncol 1999, 17: 991-997.PubMed Groeger JS, White P Jr, Nierman DM, Glassman J, Shi W, Horak D, Price K: Outcome for cancer patients requiring mechanical ventilation. J Clin Oncol 1999, 17: 991-997.PubMed
34.
go back to reference Massion PB, Dive AM, Doyen C, Bulpa P, Jamart J, Bosly A, Installé E: Prognosis of hematologic malignancies does not predict intensive care unit mortality. Crit Care Med 2002, 30: 2260-2270. 10.1097/00003246-200210000-00014CrossRefPubMed Massion PB, Dive AM, Doyen C, Bulpa P, Jamart J, Bosly A, Installé E: Prognosis of hematologic malignancies does not predict intensive care unit mortality. Crit Care Med 2002, 30: 2260-2270. 10.1097/00003246-200210000-00014CrossRefPubMed
35.
go back to reference Price KJ, Thall PF, Kish SK, Shannon VR, Andersson BS: Prognostic indicators for blood and marrow transplant patients admitted to an intensive care unit. Am J Respir Crit Care Med 1998, 158: 876-884.CrossRefPubMed Price KJ, Thall PF, Kish SK, Shannon VR, Andersson BS: Prognostic indicators for blood and marrow transplant patients admitted to an intensive care unit. Am J Respir Crit Care Med 1998, 158: 876-884.CrossRefPubMed
36.
go back to reference Bach PB, Schrag D, Nierman DM, Horak D, White P Jr, Young JW, Groeger JS: Identification of poor prognostic features among patients requiring mechanical ventilation after hematopoietic stem cell transplantation. Blood 2001, 98: 3234-3240. 10.1182/blood.V98.12.3234CrossRefPubMed Bach PB, Schrag D, Nierman DM, Horak D, White P Jr, Young JW, Groeger JS: Identification of poor prognostic features among patients requiring mechanical ventilation after hematopoietic stem cell transplantation. Blood 2001, 98: 3234-3240. 10.1182/blood.V98.12.3234CrossRefPubMed
37.
go back to reference Azoulay E, Pochard F, Garrouste-Orgeas M, Moreau D, Montesino L, Adrie C, de Lassence A, Cohen Y, Timsit J-F: Decisions to forgo life-sustaining therapy in ICU patients independently predict hospital death. Intensive Care Med 2003, 29: 1895-1901. 10.1007/s00134-003-1989-3CrossRefPubMed Azoulay E, Pochard F, Garrouste-Orgeas M, Moreau D, Montesino L, Adrie C, de Lassence A, Cohen Y, Timsit J-F: Decisions to forgo life-sustaining therapy in ICU patients independently predict hospital death. Intensive Care Med 2003, 29: 1895-1901. 10.1007/s00134-003-1989-3CrossRefPubMed
38.
go back to reference Moreno R, Matos R: Outcome prediction in intensive care. Solving the paradox. Intensive Care Med 2001, 27: 962-964. 10.1007/s001340100956CrossRefPubMed Moreno R, Matos R: Outcome prediction in intensive care. Solving the paradox. Intensive Care Med 2001, 27: 962-964. 10.1007/s001340100956CrossRefPubMed
Metadata
Title
Performance of six severity-of-illness scores in cancer patients requiring admission to the intensive care unit: a prospective observational study
Authors
Márcio Soares
Flávia Fontes
Joana Dantas
Daniela Gadelha
Paloma Cariello
Flávia Nardes
César Amorim
Luisa Toscano
José R Rocco
Publication date
01-08-2004
Publisher
BioMed Central
Published in
Critical Care / Issue 4/2004
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc2870

Other articles of this Issue 4/2004

Critical Care 4/2004 Go to the issue