Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Performance on the APACHE II, SAPS II, SOFA and the OHCA score of post-cardiac arrest patients treated with therapeutic hypothermia

  • Jea Yeon Choi,

    Roles Data curation, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Jae Ho Jang ,

    Roles Conceptualization, Methodology, Software, Supervision, Validation, Writing – review & editing

    giljhjang@gmail.com

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Yong Su Lim,

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Jee Yong Jang,

    Roles Data curation, Methodology, Software, Writing – original draft

    Affiliation Department of Emergency Medicine, Mokpo Hankook Hospital, Mokpo, Jeollanam-do, South Korea

  • Gun Lee,

    Roles Project administration, Supervision, Writing – review & editing

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Hyuk Jun Yang,

    Roles Conceptualization, Methodology, Supervision

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Jin Seong Cho,

    Roles Data curation, Formal analysis, Methodology, Software

    Affiliation Department of Emergency Medicine, Gachon University Gil Medical Center, Incheon, South Korea

  • Sung Youl Hyun

    Roles Conceptualization, Methodology, Supervision

    Affiliation Department of Thoracic and Cardiovascular Surgery, Gachon University Gil Medical Center, Incheon, South Korea

Abstract

Objective

This study assessed the ability of the Acute Physiologic and Chronic Health Evaluation (APACHE) II score, Simplified Acute Physiology Score (SAPS) II, Sequential Organ Failure Assessment (SOFA) score, and out-of-hospital cardiac arrest (OHCA) score to predict the outcome of OHCA patients who underwent therapeutic hypothermia (TH).

Methods

This study included OHCA patients treated with TH between January 2010 and December 2013. The APACHE II score, SAPS II, and SOFA score were calculated at the time of admission and 24 h and 48 h after intensive care unit admission. The OHCA score was calculated at the time of admission. The area under the curve (AUC) of the receiver operating characteristic curve and logistic regression analysis were used to evaluate outcome predictability.

Results

Data from a total of 173 patients were included in the analysis. The APACHE II score at 0 h and 48 h, SAPS II at 48 h, and OHCA score had moderate discrimination for mortality (AUC: 0.715, 0.750, 0.720, 0.740). For neurologic outcomes, the APACHE II score at 0 h and 48 h, SAPS II at 0 h and 48 h, and OHCA score showed moderate discrimination (AUC: 0.752, 0.738, 0.771, 0.771, 0.764). The APACHE II score, SAPS II and SOFA score at various time points, in addition to the OHCA score, were independent predictors of mortality and a poor neurologic outcome.

Conclusions

The APACHE II score, SAPS II, SOFA score, and OHCA score have different capabilities in discriminating and estimating hospital mortality and neurologic outcomes. The OHCA score, APACHE II score and SAPS II at time zero and 48 h offer moderate predictive accuracy. Other scores at 0 h and 48 h, except for the SOFA score, are independently associated with 30-day mortality and poor cerebral performance.

Introduction

Cardiac arrest (CA) is a major health problem. The global incidence of emergency medical services (EMS) treated adults for out-of-hospital cardiac arrest (OHCA) is 62 cases per 100,000 persons [1]. As post resuscitation care advanced, the rate of good neurologic outcome in witnessed ventricular tachycardia/ventricular fibrillation arrest was reported to be 59.7–66.5% [2,3]. However, the survival rates of all CA patients remain considerably low. Approximately two-thirds of initially resuscitated patients subsequently die in the hospital. A large number of these in-hospital deaths are due to post-cardiac arrest syndrome involving multiple organs [4]. Even if the patients survive past hospital discharge, many survivors have significant neurological sequela. In two randomized clinical trials, therapeutic hypothermia (TH) has been shown to improve neurological outcomes in adults who remained comatose after initial resuscitation from OHCA [5,6]. TH has been implemented as a standardized treatment for post-resuscitation care after CA [7].

The prediction of neurologic outcomes in comatose resuscitated patients is very important in order to reduce unnecessary costs, facilitate organ donation, and direct counseling with the patients’ families. The severity of illness scoring systems, such as the Acute Physiologic and Chronic Health Evaluation (APACHE) II score [8], Simplified Acute Physiology Score (SAPS) II [9], and Sequential Organ Failure Assessment (SOFA) score [10], were designed to predict in-hospital mortality or severity in critically ill patients. The purpose of these scores is to provide a value that can be averaged for a group of patients, not tell the individual patient's chance of survival. In several recent studies [1114], these scores have been tested on their ability to predict the outcome of post-cardiac arrest patients, and they showed moderate predictive accuracy. Originally, these scores were calculated using the worst values from data collected in the first 24 hours (h) after intensive care unit (ICU) admission and were therefore not immediately available at the time of admission. For this reason, the APACHE III [15] score and SAPS III [16,17] calculated using data available at the time of admission were tested in recent studies [12,13,18]. However, these two scores showed lower predictive accuracy than the APACHE II score and SAPS II. The OHCA score was developed to predict the outcome at the time of ICU admission in resuscitated OHCA patients [19]. This score showed good calibration and high discrimination in predicting poor outcomes [20]. However, all of these scores have been tested without regard to the effects of TH implementation. TH modifies the prognostic accuracy of parameters for outcome prediction [21]. It is unclear whether the use of TH influences the utility of scoring systems for predicting outcome. It is worth evaluating the performance of these scoring systems in a homogeneous group of CA patients who have undergone TH.

The purpose of this investigation was to evaluate the performance of APACHE II score, SAPS II, SOFA score, and OHCA score for predicting the mortality and poor neurologic outcome of OHCA patients who underwent TH.

Materials and methods

Setting

This was a retrospective study conducted at an urban tertiary care academic medical center with 1300 inpatient beds and nearly 100,000 emergency department (ED) visits per year. The study was conducted in the ED and ICU from January 1, 2010 to December 31, 2013.

Population

The study population included all adult (age > 18 years) patients who were admitted to the ICU after OHCA, with successful return of spontaneous resuscitation (ROSC) and underwent TH. CA patients with a primary traumatic etiology and in-hospital cardiac arrest (IHCA) patients were excluded.

Post-resuscitation care

Post-resuscitation care was based on the recommendations and guidelines of the International Liaison Committee on Resuscitation (ILCOR) [4]. The decision on whether to initiate TH was made by the treating physician according to the TH inclusion criteria: 1) successful ROSC from CA; 2) comatose patient (Glasgow coma scale [GCS] of less than or equal to 8); 3) mean arterial pressure of greater than or equal to 60 mmHg with or without the use of vasopressor agents. If the patient did not satisfy the TH indications, TH was not performed. In addition, patients were excluded if the guardian refused treatment because of malignancy with multiple metastases or old age. All patients were given mechanical ventilation, sedatives, analgesics and muscle relaxants during TH. The target temperature of 33°C was induced by either an external or endovascular cooling device in addition to ice packs, 4°C normal saline infusion, and bladder irrigation. External cooling was performed using a water blanket (Blanketrol® II, Cincinnati Sub-Zero Products, OH, USA) or a pad (ArcticGelTM Pads & Arctic Sun® 2000, Medivance, CO, USA). Endovascular cooling was performed using a catheter (Cool Line® Catheter & CoolGard 3000®, ZOLL, MA, USA). After 24 hours of the maintenance phase, rewarming began with a rate of 0.2~0.3°C/h up to 36.0°C, and normothermia was maintained for 72 hours.

Data collection and definitions

Data collected included patient demographic information, comorbid conditions, variables that are necessary for calculating severity scores, mortality and neurologic status at 30 days. CA event data was recorded in the Utstein style [22]. The APACHE II score and SAPS II were originally measured during the first 24 hours after ICU admission but in this study, the APACHE II score, SAPS II, and SOFA score were calculated at the time of admission (0 h), from the admission to the first 24 h (24 h), and from the 24 h to the 48 h (48 h) based on the worst vitals and laboratory findings in each 24-h interval. Initial physiologic values used at 0 h were not included in the calculation at 24 h. If there were any missing data points, they were calculated according to the methodology described by Vincent et al [23]. The GCS, which is included in calculation of the score, used the last value measured before sedation for TH [24]. The OHCA score was calculated based on the initial recorded rhythm, no-flow interval, low-flow interval, serum creatinine, and arterial lactate [19]. The neurologic outcome was measured using cerebral performance category (CPC) score [25]. The CPC score at 30 days after ICU admission was assessed by an ICU doctor via direct examination when the patient stayed in our hospital. The other patients were evaluated by a patient’s caregiver or doctor in the transferred hospital via telephone to define the CPC score at 30 days after CA. Patients were divided into two groups by CPC score. A CPC score of 1 or 2 is considered a good neurologic outcome, while a CPC score of 3, 4, or 5 is considered a poor neurologic outcome [5,6]. The study was approved by the Institutional Review Board at Gachon University Gil Medical Center (IRB No. GCIRB2015-100).

Statistical analysis

Continuous variables were presented as the mean with standard deviation (SD) or the median with inter-quartile range (IQR) according to data distribution. Categorical variables were presented as frequency with percentage. The t-test was used to compare differences between groups when the dependent variable was continuous. A chi-square test was used to examine the association between categorical variables. The discrimination of these scores was assessed using area under the curve (AUC) of the receiver operator characteristic (ROC) curve. An AUC value of 0.9–1.0 indicates excellent, 0.8–0.89 good, 0.7–0.79 moderate, 0.6–0.69 poor and 0.5–0.59 not useful. Multivariate analysis was performed to identify the predictors for mortality and poor neurologic outcome at 30 days. Variables had a p-value of 0.2 or less on univariate analysis entered in the backward stepwise elimination. A p-value less than 0.05 was considered statistically significant. Statistical analysis was performed using SPSS version 18.0 (SPSS, Chicago, IL, USA) and MedCalc program version 12.7.7.0 (MedCalc Software, Mariakerke, Belgium).

Results

Of the 237 patients, 173 were included, and 64 patients with the following conditions were excluded (Fig 1, S1 File). The mean age was 53 years (SD: ±14.8), and 118 patients (68.2%) were male. Baseline characteristics and cardiac arrest data are summarized in Table 1. Hospital mortality within 30 days was 39.9%. Good neurologic outcome at 30 days after ICU admission was recorded in 53 (30.6%) patients. Internal cooling was performed in 74 of 173 patients and external cooling was performed in 99 patients. There was no difference between the survivors/non-survivors (p = 0.301) and good/poor CPC groups (p = 0.226). The median time between cardiac arrest to emergency department arrival was 27 minutes (IQR: 18–86). The median time between emergency department arrival to admission was 113 minutes (IQR: 73–176).

thumbnail
Fig 1. Flow diagram of post-CA patients between January 2010 and December 2013.

https://doi.org/10.1371/journal.pone.0196197.g001

thumbnail
Table 1. Comparison of characteristics of survivors/non-survivors and good/poor CPC groups.

https://doi.org/10.1371/journal.pone.0196197.t001

The serial mean values of each scoring system according to mortality and neurologic outcome are shown in Table 2. When each score was measured over time, there was a significant difference between the survivor and non-survivor groups and between the good CPC and poor CPC groups.

thumbnail
Table 2. APACHE II score, SAPS II, SOFA score, and OHCA score according to time the period with 30-day mortality and neurologic outcome.

https://doi.org/10.1371/journal.pone.0196197.t002

Time-dependent AUC values for each scoring system to predict mortality and poor neurologic outcome at 30 days are shown in Table 3. The APACHE II score at 0-h (AUC: 0.715) and 48-h (AUC: 0.750), SAPS II at 48-h (AUC: 0.720), and OHCA score (AUC: 0.740) had a moderate ability to discriminate survivors from non-survivors. The APACHE II score at 0-h (AUC: 0.752) and 48-h (AUC: 0.738), SAPS II at 0-h (AUC: 0.771) and 48-h (AUC: 0.771), and OHCA score (AUC: 0.764) showed moderate discrimination for poor neurologic outcomes. The SOFA score showed poor discrimination of both mortality and neurologic outcomes. All scores measured at 24-h had poor discrimination. In addition, we analyzed whether mortality and neurologic outcome could be predicted by GCS alone. The initial GCS measured before sedation was not useful for discrimination for mortality (AUC: 0.486, 95% CI: 0.393–0.580, P = 0.773) and poor neurologic outcome (AUC: 0.518, 95% CI: 0.429–0.607, P = 0.688).

thumbnail
Table 3. AUC values for each scoring system to predict 30-day mortality and neurologic outcomes.

https://doi.org/10.1371/journal.pone.0196197.t003

The ROC curves for the APACHE II score, SAPS II, SOFA score, and OHCA score are shown in Fig 2. In predicting mortality, there was no statistical difference of the AUC values between scorings for each time period. In the neurologic outcome prediction, the AUC value of SAPS II measured at 0-h was statistically higher than the AUC value of SOFA score (P = 0.039). The AUC values for the SAPS II and APACHE II score measured at 48-h were statistically higher than the AUC value for the SOFA score (P = 0.001, 0.022).

thumbnail
Fig 2. The ROC curves for severity scores and OHCA score over time.

https://doi.org/10.1371/journal.pone.0196197.g002

Severity scores and OHCA score association at each time point are shown in Table 4. Multivariate logistic regression was performed for each severity scoring system and time interval with other variables. Variables included in the analysis were age, sex, witnessed arrest, comorbidities (diabetes, coronary artery disease, COPD), initial shockable rhythm, cause of cardiac arrest, interval from collapse to ROSC, and initial lactate. As a result, 10 models for mortality and 10 models for poor CPC were performed to predict significant predictors.

thumbnail
Table 4. Multivariate analysis of severity scoring systems with 30-day mortality and poor neurologic outcome.

https://doi.org/10.1371/journal.pone.0196197.t004

In the logistic regression analysis, the APACHE II score (0-h OR: 1.101; 95% CI: 1.024–1.185; 48-h OR: 1.162, 95% CI: 1.052–1.284) and SAPS II (0-h OR: 1.047, 95% CI: 1.010–1.085; 48-h OR: 1.107, 95% CI: 1.056–1.160) were determined to be independent factors in predicting mortality. The APACHE II score (0-h OR: 1.131, 95% CI: 1.019–1.256; 48-h OR: 1.154, 95% CI: 1.034–1.289) and SAPS II (0-h OR: 1.086, 95% CI: 1.033–1.142; 48-h OR: 1.107; 95% CI: 1.052–1.164) were also independently associated with poor neurologic outcomes. The OHCA score was a significant predictor of death and poor CPC.

Discussion

To the best of our knowledge, this is the first study to simultaneously evaluate the performance of different scoring systems, such as the APACHE II score, SAPS II, SOFA score, and OHCA score, in a homogeneous group of OHCA patients who underwent TH. In this investigation, we found that the APACHE II score, SAPS II, and OHCA score had a moderate ability to discriminate outcomes following CA. When examining various severity scores by time, we were able to identify that the scores at certain time points were independently associated with mortality and poor neurologic outcome. It should be emphasized, however, that the scoring systems are intended to predict disease severity and mortality, not to determine patient’s medical management. In clinical settings, this result should not influence the decision to discontinue treatments.

The SAPS II at 48-h and the APACHE II score at 0-h and 48-h time points and the OHCA score were moderate predictors of 30-day mortality. The SAPS II and APACHE II score at 0-h and 48-h time points and the OHCA score were moderate predictors of the 30-day neurologic outcome. The SAPS II and APACHE II score at 24-h and the SOFA score at all time-points were poor predictors. The largest AUC was obtained by the SAPS II at 0 h (AUC: 0.771) and 48 h (AUC: 0.771) for neurologic outcome and the APACHE II score at 48 h (AUC: 0.750) for mortality. In multivariate logistic regression analysis, the SAPS II and APACHE II score at the 0-h and 48-h time points were associated with 30-day mortality and poor neurologic outcome. We also analyzed whether any of the variables except the severity scores were related to mortality or poor CPC. Variables such as cause of CA (non-cardiac origin), interval form collapse to ROSC, initial non-shockable rhythm, and initial lactate level were significant predictors of both mortality and poor neurologic outcome. However, these factors are not included in the calculation of the APACHE II score, SAPS II, and SOFA score. As noted in previous studies [1114], severity scoring systems should be considered to not be specifically developed for CA patients’ evaluation. Pre- and intra-arrest conditions and factors contribute substantially to the severity of the post-cardiac arrest syndrome and on outcomes [26]. If the severity scores, such as the APACHE II score and SAPS II, are increasingly combined with related factors, they may improve predictability of outcome in OHCA patients.

In a study by Donnino et al. [11], the APACHE II score measured at 0 h (AUC: 0.58) was not useful to predict neurologic outcome in OHCA patients. The performance score increased incrementally over the next 24-h (AUC: 0.74), 48-h (AUC: 0.79), and 72-h (AUC: 0.90) time points. However, in our series, the APACHE II score at 0 h (AUC: 0.752) showed moderate discrimination. These differences are explained by the following reasons. First, the GCS score included in the calculation of severity scoring systems in our study was the last measured GCS before sedation for TH. In the study by Livingstan et al. [24], using the GCS recorded before sedation increased the discrimination of APACHE II score. Second, other studies include a heterogeneous group with TH implementation. On the other hand, our study only included patients undergoing TH that may have more effect on results. The differences in the patient groups included in the analysis, the outcome predictability of scoring systems could differ.

The OHCA score incorporates variables available early after ROSC, such as no-flow and low-flow intervals, serum lactate and creatinine levels at admission, and initial cardiac rhythm. Previous validation studies of OHCA score showed a similar good performance in terms of discrimination, which supports the generalizability of the score despite the differences in age, no-flow time, initial rhythm, and the rate of TH. In our study, OHCA score achieved moderate discrimination (AUC: 0.740 for mortality, 0.764 for neurologic outcome) for the 30-day outcome, but it was lower compared with that of previous studies [1820]. In addition to the OHCA score, the Pittsburgh Cardiac Arrest Category (PCAC) was showed AUC of 0.79–0.82 for mortality and functional outcome [27]. This can be due to differences in patient baseline characteristics, emergency medical system, and TH application rate. Specifically, previous studies with high discriminatory performance have only a small percentage (11% and 34%) of TH application compared with 100% in our study. This suggests that TH affects the performance of the OHCA score.

The time-dependent predictive performances of the APACHE II score and SAPS II were moderate at 0 h and 48 h, but the predictability of all scoring systems declined at 24 h. Regarding adjusted OR, the scores at 24 h were not predictors of outcome except for SAPS II at 24 h for mortality. This tendency seems to be due to the effect of TH. Induction of TH usually starts at the time of admission. Parameters needed to calculate scores at 24 h were obtained during the first 24 hours after ICU admission. Parameters obtained in this period may reflect the effect of TH because the target temperature is maintained for 24 hours after induction of TH. TH affects various clinical and laboratory parameters [28]. Mean arterial pressure increases slightly (±10mmHg), and cardiac output decreases due to a decrease in heart rate. In blood samples from hypothermic patients, PO2 and PCO2 are overestimated, while pH is underestimated, and thus metabolic acidosis looks more severe. White blood cells and platelets decrease and hematocrit mildly increases. These physiologic changes generally do not require treatment and also do not affect prognosis. However, the severity scores were changed because these parameters are used to calculate severity scores. It is thought that outcome predictability is reduced when the score is calculated using measured parameters during 24 hour hypothermic treatment.

In our study, survival was 104/173 patients but good CPC occurred in only 53. This is because of many patients with CPC 4 are in the survival group compared with previous studies. The end-of-life decision such as the withdrawal of life-sustaining therapy (WLST) is a very sensitive and difficult problem due to medical, ethical, and economical reasons. In Korea, WLST is not permitted unless the patient is brain death and donate organ. Therefore, comatose resuscitated patients receive intensive care support for prolonged periods compared with Europe and may lead to different outcome of early stage. As a result, discrimination for mortality decreases compared with that for poor neurologic outcome.

This study has several limitations because it was a single-center study and because a sample size calculation was not performed. In addition, the severity scoring was performed within the first 48 hours after ICU admission. As discussed, the effect of hypothermia including rewarming is not resolved within this time. In the case of the APACHE score and SAPS, the temperature variable is included in calculations. In our study, no correction was made for the temperature effect, thus the results may look worse. The TH also affects other variables such as vital signs and laboratory tests’ results, especially the 24-h outcome. The clearance of drugs such as sedatives and muscle relaxants may not have been metabolized within 48 hours due to the influence of TH. If these score calculations were extended to 72 hours after ICU admission, facilitation of the identification of changes in scores over time and clearer determination of the effect of TH would be possible. Finally, although this study is meaningful to analyze only patients who underwent TH, patients who were too unstable initially to be treated with TH were excluded, thus possibly affecting the outcome due to bias.

Conclusions

The OHCA score and most severity scores of different time points, except scores measured at 24 h, are significantly associated with mortality and poor neurologic outcome. The OHCA score, 0-h and 48-h scores of the APACHE II score and SAPS II offer moderate prediction accuracy ability in OHCA patients who underwent TH; however, the SOFA score remained poor. To improve the outcome predictability of CA patients, development of a new scoring system including cardiac arrest-related variables is needed.

Supporting information

S1 File. Data collection of 173 including patients.

General characteristics, data for calculating severity scores at 0, 24, 48-hour and the outcome are shown in the each sheet.

https://doi.org/10.1371/journal.pone.0196197.s001

(XLSX)

References

  1. 1. Berdowski J, Berg RA, Tijssen JG, Koster RW. Global incidences of out-of-hospital cardiac arrest and survival rates: Systematic review of 67 prospective studies. Resuscitation. 2010;81:1479–87. pmid:20828914
  2. 2. Kim F, Nichol G, Maynard C, Hallstrom A, Kudenchuk PJ, Rea T, et al. Effect of prehospital induction of mild hypothermia on survival and neurological status among adults with cardiac arrest: a randomized clinical trial. JAMA. 2014;311:45–52. pmid:24240712
  3. 3. Kirkegaard H, Soreide E, de Haas I, Pettila V, Taccone FS, Arus U, et al. Targeted temperature management for 48 vs 24 hours and neurologic outcome after out-of-hospital cardiac arrest: a randomized clinical trial. JAMA. 2017;318:341–350. pmid:28742911
  4. 4. Nolan JP, Neumar RW, Adrie C, Albiki M, Berg RA, Bottiger BW, et al. Post-cardiac arrest syndrome: Epidemiology, pathophysiology, treatment, and prognostication: A Scientific Statement from the International Liaison Committee on Resuscitation; the American Heart Association Emergency Cardiovascular Care Committee; the Council on Cardiovascular Surgery and Anesthesia; the Council on Cardiopulmonary, Perioperative, and Critical Care; the Council on Clinical Cardiology; the Council on Stroke. Resuscitation. 2008;79:350–79. pmid:18963350
  5. 5. Hypothermia After Cardiac Arrest Study Group. Mild therapeutic hypothermia to improve the neurologic outcome after cardiac arrest. N Engl J Med. 2002;346:549–56. pmid:11856793
  6. 6. Bernard SA, Gray TW, Buist MD, Jones BM, Silvester W, Gutteridge G, et al. Treatment of comatose survivors of out-of-hospital cardiac arrest with induced hypothermia. N Engl J Med. 2002;346:557–63. pmid:11856794
  7. 7. Sunde K, Pytte M, Jacobsen D, Mangschau A, Jensen LP, Smedsrud C. Implementation of a standardised treatment protocol for post resuscitation care after out-of-hospital cardiac arrest. Resuscitation. 2007;73:29–39. pmid:17258378
  8. 8. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: A severity of disease classification system. Crit Care Med. 1985;13:818–29. pmid:3928249
  9. 9. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993;270:2957–63. pmid:8254858
  10. 10. Vincent JL, Moreno R, Takala J, Willatts S, de Mendonca A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–10. pmid:8844239
  11. 11. Donnino MW, Salciccioli JD, Dejam A, Giberson T, Giberson B, Cristia C, et al. APACHE II scoring to predict outcome in post-cardiac arrest. Resuscitation. 2013;84:651–6. pmid:23178739
  12. 12. Bisbal M, Jouve E, Papazian L, de Bourmont S, Gilles P, Eon B, et al. Effectiveness of SAPS III to predict hospital mortality for post-cardiac arrest patients. Resuscitation. 2014;85:939–44. pmid:24704139
  13. 13. Salciccioli JD, Cristia C, Chase M, Gilberson T, Graver A, Gautam S, et al. Performance of SAPS II and SAPS III scores in post-cardiac arrest. Minerva Anestesiol. 2012;78:1341–7. pmid:22743785
  14. 14. Roberts BW, Kilgannon JH, Chansky ME, Mittal N, Wooden J, Parrillo JE, et al. Multiple organ dysfunction after return of spontaneous circulation in postcardiac arrest syndrome. Crit Care Med. 2013;41:1492–501. pmid:23507719
  15. 15. Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991;100:1619–36 pmid:1959406
  16. 16. Mentnitz PG, Moreno RP, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3 –from evaluation of the patient to evaluation of the intensive care unit. Part 1: objectives, methods and cohort description. Intensive Care Med. 2005;31:1336–44. pmid:16132893
  17. 17. Moreno RP, Mentnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3 –from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 2005;31:1345–55 pmid:16132892
  18. 18. Skrifvars MB, Varghese B, Parr MJ. Survival and outcome prediction using the Apache III and out-of-hospital cardiac arrest (OHCA) score in patients treated in the intensive care unit (ICU) following out-of-hospital, in-hospital of ICU cardiac arrest. Resuscitation. 2012;83:728–33. pmid:22281225
  19. 19. Adrie C, Cariou A, Mourvillier B, Laurent I, Dabbane H, Hantala F, et al. Predicting survival with good neurological recovery at hospital admission after successful resuscitation of out-of-hospital cardiac arrest: the OHCA score. Eur Heart J. 2006;27:2840–5. pmid:17082207
  20. 20. Hunziker S, Bivens MJ, Cocchi MN, Miller J, Salciccioli J, Howell MD, et al. International validation of the out-of-hospital cardiac arrest score in the United States. Crit Care Med. 2011;39:1670–4. pmid:21494106
  21. 21. Oddo M, Rossetti AO. Predicting neurological outcome after cardiac arrest. Curr Opin Crit Care. 2011;17:254–9. pmid:21346563
  22. 22. Jacobs I, Nadkarni V, Bahr J, Berg RA, Billi JE, Bossaert L, et al. Cardiac arrest and cardiopulmonary resuscitation outcome reports: update and simplification of the Utstein templates for resuscitation registries. A statement for healthcare professionals from a task of the international liaison committee on resuscitation (American Heart Association, European Resuscitation Council, Australian Resuscitation Council, New Zealand Resuscitation Council, Heart and Stroke Foundation of Canada, Inter American Heart Foundation, Resuscitation Council of Southern Africa). Resuscitation. 2004;63:233–49. pmid:15582757
  23. 23. Vincent JL, de Mendonca A, Cantraine F, Moreno R, Takala J, Suter PM, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units: results of a multicenter, prospective study. Working group on “sepsis-related problems” of the European Society of Intensive Care Medicine. Crit Care Med. 1998;26:1792–800.
  24. 24. Livingston BM, Mackenzie SJ, MacKirdy FN, Howie JC. Should the pre-sedation Glasgow Coma Scale value be used when calculating Acute Physiology and Chronic Health Evaluation scores for sedated patients? Scottish Intensive Care Society Adult Group. Crit Care Med. 2000;28:389–94. pmid:10708172
  25. 25. Jennett B, Bond M. Assessment of outcome after severe brain damage. Lancet. 1975;1:480–4. pmid:46957
  26. 26. Donnino MW, Miller JC, Bivens M, Cocchi MN, Salciccioli JD, Farris S, et al. A pilot study examining the severity and outcome of the post-cardiac arrest syndrome: a comparative analysis of two geographically distinct hospital. Circulation. 2012;126:1478–83. pmid:22879369
  27. 27. Coppler PJ, Elmer J, Calderon L, Sabedra A, Doshi AA, Callaway CW, et al. Validation of the Pittsburgh Cardiac Arrest Category illness severity score. Resuscitation. 2015;89:86–92. pmid:25636896
  28. 28. Polderman KH, Herold I. Therapeutic hypothermia and controlled normothermia in the intensive care unit: practical considerations, side effects, and cooling methods. Crit Care Med. 2009;37(3):1101–20. pmid:19237924