Skip to main content
Top
Published in: Critical Care 1/2017

Open Access 01-12-2017 | Research

SOFA and mortality endpoints in randomized controlled trials: a systematic review and meta-regression analysis

Authors: Harm-Jan de Grooth, Irma L. Geenen, Armand R. Girbes, Jean-Louis Vincent, Jean-Jacques Parienti, Heleen M. Oudemans-van Straaten

Published in: Critical Care | Issue 1/2017

Login to get access

Abstract

Background

The sequential organ failure assessment score (SOFA) is increasingly used as an endpoint in intensive care randomized controlled trials (RCTs). Although serially measured SOFA is independently associated with mortality in observational cohorts, the association between treatment effects on SOFA vs. effects on mortality has not yet been quantified in RCTs. The aim of this study was to quantify the relationship between SOFA and mortality in RCTs and to identify which SOFA derivative best reflects between-group mortality differences.

Methods

The review protocol was prospectively registered (Prospero CRD42016034014). We performed a literature search (up to May 1, 2016) for RCTs reporting both SOFA and mortality, and analyzed between-group differences in these outcomes. Treatment effects on SOFA and mortality were calculated as the between-group SOFA standardized difference and log odds ratio (OR), respectively. We used random-effects meta-regression to (1) quantify the linear relationship between RCT treatment effects on mortality (logOR) and SOFA (i.e. responsiveness) and (2) quantify residual heterogeneity (i.e. consistency, expressed as I 2).

Results

Of 110 eligible RCTs, 87 qualified for analysis. Using all RCTs, SOFA was significantly associated with mortality (slope = 0.49 (95% CI 0.17; 0.82), p = 0.006, I 2 = 5%); the overall mortality effect explained by SOFA score (R 2) was 9%. Fifty-eight RCTs used Fixed-day SOFA as an endpoint (i.e. the score on a fixed day after randomization), 25 studies used Delta SOFA as an endpoint (i.e. the trajectory from baseline score) and 15 studies used other SOFA derivatives as an endpoint. Fixed-day SOFA was not significantly associated with mortality (slope = 0.35 (95% CI −0.04; 0.75), p = 0.08, I 2 = 12%) and explained 3% of the overall mortality effect (R 2). Delta SOFA was significantly associated with mortality (slope = 0.70 (95% CI 0.26; 1.14), p = 0.004, I 2 = 0%) and explained 32% of the overall mortality effect (R 2).

Conclusions

Treatment effects on Delta SOFA appear to be reliably and consistently associated with mortality in RCTs. Fixed-day SOFA was the most frequently reported outcome among the reviewed RCTs, but was not significantly associated with mortality. Based on this study, we recommend using Delta SOFA rather than Fixed-day SOFA as an endpoint in future RCTs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–10.CrossRefPubMed Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med. 1996;22:707–10.CrossRefPubMed
2.
go back to reference Moreno R, Vincent JL, Matos R, Mendonça A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis related Problems of the ESICM. Intensive Care Med. 1999;25:686–96.CrossRefPubMed Moreno R, Vincent JL, Matos R, Mendonça A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study. Working Group on Sepsis related Problems of the ESICM. Intensive Care Med. 1999;25:686–96.CrossRefPubMed
3.
go back to reference Ferreira FL, Bota DP, Bross A, Mélot C, Vincent JL. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286:1754–8.CrossRefPubMed Ferreira FL, Bota DP, Bross A, Mélot C, Vincent JL. Serial evaluation of the SOFA score to predict outcome in critically ill patients. JAMA. 2001;286:1754–8.CrossRefPubMed
4.
5.
go back to reference Rubenfeld GD. Surrogate Measures of Patient-centered Outcomes in Critical Care. In: Angus DC, Carlet J, editors. Surviv. Intensive Care. Berlin: Springer; 2003. p. 169–80.CrossRef Rubenfeld GD. Surrogate Measures of Patient-centered Outcomes in Critical Care. In: Angus DC, Carlet J, editors. Surviv. Intensive Care. Berlin: Springer; 2003. p. 169–80.CrossRef
6.
go back to reference International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. ICH Harmonized Tripartite Guideline: Statistical Principles for Clinical Trials E9. 1998. International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use. ICH Harmonized Tripartite Guideline: Statistical Principles for Clinical Trials E9. 1998.
7.
go back to reference Fleming TR, DeMets DL. Surrogate end points in clinical trials: are we being misled? Ann Intern Med. 1996;125:605–13.CrossRefPubMed Fleming TR, DeMets DL. Surrogate end points in clinical trials: are we being misled? Ann Intern Med. 1996;125:605–13.CrossRefPubMed
8.
go back to reference Kassaï B, Shah NR, Leizorovicza A, Cucherat M, Gueyffier F, Boissel J-P. The true treatment benefit is unpredictable in clinical trials using surrogate outcome measured with diagnostic tests. J Clin Epidemiol. 2005;58:1042–51.CrossRefPubMedPubMedCentral Kassaï B, Shah NR, Leizorovicza A, Cucherat M, Gueyffier F, Boissel J-P. The true treatment benefit is unpredictable in clinical trials using surrogate outcome measured with diagnostic tests. J Clin Epidemiol. 2005;58:1042–51.CrossRefPubMedPubMedCentral
10.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17:1–12.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17:1–12.CrossRefPubMed
12.
go back to reference Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 1988;75:383–6.CrossRef Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika. 1988;75:383–6.CrossRef
13.
go back to reference Viechtbauer W. Conducting meta-analyses in R with the metafor Package. J Stat Softw. 2010;36:1–48.CrossRef Viechtbauer W. Conducting meta-analyses in R with the metafor Package. J Stat Softw. 2010;36:1–48.CrossRef
14.
go back to reference Peres Bota D, Melot C, Lopes Ferreira F, Nguyen Ba V, Vincent J-L. The Multiple Organ Dysfunction Score (MODS) versus the Sequential Organ Failure Assessment (SOFA) score in outcome prediction. Intensive Care Med. 2002;28:1619–24.CrossRefPubMed Peres Bota D, Melot C, Lopes Ferreira F, Nguyen Ba V, Vincent J-L. The Multiple Organ Dysfunction Score (MODS) versus the Sequential Organ Failure Assessment (SOFA) score in outcome prediction. Intensive Care Med. 2002;28:1619–24.CrossRefPubMed
15.
go back to reference Timsit J-F, Fosse J-P, Troché G, De Lassence A, Alberti C, Garrouste-Orgeas M, et al. Calibration and discrimination by daily Logistic Organ Dysfunction scoring comparatively with daily Sequential Organ Failure Assessment scoring for predicting hospital mortality in critically ill patients. Crit Care Med. 2002;30:2003–13.CrossRefPubMed Timsit J-F, Fosse J-P, Troché G, De Lassence A, Alberti C, Garrouste-Orgeas M, et al. Calibration and discrimination by daily Logistic Organ Dysfunction scoring comparatively with daily Sequential Organ Failure Assessment scoring for predicting hospital mortality in critically ill patients. Crit Care Med. 2002;30:2003–13.CrossRefPubMed
16.
go back to reference Pettilä V, Pettilä M, Sarna S, Voutilainen P, Takkunen O. Comparison of multiple organ dysfunction scores in the prediction of hospital mortality in the critically ill. Crit Care Med. 2002;30:1705–11.CrossRefPubMed Pettilä V, Pettilä M, Sarna S, Voutilainen P, Takkunen O. Comparison of multiple organ dysfunction scores in the prediction of hospital mortality in the critically ill. Crit Care Med. 2002;30:1705–11.CrossRefPubMed
17.
go back to reference Junger A, Engel J, Benson M, Böttger S, Grabow C, Hartmann B, et al. Discriminative power on mortality of a modified Sequential Organ Failure Assessment score for complete automatic computation in an operative intensive care unit. Crit Care Med. 2002;30:338–42.CrossRefPubMed Junger A, Engel J, Benson M, Böttger S, Grabow C, Hartmann B, et al. Discriminative power on mortality of a modified Sequential Organ Failure Assessment score for complete automatic computation in an operative intensive care unit. Crit Care Med. 2002;30:338–42.CrossRefPubMed
18.
go back to reference Vincent J-L. Endpoints in sepsis trials: more than just 28-day mortality? Crit Care Med. 2004;32:S209–13.CrossRefPubMed Vincent J-L. Endpoints in sepsis trials: more than just 28-day mortality? Crit Care Med. 2004;32:S209–13.CrossRefPubMed
19.
go back to reference Petros AJ, Marshall JC, van Saene HK. Should morbidity replace mortality as an endpoint for clinical trials in intensive care? Lancet (London, England). 1995;345:369–71. 345.CrossRef Petros AJ, Marshall JC, van Saene HK. Should morbidity replace mortality as an endpoint for clinical trials in intensive care? Lancet (London, England). 1995;345:369–71. 345.CrossRef
20.
go back to reference Cleophas TJ, Zwinderman AH. Validating surrogate endpoints. Mach. Learn. Med. Dordrecht: Springer Netherlands; 2013. p. 53–64. Cleophas TJ, Zwinderman AH. Validating surrogate endpoints. Mach. Learn. Med. Dordrecht: Springer Netherlands; 2013. p. 53–64.
21.
go back to reference Freedman LS, Graubard BI, Schatzkin A. Statistical validation of intermediate endpoints for chronic diseases. Stat Med. 1992;11:167–78.CrossRefPubMed Freedman LS, Graubard BI, Schatzkin A. Statistical validation of intermediate endpoints for chronic diseases. Stat Med. 1992;11:167–78.CrossRefPubMed
22.
go back to reference Chen LM, Martin CM, Morrison TL, Sibbald WJ. Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med. 1999;27:1999–2004.CrossRefPubMed Chen LM, Martin CM, Morrison TL, Sibbald WJ. Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med. 1999;27:1999–2004.CrossRefPubMed
23.
go back to reference Arts DGT, de Keizer NF, Vroom MB, de Jonge E. Reliability and accuracy of Sequential Organ Failure Assessment (SOFA) scoring. Crit Care Med. 2005;33:1988–93.CrossRefPubMed Arts DGT, de Keizer NF, Vroom MB, de Jonge E. Reliability and accuracy of Sequential Organ Failure Assessment (SOFA) scoring. Crit Care Med. 2005;33:1988–93.CrossRefPubMed
24.
go back to reference Baykara N, Gökduman K, Hoşten T, Solak M, Toker K. Comparison of sequential organ failure assessment (SOFA) scoring between nurses and residents. J Anesth. 2011;25:839–44.CrossRefPubMed Baykara N, Gökduman K, Hoşten T, Solak M, Toker K. Comparison of sequential organ failure assessment (SOFA) scoring between nurses and residents. J Anesth. 2011;25:839–44.CrossRefPubMed
Metadata
Title
SOFA and mortality endpoints in randomized controlled trials: a systematic review and meta-regression analysis
Authors
Harm-Jan de Grooth
Irma L. Geenen
Armand R. Girbes
Jean-Louis Vincent
Jean-Jacques Parienti
Heleen M. Oudemans-van Straaten
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2017
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-017-1609-1

Other articles of this Issue 1/2017

Critical Care 1/2017 Go to the issue