Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Critical Care
Published in: Critical Care 1/2019

Open Access 01-12-2019 | Septicemia | Research

Heterogeneity of treatment effect by baseline risk of mortality in critically ill patients: re-analysis of three recent sepsis and ARDS randomised controlled trials

Authors: Shalini Santhakumaran, Anthony Gordon, A. Toby Prevost, Cecilia O’Kane, Daniel F. McAuley, Manu Shankar-Hari

Published in: Critical Care | Issue 1/2019

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) enrolling patients with sepsis or acute respiratory distress syndrome (ARDS) generate heterogeneous trial populations. Non-random variation in the treatment effect of an intervention due to differences in the baseline risk of death between patients in a population represents one form of heterogeneity of treatment effect (HTE). We assessed whether HTE in two sepsis and one ARDS RCTs could explain indeterminate trial results and inform future trial design.

Methods

We assessed HTE for vasopressin, hydrocortisone and levosimendan in sepsis and simvastatin in ARDS patients, on 28-day mortality, using the total Acute Physiology And Chronic Health Evaluation II (APACHE II) score as the baseline risk measurement, comparing above (high) and below (low) the median score. Secondary risk measures were the acute physiology component of APACHE II and predicted risk of mortality using the APACHE II score. HTE was quantified both in additive (difference in risk difference (RD)) and multiplicative (ratio of relative risks (RR)) scales using estimated treatment differences from a logistic regression model with treatment risk as the interaction term.

Results

The ratio of the odds of death in the highest APACHE II quartile was 4.9 to 7.4 times compared to the lowest quartile, across the three trials. We did not observe HTE for vasopressin, hydrocortisone and levosimendan in the two sepsis trials. In the HARP-2 trial, simvastatin reduced mortality in the low APACHE II group and increased mortality in the high APACHE II group (difference in RD = 0.34 (0.12, 0.55) (p = 0.02); ratio of RR 3.57 (1.77, 7.17) (p < 0.001). The HTE patterns were inconsistent across the secondary risk measures. The sensitivity analyses of HTE effects for vasopressin, hydrocortisone and levosimendan were consistent with the main analyses and attenuated for simvastatin.

Conclusions

We assessed HTE in three recent ICU RCTs, using multivariable baseline risk of death models. There was considerable within-trial variation in the baseline risk of death. We observed potential HTE for simvastatin in ARDS, but no evidence of HTE for vasopressin, hydrocortisone or levosimendan in the two sepsis trials. Our findings could be explained either by true lack of HTE (no benefit of vasopressin, hydrocortisone or levosimendan vs comparator for any patient subgroups) or by lack of power to detect HTE. Our results require validation using similar trial databases.
Appendix
Available only for authorised users
Literature
1.
Kent DM, Rothwell PM, Ioannidis JP, Altman DG, Hayward RA. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal. Trials. 2010;11:85.CrossRefPubMedPubMedCentral
2.
Senn S. Mastering variation: variance components and personalised medicine. Stat Med. 2016;35(7):966–77.CrossRefPubMed
3.
Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche JD, Coopersmith CM, et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):801–10.CrossRefPubMedPubMedCentral
4.
Force ADT, Ranieri VM, Rubenfeld GD, Thompson BT, Ferguson ND, Caldwell E, Fan E, Camporota L, Slutsky AS. Acute respiratory distress syndrome: the Berlin definition. JAMA. 2012;307(23):2526–33.
5.
Scicluna BP, van Vught LA, Zwinderman AH, Wiewel MA, Davenport EE, Burnham KL, Nurnberg P, Schultz MJ, Horn J, Cremer OL, et al. Classification of patients with sepsis according to blood genomic endotype: a prospective cohort study. Lancet Respir Med. 2017;5(10):816–26.CrossRefPubMed
6.
Davenport EE, Burnham KL, Radhakrishnan J, Humburg P, Hutton P, Mills TC, Rautanen A, Gordon AC, Garrard C, Hill AV, et al. Genomic landscape of the individual host response and outcomes in sepsis: a prospective cohort study. Lancet Respir Med. 2016;4(4):259–71.CrossRefPubMedPubMedCentral
7.
Bos LD, Schouten LR, van Vught LA, Wiewel MA, Ong DSY, Cremer O, Artigas A, Martin-Loeches I, Hoogendijk AJ, van der Poll T, et al. Identification and validation of distinct biological phenotypes in patients with acute respiratory distress syndrome by cluster analysis. Thorax. 2017;72(10):876–83.CrossRefPubMed
8.
Calfee CS, Delucchi K, Parsons PE, Thompson BT, Ware LB, Matthay MA, Network NA. Subphenotypes in acute respiratory distress syndrome: latent class analysis of data from two randomised controlled trials. Lancet Respir Med. 2014;2(8):611–20.CrossRefPubMedPubMedCentral
9.
Shankar-Hari M, Rubenfeld GD. The use of enrichment to reduce statistically indeterminate or negative trials in critical care. Anaesthesia. 2017;72(5):560–5.CrossRefPubMed
10.
Iwashyna TJ, Burke JF, Sussman JB, Prescott HC, Hayward RA, Angus DC. Implications of heterogeneity of treatment effect for reporting and analysis of randomized trials in critical care. Am J Respir Crit Care Med. 2015;192(9):1045–51.CrossRefPubMedPubMedCentral
11.
Sackett DL. Superiority trials, non-inferiority trials, and prisoners of the 2-sided null hypothesis. Evid Based Med. 2004;9(2):38.CrossRef
12.
Prescott HC, Calfee CS, Thompson BT, Angus DC, Liu VX. Toward smarter lumping and smarter splitting: rethinking strategies for sepsis and acute respiratory distress syndrome clinical trial design. Am J Respir Crit Care Med. 2016;194(2):147–55.CrossRefPubMedPubMedCentral
13.
Gordon AC, Mason AJ, Thirunavukkarasu N, Perkins GD, Cecconi M, Cepkova M, Pogson DG, Aya HD, Anjum A, Frazier GJ, et al. Effect of early vasopressin vs norepinephrine on kidney failure in patients with septic shock: the VANISH randomized clinical trial. JAMA. 2016;316(5):509–18.CrossRefPubMed
14.
Gordon AC, Perkins GD, Singer M, McAuley DF, Orme RM, Santhakumaran S, Mason AJ, Cross M, Al-Beidh F, Best-Lane J, et al. Levosimendan for the prevention of acute organ dysfunction in sepsis. N Engl J Med. 2016;375(17):1638–48.CrossRefPubMed
15.
McAuley DF, Laffey JG, O'Kane CM, Perkins GD, Mullan B, Trinder TJ, Johnston P, Hopkins PA, Johnston AJ, McDowell C, et al. Simvastatin in the acute respiratory distress syndrome. N Engl J Med. 2014;371(18):1695–703.CrossRefPubMed
16.
Russell JA, Walley KR, Singer J, Gordon AC, Hebert PC, Cooper DJ, Holmes CL, Mehta S, Granton JT, Storms MM, et al. Vasopressin versus norepinephrine infusion in patients with septic shock. N Engl J Med. 2008;358(9):877–87.CrossRefPubMed
17.
Rochwerg B, Oczkowski SJ, Siemieniuk RAC, Agoritsas T, Belley-Cote E, D'Aragon F, Duan E, English S, Gossack-Keenan K, Alghuroba M, et al. Corticosteroids in sepsis: an updated systematic review and meta-analysis. Crit Care Med. 2018;46(9):1411–20.CrossRefPubMed
18.
Annane D, Renault A, Brun-Buisson C, Megarbane B, Quenot JP, Siami S, Cariou A, Forceville X, Schwebel C, Martin C, et al. Hydrocortisone plus fludrocortisone for adults with septic shock. N Engl J Med. 2018;378(9):809–18.CrossRefPubMed
19.
Venkatesh B, Finfer S, Cohen J, Rajbhandari D, Arabi Y, Bellomo R, Billot L, Correa M, Glass P, Harward M, et al. Adjunctive glucocorticoid therapy in patients with septic shock. N Engl J Med. 2018;378(9):797–808.CrossRefPubMed
20.
Annane D, Sebille V, Charpentier C, Bollaert PE, Francois B, Korach JM, Capellier G, Cohen Y, Azoulay E, Troche G, et al. Effect of treatment with low doses of hydrocortisone and fludrocortisone on mortality in patients with septic shock. JAMA. 2002;288(7):862–71.CrossRefPubMed
21.
Calfee CS, Delucchi KL, Sinha P, Matthay MA, Hackett J, Shankar-Hari M, McDowell C, Laffey JG, O'Kane CM, McAuley DF, et al. Acute respiratory distress syndrome subphenotypes and differential response to simvastatin: secondary analysis of a randomised controlled trial. Lancet Respir Med. 2018;6(9):691–8.CrossRefPubMedPubMedCentral
22.
Rothenberg FG, Clay MB, Jamali H, Vandivier-Pletsch RH. Systematic review of beta blocker, aspirin, and statin in critically ill patients: importance of severity of illness and cardiac troponin. J Investig Med. 2017;65(4):747–53.CrossRefPubMed
23.
Knaus WA, Harrell FE Jr, LaBrecque JF, Wagner DP, Pribble JP, Draper EA, Fisher CJ Jr, Soll L. Use of predicted risk of mortality to evaluate the efficacy of anticytokine therapy in sepsis. The rhIL-1ra Phase III Sepsis Syndrome Study Group. Crit Care Med. 1996;24(1):46–56.CrossRefPubMed
24.
Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–29.CrossRefPubMed
25.
Shankar-Hari M, Harrison DA, Rowan KM, Rubenfeld GD. Estimating attributable fraction of mortality from sepsis to inform clinical trials. J Crit Care. 2018;45:33–9.CrossRefPubMed
26.
Ioannidis JPA, Lau J. Heterogeneity of the baseline risk within patient populations of clinical trials - a proposed evaluation algorithm. Am J Epidemiol. 1998;148(11):1117–26.CrossRefPubMed
27.
Burke JF, Hayward RA, Nelson JP, Kent DM. Using internally developed risk models to assess heterogeneity in treatment effects in clinical trials. Circ Cardiovasc Qual Outcomes. 2014;7(1):163–9.CrossRefPubMedPubMedCentral
28.
29.
Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.CrossRefPubMed
30.
Rothman KJ, Greenland S. Causation and causal inference in epidemiology. Am J Public Health. 2005;95(Suppl 1):S144–50.CrossRefPubMed
31.
Ioannidis JP, Cappelleri JC, Schmid CH, Lau J. Impact of epidemic and individual heterogeneity on the population distribution of disease progression rates. An example from patient populations in trials of human immunodeficiency virus infection. Am J Epidemiol. 1996;144(11):1074–85.CrossRefPubMed
32.
Semler MW, Self WH, Wanderer JP, Ehrenfeld JM, Wang L, Byrne DW, Stollings JL, Kumar AB, Hughes CG, Hernandez A, et al. Balanced crystalloids versus saline in critically ill adults. N Engl J Med. 2018;378(9):829–39.CrossRefPubMedPubMedCentral
33.
McKown AC, Huerta LE, Rice TW, Semler MW, Pragmatic critical care research G. Heterogeneity of treatment effect by baseline risk in a trial of balanced crystalloids versus saline. Am J Respir Crit Care Med. 2018;198(6):810–3.CrossRefPubMedPubMedCentral
34.
Shankar-Hari M, McAuley DF. Divide and conquer: identifying acute respiratory distress syndrome subphenotypes. Thorax. 2017;72(10):867–9.CrossRefPubMed
35.
Russell JA, Lee T, Singer J, Boyd JH, Walley KR, Vasopressin SSTG. The septic shock 3.0 definition and trials: a vasopressin and septic shock trial experience. Crit Care Med. 2017;45(6):940–8.CrossRefPubMed
36.
Wong HR, Atkinson SJ, Cvijanovich NZ, Anas N, Allen GL, Thomas NJ, Bigham MT, Weiss SL, Fitzgerald JC, Checchia PA, et al. Combining prognostic and predictive enrichment strategies to identify children with septic shock responsive to corticosteroids. Crit Care Med. 2016;44(10):e1000–3.CrossRefPubMedPubMedCentral
37.
Wong HR, Cvijanovich NZ, Anas N, Allen GL, Thomas NJ, Bigham MT, Weiss SL, Fitzgerald J, Checchia PA, Meyer K, et al. Developing a clinically feasible personalized medicine approach to pediatric septic shock. Am J Respir Crit Care Med. 2015;191(3):309–15.CrossRefPubMedPubMedCentral
38.
Antcliffe DB, Burnham KL, Al-Beidh F, Santhakumaran S, Brett SJ, Hinds CJ, Ashby D, Knight JC, Gordon AC:Transcriptomic Signatures in Sepsis and a Differential Response to Steroids. From the VANISH Randomized Trial. Am J Respir Crit Care Med. 2019;199(8):980-86.CrossRefPubMedPubMedCentral
39.
Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, Clarke M, Gargon E, Gorst S, Harman N, et al. The COMET handbook: version 1.0. Trials. 2017;18(Suppl 3):280.CrossRefPubMedPubMedCentral
Metadata
Title
Heterogeneity of treatment effect by baseline risk of mortality in critically ill patients: re-analysis of three recent sepsis and ARDS randomised controlled trials
Authors
Shalini Santhakumaran
Anthony Gordon
A. Toby Prevost
Cecilia O’Kane
Daniel F. McAuley
Manu Shankar-Hari
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Critical Care / Issue 1/2019
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/s13054-019-2446-1

Other articles of this Issue 1/2019

Critical Care 1/2019 Go to the issue

Research

Permissive versus restrictive temperature thresholds in critically ill children with fever and infection: a multicentre randomized clinical pilot trial

Research

Subjective right ventricle assessment by echo qualified intensive care specialists: assessing agreement with objective measures

Letter

New-onset QT prolongation is a novel predictor of mortality in critically ill patients

Research

Intravascular versus surface cooling for targeted temperature management after out-of-hospital cardiac arrest: an analysis of the TTH48 trial

Review

Diagnostic and therapeutic approach in adult patients with traumatic brain injury receiving oral anticoagulant therapy: an Austrian interdisciplinary consensus statement

Research

Mottling score is a strong predictor of 14-day mortality in septic patients whatever vasopressor doses and other tissue perfusion parameters