Skip to main content
Top
Published in: Annals of Intensive Care 1/2020

01-12-2020 | Acute Kidney Injury | Research

Urine NGAL as a biomarker for septic AKI: a critical appraisal of clinical utility—data from the observational FINNAKI study

Authors: Sanna Törnblom, Sara Nisula, Liisa Petäjä, Suvi T. Vaara, Mikko Haapio, Eero Pesonen, Ville Pettilä, the FINNAKI study group

Published in: Annals of Intensive Care | Issue 1/2020

Login to get access

Abstract

Background

Neutrophil gelatinase-associated lipocalin (NGAL) is released from kidney tubular cells under stress as well as from neutrophils during inflammation. It has been suggested as a biomarker for acute kidney injury (AKI) in critically ill patients with sepsis. To evaluate clinical usefulness of urine NGAL (uNGAL), we post-hoc applied recently introduced statistical methods to a sub-cohort of septic patients from the prospective observational Finnish Acute Kidney Injury (FINNAKI) study. Accordingly, in 484 adult intensive care unit patients with sepsis by Sepsis-3 criteria, we calculated areas under the receiver operating characteristic curves (AUCs) for the first available uNGAL to assess discrimination for four outcomes: AKI defined by Kidney Disease: Improving Global Outcomes (KDIGO) criteria, severe (KDIGO 2–3) AKI, and renal replacement therapy (RRT) during the first 3 days of intensive care, and mortality at day 90. We constructed clinical prediction models for the outcomes and used risk assessment plots and decision curve analysis with predefined threshold probabilities to test whether adding uNGAL to the models improved reclassification or decision making in clinical practice.

Results

Incidences of AKI, severe AKI, RRT, and mortality were 44.8% (217/484), 27.7% (134/484), 9.5% (46/484), and 28.1% (136/484). Corresponding AUCs for uNGAL were 0.690, 0.728, 0.769, and 0.600. Adding uNGAL to the clinical prediction models improved discrimination of AKI, severe AKI, and RRT. However, the net benefits for the new models were only 1.4% (severe AKI and RRT) to 2.5% (AKI), and the number of patients needed to be tested per one extra true-positive varied from 40 (AKI) to 74 (RRT) at the predefined threshold probabilities.

Conclusions

The results of the recommended new statistical methods do not support the use of uNGAL in critically ill septic patients to predict AKI or clinical outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Haase M, Bellomo R, Devarajan P, Schlattmann P, Haase-Fielitz A, NGAL Meta-analysis Investigator Group. Accuracy of neutrophil gelatinase-associated lipocalin (NGAL) in diagnosis and prognosis in acute kidney injury: a systematic review and meta-analysis. Am J Kidney Dis. 2009;54(6):1012–24.PubMedCrossRef Haase M, Bellomo R, Devarajan P, Schlattmann P, Haase-Fielitz A, NGAL Meta-analysis Investigator Group. Accuracy of neutrophil gelatinase-associated lipocalin (NGAL) in diagnosis and prognosis in acute kidney injury: a systematic review and meta-analysis. Am J Kidney Dis. 2009;54(6):1012–24.PubMedCrossRef
2.
go back to reference Hjortrup PB, Haase N, Wetterslev M, Perner A. Clinical review: predictive value of neutrophil gelatinase-associated lipocalin for acute kidney injury in intensive care patients. Crit Care. 2013;17(2):211.PubMedPubMedCentralCrossRef Hjortrup PB, Haase N, Wetterslev M, Perner A. Clinical review: predictive value of neutrophil gelatinase-associated lipocalin for acute kidney injury in intensive care patients. Crit Care. 2013;17(2):211.PubMedPubMedCentralCrossRef
3.
go back to reference Xu SY, Carlson M, Engstrom A, Garcia R, Peterson CG, Venge P. Purification and characterization of a human neutrophil lipocalin (HNL) from the secondary granules of human neutrophils. Scand J Clin Lab Invest. 1994;54(5):365–76.PubMedCrossRef Xu SY, Carlson M, Engstrom A, Garcia R, Peterson CG, Venge P. Purification and characterization of a human neutrophil lipocalin (HNL) from the secondary granules of human neutrophils. Scand J Clin Lab Invest. 1994;54(5):365–76.PubMedCrossRef
4.
go back to reference Schmidt-Ott KM, Mori K, Li JY, Kalandadze A, Cohen DJ, Devarajan P, et al. Dual action of neutrophil gelatinase-associated lipocalin. J Am Soc Nephrol. 2007;18(2):407–13.PubMedCrossRef Schmidt-Ott KM, Mori K, Li JY, Kalandadze A, Cohen DJ, Devarajan P, et al. Dual action of neutrophil gelatinase-associated lipocalin. J Am Soc Nephrol. 2007;18(2):407–13.PubMedCrossRef
5.
go back to reference Mårtensson J, Bell M, Oldner A, Xu S, Venge P, Martling C-R. Neutrophil gelatinase-associated lipocalin in adult septic patients with and without acute kidney injury. Intensive Care Med. 2010;36(8):1333–40.PubMedCrossRef Mårtensson J, Bell M, Oldner A, Xu S, Venge P, Martling C-R. Neutrophil gelatinase-associated lipocalin in adult septic patients with and without acute kidney injury. Intensive Care Med. 2010;36(8):1333–40.PubMedCrossRef
6.
go back to reference Mårtensson J, Bell M, Xu S, Bottai M, Ravn B, Venge P, et al. Association of plasma neutrophil gelatinase-associated lipocalin (NGAL) with sepsis and acute kidney dysfunction. Biomarkers. 2013;18(4):349–56.PubMedCrossRef Mårtensson J, Bell M, Xu S, Bottai M, Ravn B, Venge P, et al. Association of plasma neutrophil gelatinase-associated lipocalin (NGAL) with sepsis and acute kidney dysfunction. Biomarkers. 2013;18(4):349–56.PubMedCrossRef
7.
go back to reference Otto GP, Hurtado-Oliveros J, Chung H-Y, Knoll K, Neumann T, Müller HJ, et al. Plasma neutrophil gelatinase-associated lipocalin is primarily related to inflammation during sepsis: a translational approach. PLoS ONE. 2015;10(4):e0124429-e.CrossRef Otto GP, Hurtado-Oliveros J, Chung H-Y, Knoll K, Neumann T, Müller HJ, et al. Plasma neutrophil gelatinase-associated lipocalin is primarily related to inflammation during sepsis: a translational approach. PLoS ONE. 2015;10(4):e0124429-e.CrossRef
8.
go back to reference Zhang A, Cai Y, Wang P-F, Qu J-N, Luo Z-C, Chen X-D, et al. Diagnosis and prognosis of neutrophil gelatinase-associated lipocalin for acute kidney injury with sepsis: a systematic review and meta-analysis. Crit Care. 2016;20:41.PubMedPubMedCentralCrossRef Zhang A, Cai Y, Wang P-F, Qu J-N, Luo Z-C, Chen X-D, et al. Diagnosis and prognosis of neutrophil gelatinase-associated lipocalin for acute kidney injury with sepsis: a systematic review and meta-analysis. Crit Care. 2016;20:41.PubMedPubMedCentralCrossRef
9.
go back to reference Ray P, Manach Yannick L, Riou B, Houle Tim T. Statistical evaluation of a biomarker. Anesthesiology. 2010;112(4):1023–40.PubMedCrossRef Ray P, Manach Yannick L, Riou B, Houle Tim T. Statistical evaluation of a biomarker. Anesthesiology. 2010;112(4):1023–40.PubMedCrossRef
11.
go back to reference Kerr KF, Wang Z, Janes H, McClelland RL, Psaty BM, Pepe MS. Net reclassification indices for evaluating risk prediction instruments: a critical review. Epidemiology. 2014;25(1):114–21.PubMedPubMedCentralCrossRef Kerr KF, Wang Z, Janes H, McClelland RL, Psaty BM, Pepe MS. Net reclassification indices for evaluating risk prediction instruments: a critical review. Epidemiology. 2014;25(1):114–21.PubMedPubMedCentralCrossRef
12.
go back to reference Vanmassenhove J, Kielstein J, Ostermann M. Have renal biomarkers failed in acute kidney injury? Yes. Intensive Care Med. 2017;43:883–6.PubMedCrossRef Vanmassenhove J, Kielstein J, Ostermann M. Have renal biomarkers failed in acute kidney injury? Yes. Intensive Care Med. 2017;43:883–6.PubMedCrossRef
13.
go back to reference Nisula S, Yang R, Kaukonen K-M, Vaara ST, Kuitunen A, Tenhunen J, et al. The urine protein NGAL predicts renal replacement therapy, but not acute kidney injury or 90-day mortality in critically iII adult patients. Anesth Analg. 2014;119(1):95–102.PubMedCrossRef Nisula S, Yang R, Kaukonen K-M, Vaara ST, Kuitunen A, Tenhunen J, et al. The urine protein NGAL predicts renal replacement therapy, but not acute kidney injury or 90-day mortality in critically iII adult patients. Anesth Analg. 2014;119(1):95–102.PubMedCrossRef
14.
go back to reference Pickering JW, Endre ZH. New metrics for assessing diagnostic potential of candidate biomarkers. Clin J Am Soc Nephrol. 2012;7(8):1355–64.PubMedCrossRef Pickering JW, Endre ZH. New metrics for assessing diagnostic potential of candidate biomarkers. Clin J Am Soc Nephrol. 2012;7(8):1355–64.PubMedCrossRef
15.
go back to reference Nisula S, Kaukonen K-M, Vaara ST, Korhonen A-M, Poukkanen M, Karlsson S, et al. Incidence, risk factors and 90-day mortality of patients with acute kidney injury in Finnish intensive care units: the FINNAKI study. Intensive Care Med. 2013;39(3):420–8.PubMedCrossRef Nisula S, Kaukonen K-M, Vaara ST, Korhonen A-M, Poukkanen M, Karlsson S, et al. Incidence, risk factors and 90-day mortality of patients with acute kidney injury in Finnish intensive care units: the FINNAKI study. Intensive Care Med. 2013;39(3):420–8.PubMedCrossRef
16.
go back to reference Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101(6):1644–55.PubMedCrossRef Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest. 1992;101(6):1644–55.PubMedCrossRef
17.
go back to reference Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. 2016;315(8):801–10.PubMedPubMedCentralCrossRef Singer M, Deutschman CS, Seymour C, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. 2016;315(8):801–10.PubMedPubMedCentralCrossRef
18.
go back to reference Kellum JA, Lameire N, Aspelin P, Barsoum RS, Burdmann EA, Goldstein SL, et al. Kidney disease: improving global outcomes (KDIGO) acute kidney injury work group. KDIGO clinical practice guideline for acute kidney injury. Kidney Int Suppl. 2012;2(1):1–138.CrossRef Kellum JA, Lameire N, Aspelin P, Barsoum RS, Burdmann EA, Goldstein SL, et al. Kidney disease: improving global outcomes (KDIGO) acute kidney injury work group. KDIGO clinical practice guideline for acute kidney injury. Kidney Int Suppl. 2012;2(1):1–138.CrossRef
19.
go back to reference Levey AS, Coresh J, Balk E, Kausz AT, Levin A, Steffes MW, et al. National kidney foundation practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Ann Intern Med. 2003;139(2):137–47.PubMedCrossRef Levey AS, Coresh J, Balk E, Kausz AT, Levin A, Steffes MW, et al. National kidney foundation practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Ann Intern Med. 2003;139(2):137–47.PubMedCrossRef
20.
go back to reference Pedersen KR, Ravn HB, Hjortdal VE, Nørregaard R, Povlsen JV. Neutrophil gelatinase-associated lipocalin (NGAL): validation of commercially available ELISA. Scand J Clin Lab Invest. 2010;70(5):374–82.PubMedCrossRef Pedersen KR, Ravn HB, Hjortdal VE, Nørregaard R, Povlsen JV. Neutrophil gelatinase-associated lipocalin (NGAL): validation of commercially available ELISA. Scand J Clin Lab Invest. 2010;70(5):374–82.PubMedCrossRef
21.
go back to reference Biondi-Zoccai G, Romagnoli E, Agostoni P, Capodanno D, Castagno D, D’Ascenzo F, et al. Are propensity scores really superior to standard multivariable analysis? Contemp Clin Trials. 2011;32(5):731–40.PubMedCrossRef Biondi-Zoccai G, Romagnoli E, Agostoni P, Capodanno D, Castagno D, D’Ascenzo F, et al. Are propensity scores really superior to standard multivariable analysis? Contemp Clin Trials. 2011;32(5):731–40.PubMedCrossRef
22.
go back to reference Vesin A, Azoulay E, Ruckly S, Vignoud L, Rusinovà K, Benoit D, et al. Reporting and handling missing values in clinical studies in intensive care units. Intensive Care Med. 2013;39(8):1396–404.PubMedCrossRef Vesin A, Azoulay E, Ruckly S, Vignoud L, Rusinovà K, Benoit D, et al. Reporting and handling missing values in clinical studies in intensive care units. Intensive Care Med. 2013;39(8):1396–404.PubMedCrossRef
23.
go back to reference Pencina MJ, D’Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011;30(1):11–21.PubMedCrossRef Pencina MJ, D’Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011;30(1):11–21.PubMedCrossRef
24.
go back to reference Pencina MJ, D’ Agostino RB, D’ Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2):157–72.PubMedCrossRef Pencina MJ, D’ Agostino RB, D’ Agostino RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2):157–72.PubMedCrossRef
25.
go back to reference Van Calster B, Wynants L, Verbeek JFM, Verbakel JY, Christodoulou E, Vickers AJ, et al. Reporting and interpreting decision curve analysis: a guide for investigators. Eur Urol. 2018;74(6):796–804.PubMedPubMedCentralCrossRef Van Calster B, Wynants L, Verbeek JFM, Verbakel JY, Christodoulou E, Vickers AJ, et al. Reporting and interpreting decision curve analysis: a guide for investigators. Eur Urol. 2018;74(6):796–804.PubMedPubMedCentralCrossRef
26.
go back to reference Hjortrup PB, Haase N, Treschow F, Møller MH, Perner A. Predictive value of NGAL for use of renal replacement therapy in patients with severe sepsis. Acta Anaesthesiol Scand. 2015;59(1):25–34.PubMedCrossRef Hjortrup PB, Haase N, Treschow F, Møller MH, Perner A. Predictive value of NGAL for use of renal replacement therapy in patients with severe sepsis. Acta Anaesthesiol Scand. 2015;59(1):25–34.PubMedCrossRef
27.
go back to reference Investigators S-A. Standard versus accelerated initiation of renal replacement therapy in acute kidney injury: study protocol for a multi-national, multi-center, randomized controlled trial. Can J Kidney Health Dis. 2019;6:2054358119852937. Investigators S-A. Standard versus accelerated initiation of renal replacement therapy in acute kidney injury: study protocol for a multi-national, multi-center, randomized controlled trial. Can J Kidney Health Dis. 2019;6:2054358119852937.
28.
go back to reference Md Ralib A, Pickering JW, Shaw GM, Devarajan P, Edelstein CL, Bonventre JV, et al. Test characteristics of urinary biomarkers depend on quantitation method in acute kidney injury. J Am Soc Nephrol. 2012;23(2):322–33.PubMedCentralCrossRef Md Ralib A, Pickering JW, Shaw GM, Devarajan P, Edelstein CL, Bonventre JV, et al. Test characteristics of urinary biomarkers depend on quantitation method in acute kidney injury. J Am Soc Nephrol. 2012;23(2):322–33.PubMedCentralCrossRef
29.
go back to reference Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925–31.PubMedPubMedCentralCrossRef Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925–31.PubMedPubMedCentralCrossRef
30.
go back to reference Kerr KF, Meisner A, Thiessen-Philbrook H, Coca SG, Parikh CR. Developing risk prediction models for kidney injury and assessing incremental value for novel biomarkers. Clin J Am Soc Nephrol. 2014;9(8):1488–96.PubMedPubMedCentralCrossRef Kerr KF, Meisner A, Thiessen-Philbrook H, Coca SG, Parikh CR. Developing risk prediction models for kidney injury and assessing incremental value for novel biomarkers. Clin J Am Soc Nephrol. 2014;9(8):1488–96.PubMedPubMedCentralCrossRef
Metadata
Title
Urine NGAL as a biomarker for septic AKI: a critical appraisal of clinical utility—data from the observational FINNAKI study
Authors
Sanna Törnblom
Sara Nisula
Liisa Petäjä
Suvi T. Vaara
Mikko Haapio
Eero Pesonen
Ville Pettilä
the FINNAKI study group
Publication date
01-12-2020
Publisher
Springer International Publishing
Published in
Annals of Intensive Care / Issue 1/2020
Electronic ISSN: 2110-5820
DOI
https://doi.org/10.1186/s13613-020-00667-7

Other articles of this Issue 1/2020

Annals of Intensive Care 1/2020 Go to the issue