Skip to main content
Top
Published in: Critical Care 4/2011

Open Access 01-08-2011 | Research

Validation and comparison of clinical prediction rules for invasive candidiasis in intensive care unit patients: a matched case-control study

Authors: Elizabeth D Hermsen, Michelle K Zapapas, Melissa Maiefski, Mark E Rupp, Alison G Freifeld, Andre C Kalil

Published in: Critical Care | Issue 4/2011

Login to get access

Abstract

Introduction

Due to the increasing prevalence and severity of invasive candidiasis, investigators have developed clinical prediction rules to identify patients who may benefit from antifungal prophylaxis or early empiric therapy. The aims of this study were to validate and compare the Paphitou and Ostrosky-Zeichner clinical prediction rules in ICU patients in a 689-bed academic medical center.

Methods

We conducted a retrospective matched case-control study from May 2003 to June 2008 to evaluate the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of each rule. Cases included adults with ICU stays of at least four days and invasive candidiasis matched to three controls by age, gender and ICU admission date. The clinical prediction rules were applied to cases and controls via retrospective chart review to evaluate the success of the rules in predicting invasive candidiasis. Paphitou's rule included diabetes, total parenteral nutrition (TPN) and dialysis with or without antibiotics. Ostrosky-Zeichner's rule included antibiotics or central venous catheter plus at least two of the following: surgery, immunosuppression, TPN, dialysis, corticosteroids and pancreatitis. Conditional logistic regression was performed to evaluate the rules. Discriminative power was evaluated by area under the receiver operating characteristic curve (AUC ROC).

Results

A total of 352 patients were included (88 cases and 264 controls). The incidence of invasive candidiasis among adults with an ICU stay of at least four days was 2.3%. The prediction rules performed similarly, exhibiting low PPVs (0.041 to 0.054), high NPVs (0.983 to 0.990) and AUC ROCs (0.649 to 0.705). A new prediction rule (Nebraska Medical Center rule) was developed with PPVs, NPVs and AUC ROCs of 0.047, 0.994 and 0.770, respectively.

Conclusions

Based on low PPVs and high NPVs, the rules are most useful for identifying patients who are not likely to develop invasive candidiasis, potentially preventing unnecessary antifungal use, optimizing patient ICU care and facilitating the design of forthcoming antifungal clinical trials.
Literature
2.
go back to reference Wisplinghoff H, Bischoff T, Tallent SM, Seifert H, Wenzel RP, Edmond MB: Nosocomial bloodstream infections in US hospitals: analysis of 24,179 cases from a prospective nationwide surveillance study. Clin Infect Dis 2004, 39: 309-317. 10.1086/421946PubMedCrossRef Wisplinghoff H, Bischoff T, Tallent SM, Seifert H, Wenzel RP, Edmond MB: Nosocomial bloodstream infections in US hospitals: analysis of 24,179 cases from a prospective nationwide surveillance study. Clin Infect Dis 2004, 39: 309-317. 10.1086/421946PubMedCrossRef
3.
go back to reference Blumberg HM, Jarvis WR, Soucie JM, Edwards JE, Patterson JE, Pfaller MA, Rangel-Frausto MS, Rinaldi MG, Saiman L, Wiblin RT, Wenzel RP, National Epidemiology of Mycoses Survey (NEMIS) Study Group: Risk factors for candidal bloodstream infections in surgical intensive care unit patients: the NEMIS prospective multicenter study. The National Epidemiology of Mycosis Survey. Clin Infect Dis 2001, 33: 177-186. 10.1086/321811PubMedCrossRef Blumberg HM, Jarvis WR, Soucie JM, Edwards JE, Patterson JE, Pfaller MA, Rangel-Frausto MS, Rinaldi MG, Saiman L, Wiblin RT, Wenzel RP, National Epidemiology of Mycoses Survey (NEMIS) Study Group: Risk factors for candidal bloodstream infections in surgical intensive care unit patients: the NEMIS prospective multicenter study. The National Epidemiology of Mycosis Survey. Clin Infect Dis 2001, 33: 177-186. 10.1086/321811PubMedCrossRef
4.
go back to reference Rentz AM, Halpern MT, Bowden R: The impact of candidemia on length of hospital stay, outcome, and overall cost of illness. Clin Infect Dis 1998, 27: 781-788. 10.1086/514955PubMedCrossRef Rentz AM, Halpern MT, Bowden R: The impact of candidemia on length of hospital stay, outcome, and overall cost of illness. Clin Infect Dis 1998, 27: 781-788. 10.1086/514955PubMedCrossRef
5.
go back to reference Garey KW, Rege M, Pai MP, Mingo DE, Suda KJ, Turpin RS, Bearden DT: Time to initiation of fluconazole therapy impacts mortality in patients with candidemia: a multi-institutional study. Clin Infect Dis 2006, 43: 25-31. 10.1086/504810PubMedCrossRef Garey KW, Rege M, Pai MP, Mingo DE, Suda KJ, Turpin RS, Bearden DT: Time to initiation of fluconazole therapy impacts mortality in patients with candidemia: a multi-institutional study. Clin Infect Dis 2006, 43: 25-31. 10.1086/504810PubMedCrossRef
6.
go back to reference Morrell M, Fraser VJ, Kollef MH: Delaying the empiric treatment of Candida bloodstream infection until positive blood culture results are obtained: a potential risk factor for hospital mortality. Antimicrob Agents Chemother 2005, 49: 3640-3645. 10.1128/AAC.49.9.3640-3645.2005PubMedPubMedCentralCrossRef Morrell M, Fraser VJ, Kollef MH: Delaying the empiric treatment of Candida bloodstream infection until positive blood culture results are obtained: a potential risk factor for hospital mortality. Antimicrob Agents Chemother 2005, 49: 3640-3645. 10.1128/AAC.49.9.3640-3645.2005PubMedPubMedCentralCrossRef
7.
go back to reference Nolla-Salas J, Sitges-Serra A, León-Gil C, Martínez-González J, León-Regidor MA, Ibáñez-Lucia P, Torres-Rodríguez JM: Candidemia in non-neutropenic critically ill patients: analysis of prognostic factors and assessment of systemic antifungal therapy. Study Group of Fungal Infection in the ICU. Intensive Care Med 1997, 23: 23-30. 10.1007/s001340050286PubMedCrossRef Nolla-Salas J, Sitges-Serra A, León-Gil C, Martínez-González J, León-Regidor MA, Ibáñez-Lucia P, Torres-Rodríguez JM: Candidemia in non-neutropenic critically ill patients: analysis of prognostic factors and assessment of systemic antifungal therapy. Study Group of Fungal Infection in the ICU. Intensive Care Med 1997, 23: 23-30. 10.1007/s001340050286PubMedCrossRef
8.
go back to reference Cruciani M, de Lalla F, Mengoli C: Prophylaxis of Candida infections in adult trauma and surgical intensive care patients: a systematic review and meta-analysis. Intensive Care Med 2005, 31: 1479-1487. 10.1007/s00134-005-2794-yPubMedCrossRef Cruciani M, de Lalla F, Mengoli C: Prophylaxis of Candida infections in adult trauma and surgical intensive care patients: a systematic review and meta-analysis. Intensive Care Med 2005, 31: 1479-1487. 10.1007/s00134-005-2794-yPubMedCrossRef
9.
go back to reference Eggimann P, Francioli P, Bille J, Schneider R, Wu MM, Chapuis G, Chiolero R, Pannatier A, Schilling J, Geroulanos S, Glauser MP, Calandra T: Fluconazole prophylaxis prevents intra-abdominal candidiasis in high-risk surgical patients. Crit Care Med 1999, 27: 1066-1072. 10.1097/00003246-199906000-00019PubMedCrossRef Eggimann P, Francioli P, Bille J, Schneider R, Wu MM, Chapuis G, Chiolero R, Pannatier A, Schilling J, Geroulanos S, Glauser MP, Calandra T: Fluconazole prophylaxis prevents intra-abdominal candidiasis in high-risk surgical patients. Crit Care Med 1999, 27: 1066-1072. 10.1097/00003246-199906000-00019PubMedCrossRef
10.
go back to reference Garbino J, Lew DP, Romand JA, Hugonnet S, Auckenthaler R, Pittet D: Prevention of severe Candida infections in nonneutropenic, high-risk, critically ill patients: a randomized, double-blind, placebo-controlled trial in patients treated by selective digestive decontamination. Intensive Care Med 2002, 28: 1708-1717. 10.1007/s00134-002-1540-yPubMedCrossRef Garbino J, Lew DP, Romand JA, Hugonnet S, Auckenthaler R, Pittet D: Prevention of severe Candida infections in nonneutropenic, high-risk, critically ill patients: a randomized, double-blind, placebo-controlled trial in patients treated by selective digestive decontamination. Intensive Care Med 2002, 28: 1708-1717. 10.1007/s00134-002-1540-yPubMedCrossRef
11.
go back to reference Pelz RK, Hendrix CW, Swoboda SM, Diener-West M, Merz WG, Hammond J, Lipsett PA: Double-blind placebo-controlled trial of fluconazole to prevent candidal infections in critically ill surgical patients. Ann Surg 2001, 233: 542-548. 10.1097/00000658-200104000-00010PubMedPubMedCentralCrossRef Pelz RK, Hendrix CW, Swoboda SM, Diener-West M, Merz WG, Hammond J, Lipsett PA: Double-blind placebo-controlled trial of fluconazole to prevent candidal infections in critically ill surgical patients. Ann Surg 2001, 233: 542-548. 10.1097/00000658-200104000-00010PubMedPubMedCentralCrossRef
12.
go back to reference Savino JA, Agarwal N, Wry P, Policastro A, Cerabona T, Austria L: Routine prophylactic antifungal agents (clotrimazole, ketoconazole, and nystatin) in nontransplant/nonburned critically ill surgical and trauma patients. J Trauma 1994, 36: 20-26. 10.1097/00005373-199401000-00004PubMedCrossRef Savino JA, Agarwal N, Wry P, Policastro A, Cerabona T, Austria L: Routine prophylactic antifungal agents (clotrimazole, ketoconazole, and nystatin) in nontransplant/nonburned critically ill surgical and trauma patients. J Trauma 1994, 36: 20-26. 10.1097/00005373-199401000-00004PubMedCrossRef
13.
go back to reference Playford EG, Webster AC, Sorrell TC, Craig JC: Antifungal agents for preventing fungal infections in non-neutropenic critically ill and surgical patients: systematic review and meta-analysis of randomized clinical trials. J Antimicrob Chemother 2006, 57: 628-638. 10.1093/jac/dki491PubMedCrossRef Playford EG, Webster AC, Sorrell TC, Craig JC: Antifungal agents for preventing fungal infections in non-neutropenic critically ill and surgical patients: systematic review and meta-analysis of randomized clinical trials. J Antimicrob Chemother 2006, 57: 628-638. 10.1093/jac/dki491PubMedCrossRef
14.
go back to reference Shorr AF, Chung K, Jackson WL, Waterman PE, Kollef MH: Fluconazole prophylaxis in critically ill surgical patients: a meta-analysis. Crit Care Med 2005, 33: 1928-1936. 10.1097/01.CCM.0000178352.14703.49PubMedCrossRef Shorr AF, Chung K, Jackson WL, Waterman PE, Kollef MH: Fluconazole prophylaxis in critically ill surgical patients: a meta-analysis. Crit Care Med 2005, 33: 1928-1936. 10.1097/01.CCM.0000178352.14703.49PubMedCrossRef
15.
go back to reference Paphitou NI, Ostrosky-Zeichner L, Rex JH: Rules for identifying patients at increased risk for candidal infections in the surgical intensive care unit: approach to developing practical criteria for systematic use in antifungal prophylaxis trials. Med Mycol 2005, 43: 235-243. 10.1080/13693780410001731619PubMedCrossRef Paphitou NI, Ostrosky-Zeichner L, Rex JH: Rules for identifying patients at increased risk for candidal infections in the surgical intensive care unit: approach to developing practical criteria for systematic use in antifungal prophylaxis trials. Med Mycol 2005, 43: 235-243. 10.1080/13693780410001731619PubMedCrossRef
16.
go back to reference Ostrosky-Zeichner L, Sable C, Sobel J, Alexander BD, Donowitz G, Kan V, Kauffman CA, Kett D, Larsen RA, Morrison V, Nucci M, Pappas PG, Bradley ME, Major S, Zimmer L, Wallace D, Dismukes WE, Rex JH: Multicenter retrospective development and validation of a clinical prediction rule for nosocomial invasive candidiasis in the intensive care setting. Eur J Clin Microbiol Infect Dis 2007, 26: 271-276. 10.1007/s10096-007-0270-zPubMedCrossRef Ostrosky-Zeichner L, Sable C, Sobel J, Alexander BD, Donowitz G, Kan V, Kauffman CA, Kett D, Larsen RA, Morrison V, Nucci M, Pappas PG, Bradley ME, Major S, Zimmer L, Wallace D, Dismukes WE, Rex JH: Multicenter retrospective development and validation of a clinical prediction rule for nosocomial invasive candidiasis in the intensive care setting. Eur J Clin Microbiol Infect Dis 2007, 26: 271-276. 10.1007/s10096-007-0270-zPubMedCrossRef
17.
go back to reference Ostrosky-Zeichner L, Pappas PG, Shoham S, Reboli A, Barron MA, Sims C, Wood C, Sobel JD: Improvement of a clinical prediction rule for clinical trials on prophylaxis for invasive candidiasis in the intensive care unit. Mycoses 2011, 54: 46-51. 10.1111/j.1439-0507.2009.01756.xPubMedCrossRef Ostrosky-Zeichner L, Pappas PG, Shoham S, Reboli A, Barron MA, Sims C, Wood C, Sobel JD: Improvement of a clinical prediction rule for clinical trials on prophylaxis for invasive candidiasis in the intensive care unit. Mycoses 2011, 54: 46-51. 10.1111/j.1439-0507.2009.01756.xPubMedCrossRef
18.
go back to reference Playford EG, Lipman J, Kabir M, McBryde ES, Nimmo GR, Lau A, Sorrell TC: Assessment of clinical risk predictive rules for invasive candidiasis in a prospective multicentre cohort of ICU patients. Intensive Care Med 2009, 35: 2141-2145. 10.1007/s00134-009-1619-9PubMedCrossRef Playford EG, Lipman J, Kabir M, McBryde ES, Nimmo GR, Lau A, Sorrell TC: Assessment of clinical risk predictive rules for invasive candidiasis in a prospective multicentre cohort of ICU patients. Intensive Care Med 2009, 35: 2141-2145. 10.1007/s00134-009-1619-9PubMedCrossRef
19.
go back to reference De Pauw B, Walsh TJ, Donnelly JP, Stevens DA, Edwards JE, Calandra T, Pappas PG, Maertens J, Lortholary O, Kauffman CA, Denning DW, Patterson TF, Maschmeyer G, Bille J, Dismukes WE, Herbrecht R, Hope WW, Kibbler CC, Kullberg BJ, Marr KA, Muñoz P, Odds FC, Perfect JR, Restrepo A, Ruhnke M, Segal BH, Sobel JD, Sorrell TC, Viscoli C, Wingard JR, Zaoutis T, Bennett JE, European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group; National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) Consensus Group: Revised definitions of invasive fungal disease from the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) Consensus Group. Clin Infect Dis 2008, 46: 1813-1821. 10.1086/588660PubMedPubMedCentralCrossRef De Pauw B, Walsh TJ, Donnelly JP, Stevens DA, Edwards JE, Calandra T, Pappas PG, Maertens J, Lortholary O, Kauffman CA, Denning DW, Patterson TF, Maschmeyer G, Bille J, Dismukes WE, Herbrecht R, Hope WW, Kibbler CC, Kullberg BJ, Marr KA, Muñoz P, Odds FC, Perfect JR, Restrepo A, Ruhnke M, Segal BH, Sobel JD, Sorrell TC, Viscoli C, Wingard JR, Zaoutis T, Bennett JE, European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group; National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) Consensus Group: Revised definitions of invasive fungal disease from the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC/MSG) Consensus Group. Clin Infect Dis 2008, 46: 1813-1821. 10.1086/588660PubMedPubMedCentralCrossRef
20.
go back to reference Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 3rd edition. Philadelphia Lippincott Williams & Wilkins; 2008. Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 3rd edition. Philadelphia Lippincott Williams & Wilkins; 2008.
21.
go back to reference Pittet D, Monod M, Suter PM, Frenk E, Auckenthaler R: Candida colonization and subsequent infections in critically ill surgical patients. Ann Surg 1994, 220: 751-758. 10.1097/00000658-199412000-00008PubMedPubMedCentralCrossRef Pittet D, Monod M, Suter PM, Frenk E, Auckenthaler R: Candida colonization and subsequent infections in critically ill surgical patients. Ann Surg 1994, 220: 751-758. 10.1097/00000658-199412000-00008PubMedPubMedCentralCrossRef
22.
go back to reference Schuster MG, Edwards JE Jr, Sobel JD, Darouiche RO, Karchmer AW, Hadley S, Slotman G, Panzer H, Biswas P, Rex JH: Empirical fluconazole versus placebo for intensive care unit patients: a randomized trial. Ann Intern Med 2008, 149: 83-90.PubMedCrossRef Schuster MG, Edwards JE Jr, Sobel JD, Darouiche RO, Karchmer AW, Hadley S, Slotman G, Panzer H, Biswas P, Rex JH: Empirical fluconazole versus placebo for intensive care unit patients: a randomized trial. Ann Intern Med 2008, 149: 83-90.PubMedCrossRef
23.
go back to reference León C, Ruiz-Santana S, Saavedra P, Almirante B, Nolla-Salas J, Alvarez-Lerma F, Garnacho-Montero J, León MA, EPCAN Study Group: A bedside scoring system (" Candida score") for early antifungal treatment in nonneutropenic critically ill patients with Candida colonization. Crit Care Med 2006, 34: 730-737. 10.1097/01.CCM.0000202208.37364.7DPubMedCrossRef León C, Ruiz-Santana S, Saavedra P, Almirante B, Nolla-Salas J, Alvarez-Lerma F, Garnacho-Montero J, León MA, EPCAN Study Group: A bedside scoring system (" Candida score") for early antifungal treatment in nonneutropenic critically ill patients with Candida colonization. Crit Care Med 2006, 34: 730-737. 10.1097/01.CCM.0000202208.37364.7DPubMedCrossRef
24.
go back to reference Wey SB, Mori M, Pfaller MA, Woolson RF, Wenzel RP: Risk factors for hospital-acquired candidemia: a matched case-control study. Arch Intern Med 1989, 149: 2349-2353. 10.1001/archinte.149.10.2349PubMedCrossRef Wey SB, Mori M, Pfaller MA, Woolson RF, Wenzel RP: Risk factors for hospital-acquired candidemia: a matched case-control study. Arch Intern Med 1989, 149: 2349-2353. 10.1001/archinte.149.10.2349PubMedCrossRef
25.
go back to reference Pelz RK, Lipsett PA, Swoboda SM, Diener-West M, Hammond JM, Hendrix CW: The diagnostic value of fungal surveillance cultures in critically ill patients. Surg Infect (Larchmt) 2000, 1: 273-281. 10.1089/109629600750067200CrossRef Pelz RK, Lipsett PA, Swoboda SM, Diener-West M, Hammond JM, Hendrix CW: The diagnostic value of fungal surveillance cultures in critically ill patients. Surg Infect (Larchmt) 2000, 1: 273-281. 10.1089/109629600750067200CrossRef
Metadata
Title
Validation and comparison of clinical prediction rules for invasive candidiasis in intensive care unit patients: a matched case-control study
Authors
Elizabeth D Hermsen
Michelle K Zapapas
Melissa Maiefski
Mark E Rupp
Alison G Freifeld
Andre C Kalil
Publication date
01-08-2011
Publisher
BioMed Central
Published in
Critical Care / Issue 4/2011
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc10366

Other articles of this Issue 4/2011

Critical Care 4/2011 Go to the issue