Skip to main content
Top
Published in: BMC Infectious Diseases 1/2016

Open Access 01-12-2016 | Research article

Classification and Regression Tree (CART) analysis to predict influenza in primary care patients

Authors: Richard K. Zimmerman, G. K. Balasubramani, Mary Patricia Nowalk, Heather Eng, Leonard Urbanski, Michael L. Jackson, Lisa A. Jackson, Huong Q. McLean, Edward A. Belongia, Arnold S. Monto, Ryan E. Malosh, Manjusha Gaglani, Lydia Clipper, Brendan Flannery, Stephen R. Wisniewski

Published in: BMC Infectious Diseases | Issue 1/2016

Login to get access

Abstract

Background

The use of neuraminidase-inhibiting anti-viral medication to treat influenza is relatively infrequent. Rapid, cost-effective methods for diagnosing influenza are needed to enable appropriate prescribing. Multi-viral respiratory panels using reverse transcription polymerase chain reaction (PCR) assays to diagnose influenza are accurate but expensive and more time-consuming than low sensitivity rapid influenza tests. Influenza clinical decision algorithms are both rapid and inexpensive, but most are based on regression analyses that do not account for higher order interactions. This study used classification and regression trees (CART) modeling to estimate probabilities of influenza.

Methods

Eligible enrollees ≥ 5 years old (n = 4,173) who presented at ambulatory centers for treatment of acute respiratory illness (≤7 days) with cough or fever in 2011–2012, provided nasal and pharyngeal swabs for PCR testing for influenza, information on demographics, symptoms, personal characteristics and self-reported influenza vaccination status.

Results

Antiviral medication was prescribed for just 15 % of those with PCR-confirmed influenza. An algorithm that included fever, cough, and fatigue had sensitivity of 84 %, specificity of 48 %, positive predictive value (PPV) of 23 % and negative predictive value (NPV) of 94 % for the development sample.

Conclusions

The CART algorithm has good sensitivity and high NPV, but low PPV for identifying influenza among outpatients ≥5 years. Thus, it is good at identifying a group who do not need testing or antivirals and had fair to good predictive performance for influenza. Further testing of the algorithm in other influenza seasons would help to optimize decisions for lab testing or treatment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, Cox NJ, Fukuda K. Influenza-associated hospitalizations in the United States. JAMA. 2004;292(11):1333–40.CrossRefPubMed Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, Cox NJ, Fukuda K. Influenza-associated hospitalizations in the United States. JAMA. 2004;292(11):1333–40.CrossRefPubMed
2.
go back to reference Molinari NA, Ortega-Sanchez IR, Messonnier ML, Thompson WW, Wortley PM, Weintraub E, Bridges CB. The annual impact of seasonal influenza in the US: measuring disease burden and costs. Vaccine. 2007;25(27):5086–96.CrossRefPubMed Molinari NA, Ortega-Sanchez IR, Messonnier ML, Thompson WW, Wortley PM, Weintraub E, Bridges CB. The annual impact of seasonal influenza in the US: measuring disease burden and costs. Vaccine. 2007;25(27):5086–96.CrossRefPubMed
3.
go back to reference Heneghan CJ, Onakpoya I, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for influenza: a systematic review and meta-analysis of regulatory and mortality data. Health Technol Assess. 2016;20(42):1–242.CrossRefPubMedPubMedCentral Heneghan CJ, Onakpoya I, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for influenza: a systematic review and meta-analysis of regulatory and mortality data. Health Technol Assess. 2016;20(42):1–242.CrossRefPubMedPubMedCentral
4.
go back to reference Jefferson T, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Onakpoya I, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2014;4, CD008965. Jefferson T, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Onakpoya I, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2014;4, CD008965.
5.
go back to reference Fiore AE, Fry A, Shay D, Gubareva L, Bresee JS, Uyeki TM. Antiviral agents for the treatment and chemoprophylaxis of influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP). Recommendations and Reports. MMWR. 2011;60(RR01);1–24. Fiore AE, Fry A, Shay D, Gubareva L, Bresee JS, Uyeki TM. Antiviral agents for the treatment and chemoprophylaxis of influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP). Recommendations and Reports. MMWR. 2011;60(RR01);1–24.
6.
go back to reference Dobson J, Whitley RJ, Pocock S, Monto AS. Oseltamivir treatment for influenza in adults: a meta-analysis of randomised controlled trials. Lancet. 2015;385(9979):1729–37.CrossRefPubMed Dobson J, Whitley RJ, Pocock S, Monto AS. Oseltamivir treatment for influenza in adults: a meta-analysis of randomised controlled trials. Lancet. 2015;385(9979):1729–37.CrossRefPubMed
7.
go back to reference Hernan MA, Lipsitch M. Oseltamivir and risk of lower respiratory tract complications in patients with flu symptoms: a meta-analysis of eleven randomized clinical trials. Clin Infect Dis. 2011;53(3):277–9.CrossRefPubMedPubMedCentral Hernan MA, Lipsitch M. Oseltamivir and risk of lower respiratory tract complications in patients with flu symptoms: a meta-analysis of eleven randomized clinical trials. Clin Infect Dis. 2011;53(3):277–9.CrossRefPubMedPubMedCentral
8.
go back to reference Hsu J, Santesso N, Mustafa R, Brozek J, Chen YL, Hopkins JP, Cheung A, Hovhannisyan G, Ivanova L, Flottorp SA, et al. Antivirals for treatment of influenza: a systematic review and meta-analysis of observational studies. Ann Intern Med. 2012;156(7):512–24.CrossRefPubMed Hsu J, Santesso N, Mustafa R, Brozek J, Chen YL, Hopkins JP, Cheung A, Hovhannisyan G, Ivanova L, Flottorp SA, et al. Antivirals for treatment of influenza: a systematic review and meta-analysis of observational studies. Ann Intern Med. 2012;156(7):512–24.CrossRefPubMed
9.
go back to reference Havers F, Thaker S, Clippard JR, Jackson M, McLean HQ, Gaglani M, Monto AS, Zimmerman RK, Jackson L, Petrie JG, et al. Use of Influenza Antiviral Agents by Ambulatory Care Clinicians During the 2012–2013 Influenza Season. Clin Infect Dis. 2015;60(11):1677–80.CrossRefPubMedPubMedCentral Havers F, Thaker S, Clippard JR, Jackson M, McLean HQ, Gaglani M, Monto AS, Zimmerman RK, Jackson L, Petrie JG, et al. Use of Influenza Antiviral Agents by Ambulatory Care Clinicians During the 2012–2013 Influenza Season. Clin Infect Dis. 2015;60(11):1677–80.CrossRefPubMedPubMedCentral
11.
go back to reference Bright T, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux R, Samsa G, Hasselblad V, Williams J, Musty M, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43.CrossRefPubMed Bright T, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux R, Samsa G, Hasselblad V, Williams J, Musty M, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43.CrossRefPubMed
12.
go back to reference Patel RB, Mathur MB, Gould M, Uyeki TM, Bhattacharya J, Xiao Y, Khazeni N. Demographic and clinical predictors of mortality from highly pathogenic avian influenza A (H5N1) virus infection: CART analysis of international cases. PLoS One. 2014;9(3), e91630.CrossRefPubMedPubMedCentral Patel RB, Mathur MB, Gould M, Uyeki TM, Bhattacharya J, Xiao Y, Khazeni N. Demographic and clinical predictors of mortality from highly pathogenic avian influenza A (H5N1) virus infection: CART analysis of international cases. PLoS One. 2014;9(3), e91630.CrossRefPubMedPubMedCentral
13.
go back to reference Ebell MH, Afonso AM, Gonzales R, Stein J, Genton B, Senn N. Development and validation of a clinical decision rule for the diagnosis of influenza. J Am Board Fam Med. 2012;25(1):55–62.CrossRefPubMed Ebell MH, Afonso AM, Gonzales R, Stein J, Genton B, Senn N. Development and validation of a clinical decision rule for the diagnosis of influenza. J Am Board Fam Med. 2012;25(1):55–62.CrossRefPubMed
14.
go back to reference Afonso AM, Ebell MH, Gonzales R, Stein J, Genton B, Senn N. The use of classification and regression trees to predict the likelihood of seasonal influenza. Fam Pract. 2012;29(6):671–7.CrossRefPubMed Afonso AM, Ebell MH, Gonzales R, Stein J, Genton B, Senn N. The use of classification and regression trees to predict the likelihood of seasonal influenza. Fam Pract. 2012;29(6):671–7.CrossRefPubMed
15.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees (Wadsworth statistics/probability). Boca Raton: Chapman & Hall; 1984. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees (Wadsworth statistics/probability). Boca Raton: Chapman & Hall; 1984.
16.
go back to reference Ohmit SE, Thompson MG, Petrie JG, Thaker SN, Jackson ML, Belongia EA, Zimmerman RK, Gaglani M, Lamerato L, Spencer SM, et al. Influenza vaccine effectiveness in the 2011–2012 season: protection against each circulating virus and the effect of prior vaccination on estimates. Clin Infect Dis. 2014;58(3):319–27.CrossRefPubMed Ohmit SE, Thompson MG, Petrie JG, Thaker SN, Jackson ML, Belongia EA, Zimmerman RK, Gaglani M, Lamerato L, Spencer SM, et al. Influenza vaccine effectiveness in the 2011–2012 season: protection against each circulating virus and the effect of prior vaccination on estimates. Clin Infect Dis. 2014;58(3):319–27.CrossRefPubMed
17.
go back to reference Spencer S, Gaglani M, Naleway A, Reynolds S, Ball S, Bozeman S, Henkle E, Meece J, Vandermause M, Clipper L, et al. Consistency of influenza A virus detection test results across respiratory specimen collection methods using real-time reverse transcription-PCR. J Clin Microbiol. 2013;51(11):3880–2.CrossRefPubMedPubMedCentral Spencer S, Gaglani M, Naleway A, Reynolds S, Ball S, Bozeman S, Henkle E, Meece J, Vandermause M, Clipper L, et al. Consistency of influenza A virus detection test results across respiratory specimen collection methods using real-time reverse transcription-PCR. J Clin Microbiol. 2013;51(11):3880–2.CrossRefPubMedPubMedCentral
18.
go back to reference Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17):2165–8.CrossRefPubMed Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17):2165–8.CrossRefPubMed
19.
go back to reference Foppa IM, Haber M, Ferdinands JM, Shay DK. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine. 2013;31(30):3104–9.CrossRefPubMed Foppa IM, Haber M, Ferdinands JM, Shay DK. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine. 2013;31(30):3104–9.CrossRefPubMed
20.
go back to reference De Serres G, Skowronski DM, Wu XW, Ambrose CS. The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveillance 2013; 18(37). De Serres G, Skowronski DM, Wu XW, Ambrose CS. The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveillance 2013; 18(37).
21.
go back to reference Monto AS, Gravenstein S, Elliott M, Colopy M, Schweinle J. Clinical signs and symptoms predicting influenza infection. Arch Intern Med. 2000;160(21):3243–7.CrossRefPubMed Monto AS, Gravenstein S, Elliott M, Colopy M, Schweinle J. Clinical signs and symptoms predicting influenza infection. Arch Intern Med. 2000;160(21):3243–7.CrossRefPubMed
22.
go back to reference Stein J, Louie J, Flanders S, Maselli J, Hacker JK, Drew WL, Gonzales R. Performance characteristics of clinical diagnosis, a clinical decision rule, and a rapid influenza test in the detection of influenza infection in a community sample of adults. Ann Emerg Med. 2005;46(5):412–9.CrossRefPubMed Stein J, Louie J, Flanders S, Maselli J, Hacker JK, Drew WL, Gonzales R. Performance characteristics of clinical diagnosis, a clinical decision rule, and a rapid influenza test in the detection of influenza infection in a community sample of adults. Ann Emerg Med. 2005;46(5):412–9.CrossRefPubMed
23.
go back to reference Ohmit SE, Monto AS. Symptomatic predictors of influenza virus positivity in children during the influenza season. Clin Infect Dis. 2006;43(5):564–8.CrossRefPubMed Ohmit SE, Monto AS. Symptomatic predictors of influenza virus positivity in children during the influenza season. Clin Infect Dis. 2006;43(5):564–8.CrossRefPubMed
25.
go back to reference Pauker SG, Kassirer JP. The threshold approach to clinical decision making. N Engl J Med. 1980;302(20):1109–17.CrossRefPubMed Pauker SG, Kassirer JP. The threshold approach to clinical decision making. N Engl J Med. 1980;302(20):1109–17.CrossRefPubMed
26.
go back to reference Ebell MH, Locatelli I, Senn N. A novel approach to the determination of clinical decision thresholds. Evid Based Med. 2015. Ebell MH, Locatelli I, Senn N. A novel approach to the determination of clinical decision thresholds. Evid Based Med. 2015.
27.
go back to reference Havers FP, Flannery B, Clippard JR, Gaglani M, Zimmerman RK, Jackson LA, Petrie JG, McLean HQ, Nowalk MP, Jackson ML, et al. Use of influenza antiviral medications among outpatients at high risk for influenza-associated complications during the 2013–14 influenza season. Clin Infect Dis. 2015. Havers FP, Flannery B, Clippard JR, Gaglani M, Zimmerman RK, Jackson LA, Petrie JG, McLean HQ, Nowalk MP, Jackson ML, et al. Use of influenza antiviral medications among outpatients at high risk for influenza-associated complications during the 2013–14 influenza season. Clin Infect Dis. 2015.
28.
go back to reference Nelson RE, Stockmann C, Hersh AL, Pavia AT, Korgenksi K, Daly JA, Couturier MR, Ampofo K, Thorell EA, Doby EH, et al. Economic analysis of rapid and sensitive polymerase chain reaction testing in the emergency department for influenza infections in children. Pediatr Infect Dis J. 2015;34(6):577–82.CrossRefPubMed Nelson RE, Stockmann C, Hersh AL, Pavia AT, Korgenksi K, Daly JA, Couturier MR, Ampofo K, Thorell EA, Doby EH, et al. Economic analysis of rapid and sensitive polymerase chain reaction testing in the emergency department for influenza infections in children. Pediatr Infect Dis J. 2015;34(6):577–82.CrossRefPubMed
29.
go back to reference Nicholson KG, Abrams KR, Batham S, Medina MJ, Warren FC, Barer M, Bermingham A, Clark TW, Latimer N, Fraser M, et al. Randomised controlled trial and health economic evaluation of the impact of diagnostic testing for influenza, respiratory syncytial virus and Streptococcus pneumoniae infection on the management of acute admissions in the elderly and high-risk 18- to 64-year-olds. Health Technol Assess. 2014;18(36):1–274. vii-viii.CrossRefPubMedPubMedCentral Nicholson KG, Abrams KR, Batham S, Medina MJ, Warren FC, Barer M, Bermingham A, Clark TW, Latimer N, Fraser M, et al. Randomised controlled trial and health economic evaluation of the impact of diagnostic testing for influenza, respiratory syncytial virus and Streptococcus pneumoniae infection on the management of acute admissions in the elderly and high-risk 18- to 64-year-olds. Health Technol Assess. 2014;18(36):1–274. vii-viii.CrossRefPubMedPubMedCentral
Metadata
Title
Classification and Regression Tree (CART) analysis to predict influenza in primary care patients
Authors
Richard K. Zimmerman
G. K. Balasubramani
Mary Patricia Nowalk
Heather Eng
Leonard Urbanski
Michael L. Jackson
Lisa A. Jackson
Huong Q. McLean
Edward A. Belongia
Arnold S. Monto
Ryan E. Malosh
Manjusha Gaglani
Lydia Clipper
Brendan Flannery
Stephen R. Wisniewski
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Infectious Diseases / Issue 1/2016
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-016-1839-x

Other articles of this Issue 1/2016

BMC Infectious Diseases 1/2016 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.