Skip to main content
Top
Published in: BMC Pulmonary Medicine 1/2018

Open Access 01-12-2018 | Research article

Automated chart review utilizing natural language processing algorithm for asthma predictive index

Authors: Harsheen Kaur, Sunghwan Sohn, Chung-Il Wi, Euijung Ryu, Miguel A. Park, Kay Bachman, Hirohito Kita, Ivana Croghan, Jose A. Castro-Rodriguez, Gretchen A. Voge, Hongfang Liu, Young J. Juhn

Published in: BMC Pulmonary Medicine | Issue 1/2018

Login to get access

Abstract

Background

Thus far, no algorithms have been developed to automatically extract patients who meet Asthma Predictive Index (API) criteria from the Electronic health records (EHR) yet. Our objective is to develop and validate a natural language processing (NLP) algorithm to identify patients that meet API criteria.

Methods

This is a cross-sectional study nested in a birth cohort study in Olmsted County, MN. Asthma status ascertained by manual chart review based on API criteria served as gold standard. NLP-API was developed on a training cohort (n = 87) and validated on a test cohort (n = 427). Criterion validity was measured by sensitivity, specificity, positive predictive value and negative predictive value of the NLP algorithm against manual chart review for asthma status. Construct validity was determined by associations of asthma status defined by NLP-API with known risk factors for asthma.

Results

Among the eligible 427 subjects of the test cohort, 48% were males and 74% were White. Median age was 5.3 years (interquartile range 3.6–6.8). 35 (8%) had a history of asthma by NLP-API vs. 36 (8%) by abstractor with 31 by both approaches. NLP-API predicted asthma status with sensitivity 86%, specificity 98%, positive predictive value 88%, negative predictive value 98%. Asthma status by both NLP and manual chart review were significantly associated with the known asthma risk factors, such as history of allergic rhinitis, eczema, family history of asthma, and maternal history of smoking during pregnancy (p value < 0.05). Maternal smoking [odds ratio: 4.4, 95% confidence interval 1.8–10.7] was associated with asthma status determined by NLP-API and abstractor, and the effect sizes were similar between the reviews with 4.4 vs 4.2 respectively.

Conclusion

NLP-API was able to ascertain asthma status in children mining from EHR and has a potential to enhance asthma care and research through population management and large-scale studies when identifying children who meet API criteria.
Literature
2.
go back to reference Centers for Disease Control and Prevention. Vital signs: asthma prevalence, disease characteristics, and self-management education: United States, 2001--2009. MMWR Morb Mortal Wkly Rep. 2011;60(17):547–52. Centers for Disease Control and Prevention. Vital signs: asthma prevalence, disease characteristics, and self-management education: United States, 2001--2009. MMWR Morb Mortal Wkly Rep. 2011;60(17):547–52.
3.
go back to reference Asher MI, et al. Worldwide time trends in the prevalence of symptoms of asthma, allergic rhinoconjunctivitis, and eczema in childhood: ISAAC phases one and three repeat multicountry cross-sectional surveys. Lancet. 2006;368(9537):733–43.CrossRefPubMed Asher MI, et al. Worldwide time trends in the prevalence of symptoms of asthma, allergic rhinoconjunctivitis, and eczema in childhood: ISAAC phases one and three repeat multicountry cross-sectional surveys. Lancet. 2006;368(9537):733–43.CrossRefPubMed
4.
go back to reference Nurmagambetov T, et al. State-level medical and absenteeism cost of asthma in the United States. J Asthma. 2017;54(4):357–70.CrossRefPubMed Nurmagambetov T, et al. State-level medical and absenteeism cost of asthma in the United States. J Asthma. 2017;54(4):357–70.CrossRefPubMed
5.
go back to reference Mukherjee M, et al. The epidemiology, healthcare and societal burden and costs of asthma in the UK and its member nations: analyses of standalone and linked national databases. BMC Med. 2016;14(1):113.CrossRefPubMedPubMedCentral Mukherjee M, et al. The epidemiology, healthcare and societal burden and costs of asthma in the UK and its member nations: analyses of standalone and linked national databases. BMC Med. 2016;14(1):113.CrossRefPubMedPubMedCentral
6.
go back to reference Deborah AM. Genetics of asthma and allergy: what have we learned? J Allergy Clin Immunol. 2010;126(3):439–46.CrossRef Deborah AM. Genetics of asthma and allergy: what have we learned? J Allergy Clin Immunol. 2010;126(3):439–46.CrossRef
7.
go back to reference Ducharme FM, et al. Preemptive use of high-dose Fluticasone for virus-induced wheezing in young children. N Engl J Med. 2009;360(4):339–53.CrossRefPubMed Ducharme FM, et al. Preemptive use of high-dose Fluticasone for virus-induced wheezing in young children. N Engl J Med. 2009;360(4):339–53.CrossRefPubMed
8.
go back to reference Panickar J, et al. Oral Prednisolone for preschool children with acute virus-induced wheezing. N Engl J Med. 2009;360(4):329–38.CrossRefPubMed Panickar J, et al. Oral Prednisolone for preschool children with acute virus-induced wheezing. N Engl J Med. 2009;360(4):329–38.CrossRefPubMed
9.
go back to reference Fitzpatrick AM, et al. Heterogeneity of severe asthma in childhood: confirmation by cluster analysis of children in the National Institutes of Health/National Heart, Lung, and Blood Institute severe asthma research program. J Allergy Clin Immunol. 2011;127(2):382–9. e13CrossRefPubMed Fitzpatrick AM, et al. Heterogeneity of severe asthma in childhood: confirmation by cluster analysis of children in the National Institutes of Health/National Heart, Lung, and Blood Institute severe asthma research program. J Allergy Clin Immunol. 2011;127(2):382–9. e13CrossRefPubMed
10.
go back to reference Moore WC, et al. Identification of asthma phenotypes using cluster analysis in the severe asthma research program. Am J Respir Crit Care Med. 2010;181(4):315–23.CrossRefPubMed Moore WC, et al. Identification of asthma phenotypes using cluster analysis in the severe asthma research program. Am J Respir Crit Care Med. 2010;181(4):315–23.CrossRefPubMed
11.
go back to reference Miller JE, Gaboda D, Davis D. Early childhood chronic illness: comparability of maternal reports and medical records. Vital Health Stat 2. 2001;131:1–10. Miller JE, Gaboda D, Davis D. Early childhood chronic illness: comparability of maternal reports and medical records. Vital Health Stat 2. 2001;131:1–10.
12.
go back to reference Radhakrishnan DK, et al. Trends in the age of diagnosis of childhood asthma. J Allergy Clin Immunol. 2014;134(5):1057–62. e5CrossRefPubMed Radhakrishnan DK, et al. Trends in the age of diagnosis of childhood asthma. J Allergy Clin Immunol. 2014;134(5):1057–62. e5CrossRefPubMed
13.
go back to reference Kuehni CE, Frey U. Age-related differences in perceived asthma control in childhood: guidelines and reality. Eur Respir J. 2002;20(4):880–9.CrossRefPubMed Kuehni CE, Frey U. Age-related differences in perceived asthma control in childhood: guidelines and reality. Eur Respir J. 2002;20(4):880–9.CrossRefPubMed
14.
go back to reference Morgan WJ, et al. Outcome of asthma and wheezing in the first 6 years of life: follow-up through adolescence. Am J Respir Crit Care Med. 2005;172(10):1253–8.CrossRefPubMedPubMedCentral Morgan WJ, et al. Outcome of asthma and wheezing in the first 6 years of life: follow-up through adolescence. Am J Respir Crit Care Med. 2005;172(10):1253–8.CrossRefPubMedPubMedCentral
15.
go back to reference Castro-Rodriguez JA, et al. A clinical index to define risk of asthma in young children with recurrent wheezing. Am J Respir Crit Care Med. 2000;162(4 Pt 1):1403–6.CrossRefPubMed Castro-Rodriguez JA, et al. A clinical index to define risk of asthma in young children with recurrent wheezing. Am J Respir Crit Care Med. 2000;162(4 Pt 1):1403–6.CrossRefPubMed
16.
go back to reference Wu ST, et al. Automated chart review for asthma cohort identification using natural language processing: an exploratory study. Ann Allergy Asthma Immunol. 2013;111(5):364–9.CrossRefPubMed Wu ST, et al. Automated chart review for asthma cohort identification using natural language processing: an exploratory study. Ann Allergy Asthma Immunol. 2013;111(5):364–9.CrossRefPubMed
17.
go back to reference Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment. An automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.CrossRefPubMed Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment. An automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.CrossRefPubMed
19.
go back to reference Yunginger JW, et al. A community-based study of the epidemiology of asthma. Incidence rates, 1964-1983. Am Rev Respir Dis. 1992;146(4):888–94.CrossRefPubMed Yunginger JW, et al. A community-based study of the epidemiology of asthma. Incidence rates, 1964-1983. Am Rev Respir Dis. 1992;146(4):888–94.CrossRefPubMed
20.
go back to reference Yawn BP, et al. Allergic rhinitis in Rochester, Minnesota residents with asthma: frequency and impact on health care charges. J Allergy Clin Immunol. 1999;103(1 Pt 1):54–9.CrossRefPubMed Yawn BP, et al. Allergic rhinitis in Rochester, Minnesota residents with asthma: frequency and impact on health care charges. J Allergy Clin Immunol. 1999;103(1 Pt 1):54–9.CrossRefPubMed
21.
go back to reference Juhn YJ. Risks for infection in patients with asthma (or other atopic conditions): is asthma more than a chronic airway disease? J Allergy Clin Immunol. 2014;134(2):247.CrossRefPubMedPubMedCentral Juhn YJ. Risks for infection in patients with asthma (or other atopic conditions): is asthma more than a chronic airway disease? J Allergy Clin Immunol. 2014;134(2):247.CrossRefPubMedPubMedCentral
23.
go back to reference Wi CI, Park MA, Juhn YJ. Development and initial testing of asthma predictive index for a retrospective study: an exploratory study. Journal Asthma. 2015;52(2):183–90.CrossRef Wi CI, Park MA, Juhn YJ. Development and initial testing of asthma predictive index for a retrospective study: an exploratory study. Journal Asthma. 2015;52(2):183–90.CrossRef
24.
go back to reference National Asthma Education and Prevention Program. Expert Panel Report 3 (EPR-3): Guidelines for the Diagnosis and Management of Asthma-Summary Report 2007. J Allergy Clin Immunol. 2007;120(5 Suppl):S94–138. National Asthma Education and Prevention Program. Expert Panel Report 3 (EPR-3): Guidelines for the Diagnosis and Management of Asthma-Summary Report 2007. J Allergy Clin Immunol. 2007;120(5 Suppl):S94–138.
25.
go back to reference Yawn BP, et al. The impact of requiring patient authorization for use of data in medical records research. J Fam Pract. 1998;47(5):361–5.PubMed Yawn BP, et al. The impact of requiring patient authorization for use of data in medical records research. J Fam Pract. 1998;47(5):361–5.PubMed
26.
go back to reference Rocca WA, et al. History of the Rochester epidemiology project: half a century of medical records linkage in a US population. Mayo Clinic Proc. 2012;87(12):1202–13.CrossRef Rocca WA, et al. History of the Rochester epidemiology project: half a century of medical records linkage in a US population. Mayo Clinic Proc. 2012;87(12):1202–13.CrossRef
28.
go back to reference Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment: an automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.CrossRefPubMed Wi CI, et al. Application of a natural language processing algorithm to asthma ascertainment: an automated chart review. Am J Respir Crit Care Med. 2017;196(4):430–7.CrossRefPubMed
29.
go back to reference Klaassen EM, et al. Exhaled biomarkers and gene expression at preschool age improve asthma prediction at 6 years of age. Am J Respir Crit Care Med. 2015;191(2):201–7.CrossRefPubMed Klaassen EM, et al. Exhaled biomarkers and gene expression at preschool age improve asthma prediction at 6 years of age. Am J Respir Crit Care Med. 2015;191(2):201–7.CrossRefPubMed
30.
go back to reference Castro-Rodriguez, J.A., et al., Risk and Protective Factors for Childhood Asthma: What Is the Evidence? J Allergy Clin Immunol Pract. 2016. 4(6): p. 1111-1122. Castro-Rodriguez, J.A., et al., Risk and Protective Factors for Childhood Asthma: What Is the Evidence? J Allergy Clin Immunol Pract. 2016. 4(6): p. 1111-1122.
32.
33.
go back to reference Dustin Charles, M.M.G., PhD; Talisha Searcy, MPA, MA Adoption of Electronic Health Record Systems among U.S. Non Federal Acute Care Hospitals: 2008–2014, in ONC Data Brief. 2015, Office of the National Coordinator for Health Information Technology (ONC). Dustin Charles, M.M.G., PhD; Talisha Searcy, MPA, MA Adoption of Electronic Health Record Systems among U.S. Non Federal Acute Care Hospitals: 2008–2014, in ONC Data Brief. 2015, Office of the National Coordinator for Health Information Technology (ONC).
34.
go back to reference Kirby JC, et al. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. Journal of the American Medical Informatics Association: JAMIA. 2016;23(6):1046–52.CrossRefPubMedPubMedCentral Kirby JC, et al. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. Journal of the American Medical Informatics Association: JAMIA. 2016;23(6):1046–52.CrossRefPubMedPubMedCentral
35.
go back to reference Heinze, D.T. and M.L. Morsch, Automatically assigning medical codes using natural language processing. 2005, Google Patents. Heinze, D.T. and M.L. Morsch, Automatically assigning medical codes using natural language processing. 2005, Google Patents.
36.
go back to reference Friedman C, et al. GENIES: a natural-language processing system for the extraction of molecular pathways from journal articles. Bioinformatics. 2001;17(suppl 1):S74–82.CrossRefPubMed Friedman C, et al. GENIES: a natural-language processing system for the extraction of molecular pathways from journal articles. Bioinformatics. 2001;17(suppl 1):S74–82.CrossRefPubMed
37.
go back to reference Hripcsak G, et al. Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports 1. Radiology. 2002;224(1):157–63.CrossRefPubMed Hripcsak G, et al. Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports 1. Radiology. 2002;224(1):157–63.CrossRefPubMed
38.
go back to reference Murff HJ, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306(8):848–55.CrossRefPubMed Murff HJ, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306(8):848–55.CrossRefPubMed
39.
go back to reference Zeng QT, et al. Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak. 2006;6:30.CrossRefPubMedPubMedCentral Zeng QT, et al. Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system. BMC Med Inform Decis Mak. 2006;6:30.CrossRefPubMedPubMedCentral
40.
go back to reference Pacheco JA, et al. A highly specific algorithm for identifying asthma cases and controls for genome-wide association studies. AMIA Annu Symp Proc. 2009;2009:497–501. AMIA SymposiumPubMedPubMedCentral Pacheco JA, et al. A highly specific algorithm for identifying asthma cases and controls for genome-wide association studies. AMIA Annu Symp Proc. 2009;2009:497–501. AMIA SymposiumPubMedPubMedCentral
41.
go back to reference Ertle, A.R., E.M. Campbell, and W.R. Hersh, Automated application of clinical practice guidelines for asthma management. Proceedings : a conference of the American Medical Informatics Association / ... AMIA Annual Fall Symposium. AMIA Fall Symposium, 1996: p. 552–6. Ertle, A.R., E.M. Campbell, and W.R. Hersh, Automated application of clinical practice guidelines for asthma management. Proceedings : a conference of the American Medical Informatics Association / ... AMIA Annual Fall Symposium. AMIA Fall Symposium, 1996: p. 552–6.
42.
go back to reference Huffaker MF, Phipatanakul W. Utility of the asthma predictive index in predicting childhood asthma and identifying disease-modifying interventions. Ann Allergy Asthma Immunol. 2014;112(3):188–90.CrossRefPubMed Huffaker MF, Phipatanakul W. Utility of the asthma predictive index in predicting childhood asthma and identifying disease-modifying interventions. Ann Allergy Asthma Immunol. 2014;112(3):188–90.CrossRefPubMed
43.
go back to reference Sohn, S., et al., Clinical documentation variations and NLP system portability: a case study in asthma birth cohorts across institutions. J Am Med Inform Assoc 2017 (Epub ahead of print). Sohn, S., et al., Clinical documentation variations and NLP system portability: a case study in asthma birth cohorts across institutions. J Am Med Inform Assoc 2017 (Epub ahead of print).
44.
go back to reference Juhn YJ, et al. The potential biases in studying the relationship between asthma and microbial infection. J Asthma. 2007;44(10):827–32.CrossRefPubMed Juhn YJ, et al. The potential biases in studying the relationship between asthma and microbial infection. J Asthma. 2007;44(10):827–32.CrossRefPubMed
45.
go back to reference Voigt RG, et al. Why parents seek medical evaluations for their children with mild acute illnesses. Clin Pediatr (Phila). 2008;47(3):244–51.CrossRef Voigt RG, et al. Why parents seek medical evaluations for their children with mild acute illnesses. Clin Pediatr (Phila). 2008;47(3):244–51.CrossRef
Metadata
Title
Automated chart review utilizing natural language processing algorithm for asthma predictive index
Authors
Harsheen Kaur
Sunghwan Sohn
Chung-Il Wi
Euijung Ryu
Miguel A. Park
Kay Bachman
Hirohito Kita
Ivana Croghan
Jose A. Castro-Rodriguez
Gretchen A. Voge
Hongfang Liu
Young J. Juhn
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Pulmonary Medicine / Issue 1/2018
Electronic ISSN: 1471-2466
DOI
https://doi.org/10.1186/s12890-018-0593-9

Other articles of this Issue 1/2018

BMC Pulmonary Medicine 1/2018 Go to the issue