Skip to main content
Top
Published in: BMC Oral Health 1/2021

Open Access 01-12-2021 | Care | Research

Assessing the completeness of periodontal disease documentation in the EHR: a first step in measuring the quality of care

Authors: Joanna Mullins, Alfa Yansane, Shwetha V. Kumar, Suhasini Bangar, Ana Neumann, Todd R. Johnson, Gregory W. Olson, Krishna Kumar Kookal, Emily Sedlock, Aram Kim, Elizabeth Mertz, Ryan Brandon, Kristen Simmons, Joel M. White, Elsbeth Kalenderian, Muhammad F. Walji

Published in: BMC Oral Health | Issue 1/2021

Login to get access

Abstract

Background

Our objective was to measure the proportion of patients for which comprehensive periodontal charting, periodontal disease risk factors (diabetes status, tobacco use, and oral home care compliance), and periodontal diagnoses were documented in the electronic health record (EHR). We developed an EHR-based quality measure to assess how well four dental institutions documented periodontal disease-related information. An automated database script was developed and implemented in the EHR at each institution. The measure was validated by comparing the findings from the measure with a manual review of charts.

Results

The overall measure scores varied significantly across the four institutions (institution 1 = 20.47%, institution 2 = 0.97%, institution 3 = 22.27% institution 4 = 99.49%, p-value < 0.0001). The largest gaps in documentation were related to periodontal diagnoses and capturing oral homecare compliance. A random sample of 1224 charts were manually reviewed and showed excellent validity when compared with the data generated from the EHR-based measure (Sensitivity, Specificity, PPV, and NPV > 80%).

Conclusion

Our results demonstrate the feasibility of developing automated data extraction scripts using structured data from EHRs, and successfully implementing these to identify and measure the periodontal documentation completeness within and across different dental institutions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bloomrosen M, Detmer DE. Informatics, evidence-based care, and research; implications for national policy: a report of an American Medical Informatics Association health policy conference. J Am Med Inform Assoc. 2010;17(2):115–23.PubMedPubMedCentralCrossRef Bloomrosen M, Detmer DE. Informatics, evidence-based care, and research; implications for national policy: a report of an American Medical Informatics Association health policy conference. J Am Med Inform Assoc. 2010;17(2):115–23.PubMedPubMedCentralCrossRef
2.
go back to reference Timmermans S, Berg M. The gold standard: The challenge of evidence-based medicine and standardization in health care. Philadelphia: Temple University Press; 2010. Timmermans S, Berg M. The gold standard: The challenge of evidence-based medicine and standardization in health care. Philadelphia: Temple University Press; 2010.
3.
go back to reference Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability measures—using measurement to promote quality improvement. Waltham: Mass Medical Soc; 2010.CrossRef Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability measures—using measurement to promote quality improvement. Waltham: Mass Medical Soc; 2010.CrossRef
4.
go back to reference Jha AK, Joynt KE, Orav EJ, Epstein AM. The long-term effect of premier pay for performance on patient outcomes. N Engl J Med. 2012;366(17):1606–15.PubMedCrossRef Jha AK, Joynt KE, Orav EJ, Epstein AM. The long-term effect of premier pay for performance on patient outcomes. N Engl J Med. 2012;366(17):1606–15.PubMedCrossRef
6.
go back to reference Herndon JB, Tomar SL, Catalanotto FA, Rudner N, Huang I-C, Aravamudhan K, et al. Measuring quality of dental care: caries prevention services for children. J Am Dent Assoc. 2015;146(8):581–91.PubMedCrossRef Herndon JB, Tomar SL, Catalanotto FA, Rudner N, Huang I-C, Aravamudhan K, et al. Measuring quality of dental care: caries prevention services for children. J Am Dent Assoc. 2015;146(8):581–91.PubMedCrossRef
7.
go back to reference Herndon JB, Crall JJ, Aravamudhan K, Catalanotto FA, Huang IC, Rudner N, et al. Developing and testing pediatric oral healthcare quality measures. J Public Health Dent. 2015;75(3):191–201.PubMedCrossRef Herndon JB, Crall JJ, Aravamudhan K, Catalanotto FA, Huang IC, Rudner N, et al. Developing and testing pediatric oral healthcare quality measures. J Public Health Dent. 2015;75(3):191–201.PubMedCrossRef
9.
go back to reference Simmons K, Gibson S, White JM. Drivers advancing oral health in a large group dental practice organization. J Evid Based Dent Pract. 2016;16:104–12.PubMedCrossRef Simmons K, Gibson S, White JM. Drivers advancing oral health in a large group dental practice organization. J Evid Based Dent Pract. 2016;16:104–12.PubMedCrossRef
10.
go back to reference Blumenthal D, Tavenner M. The, “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4.PubMedCrossRef Blumenthal D, Tavenner M. The, “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4.PubMedCrossRef
11.
go back to reference Kalenderian E, Walji M, Ramoni RB. “Meaningful use” of EHR in dental school clinics: how to benefit from the U.S. HITECH Act’s financial and quality improvement incentives. J Dent Educ. 2013;77(4):401–15.PubMedCrossRef Kalenderian E, Walji M, Ramoni RB. “Meaningful use” of EHR in dental school clinics: how to benefit from the U.S. HITECH Act’s financial and quality improvement incentives. J Dent Educ. 2013;77(4):401–15.PubMedCrossRef
12.
go back to reference Bhardwaj A, Ramoni R, Kalenderian E, Neumann A, Hebballi NB, White JM, et al. Measuring up: implementing a dental quality measure in the electronic health record context. J Am Dent Assoc. 2016;147(1):35–40.PubMedCrossRef Bhardwaj A, Ramoni R, Kalenderian E, Neumann A, Hebballi NB, White JM, et al. Measuring up: implementing a dental quality measure in the electronic health record context. J Am Dent Assoc. 2016;147(1):35–40.PubMedCrossRef
13.
go back to reference Neumann A, Kalenderian E, Ramoni R, Yansane A, Tokede B, Etolue J, et al. Evaluating quality of dental care among patients with diabetes: adaptation and testing of a dental quality measure in electronic health records. J Am Dent Assoc. 2017;148(9):634-43.e1.PubMedPubMedCentralCrossRef Neumann A, Kalenderian E, Ramoni R, Yansane A, Tokede B, Etolue J, et al. Evaluating quality of dental care among patients with diabetes: adaptation and testing of a dental quality measure in electronic health records. J Am Dent Assoc. 2017;148(9):634-43.e1.PubMedPubMedCentralCrossRef
14.
go back to reference Kumar SV, Bangar S, Neumann A, Kookal KK, Yansane A, Tokede O, et al. Assessing the validity of existing dental sealant quality measures. J Am Dent Assoc. 2018;149(9):756-64.e1.PubMedCrossRefPubMedCentral Kumar SV, Bangar S, Neumann A, Kookal KK, Yansane A, Tokede O, et al. Assessing the validity of existing dental sealant quality measures. J Am Dent Assoc. 2018;149(9):756-64.e1.PubMedCrossRefPubMedCentral
15.
16.
go back to reference Eke PI, Dye BA, Wei L, Thornton-Evans GO, Genco RJ. Prevalence of periodontitis in adults in the United States: 2009 and 2010. J Dent Res. 2012;91(10):914–20.PubMedCrossRef Eke PI, Dye BA, Wei L, Thornton-Evans GO, Genco RJ. Prevalence of periodontitis in adults in the United States: 2009 and 2010. J Dent Res. 2012;91(10):914–20.PubMedCrossRef
17.
go back to reference Lang NP, Suvan JE, Tonetti MS. Risk factor assessment tools for the prevention of periodontitis progression a systematic review. J Clin Periodontol. 2015;42:S59–70.PubMedCrossRef Lang NP, Suvan JE, Tonetti MS. Risk factor assessment tools for the prevention of periodontitis progression a systematic review. J Clin Periodontol. 2015;42:S59–70.PubMedCrossRef
19.
go back to reference De Wet L, Slot D, Van der Weijden G. Supportive periodontal treatment: Pocket depth changes and tooth loss. Int J Dent Hyg. 2018;16(2):210–8.PubMedCrossRef De Wet L, Slot D, Van der Weijden G. Supportive periodontal treatment: Pocket depth changes and tooth loss. Int J Dent Hyg. 2018;16(2):210–8.PubMedCrossRef
20.
go back to reference Thyvalikakath T, Song M, Schleyer T. Perceptions and attitudes toward performing risk assessment for periodontal disease: a focus group exploration. BMC Oral Health. 2018;18(1):90.PubMedPubMedCentralCrossRef Thyvalikakath T, Song M, Schleyer T. Perceptions and attitudes toward performing risk assessment for periodontal disease: a focus group exploration. BMC Oral Health. 2018;18(1):90.PubMedPubMedCentralCrossRef
21.
go back to reference Trombelli L, Minenna L, Toselli L, Zaetta A, Checchi L, Checchi V, et al. Prognostic value of a simplified method for periodontal risk assessment during supportive periodontal therapy. J Clin Periodontol. 2017;44(1):51–7.PubMedCrossRef Trombelli L, Minenna L, Toselli L, Zaetta A, Checchi L, Checchi V, et al. Prognostic value of a simplified method for periodontal risk assessment during supportive periodontal therapy. J Clin Periodontol. 2017;44(1):51–7.PubMedCrossRef
22.
go back to reference Mullins JM, Even JB, White JM. Periodontal management by risk assessment: a pragmatic approach. J Evid Based Dent Pract. 2016;16:91–8.PubMedCrossRef Mullins JM, Even JB, White JM. Periodontal management by risk assessment: a pragmatic approach. J Evid Based Dent Pract. 2016;16:91–8.PubMedCrossRef
24.
go back to reference Preshaw PM. Detection and diagnosis of periodontal conditions amenable to prevention. BMC Oral Health. 2015;15(1):S5. Preshaw PM. Detection and diagnosis of periodontal conditions amenable to prevention. BMC Oral Health. 2015;15(1):S5.
26.
go back to reference Du M, Bo T, Kapellas K, Peres MA. Prediction models for the incidence and progression of periodontitis: A systematic review. J Clin Periodontol. 2018;45(12):1408–20. Du M, Bo T, Kapellas K, Peres MA. Prediction models for the incidence and progression of periodontitis: A systematic review. J Clin Periodontol. 2018;45(12):1408–20.
27.
go back to reference Martin J, Mills S, Foley ME. Innovative models of dental care delivery and coverage: patient-centric dental benefits based on digital oral health risk assessment. Dent Clin N Am. 2018;62(2):319–25.PubMedCrossRef Martin J, Mills S, Foley ME. Innovative models of dental care delivery and coverage: patient-centric dental benefits based on digital oral health risk assessment. Dent Clin N Am. 2018;62(2):319–25.PubMedCrossRef
28.
go back to reference Page RC, Martin JA. Quantification of periodontal risk and disease severity and extent using the Oral Health Information Suite (OHIS). Periodontal Practice Today. 2007;4(3):163–80. Page RC, Martin JA. Quantification of periodontal risk and disease severity and extent using the Oral Health Information Suite (OHIS). Periodontal Practice Today. 2007;4(3):163–80.
29.
go back to reference Lane BA, Luepke P, Chaves E, Maupome G, Eckert GJ, Blanchard S, et al. Assessment of the calibration of periodontal diagnosis and treatment planning among dental students at three dental schools. J Dent Educ. 2015;79(1):16–24. PubMedCrossRef Lane BA, Luepke P, Chaves E, Maupome G, Eckert GJ, Blanchard S, et al. Assessment of the calibration of periodontal diagnosis and treatment planning among dental students at three dental schools. J Dent Educ. 2015;79(1):16–24. PubMedCrossRef
30.
go back to reference Genco RJ, Genco FD. Common risk factors in the management of periodontal and associated systemic diseases: the dental setting and interprofessional collaboration. J Evid Based Dent Pract. 2014;14(Suppl):4–16.PubMedCrossRef Genco RJ, Genco FD. Common risk factors in the management of periodontal and associated systemic diseases: the dental setting and interprofessional collaboration. J Evid Based Dent Pract. 2014;14(Suppl):4–16.PubMedCrossRef
31.
go back to reference Mealey BL, Oates TW. Diabetes mellitus and periodontal diseases. J Periodontol. 2006;77(8):1289–303.PubMedCrossRef Mealey BL, Oates TW. Diabetes mellitus and periodontal diseases. J Periodontol. 2006;77(8):1289–303.PubMedCrossRef
32.
go back to reference Lindskog S, Blomlof J, Persson I, Niklason A, Hedin A, Ericsson L, et al. Validation of an algorithm for chronic periodontitis risk assessment and prognostication: risk predictors, explanatory values, measures of quality, and clinical use. J Periodontol. 2010;81(4):584–93.PubMedCrossRef Lindskog S, Blomlof J, Persson I, Niklason A, Hedin A, Ericsson L, et al. Validation of an algorithm for chronic periodontitis risk assessment and prognostication: risk predictors, explanatory values, measures of quality, and clinical use. J Periodontol. 2010;81(4):584–93.PubMedCrossRef
34.
go back to reference Yansane A, Tokede O, White J, Etolue J, McClellan L, Walji M, et al. Utilization and validity of the dental diagnostic system over time in academic and private practice. JDR Clin Trans Res. 2019;4(2):143–50.PubMed Yansane A, Tokede O, White J, Etolue J, McClellan L, Walji M, et al. Utilization and validity of the dental diagnostic system over time in academic and private practice. JDR Clin Trans Res. 2019;4(2):143–50.PubMed
35.
go back to reference Armitage GC. Development of a classification system for periodontal diseases and conditions. Ann Periodontol. 1999;4(1):1–6.PubMedCrossRef Armitage GC. Development of a classification system for periodontal diseases and conditions. Ann Periodontol. 1999;4(1):1–6.PubMedCrossRef
36.
go back to reference Neumann A, Kumar S, Bangar S, Kookal KK, Spallek H, Tokede O, et al. Tobacco screening and cessation efforts by dental providers: a quality measure evaluation. J Public Health Dent. 2019;79(2):93–101.PubMedCrossRef Neumann A, Kumar S, Bangar S, Kookal KK, Spallek H, Tokede O, et al. Tobacco screening and cessation efforts by dental providers: a quality measure evaluation. J Public Health Dent. 2019;79(2):93–101.PubMedCrossRef
37.
go back to reference Neumann A, Obadan-Udoh E, Bangar S, Kumar SV, Tokede O, Kim A, et al. Number of pregnant women at four dental clinics and the care they received: a dental quality emeasure evaluation. Journal of dental education. 2019;83(10):1158–65. Neumann A, Obadan-Udoh E, Bangar S, Kumar SV, Tokede O, Kim A, et al. Number of pregnant women at four dental clinics and the care they received: a dental quality emeasure evaluation. Journal of dental education. 2019;83(10):1158–65.
38.
go back to reference Cunningham M, editor. More than just the kappa coefficient: a program to fully characterize inter-rater reliability between two raters. SAS global forum. Washington: Gaylord National Resort and Convention Center; 2009. Cunningham M, editor. More than just the kappa coefficient: a program to fully characterize inter-rater reliability between two raters. SAS global forum. Washington: Gaylord National Resort and Convention Center; 2009.
39.
go back to reference Kalenderian E, Ramoni RL, White JM, Schoonheim-Klein ME, Stark PC, Kimmes NS, et al. The development of a dental diagnostic terminology. J Dent Educ. 2011;75(1):68–76.PubMedPubMedCentralCrossRef Kalenderian E, Ramoni RL, White JM, Schoonheim-Klein ME, Stark PC, Kimmes NS, et al. The development of a dental diagnostic terminology. J Dent Educ. 2011;75(1):68–76.PubMedPubMedCentralCrossRef
40.
go back to reference Kalenderian E, Tokede B, Ramoni R, Khan M, Kimmes N, White J, et al. Dental clinical research: an illustration of the value of standardized diagnostic terms. J Public Health Dent. 2016;76(2):152–6.PubMedCrossRef Kalenderian E, Tokede B, Ramoni R, Khan M, Kimmes N, White J, et al. Dental clinical research: an illustration of the value of standardized diagnostic terms. J Public Health Dent. 2016;76(2):152–6.PubMedCrossRef
42.
go back to reference Page RC, Krall EA, Martin J, Mancl L, Garcia RI. Validity and accuracy of a risk calculator in predicting periodontal disease. J Am Dent Assoc. 2002;133(5):569–76.PubMedCrossRef Page RC, Krall EA, Martin J, Mancl L, Garcia RI. Validity and accuracy of a risk calculator in predicting periodontal disease. J Am Dent Assoc. 2002;133(5):569–76.PubMedCrossRef
43.
44.
go back to reference Mertz E, Wides C, White J. Clinician attitudes, skills, motivations and experience following the implementation of clinical decision support tools in a large dental practice. J Evid Based Dent Pract. 2017;17(1):1–12.PubMedCrossRef Mertz E, Wides C, White J. Clinician attitudes, skills, motivations and experience following the implementation of clinical decision support tools in a large dental practice. J Evid Based Dent Pract. 2017;17(1):1–12.PubMedCrossRef
45.
go back to reference Douglass CW. Risk assessment and management of periodontal disease. J Am Dent Assoc. 2006;137(Suppl):27S-32S.PubMedCrossRef Douglass CW. Risk assessment and management of periodontal disease. J Am Dent Assoc. 2006;137(Suppl):27S-32S.PubMedCrossRef
46.
go back to reference Marcenes W, Kassebaum NJ, Bernabé E, Flaxman A, Naghavi M, Lopez A, et al. Global burden of oral conditions in 1990–2010: a systematic analysis. J Dent Res. 2013;92(7):592–7.PubMedPubMedCentralCrossRef Marcenes W, Kassebaum NJ, Bernabé E, Flaxman A, Naghavi M, Lopez A, et al. Global burden of oral conditions in 1990–2010: a systematic analysis. J Dent Res. 2013;92(7):592–7.PubMedPubMedCentralCrossRef
47.
go back to reference Tonetti MS, Jepsen S, Jin L, Otomo-Corgel J. Impact of the global burden of periodontal diseases on health, nutrition and wellbeing of mankind: a call for global action. J Clin Periodontol. 2017;44(5):456–62.PubMedCrossRef Tonetti MS, Jepsen S, Jin L, Otomo-Corgel J. Impact of the global burden of periodontal diseases on health, nutrition and wellbeing of mankind: a call for global action. J Clin Periodontol. 2017;44(5):456–62.PubMedCrossRef
48.
go back to reference Ettinger RL. The unique oral health needs of an aging population. Dent Clin N Am. 1997;41(4):633–49.PubMedCrossRef Ettinger RL. The unique oral health needs of an aging population. Dent Clin N Am. 1997;41(4):633–49.PubMedCrossRef
49.
go back to reference Dall TM, Gallo PD, Chakrabarti R, West T, Semilla AP, Storm MV. An aging population and growing disease burden will require alarge and specialized health care workforce by 2025. Health Aff. 2013;32(11):2013–20.CrossRef Dall TM, Gallo PD, Chakrabarti R, West T, Semilla AP, Storm MV. An aging population and growing disease burden will require alarge and specialized health care workforce by 2025. Health Aff. 2013;32(11):2013–20.CrossRef
50.
go back to reference Ettinger RL. Oral health and the aging population. J Am Dent Assoc. 2007;138:S5–6.CrossRef Ettinger RL. Oral health and the aging population. J Am Dent Assoc. 2007;138:S5–6.CrossRef
51.
go back to reference Ogawa H, Yoshihara A, Hirotomi T, Ando Y, Miyazaki H. Risk factors for periodontal disease progression among elderly people. J Clin Periodontol. 2002;29(7):592–7.PubMedCrossRef Ogawa H, Yoshihara A, Hirotomi T, Ando Y, Miyazaki H. Risk factors for periodontal disease progression among elderly people. J Clin Periodontol. 2002;29(7):592–7.PubMedCrossRef
52.
go back to reference Lang NP, Suvan JE, Tonetti MS. Risk factor assessment tools for the prevention of periodontitis progression a systematic review. J Clin Periodontol. 2015;42(Suppl 16):S59-70.PubMedCrossRef Lang NP, Suvan JE, Tonetti MS. Risk factor assessment tools for the prevention of periodontitis progression a systematic review. J Clin Periodontol. 2015;42(Suppl 16):S59-70.PubMedCrossRef
53.
go back to reference Page RC, Martin JA, Loeb CF. The Oral Health Information Suite (OHIS): its use in the management of periodontal disease. J Dent Educ. 2005;69(5):509–20.PubMedCrossRef Page RC, Martin JA, Loeb CF. The Oral Health Information Suite (OHIS): its use in the management of periodontal disease. J Dent Educ. 2005;69(5):509–20.PubMedCrossRef
54.
go back to reference Mertz E, Bolarinwa O, Wides C, Gregorich S, Simmons K, Vaderhobli R, et al. Provider attitudes toward the implementation of clinical decision support tools in dental practice. J Evid Based Dent Pract. 2015;15(4):152–63.PubMedCrossRef Mertz E, Bolarinwa O, Wides C, Gregorich S, Simmons K, Vaderhobli R, et al. Provider attitudes toward the implementation of clinical decision support tools in dental practice. J Evid Based Dent Pract. 2015;15(4):152–63.PubMedCrossRef
56.
go back to reference Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ. Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004;57(10):1096–103.PubMedCrossRef Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ. Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004;57(10):1096–103.PubMedCrossRef
57.
go back to reference Donoff B, McDonough JE, Riedy CA. Integrating oral and general health care. N Engl J Med. 2014;371(24):2247–9.PubMedCrossRef Donoff B, McDonough JE, Riedy CA. Integrating oral and general health care. N Engl J Med. 2014;371(24):2247–9.PubMedCrossRef
Metadata
Title
Assessing the completeness of periodontal disease documentation in the EHR: a first step in measuring the quality of care
Authors
Joanna Mullins
Alfa Yansane
Shwetha V. Kumar
Suhasini Bangar
Ana Neumann
Todd R. Johnson
Gregory W. Olson
Krishna Kumar Kookal
Emily Sedlock
Aram Kim
Elizabeth Mertz
Ryan Brandon
Kristen Simmons
Joel M. White
Elsbeth Kalenderian
Muhammad F. Walji
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Oral Health / Issue 1/2021
Electronic ISSN: 1472-6831
DOI
https://doi.org/10.1186/s12903-021-01633-w

Other articles of this Issue 1/2021

BMC Oral Health 1/2021 Go to the issue