Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medicine
Published in: BMC Medicine 1/2019

Open Access 01-12-2019 | Endocarditis | Research article

‘Caveat emptor’: the cautionary tale of endocarditis and the potential pitfalls of clinical coding data—an electronic health records study

Authors: Nicola Fawcett, Bernadette Young, Leon Peto, T. Phuong Quan, Richard Gillott, Jianhua Wu, Chris Middlemass, Sheila Weston, Derrick W. Crook, Tim E. A. Peto, Berit Muller-Pebody, Alan P. Johnson, A. Sarah Walker, Jonathan A. T. Sandoe

Published in: BMC Medicine | Issue 1/2019

Login to get access

Abstract

Background

Diagnostic codes from electronic health records are widely used to assess patterns of disease. Infective endocarditis is an uncommon but serious infection, with objective diagnostic criteria. Electronic health records have been used to explore the impact of changing guidance on antibiotic prophylaxis for dental procedures on incidence, but limited data on the accuracy of the diagnostic codes exists. Endocarditis was used as a clinically relevant case study to investigate the relationship between clinical cases and diagnostic codes, to understand discrepancies and to improve design of future studies.

Methods

Electronic health record data from two UK tertiary care centres were linked with data from a prospectively collected clinical endocarditis service database (Leeds Teaching Hospital) or retrospective clinical audit and microbiology laboratory blood culture results (Oxford University Hospitals Trust). The relationship between diagnostic codes for endocarditis and confirmed clinical cases according to the objective Duke criteria was assessed, and impact on estimations of disease incidence and trends.

Results

In Leeds 2006–2016, 738/1681(44%) admissions containing any endocarditis code represented a definite/possible case, whilst 263/1001(24%) definite/possible endocarditis cases had no endocarditis code assigned. In Oxford 2010–2016, 307/552(56%) reviewed endocarditis-coded admissions represented a clinical case. Diagnostic codes used by most endocarditis studies had good positive predictive value (PPV) but low sensitivity (e.g. I33-primary 82% and 43% respectively); one (I38-secondary) had PPV under 6%. Estimating endocarditis incidence using raw admission data overestimated incidence trends twofold. Removing records with non-specific codes, very short stays and readmissions improved predictive ability. Estimating incidence of streptococcal endocarditis using secondary codes also overestimated increases in incidence over time. Reasons for discrepancies included changes in coding behaviour over time, and coding guidance allowing assignment of a code mentioning ‘endocarditis’ where endocarditis was never mentioned in the clinical notes.

Conclusions

Commonly used diagnostic codes in studies of endocarditis had good predictive ability. Other apparently plausible codes were poorly predictive. Use of diagnostic codes without examining sensitivity and predictive ability can give inaccurate estimations of incidence and trends. Similar considerations may apply to other diseases. Health record studies require validation of diagnostic codes and careful data curation to minimise risk of serious errors.
Appendix
Available only for authorised users
Literature
1.
ICD-10-CM Official Guidelines for Coding and Reporting, World Health Organisation, 2014.
2.
3.
Nouraei SA, Virk JS, Hudovsky A, Wathen C, Darzi A, Parsons D. Accuracy of clinician-clinical coder information handover following acute medical admissions: implication for using administrative datasets in clinical outcomes management. J Public Health (Oxf). 2016;38(2):352–62.CrossRef
4.
Li L, Rothwell PM, Study OV. Biases in detection of apparent ‘weekend effect’ on outcome with administrative coding data: population based study of stroke. BMJ. 2016;353:i2648.PubMedPubMedCentralCrossRef
5.
Prophylaxis against infective endocarditis: antimicrobial prophylaxis against infective endocarditis in adults and children undergoing interventional procedures In: Department of Health U, ed: National Institute of Clinical Excellence; 2008.
6.
Prophylaxis against infective endocarditis: antimicrobial prophylaxis against infective endocarditis in adults and children undergoing interventional procedures CG64: 2016 update. In: Department of Health U, ed: National Institute of Clinical Excellence; 2016.
7.
Prophylaxis against infective endocarditis: antimicrobial prophylaxis against infective endocarditis in adults and children undergoing interventional procedures. In: National Institute of Clinical Excellence (NICE), Department of Health, UK; 2008.
8.
Gould FK, Denning DW, Elliott TS, et al. Guidelines for the diagnosis and antibiotic treatment of endocarditis in adults: a report of the working Party of the British Society for antimicrobial chemotherapy. J Antimicrob Chemother. 2012;67(2):269–89.PubMedCrossRef
9.
Habib G, Hoen B, Tornos P, et al. Guidelines on the prevention, diagnosis, and treatment of infective endocarditis (new version 2009): the task force on the prevention, diagnosis, and treatment of infective endocarditis of the European Society of Cardiology (ESC). Endorsed by the European Society of Clinical Microbiology and Infectious Diseases (ESCMID) and the International Society of Chemotherapy (ISC) for infection and Cancer. Eur Heart J. 2009;30(19):2369–413.PubMedCrossRef
10.
Wilson W, Taubert KA, Gewitz M, et al. Prevention of infective endocarditis: guidelines from the American Heart Association: a guideline from the American Heart Association rheumatic fever, endocarditis, and Kawasaki disease committee, council on cardiovascular disease in the young, and the council on clinical cardiology, council on cardiovascular surgery and anesthesia, and the quality of care and outcomes research interdisciplinary working group. Circulation. 2007;116(15):1736–54.PubMedCrossRef
11.
Tubiana S, Blotière PO, Hoen B, et al. Dental procedures, antibiotic prophylaxis, and endocarditis among people with prosthetic heart valves: nationwide population based cohort and a case crossover study. BMJ. 2017;358:j3776.PubMedPubMedCentralCrossRef
12.
Bates KE, Hall M, Shah SS, Hill KD, Pasquali SK. Trends in infective endocarditis hospitalisations at United States children’s hospitals from 2003 to 2014: impact of the 2007 American Heart Association antibiotic prophylaxis guidelines. Cardiol Young. 2017;27(4):686–90.PubMedCrossRef
13.
Bikdeli B, Wang Y, Kim N, Desai MM, Quagliarello V, Krumholz HM. Trends in hospitalization rates and outcomes of endocarditis among Medicare beneficiaries. J Am Coll Cardiol. 2013;62(23):2217–26.PubMedPubMedCentralCrossRef
14.
Dayer MJ, Jones S, Prendergast B, Baddour LM, Lockhart PB, Thornhill MH. Incidence of infective endocarditis in England, 2000-13: a secular trend, interrupted time-series analysis. Lancet. 2015;385(9974):1219–28.PubMedCrossRef
15.
Keller K, von Bardeleben RS, Ostad MA, et al. Temporal trends in the prevalence of infective endocarditis in Germany between 2005 and 2014. Am J Cardiol. 2017;119(2):317–22.PubMedCrossRef
16.
Pant S, Patel NJ, Deshmukh A, et al. Trends in infective endocarditis incidence, microbiology, and valve replacement in the United States from 2000 to 2011. J Am Coll Cardiol. 2015;65(19):2070–6.CrossRefPubMed
17.
Bor DH, Woolhandler S, Nardin R, Brusch J, Himmelstein DU. Infective endocarditis in the U.S., 1998-2009: a nationwide study. PLoS One. 2013;8(3):e60033.PubMedPubMedCentralCrossRef
18.
Mackie AS, Liu W, Savu A, Marelli AJ, Kaul P. Infective endocarditis hospitalizations before and after the 2007 American Heart Association prophylaxis guidelines. Can J Cardiol. 2016;32(8):942–8.PubMedCrossRef
19.
Toyoda N, Chikwe J, Itagaki S, Gelijns AC, Adams DH, Egorova NN. Trends in infective endocarditis in California and New York state, 1998-2013. JAMA. 2017;317(16):1652–60.PubMedPubMedCentralCrossRef
20.
Sakai Bizmark R, Chang RR, Tsugawa Y, Zangwill KM, Kawachi I. Impact of AHA’s 2007 guideline change on incidence of infective endocarditis in infants and children. Am Heart J. 2017;189:110–9.CrossRefPubMed
21.
Cresti A, Chiavarelli M, Scalese M, et al. Epidemiological and mortality trends in infective endocarditis, a 17-year population-based prospective study. Cardiovasc Diagn Ther. 2017;7(1):27–35.PubMedPubMedCentralCrossRef
22.
Gupta S, Sakhuja A, McGrath E, Asmar B. Trends, microbiology, and outcomes of infective endocarditis in children during 2000-2010 in the United States. Congenit Heart Dis. 2017;12(2):196–201.PubMedCrossRef
23.
Pasquali SK, He X, Mohamad Z, et al. Trends in endocarditis hospitalizations at US children’s hospitals: impact of the 2007 American Heart Association antibiotic prophylaxis guidelines. Am Heart J. 2012;163(5):894–9.PubMedPubMedCentralCrossRef
24.
Thornhill MH, Gibson TB, Cutler E, et al. Antibiotic prophylaxis and incidence of endocarditis before and after the 2007 AHA recommendations. J Am Coll Cardiol. 2018;72(20):2443–54.PubMedCrossRef
25.
26.
Pant S, Deshmukh A, Mehta JL. Reply: trends in infective endocarditis: incidence, microbiology, and valve replacement in the United States from 2000 to 2011: the devil is in the details. J Am Coll Cardiol. 2015;66(10):1202–3.
27.
Desimone DC, Tleyjeh IM, Correa de Sa DD, et al. Incidence of infective endocarditis caused by viridans group streptococci before and after publication of the 2007 American Heart Association’s endocarditis prevention guidelines. Circulation. 2012;126(1):60–4.PubMedPubMedCentralCrossRef
28.
Li JS, Sexton DJ, Mick N, et al. Proposed modifications to the Duke criteria for the diagnosis of infective endocarditis. Clin Infect Dis. 2000;30(4):633–8.CrossRefPubMed
29.
Akram A, Maley M, Gosbell I, Nguyen T, Chavada R. Utility of 16S rRNA PCR performed on clinical specimens in patient management. Int J Infect Dis. 2017;57:144–9.PubMedCrossRef
30.
Finney JM, Walker AS, Peto TE, Wyllie DH. An efficient record linkage scheme using graphical analysis for identifier error detection. BMC Med Inform Decis Mak. 2011;11:7.PubMedPubMedCentralCrossRef
31.
The European Committee on Antimicrobial Susceptibility Testing (EUCAST) breakpoint tables for interpretation of MICs and zone diameters. In:2016.
32.
33.
34.
35.
36.
Population Estimates for UK, England and Wales, Scotland and Northern Ireland, The Office for National Statistics, 2001–2016.
37.
National Clinical Coding Standards ICD-10 4th Edition. NHS Classifications Service, Health and Social Care Information Centre, UK; 2013.
38.
Thornhill MH, Dayer MJ, Forde JM, et al. Impact of the NICE guideline recommending cessation of antibiotic prophylaxis for prevention of infective endocarditis: before and after study. Bmj. 2011;342:d2392.PubMedPubMedCentralCrossRef
39.
Tan C, Hansen M, Cohen G, Boyle K, Daneman N, Adhikari NK. Accuracy of administrative data for identification of patients with infective endocarditis. Int J Cardiol. 2016;224:162–4.PubMedCrossRef
40.
Goto M, Ohl ME, Schweizer ML, Perencevich EN. Accuracy of administrative code data for the surveillance of healthcare-associated infections: a systematic review and meta-analysis. Clin Infect Dis. 2014;58(5):688–96.PubMedCrossRef
41.
Rhee C, Dantes R, Epstein L, et al. Incidence and trends of Sepsis in US hospitals using clinical vs claims data, 2009-2014. JAMA. 2017;318(13):1241–9.PubMedPubMedCentralCrossRef
42.
Duval X, Delahaye F, Alla F, et al. Temporal trends in infective endocarditis in the context of prophylaxis guideline modifications: three successive population-based surveys. J Am Coll Cardiol. 2012;59(22):1968–76.PubMedCrossRef
43.
Fedeli U, Schievano E, Buonfrate D, Pellizzer G, Spolaore P. Increasing incidence and mortality of infective endocarditis: a population-based study through a record-linkage system. BMC Infect Dis. 2011;11:48.PubMedPubMedCentralCrossRef
44.
Serdén L, Lindqvist R, Rosén M. Have DRG-based prospective payment systems influenced the number of secondary diagnoses in health care administrative data? Health Policy. 2003;65(2):101–7.PubMedCrossRef
45.
McLintock K, Russell AM, Alderson SL, et al. The effects of financial incentives for case finding for depression in patients with diabetes and coronary heart disease: interrupted time series analysis. BMJ Open. 2014;4(8):e005178.PubMedPubMedCentralCrossRef
46.
Sunder S, Grammatico-Guillon L, Baron S, et al. Clinical and economic outcomes of infective endocarditis. Infect Dis (Lond). 2015;47(2):80–7.CrossRef
47.
Emergency readmissions: Trends in emergency readmissions to hospital in England. In: The Nuffield Trust; 2018.
48.
Or Z. Implementation of DRG payment in France: issues and recent developments. Health Policy. 2014;117(2):146–50.PubMedCrossRef
49.
Eric I. Benchimol, Liam Smeeth, Astrid Guttmann, Katie Harron, David Moher, Irene Petersen, Henrik T. Sørensen, Erik von Elm, Sinéad M. Langan, (2015) The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) Statement. PLOS Medicine 12 (10):e1001885.PubMedPubMedCentralCrossRef
50.
Brooks Udelsman, Isabel Chien, Kei Ouchi, Kate Brizzi, James A. Tulsky, Charlotta Lindvall, (2019) Needle in a Haystack: Natural Language Processing to Identify Serious Illness. Journal of Palliative Medicine 22 (2):179–182.PubMedCrossRefPubMedCentral
51.
Vibhu Agarwal, Tanya Podchiyska, Juan M Banda, Veena Goel, Tiffany I Leung, Evan P Minty, Timothy E Sweeney, Elsie Gyang, Nigam H Shah, (2016) Learning statistical models of phenotypes using noisy labeled training data. Journal of the American Medical Informatics Association 23 (6):1166–1173.PubMedPubMedCentralCrossRef
52.
Agniel D, Kohane IS, Weber GM, (2018) Biases in electronic health record data due to processes within the healthcare system: retrospective observational study. British Medical Journal; 360:k1479.
53.
Kirby JC, Speltz P, Rasmussen LV, et al. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. J Am Med Inform Assoc. 2016;23(6):1046–52.PubMedPubMedCentralCrossRef
Metadata
Title
‘Caveat emptor’: the cautionary tale of endocarditis and the potential pitfalls of clinical coding data—an electronic health records study
Authors
Nicola Fawcett
Bernadette Young
Leon Peto
T. Phuong Quan
Richard Gillott
Jianhua Wu
Chris Middlemass
Sheila Weston
Derrick W. Crook
Tim E. A. Peto
Berit Muller-Pebody
Alan P. Johnson
A. Sarah Walker
Jonathan A. T. Sandoe
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Endocarditis
Published in
BMC Medicine / Issue 1/2019
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-019-1390-x

Other articles of this Issue 1/2019

BMC Medicine 1/2019 Go to the issue

Research article

A step beyond the hygiene hypothesis—immune-mediated classes determined in a population-based study

Research article

Childhood generalized specific phobia as an early marker of internalizing psychopathology across the lifespan: results from the World Mental Health Surveys

Opinion

Knowledge translation in health: how implementation science could contribute more

Research article

Distinct mortality patterns at 0–2 days versus the remaining neonatal period: results from population-based assessment in the Indian state of Bihar

Research article

Antibody responses to merozoite antigens after natural Plasmodium falciparum infection: kinetics and longevity in absence of re-exposure

Correction

Correction to: How can clinicians, specialty societies and others evaluate and improve the quality of apps for patient use?