Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Limitations of pulmonary embolism ICD-10 codes in emergency department administrative data: let the buyer beware

Authors: Kristin Burles, Grant Innes, Kevin Senior, Eddy Lang, Andrew McRae

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Administrative data is a useful tool for research and quality improvement; however, validity of research findings based on these data depends on their reliability. Diagnoses assigned by physicians are subsequently converted by nosologists to ICD-10 codes (International Statistical Classification of Diseases and Related Health Problems, 10th Revision). Several groups have reported ICD-9 coding errors in inpatient data that have implications for research, quality improvement, and policymaking, but few have assessed ICD-10 code validity in ambulatory care databases. Our objective was to evaluate pulmonary embolism (PE) ICD-10 code accuracy in our large, integrated hospital system, and the validity of using these codes for operational and health services research using ED ambulatory care databases.

Methods

Ambulatory care data for patients (age ≥ 18 years) with a PE ICD-10 code (I26.0 and I26.9) were obtained from the records of four urban EDs between July 2013 to January 2015. PE diagnoses were confirmed by reviewing medical records and imaging reports. In cases where chart diagnosis and ICD-10 code were discrepant, chart review was considered correct. Physicians’ written discharge diagnoses were also searched using ‘pulmonary embolism’ and ‘PE’, and patients who were diagnosed with PE but not coded as PE were identified. Coding discrepancies were quantified and described.

Results

One thousand, four hundred and fifty-three ED patients had a PE ICD-10 code. Of these, 257 (17.7%) were false positive, with an incorrectly assigned PE code. Among the 257 false positives, 193 cases had ambiguous ED diagnoses such as ‘rule out PE’ or ‘query PE’, while 64 cases should have had non-PE codes. An additional 117 patients (8.90%) with a PE discharge diagnosis were incorrectly assigned a non-PE ICD-10 code (false negative group). The sensitivity of PE ICD-10 codes in this dataset was 91.1% (95%CI, 89.4–92.6) with a specificity of 99.9% (95%CI, 99.9–99.9). The positive and negative predictive values were 82.3% (95%CI, 80.3–84.2) and 99.9% (95%CI, 99.9–99.9), respectively.

Conclusions

Ambulatory care data, like inpatient data, are subject to coding errors. This confirms the importance of ICD-10 code validation prior to use. The largest proportion of coding errors arises from ambiguous physician documentation; therefore, physicians and data custodians must ensure that quality improvement processes are in place to promote ICD-10 coding accuracy.
Literature
1.
go back to reference World Health Organization. International Statistical Classification of Diseases and Related Health Problems 10th revision instruction manual. Geneva; 2010. World Health Organization. International Statistical Classification of Diseases and Related Health Problems 10th revision instruction manual. Geneva; 2010.
3.
4.
go back to reference Kline JA: Pulmonary embolism and deep vein thrombosis. In: Rosen's emergency medicine - concepts and clinical practice. Volume 1, 8 edn. Edited by Marx JA: Elsevier, Saunders; 2014: 1157-1169. Kline JA: Pulmonary embolism and deep vein thrombosis. In: Rosen's emergency medicine - concepts and clinical practice. Volume 1, 8 edn. Edited by Marx JA: Elsevier, Saunders; 2014: 1157-1169.
5.
go back to reference Alberta Health and Wellness. Data disclosure handbook; 2003. p. 1–15. Alberta Health and Wellness. Data disclosure handbook; 2003. p. 1–15.
6.
go back to reference Mercaldo ND, Lau KF, Zhou XH. Confidence intervals for predictive values with an emphasis to case-control studies. Stat Med. 2007;26(10):2170–83.CrossRefPubMed Mercaldo ND, Lau KF, Zhou XH. Confidence intervals for predictive values with an emphasis to case-control studies. Stat Med. 2007;26(10):2170–83.CrossRefPubMed
7.
go back to reference Sadeghi B, White RH, Maynard G, Zrelak P, Strater A, Hensley L, et al. Improved coding of postoperative deep vein thrombosis and pulmonary embolism in administrative data (AHRQ patient safety indicator 12) after introduction of new ICD-9-CM diagnosis codes. Med Care. 2015;53(5):e37–40. Sadeghi B, White RH, Maynard G, Zrelak P, Strater A, Hensley L, et al. Improved coding of postoperative deep vein thrombosis and pulmonary embolism in administrative data (AHRQ patient safety indicator 12) after introduction of new ICD-9-CM diagnosis codes. Med Care. 2015;53(5):e37–40.
8.
go back to reference Kniffin WD Jr, Baron JA, Barrett J, Birkmeyer JD, Anderson FA Jr. The epidemiology of diagnosed pulmonary embolism and deep venous thrombosis in the elderly. Arch Intern Med. 1994;154(8):861–6.CrossRefPubMed Kniffin WD Jr, Baron JA, Barrett J, Birkmeyer JD, Anderson FA Jr. The epidemiology of diagnosed pulmonary embolism and deep venous thrombosis in the elderly. Arch Intern Med. 1994;154(8):861–6.CrossRefPubMed
9.
go back to reference Arnason T, Wells PS, van Walraven C, Forster AJ. Accuracy of coding for possible warfarin complications in hospital discharge abstracts. Thromb Res. 2006;118(2):253–62.CrossRefPubMed Arnason T, Wells PS, van Walraven C, Forster AJ. Accuracy of coding for possible warfarin complications in hospital discharge abstracts. Thromb Res. 2006;118(2):253–62.CrossRefPubMed
10.
go back to reference Tagalakis V, Kahn SR. Determining the test characteristics of claims-based diagnostic codes for the diagnosis of venous thromboembolism in a medical service claims database. Pharmacoepidemiol Drug Saf. 2011;20(3):304–7.CrossRefPubMed Tagalakis V, Kahn SR. Determining the test characteristics of claims-based diagnostic codes for the diagnosis of venous thromboembolism in a medical service claims database. Pharmacoepidemiol Drug Saf. 2011;20(3):304–7.CrossRefPubMed
11.
go back to reference Scarvelis D, Anderson J, Davis L, Forgie M, Lee J, Petersson L, et al. Hospital mortality due to pulmonary embolism and an evaluation of the usefulness of preventative interventions. Thromb Res. 2010;125(2):166–70.CrossRefPubMed Scarvelis D, Anderson J, Davis L, Forgie M, Lee J, Petersson L, et al. Hospital mortality due to pulmonary embolism and an evaluation of the usefulness of preventative interventions. Thromb Res. 2010;125(2):166–70.CrossRefPubMed
12.
go back to reference Casez P, Labarere J, Sevestre MA, Haddouche M, Courtois X, Mercier S, et al. ICD-10 hospital discharge diagnosis codes were sensitive for identifying pulmonary embolism but not deep vein thrombosis. J Clin Epidemiol. 2010;63(7):790–7.CrossRefPubMed Casez P, Labarere J, Sevestre MA, Haddouche M, Courtois X, Mercier S, et al. ICD-10 hospital discharge diagnosis codes were sensitive for identifying pulmonary embolism but not deep vein thrombosis. J Clin Epidemiol. 2010;63(7):790–7.CrossRefPubMed
13.
go back to reference Hennessy DA, Quan H, Faris PD, Beck CA. Do coder characteristics influence validity of ICD-10 hospital discharge data? BMC Health Serv Res. 2010;10:99.CrossRefPubMedPubMedCentral Hennessy DA, Quan H, Faris PD, Beck CA. Do coder characteristics influence validity of ICD-10 hospital discharge data? BMC Health Serv Res. 2010;10:99.CrossRefPubMedPubMedCentral
14.
go back to reference So L, Beck CA, Brien S, Kennedy J, Feasby TE, Ghali WA, et al. Chart documentation quality and its relationship to the validity of administrative data discharge records. Health Informatics J. 2010;16(2):101–13. So L, Beck CA, Brien S, Kennedy J, Feasby TE, Ghali WA, et al. Chart documentation quality and its relationship to the validity of administrative data discharge records. Health Informatics J. 2010;16(2):101–13.
Metadata
Title
Limitations of pulmonary embolism ICD-10 codes in emergency department administrative data: let the buyer beware
Authors
Kristin Burles
Grant Innes
Kevin Senior
Eddy Lang
Andrew McRae
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0361-1

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue