Skip to main content
Top
Published in: BMC Health Services Research 1/2011

Open Access 01-12-2011 | Research article

Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data

Authors: Jean-Marie Januel, Jean-Christophe Luthi, Hude Quan, François Borst, Patrick Taffé, William A Ghali, Bernard Burnand

Published in: BMC Health Services Research | Issue 1/2011

Login to get access

Abstract

Background

Co-morbidity information derived from administrative data needs to be validated to allow its regular use. We assessed evolution in the accuracy of coding for Charlson and Elixhauser co-morbidities at three time points over a 5-year period, following the introduction of the International Classification of Diseases, 10th Revision (ICD-10), coding of hospital discharges.

Methods

Cross-sectional time trend evaluation study of coding accuracy using hospital chart data of 3'499 randomly selected patients who were discharged in 1999, 2001 and 2003, from two teaching and one non-teaching hospital in Switzerland. We measured sensitivity, positive predictive and Kappa values for agreement between administrative data coded with ICD-10 and chart data as the 'reference standard' for recording 36 co-morbidities.

Results

For the 17 the Charlson co-morbidities, the sensitivity - median (min-max) - was 36.5% (17.4-64.1) in 1999, 42.5% (22.2-64.6) in 2001 and 42.8% (8.4-75.6) in 2003. For the 29 Elixhauser co-morbidities, the sensitivity was 34.2% (1.9-64.1) in 1999, 38.6% (10.5-66.5) in 2001 and 41.6% (5.1-76.5) in 2003. Between 1999 and 2003, sensitivity estimates increased for 30 co-morbidities and decreased for 6 co-morbidities. The increase in sensitivities was statistically significant for six conditions and the decrease significant for one. Kappa values were increased for 29 co-morbidities and decreased for seven.

Conclusions

Accuracy of administrative data in recording clinical conditions improved slightly between 1999 and 2003. These findings are of relevance to all jurisdictions introducing new coding systems, because they demonstrate a phenomenon of improved administrative data accuracy that may relate to a coding 'learning curve' with the new coding system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, Meimban R, Warner D, Gonzales J: Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007, 297: 71-76. 10.1001/jama.297.1.71.CrossRefPubMed Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, Meimban R, Warner D, Gonzales J: Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007, 297: 71-76. 10.1001/jama.297.1.71.CrossRefPubMed
2.
go back to reference Roos NP, Roos LL, Mossey J, Havens B: Using administrative data to predict important health outcomes: untreatable nursing home and death. Med Care. 1988, 26: 221-239. 10.1097/00005650-198803000-00001.CrossRefPubMed Roos NP, Roos LL, Mossey J, Havens B: Using administrative data to predict important health outcomes: untreatable nursing home and death. Med Care. 1988, 26: 221-239. 10.1097/00005650-198803000-00001.CrossRefPubMed
3.
go back to reference Leader SG, Mallick R, Briggs NC: Myocardial infarction in newly diagnosed hypertensive Medicare patients free of coronary heart disease and treated with calcium channel workers. AM J Med. 1997, 102 (2): 150-157.CrossRefPubMed Leader SG, Mallick R, Briggs NC: Myocardial infarction in newly diagnosed hypertensive Medicare patients free of coronary heart disease and treated with calcium channel workers. AM J Med. 1997, 102 (2): 150-157.CrossRefPubMed
4.
go back to reference Mitchell JB, Ballard DJ, Whisnant JP, Ammering CJ, Matchar DB, Samsa GP: Using physician claims to identify post-operative complications of carotide undarterectomy. Health Serv Res. 1996, 31: 141-152.PubMedPubMedCentral Mitchell JB, Ballard DJ, Whisnant JP, Ammering CJ, Matchar DB, Samsa GP: Using physician claims to identify post-operative complications of carotide undarterectomy. Health Serv Res. 1996, 31: 141-152.PubMedPubMedCentral
5.
go back to reference Welsh WT, Verrilli D, Katz SJ, Latimer E: A detailed comparison of physician services fort he elderly in United States of Canada. JAMA. 1996, 275: 1410-1416. 10.1001/jama.275.18.1410.CrossRef Welsh WT, Verrilli D, Katz SJ, Latimer E: A detailed comparison of physician services fort he elderly in United States of Canada. JAMA. 1996, 275: 1410-1416. 10.1001/jama.275.18.1410.CrossRef
6.
go back to reference Weiner JP, Parente ST, Garnick DW, Fowles J, Lawthers AG, Palmer RH: Variation in office based quality: claims based profile of care provided to Medicare patients with diabetes. JAMA. 1995, 273: 1503-1508. 10.1001/jama.273.19.1503.CrossRefPubMed Weiner JP, Parente ST, Garnick DW, Fowles J, Lawthers AG, Palmer RH: Variation in office based quality: claims based profile of care provided to Medicare patients with diabetes. JAMA. 1995, 273: 1503-1508. 10.1001/jama.273.19.1503.CrossRefPubMed
7.
go back to reference Iezzoni L: How much are we willing to pay for information about quality of care. Ann Intern Med. 1997, 126: 391-393.CrossRefPubMed Iezzoni L: How much are we willing to pay for information about quality of care. Ann Intern Med. 1997, 126: 391-393.CrossRefPubMed
8.
go back to reference Romano P, Mark D: Bias in the coding of hospital discharge data and its implications for quality assessments. Med Care. 1994, 32: 81-90. 10.1097/00005650-199401000-00006.CrossRefPubMed Romano P, Mark D: Bias in the coding of hospital discharge data and its implications for quality assessments. Med Care. 1994, 32: 81-90. 10.1097/00005650-199401000-00006.CrossRefPubMed
9.
go back to reference Lloyds RJ: Physician and coding errors in patient records. JAMA. 1985, 254: 1330-1336. 10.1001/jama.254.10.1330.CrossRef Lloyds RJ: Physician and coding errors in patient records. JAMA. 1985, 254: 1330-1336. 10.1001/jama.254.10.1330.CrossRef
10.
go back to reference Hartz AJ, Kuhn EM: Comparing hospitals at performed coronary artery bypass surgery: the effect of outcome measures and data sources. Am J Public Health. 1994, 84: 1609-1614. 10.2105/AJPH.84.10.1609.CrossRefPubMedPubMedCentral Hartz AJ, Kuhn EM: Comparing hospitals at performed coronary artery bypass surgery: the effect of outcome measures and data sources. Am J Public Health. 1994, 84: 1609-1614. 10.2105/AJPH.84.10.1609.CrossRefPubMedPubMedCentral
11.
go back to reference Romano P: Administrative data to be used to compare the quality of health care?. Med Care. 1993, 50: 451-477. 10.1177/002570879305000404.CrossRef Romano P: Administrative data to be used to compare the quality of health care?. Med Care. 1993, 50: 451-477. 10.1177/002570879305000404.CrossRef
12.
go back to reference Birman-Deych E, Watermen AD, Yan Y, Nilasena DS, Radford MJ, Gage BF: Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 2005, 43: 480-4885. 10.1097/01.mlr.0000160417.39497.a9.CrossRefPubMed Birman-Deych E, Watermen AD, Yan Y, Nilasena DS, Radford MJ, Gage BF: Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 2005, 43: 480-4885. 10.1097/01.mlr.0000160417.39497.a9.CrossRefPubMed
13.
go back to reference Wilshesky N, Tamplyn RM, Huang A: Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004, 57: 131-141. 10.1016/S0895-4356(03)00246-4.CrossRef Wilshesky N, Tamplyn RM, Huang A: Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004, 57: 131-141. 10.1016/S0895-4356(03)00246-4.CrossRef
14.
go back to reference Quan H, Persons GA, Ghali WA: Validity of information and comorbidity derived from ICD-9-CM administrative data. Med Care. 2002, 40 (8): 675-685.CrossRefPubMed Quan H, Persons GA, Ghali WA: Validity of information and comorbidity derived from ICD-9-CM administrative data. Med Care. 2002, 40 (8): 675-685.CrossRefPubMed
15.
go back to reference Weingart SN, Iezzoni LI, Davis RB, Palmer RH, Cahalane M, Hamel MB, Mukamal K, Phillips RS, Davies DT, Banks NJ: Use of administrative data to find substandard care: validation of the complications screening program. Med Care. 2000, 38: 796-806. 10.1097/00005650-200008000-00004.CrossRefPubMed Weingart SN, Iezzoni LI, Davis RB, Palmer RH, Cahalane M, Hamel MB, Mukamal K, Phillips RS, Davies DT, Banks NJ: Use of administrative data to find substandard care: validation of the complications screening program. Med Care. 2000, 38: 796-806. 10.1097/00005650-200008000-00004.CrossRefPubMed
16.
go back to reference Quan H, Persons GA, Galli WA: Assessing accuracy of diagnostic-type indicators for flying complications in administrative data. J Clin Epidemiol. 2004, 57: 366-372. 10.1016/j.jclinepi.2003.01.002.CrossRefPubMed Quan H, Persons GA, Galli WA: Assessing accuracy of diagnostic-type indicators for flying complications in administrative data. J Clin Epidemiol. 2004, 57: 366-372. 10.1016/j.jclinepi.2003.01.002.CrossRefPubMed
17.
go back to reference World Health Organisation: International statistical classification of diseases and related health problems, 10th revision (ICD-10). 1992, Geneva, World Health Organisation World Health Organisation: International statistical classification of diseases and related health problems, 10th revision (ICD-10). 1992, Geneva, World Health Organisation
19.
go back to reference Quan H, Li B, Saunders D, Parsons GA, Nilsson CI, Alibhai A, Ghali WA: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually-coded database. Health Serv Res. 2008, 43: 1424-1441. 10.1111/j.1475-6773.2007.00822.x.CrossRefPubMedPubMedCentral Quan H, Li B, Saunders D, Parsons GA, Nilsson CI, Alibhai A, Ghali WA: Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually-coded database. Health Serv Res. 2008, 43: 1424-1441. 10.1111/j.1475-6773.2007.00822.x.CrossRefPubMedPubMedCentral
20.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
21.
go back to reference Elixhauser A, Steiner C, Harris DR, Coffey RM: Comorbidity measures for use with administrative data. Med Care. 1998, 36: 8-27. 10.1097/00005650-199801000-00004.CrossRefPubMed Elixhauser A, Steiner C, Harris DR, Coffey RM: Comorbidity measures for use with administrative data. Med Care. 1998, 36: 8-27. 10.1097/00005650-199801000-00004.CrossRefPubMed
22.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
23.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithm for defining co-morbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43: 1130-1139. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithm for defining co-morbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43: 1130-1139. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed
24.
go back to reference Higgins JPT, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.CrossRefPubMed Higgins JPT, Thompson SG: Quantifying heterogeneity in a meta-analysis. Stat Med. 2002, 21: 1539-1558. 10.1002/sim.1186.CrossRefPubMed
25.
go back to reference Donner A, Eliasziw M: A goodness-of-fit approach to inference procedures for the Kappa statistic: confidence interval construction, significance-testing and sample size estimation. Statistics in Medicine. 1992, 11: 1511-1519. 10.1002/sim.4780111109.CrossRefPubMed Donner A, Eliasziw M: A goodness-of-fit approach to inference procedures for the Kappa statistic: confidence interval construction, significance-testing and sample size estimation. Statistics in Medicine. 1992, 11: 1511-1519. 10.1002/sim.4780111109.CrossRefPubMed
26.
go back to reference Steven Julious: Using confidence intervals around individual means to assess statistical significance between two means. Pharmaceutical Statistics. 2004, 3: 217-222. 10.1002/pst.126.CrossRef Steven Julious: Using confidence intervals around individual means to assess statistical significance between two means. Pharmaceutical Statistics. 2004, 3: 217-222. 10.1002/pst.126.CrossRef
27.
go back to reference Rothman KJ: No adjustments are needed for multiple comparisons. Epidemiology. 1990, 1: 43-46. 10.1097/00001648-199001000-00010.CrossRefPubMed Rothman KJ: No adjustments are needed for multiple comparisons. Epidemiology. 1990, 1: 43-46. 10.1097/00001648-199001000-00010.CrossRefPubMed
28.
go back to reference Gibson N, Bridgman SA: A novel method for the assessment of the accuracy of diagnostic codes in general surgery. Ann Royal College Surgeons England. 1998, 80 (4): 293-296. Gibson N, Bridgman SA: A novel method for the assessment of the accuracy of diagnostic codes in general surgery. Ann Royal College Surgeons England. 1998, 80 (4): 293-296.
29.
go back to reference Henderson T, Shepheard J, Sundararajan V: Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care. 2006, 44: 1011-1019. 10.1097/01.mlr.0000228018.48783.34.CrossRefPubMed Henderson T, Shepheard J, Sundararajan V: Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care. 2006, 44: 1011-1019. 10.1097/01.mlr.0000228018.48783.34.CrossRefPubMed
30.
go back to reference Classifications of Diseases and Functioning & Disability: About the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM). National Center for Health Statistics. The 2009 update of ICD-10-CM in now available: http://www.cdc.gov/nchs/icd/icd10cm.htm Accessed Nov 10, 2009 Classifications of Diseases and Functioning & Disability: About the International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM). National Center for Health Statistics. The 2009 update of ICD-10-CM in now available: http://​www.​cdc.​gov/​nchs/​icd/​icd10cm.​htm Accessed Nov 10, 2009
32.
go back to reference Barazzoni F, Beffat D, Daily R, Bianchi P: Codage de maladies et des interventions chirurgicales: un projet pilote sur le contrôle de la qualité (Coding of diseases and surgical interventions: a pilot project on quality control). Bull Med Suisse. 1999, 80: 721-726. Barazzoni F, Beffat D, Daily R, Bianchi P: Codage de maladies et des interventions chirurgicales: un projet pilote sur le contrôle de la qualité (Coding of diseases and surgical interventions: a pilot project on quality control). Bull Med Suisse. 1999, 80: 721-726.
33.
go back to reference Najda A, Vader JP, Marazzi A: Cohérence du codage diagnostic: étude de coûts, contrôle de qualité dans les hôpitaux vaudois et valaisans (Consistency of diagnostic coding: cost study, quality control in the hospitals of the cantons of Vaud and Valais). Médecine Hygiène. 2000, 58: 1422-1424. Najda A, Vader JP, Marazzi A: Cohérence du codage diagnostic: étude de coûts, contrôle de qualité dans les hôpitaux vaudois et valaisans (Consistency of diagnostic coding: cost study, quality control in the hospitals of the cantons of Vaud and Valais). Médecine Hygiène. 2000, 58: 1422-1424.
34.
go back to reference Institut universitaire de médecine sociale et préventive, Lausanne, Suisse: Validation du codage, des diagnostiques et des interventions dans les établissements hospitaliers valaisans. Données 2003 (Validation of coding, diagnoses and interventions in hospitals of the canton of Valais Data. 2003, accessed Feb 3, 2009, [http://www.ovs.ch/documents/validation_codage_2003_fr.pdf] Institut universitaire de médecine sociale et préventive, Lausanne, Suisse: Validation du codage, des diagnostiques et des interventions dans les établissements hospitaliers valaisans. Données 2003 (Validation of coding, diagnoses and interventions in hospitals of the canton of Valais Data. 2003, accessed Feb 3, 2009, [http://​www.​ovs.​ch/​documents/​validation_​codage_​2003_​fr.​pdf]
35.
go back to reference Iezzoni LI, Shwartz M, Moskowitz MA, Ash AS, Sawitz E, Burnside S: Illness severity and costs of admissions at teaching and non teaching hospitals. JAMA. 1990, 264: 1426-1431. 10.1001/jama.264.11.1426.CrossRefPubMed Iezzoni LI, Shwartz M, Moskowitz MA, Ash AS, Sawitz E, Burnside S: Illness severity and costs of admissions at teaching and non teaching hospitals. JAMA. 1990, 264: 1426-1431. 10.1001/jama.264.11.1426.CrossRefPubMed
36.
go back to reference Drösler SE, Klazinga NS, Romano PS, Tancredi DJ, Gogorcena Aoiz MA, Hewitt MC, Scobie S, Soop M, Wen E, Quan H, Ghali WA, Mattke S, Kelley E: Application of patient safety indicators internationally: a pilot study among seven countries. Int J Qual Health Care. 2009, 21: 272-278. 10.1093/intqhc/mzp018.CrossRefPubMed Drösler SE, Klazinga NS, Romano PS, Tancredi DJ, Gogorcena Aoiz MA, Hewitt MC, Scobie S, Soop M, Wen E, Quan H, Ghali WA, Mattke S, Kelley E: Application of patient safety indicators internationally: a pilot study among seven countries. Int J Qual Health Care. 2009, 21: 272-278. 10.1093/intqhc/mzp018.CrossRefPubMed
37.
go back to reference Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, Januel JM, Sundararajan V: Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011, 173: 676-682. 10.1093/aje/kwq433.CrossRefPubMed Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, Januel JM, Sundararajan V: Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011, 173: 676-682. 10.1093/aje/kwq433.CrossRefPubMed
Metadata
Title
Improved accuracy of co-morbidity coding over time after the introduction of ICD-10 administrative data
Authors
Jean-Marie Januel
Jean-Christophe Luthi
Hude Quan
François Borst
Patrick Taffé
William A Ghali
Bernard Burnand
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2011
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-194

Other articles of this Issue 1/2011

BMC Health Services Research 1/2011 Go to the issue