Skip to main content
Top
Published in: Critical Care 4/2008

Open Access 01-08-2008 | Research

Reliability of diagnostic coding in intensive care patients

Authors: Benoît Misset, Didier Nakache, Aurélien Vesin, Mickael Darmon, Maïté Garrouste-Orgeas, Bruno Mourvillier, Christophe Adrie, Sébastian Pease, Marie-Aliette Costa de Beauregard, Dany Goldgran-Toledano, Elisabeth Métais, Jean-François Timsit, The Outcomerea Database Investigators

Published in: Critical Care | Issue 4/2008

Login to get access

Abstract

Introduction

Administrative coding of medical diagnoses in intensive care unit (ICU) patients is mandatory in order to create databases for use in epidemiological and economic studies. We assessed the reliability of coding between different ICU physicians.

Method

One hundred medical records selected randomly from 29,393 cases collected between 1998 and 2004 in the French multicenter Outcomerea ICU database were studied. Each record was sent to two senior physicians from independent ICUs who recoded the diagnoses using the International Statistical Classification of Diseases and Related Health Problems: Tenth Revision (ICD-10) after being trained according to guidelines developed by two French national intensive care medicine societies: the French Society of Intensive Care Medicine (SRLF) and the French Society of Anesthesiology and Intensive Care Medicine (SFAR). These codes were then compared with the original codes, which had been selected by the physician treating the patient. A specific comparison was done for the diagnoses of septicemia and shock (codes derived from A41 and R57, respectively).

Results

The ICU physicians coded an average of 4.6 ± 3.0 (range 1 to 32) diagnoses per patient, with little agreement between the three coders. The primary diagnosis was matched by both external coders in 34% (95% confidence interval (CI) 25% to 43%) of cases, by only one in 35% (95% CI 26% to 44%) of cases, and by neither in 31% (95% CI 22% to 40%) of cases. Only 18% (95% CI 16% to 20%) of all codes were selected by all three coders. Similar results were obtained for the diagnoses of septicemia and/or shock.

Conclusion

In a multicenter database designed primarily for epidemiological and cohort studies in ICU patients, the coding of medical diagnoses varied between different observers. This could limit the interpretation and validity of research and epidemiological programs using diagnoses as inclusion criteria.
Appendix
Available only for authorised users
Literature
1.
go back to reference Freeman JL, Fetter RB, Park H, Schneider KC, Lichtenstein JL, Hughes JS, Bauman WA, Duncan CC, Freeman DH, Palmer GR: Diagnosis-related group refinement with diagnosis- and procedure-specific comorbidities and complications. Med Care. 1995, 33: 806-827. 10.1097/00005650-199508000-00006.CrossRefPubMed Freeman JL, Fetter RB, Park H, Schneider KC, Lichtenstein JL, Hughes JS, Bauman WA, Duncan CC, Freeman DH, Palmer GR: Diagnosis-related group refinement with diagnosis- and procedure-specific comorbidities and complications. Med Care. 1995, 33: 806-827. 10.1097/00005650-199508000-00006.CrossRefPubMed
2.
go back to reference Holstein J, Taright N, Lepage E, Razafimamonjy J, Duboc D, Feldman L, Hittinger L, Lavergne T, Chatellier G: [Quality of medical database to valorize the DRG model by ISA cost indicators]. Rev Epidemiol Sante Publique. 2002, 50: 593-603.PubMed Holstein J, Taright N, Lepage E, Razafimamonjy J, Duboc D, Feldman L, Hittinger L, Lavergne T, Chatellier G: [Quality of medical database to valorize the DRG model by ISA cost indicators]. Rev Epidemiol Sante Publique. 2002, 50: 593-603.PubMed
3.
go back to reference Young JD, Goldfrad C, Rowan K: Development and testing of a hierarchical method to code the reason for admission to intensive care units: the ICNARC Coding Method. Intensive Care National Audit & Research Centre. Br J Anaesth. 2001, 87: 543-548. 10.1093/bja/87.4.543.CrossRefPubMed Young JD, Goldfrad C, Rowan K: Development and testing of a hierarchical method to code the reason for admission to intensive care units: the ICNARC Coding Method. Intensive Care National Audit & Research Centre. Br J Anaesth. 2001, 87: 543-548. 10.1093/bja/87.4.543.CrossRefPubMed
4.
go back to reference Cook SF, Visscher WA, Hobbs CL, Williams RL: Project IMPACT: results from a pilot validity study of a new observational database. Crit Care Med. 2002, 30: 2765-2770. 10.1097/00003246-200212000-00024.CrossRefPubMed Cook SF, Visscher WA, Hobbs CL, Williams RL: Project IMPACT: results from a pilot validity study of a new observational database. Crit Care Med. 2002, 30: 2765-2770. 10.1097/00003246-200212000-00024.CrossRefPubMed
5.
go back to reference Timsit JF, Fosse JP, Troche G, De Lassence A, Alberti C, Garrouste-Orgeas M, Azoulay E, Chevret S, Moine P, Cohen Y: Accuracy of a composite score using daily SAPS II and LOD scores for predicting hospital mortality in ICU patients hospitalized for more than 72 h. Intensive Care Med. 2001, 27: 1012-1021. 10.1007/s001340000840.CrossRefPubMed Timsit JF, Fosse JP, Troche G, De Lassence A, Alberti C, Garrouste-Orgeas M, Azoulay E, Chevret S, Moine P, Cohen Y: Accuracy of a composite score using daily SAPS II and LOD scores for predicting hospital mortality in ICU patients hospitalized for more than 72 h. Intensive Care Med. 2001, 27: 1012-1021. 10.1007/s001340000840.CrossRefPubMed
6.
go back to reference Misset B, Moine P, Garrigues B: Diagnostic thesaurus for French ICU patients – year 1999. Réan Urg. 1999, 8: 673-690. 10.1016/S1164-6756(00)87580-5.CrossRef Misset B, Moine P, Garrigues B: Diagnostic thesaurus for French ICU patients – year 1999. Réan Urg. 1999, 8: 673-690. 10.1016/S1164-6756(00)87580-5.CrossRef
7.
go back to reference World Health Organization: ICD-10: International Statistical Classification of Diseases and Related Health Problems: Tenth Revision. 2007, Geneva, Switzerland: World Health Organization World Health Organization: ICD-10: International Statistical Classification of Diseases and Related Health Problems: Tenth Revision. 2007, Geneva, Switzerland: World Health Organization
8.
go back to reference Aegerter P, Auvert B, Buonamico G, Sznajder M, Beauchet A, Guidet B, le Gall JR, Cub R: [Organization and quality control of a clinical database on intensive care medicine in central and suburban Paris]. Rev Epidemiol Sante Publique. 1998, 46: 226-237.PubMed Aegerter P, Auvert B, Buonamico G, Sznajder M, Beauchet A, Guidet B, le Gall JR, Cub R: [Organization and quality control of a clinical database on intensive care medicine in central and suburban Paris]. Rev Epidemiol Sante Publique. 1998, 46: 226-237.PubMed
9.
go back to reference Pakhomov SV, Buntrock JD, Chute CG: Automating the assignment of diagnosis codes to patient encounters using example-based and machine learning techniques. J Am Med Inform Assoc. 2006, 13: 516-525. 10.1197/jamia.M2077.PubMedCentralCrossRefPubMed Pakhomov SV, Buntrock JD, Chute CG: Automating the assignment of diagnosis codes to patient encounters using example-based and machine learning techniques. J Am Med Inform Assoc. 2006, 13: 516-525. 10.1197/jamia.M2077.PubMedCentralCrossRefPubMed
10.
go back to reference Calle JE, Saturno PJ, Parra P, Rodenas J, Perez MJ, Eustaquio FS, Aguinaga E: Quality of the information contained in the minimum basic data set: results from an evaluation in eight hospitals. Eur J Epidemiol. 2000, 16: 1073-1080. 10.1023/A:1010931111115.CrossRefPubMed Calle JE, Saturno PJ, Parra P, Rodenas J, Perez MJ, Eustaquio FS, Aguinaga E: Quality of the information contained in the minimum basic data set: results from an evaluation in eight hospitals. Eur J Epidemiol. 2000, 16: 1073-1080. 10.1023/A:1010931111115.CrossRefPubMed
11.
go back to reference Hsia DC, Krushat WM, Fagan AB, Tebbutt JA, Kusserow RP: Accuracy of diagnostic coding for Medicare patients under the prospective-payment system. N Engl J Med. 1988, 318: 352-355.CrossRefPubMed Hsia DC, Krushat WM, Fagan AB, Tebbutt JA, Kusserow RP: Accuracy of diagnostic coding for Medicare patients under the prospective-payment system. N Engl J Med. 1988, 318: 352-355.CrossRefPubMed
13.
go back to reference Misset B, Moine P, Garrigues B, Logerot-Lebrun H: Guidelines for coding the diagnoses in French ICU patients: year 1999. Réan Urg. 1999, 8: 691-695. 10.1016/S1164-6756(00)87581-7.CrossRef Misset B, Moine P, Garrigues B, Logerot-Lebrun H: Guidelines for coding the diagnoses in French ICU patients: year 1999. Réan Urg. 1999, 8: 691-695. 10.1016/S1164-6756(00)87581-7.CrossRef
14.
go back to reference Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.CrossRefPubMed Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR: Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001, 29: 1303-1310. 10.1097/00003246-200107000-00002.CrossRefPubMed
15.
go back to reference Annane D, Aegerter P, Jars-Guincestre MC, Guidet B: Current epidemiology of septic shock: the CUB-Rea Network. Am J Respir Crit Care Med. 2003, 168: 165-172. 10.1164/rccm.2201087.CrossRefPubMed Annane D, Aegerter P, Jars-Guincestre MC, Guidet B: Current epidemiology of septic shock: the CUB-Rea Network. Am J Respir Crit Care Med. 2003, 168: 165-172. 10.1164/rccm.2201087.CrossRefPubMed
16.
go back to reference Martin GS, Mannino DM, Eaton S, Moss M: The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003, 348: 1546-1554. 10.1056/NEJMoa022139.CrossRefPubMed Martin GS, Mannino DM, Eaton S, Moss M: The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. 2003, 348: 1546-1554. 10.1056/NEJMoa022139.CrossRefPubMed
17.
go back to reference Carlet J, Cohen J, Calandra T, Opal SM, Masur H: Sepsis: time to reconsider the concept. Crit Care Med. 2008, 36: 964-966.CrossRefPubMed Carlet J, Cohen J, Calandra T, Opal SM, Masur H: Sepsis: time to reconsider the concept. Crit Care Med. 2008, 36: 964-966.CrossRefPubMed
18.
go back to reference Alberti C, Tafflet M, Adrie C, Darmon M, Costa MA, De Lassence A, Garrouste-Orgeas M, Misset B, Soufir L, Timsit JF: Quality of clinical databases. Interrater reliability of initial data and daily severity scores measurements in ICU patients. Réanimation. 2003, 12 (suppl 3): 218- Alberti C, Tafflet M, Adrie C, Darmon M, Costa MA, De Lassence A, Garrouste-Orgeas M, Misset B, Soufir L, Timsit JF: Quality of clinical databases. Interrater reliability of initial data and daily severity scores measurements in ICU patients. Réanimation. 2003, 12 (suppl 3): 218-
19.
go back to reference French Ministry of Health: Decree # 2002-465 form April 5, 2002, relative to public and private hospitals providing intensive care. Journal Officiel de la République Française. 2002, 82: 6187- French Ministry of Health: Decree # 2002-465 form April 5, 2002, relative to public and private hospitals providing intensive care. Journal Officiel de la République Française. 2002, 82: 6187-
20.
go back to reference Green AM: Kappa statistics for multiple raters using categorical classifications. Proceedings of the 22nd Annual SAS User Group International Conference. 1997, San Diego, CA, 1110-1115. Green AM: Kappa statistics for multiple raters using categorical classifications. Proceedings of the 22nd Annual SAS User Group International Conference. 1997, San Diego, CA, 1110-1115.
21.
go back to reference Weissman C: Can hospital discharge diagnoses be used for intensive care unit administrative and quality management functions?. Crit Care Med. 1997, 25: 1320-1323. 10.1097/00003246-199708000-00018.CrossRefPubMed Weissman C: Can hospital discharge diagnoses be used for intensive care unit administrative and quality management functions?. Crit Care Med. 1997, 25: 1320-1323. 10.1097/00003246-199708000-00018.CrossRefPubMed
22.
go back to reference Aardal S, Berge K, Breivik K, Flaatten HK: [Medical records, DRG and intensive care patients]. Tidsskr Nor Laegeforen. 2005, 125: 903-906.PubMed Aardal S, Berge K, Breivik K, Flaatten HK: [Medical records, DRG and intensive care patients]. Tidsskr Nor Laegeforen. 2005, 125: 903-906.PubMed
23.
go back to reference Quan H, Parsons GA, Ghali WA: Validity of procedure codes in International Classification of Diseases, 9th revision, clinical modification administrative data. Med Care. 2004, 42: 801-809. 10.1097/01.mlr.0000132391.59713.0d.CrossRefPubMed Quan H, Parsons GA, Ghali WA: Validity of procedure codes in International Classification of Diseases, 9th revision, clinical modification administrative data. Med Care. 2004, 42: 801-809. 10.1097/01.mlr.0000132391.59713.0d.CrossRefPubMed
24.
go back to reference Garrouste-Orgeas M, Timsit JF, Tafflet M, Misset B, Zahar JR, Soufir L, Lazard T, Jamali S, Mourvillier B, Cohen Y, De Lassence A, Azoulay E, Cheval C, Descorps-Declere A, Adrie C, Costa de Beauregard MA, Carlet J: Excess risk of death from intensive care unit-acquired nosocomial bloodstream infections: a reappraisal. Clin Infect Dis. 2006, 42: 1118-1126. 10.1086/500318.CrossRefPubMed Garrouste-Orgeas M, Timsit JF, Tafflet M, Misset B, Zahar JR, Soufir L, Lazard T, Jamali S, Mourvillier B, Cohen Y, De Lassence A, Azoulay E, Cheval C, Descorps-Declere A, Adrie C, Costa de Beauregard MA, Carlet J: Excess risk of death from intensive care unit-acquired nosocomial bloodstream infections: a reappraisal. Clin Infect Dis. 2006, 42: 1118-1126. 10.1086/500318.CrossRefPubMed
25.
go back to reference Dorman T, Loeb L, Sample G: Evaluation and management codes: from current procedural terminology through relative update commission to Center for Medicare and Medicaid Services. Crit Care Med. 2006, 34 (3 Suppl): S71-77. 10.1097/01.CCM.0000200037.30800.E3.CrossRefPubMed Dorman T, Loeb L, Sample G: Evaluation and management codes: from current procedural terminology through relative update commission to Center for Medicare and Medicaid Services. Crit Care Med. 2006, 34 (3 Suppl): S71-77. 10.1097/01.CCM.0000200037.30800.E3.CrossRefPubMed
26.
go back to reference Métais E, Nakache D, Timsit JF: Automatic classification of medical reports, the CIREA project. Proceedings of the 5th WSEAS International Conference on Telecommunications and Informatics, Istanbul, Turkey. 2006, 354-359. Métais E, Nakache D, Timsit JF: Automatic classification of medical reports, the CIREA project. Proceedings of the 5th WSEAS International Conference on Telecommunications and Informatics, Istanbul, Turkey. 2006, 354-359.
27.
go back to reference Agence Nationale d'Accréditation et d'Evaluation en Santé (ANAES): Assessement scale for the patient's medical record. Paris: ANAES. 2003 Agence Nationale d'Accréditation et d'Evaluation en Santé (ANAES): Assessement scale for the patient's medical record. Paris: ANAES. 2003
Metadata
Title
Reliability of diagnostic coding in intensive care patients
Authors
Benoît Misset
Didier Nakache
Aurélien Vesin
Mickael Darmon
Maïté Garrouste-Orgeas
Bruno Mourvillier
Christophe Adrie
Sébastian Pease
Marie-Aliette Costa de Beauregard
Dany Goldgran-Toledano
Elisabeth Métais
Jean-François Timsit
The Outcomerea Database Investigators
Publication date
01-08-2008
Publisher
BioMed Central
Published in
Critical Care / Issue 4/2008
Electronic ISSN: 1364-8535
DOI
https://doi.org/10.1186/cc6969

Other articles of this Issue 4/2008

Critical Care 4/2008 Go to the issue