Skip to main content
Top
Published in: Population Health Metrics 1/2011

Open Access 01-12-2011 | Research

Assessing quality of medical death certification: Concordance between gold standard diagnosis and underlying cause of death in selected Mexican hospitals

Authors: Bernardo Hernández, Dolores Ramírez-Villalobos, Minerva Romero, Sara Gómez, Charles Atkinson, Rafael Lozano

Published in: Population Health Metrics | Issue 1/2011

Login to get access

Abstract

Background

In Mexico, the vital registration system relies on information collected from death certificates to generate official mortality figures. Although the death certificate has high coverage across the country, there is little information regarding its validity. The objective of this study was to assess the concordance between the underlying cause of death in official statistics obtained from death certificates and a gold standard diagnosis of the same deaths derived from medical records of hospitals.

Methods

The study sample consisted of 1,589 deaths that occurred in 34 public hospitals in the Federal District and the state of Morelos, Mexico in 2009. Neonatal, child, and adult cases were selected for causes of death that included infectious diseases, noncommunicable diseases, and injuries. We compared the underlying cause of death, obtained from medical death certificates, against a gold standard diagnosis derived from a review of medical records developed by the Population Health Metrics Research Consortium. We used chance-corrected concordance and accuracy as metrics to evaluate the quality of performance of the death certificate.

Results

Analysis considering only the underlying cause of death resulted in a median chance-corrected concordance between the cause of death in medical death certificates versus the gold standard of 54.3% (95% uncertainty interval [UI]: 52.2, 55.6) for neonates, 38.5% (37.0, 40.0) for children, and 66.5% (65.9, 66.9) for adults. The accuracy resulting from the same analysis was 0.756 (0.747, 0.769) for neonates, 0.683 (0.663, 0.701) for children, and 0.780 (0.774, 0.785) for adults. Median chance-corrected concordance and accuracy increased when considering the mention of any cause of death in the death certificate, not just the underlying cause. Concordance varied substantially depending on cause of death, and accuracy varied depending on the true cause-specific mortality fraction composition.

Conclusions

Although we cannot generalize our conclusions to Mexico as a whole, the results demonstrate important problems with the quality of the main source of information for causes of death used by decision-makers in settings with highly technological vital registration systems. It is necessary to improve death certification procedures, especially in the case of child and neonatal deaths. This requires an important commitment from the health system and health institutions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mathers CD, Fat DM, Inoue M, Rao C, Lopez AD: Counting the dead and what they died from: an assessment of the global status of cause of death data. Bull. World Health Organ 2005, 83: 171-177.PubMedPubMedCentral Mathers CD, Fat DM, Inoue M, Rao C, Lopez AD: Counting the dead and what they died from: an assessment of the global status of cause of death data. Bull. World Health Organ 2005, 83: 171-177.PubMedPubMedCentral
2.
go back to reference Lozano-Ascencio R: Is it possible to improve the death registries in Mexico? Gac Med Mex 2008, 144: 525-533.PubMed Lozano-Ascencio R: Is it possible to improve the death registries in Mexico? Gac Med Mex 2008, 144: 525-533.PubMed
7.
go back to reference Alpérovitch A, Bertrand M, Jougla E, Vidal J-S, Ducimetière P, Helmer C, Ritchie K, Pavillon G, Tzourio C: Do we really know the cause of death of the very old? Comparison between official mortality statistics and cohort study classification. Eur. J. Epidemiol 2009, 24: 669-675. 10.1007/s10654-009-9383-2CrossRefPubMed Alpérovitch A, Bertrand M, Jougla E, Vidal J-S, Ducimetière P, Helmer C, Ritchie K, Pavillon G, Tzourio C: Do we really know the cause of death of the very old? Comparison between official mortality statistics and cohort study classification. Eur. J. Epidemiol 2009, 24: 669-675. 10.1007/s10654-009-9383-2CrossRefPubMed
8.
go back to reference Sinha S, Myint PK, Luben RN, Khaw K-T: Accuracy of death certification and hospital record linkage for identification of incident stroke. BMC Med Res Methodol 2008, 8: 74. 10.1186/1471-2288-8-74CrossRefPubMedPubMedCentral Sinha S, Myint PK, Luben RN, Khaw K-T: Accuracy of death certification and hospital record linkage for identification of incident stroke. BMC Med Res Methodol 2008, 8: 74. 10.1186/1471-2288-8-74CrossRefPubMedPubMedCentral
9.
go back to reference Laurenti R, de Mello Jorge MHP, Gotlieb SLD: Underlying cause-of-death mortality statistics: considering the reliability of data. Rev. Panam. Salud Publica 2008, 23: 349-356. 10.1590/S1020-49892008000500007CrossRefPubMed Laurenti R, de Mello Jorge MHP, Gotlieb SLD: Underlying cause-of-death mortality statistics: considering the reliability of data. Rev. Panam. Salud Publica 2008, 23: 349-356. 10.1590/S1020-49892008000500007CrossRefPubMed
10.
go back to reference Nunes J, Koifman RJ, Mattos IE, Monteiro GTR: Reliability and validity of uterine cancer death certificates in the municipality of Belém, Pará, Brazil. Cad Saude Publica 2004, 20: 1262-1268. 10.1590/S0102-311X2004000500020CrossRefPubMed Nunes J, Koifman RJ, Mattos IE, Monteiro GTR: Reliability and validity of uterine cancer death certificates in the municipality of Belém, Pará, Brazil. Cad Saude Publica 2004, 20: 1262-1268. 10.1590/S0102-311X2004000500020CrossRefPubMed
11.
go back to reference Pattaraarchachai J, Rao C, Polprasert W, Porapakkham Y, Pao-In W, Singwerathum N, Lopez AD: Cause-specific mortality patterns among hospital deaths in Thailand: validating routine death certification. Popul Health Metr 2010, 8: 12. 10.1186/1478-7954-8-12CrossRefPubMedPubMedCentral Pattaraarchachai J, Rao C, Polprasert W, Porapakkham Y, Pao-In W, Singwerathum N, Lopez AD: Cause-specific mortality patterns among hospital deaths in Thailand: validating routine death certification. Popul Health Metr 2010, 8: 12. 10.1186/1478-7954-8-12CrossRefPubMedPubMedCentral
12.
go back to reference Jedrychowski W, Mróz E, Wiernikowski A, Flak E: Validity study on the certification and coding of underlying causes of death for mortality statistics. Przegl Epidemiol 2001, 55: 313-322.PubMed Jedrychowski W, Mróz E, Wiernikowski A, Flak E: Validity study on the certification and coding of underlying causes of death for mortality statistics. Przegl Epidemiol 2001, 55: 313-322.PubMed
13.
go back to reference Almada R, Ciriacos C, Piñeyrúa M, Logaldo R, González D: Calidad del registro en el certificado de defunción en un hospital público de referencia. Montevideo, Uruguay, octubre-noviembre 2009. Rev Med Urug 2010, 26: 216-223. Almada R, Ciriacos C, Piñeyrúa M, Logaldo R, González D: Calidad del registro en el certificado de defunción en un hospital público de referencia. Montevideo, Uruguay, octubre-noviembre 2009. Rev Med Urug 2010, 26: 216-223.
14.
go back to reference Tomé P, Reyes H, Guiscafré H, Martínez H, Rodríguez L, Gutiérrez G: Sobrediagnóstico de infección respiratoria y diarrea aguda en muertes de niños en Tlaxcala, México: análisis comparativo entre certificados de defunción y "autopsias verbales". Bol. méd. Hosp. Infant. Méx 1994, 51: 159-166. Tomé P, Reyes H, Guiscafré H, Martínez H, Rodríguez L, Gutiérrez G: Sobrediagnóstico de infección respiratoria y diarrea aguda en muertes de niños en Tlaxcala, México: análisis comparativo entre certificados de defunción y "autopsias verbales". Bol. méd. Hosp. Infant. Méx 1994, 51: 159-166.
15.
go back to reference Alvarez G, Harlow SD, Denman C, Hofmeister MJ: Quality of cause-of-death statements and its impact on infant mortality statistics in Hermosillo, Mexico. Rev. Panam. Salud Publica 2009, 25: 120-127. 10.1590/S1020-49892009000200004CrossRefPubMed Alvarez G, Harlow SD, Denman C, Hofmeister MJ: Quality of cause-of-death statements and its impact on infant mortality statistics in Hermosillo, Mexico. Rev. Panam. Salud Publica 2009, 25: 120-127. 10.1590/S1020-49892009000200004CrossRefPubMed
16.
go back to reference Murray CJL, Lopez AD, Black R, Ahuja R, Ali SM, Baqui A, Dandona L, Dantzer E, Das V, Dhingra U, Dutta A, Fawzi W, Flaxman AD, Gómez S, Hernández B, Joshi R, Kalter H, Kumar A, Kumar V, Lozano R, Lucero M, Mehta S, Neal B, Ohno SL, Prasad R, Praveen D, Premji Z, Ramírez-Villalobos D, Remolador H, Riley I, Romero M, Said M, Sanvictores D, Sazawal S, Tallo V: Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets. Popul Health Metr 2011, 9: 27. 10.1186/1478-7954-9-27CrossRefPubMedPubMedCentral Murray CJL, Lopez AD, Black R, Ahuja R, Ali SM, Baqui A, Dandona L, Dantzer E, Das V, Dhingra U, Dutta A, Fawzi W, Flaxman AD, Gómez S, Hernández B, Joshi R, Kalter H, Kumar A, Kumar V, Lozano R, Lucero M, Mehta S, Neal B, Ohno SL, Prasad R, Praveen D, Premji Z, Ramírez-Villalobos D, Remolador H, Riley I, Romero M, Said M, Sanvictores D, Sazawal S, Tallo V: Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets. Popul Health Metr 2011, 9: 27. 10.1186/1478-7954-9-27CrossRefPubMedPubMedCentral
17.
go back to reference Murray CJL, Lozano R, Flaxman AD, Vahdatpour A, Lopez AD: Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studies. Popul Health Metr 2011, 9: 28. 10.1186/1478-7954-9-28CrossRefPubMedPubMedCentral Murray CJL, Lozano R, Flaxman AD, Vahdatpour A, Lopez AD: Robust metrics for assessing the performance of different verbal autopsy cause assignment methods in validation studies. Popul Health Metr 2011, 9: 28. 10.1186/1478-7954-9-28CrossRefPubMedPubMedCentral
18.
go back to reference Frigyik B, Kapila A, Gupta M: Introduction to the Dirichlet Distribution and Related Processes. Seattle, WA: University of Washington Electrical Engineering, Technical Report UWEETR-2010-0006; 2010. Frigyik B, Kapila A, Gupta M: Introduction to the Dirichlet Distribution and Related Processes. Seattle, WA: University of Washington Electrical Engineering, Technical Report UWEETR-2010-0006; 2010.
19.
20.
go back to reference Moriyama IM, Dawber TR, Kannel WB: Evaluation of diagnostic information supporting medical certification of deaths from cardiovascular disease. Natl Cancer Inst Monogr 1966, 19: 405-419.PubMed Moriyama IM, Dawber TR, Kannel WB: Evaluation of diagnostic information supporting medical certification of deaths from cardiovascular disease. Natl Cancer Inst Monogr 1966, 19: 405-419.PubMed
21.
go back to reference Shojania KG, Burton EC, McDonald KM, Goldman L: Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. JAMA 2003, 289: 2849-2856. 10.1001/jama.289.21.2849CrossRefPubMed Shojania KG, Burton EC, McDonald KM, Goldman L: Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. JAMA 2003, 289: 2849-2856. 10.1001/jama.289.21.2849CrossRefPubMed
22.
23.
go back to reference Lahti RA, Penttilä A: The validity of death certificates: routine validation of death certification and its effects on mortality statistics. Forensic Sci. Int 2001, 115: 15-32. 10.1016/S0379-0738(00)00300-5CrossRefPubMed Lahti RA, Penttilä A: The validity of death certificates: routine validation of death certification and its effects on mortality statistics. Forensic Sci. Int 2001, 115: 15-32. 10.1016/S0379-0738(00)00300-5CrossRefPubMed
24.
go back to reference Johansson LA, Westerling R: Comparing Swedish hospital discharge records with death certificates: implications for mortality statistics. Int J Epidemiol 2000, 29: 495-502. 10.1093/ije/29.3.495CrossRefPubMed Johansson LA, Westerling R: Comparing Swedish hospital discharge records with death certificates: implications for mortality statistics. Int J Epidemiol 2000, 29: 495-502. 10.1093/ije/29.3.495CrossRefPubMed
25.
go back to reference Geiss L, Herman W, Smith P: Mortality in non-insulin dependent diabetes. In Diabetes in America. 2nd edition. Washington D.C.: U.S. Department of Health and Human Services, National Institutes of Health; 1995:233-257. Geiss L, Herman W, Smith P: Mortality in non-insulin dependent diabetes. In Diabetes in America. 2nd edition. Washington D.C.: U.S. Department of Health and Human Services, National Institutes of Health; 1995:233-257.
26.
go back to reference Ochi JW, Melton LJ, Palumbo PJ, Chu CP: A population-based study of diabetes mortality. Diabetes Care 1985, 8: 224-229. 10.2337/diacare.8.3.224CrossRefPubMed Ochi JW, Melton LJ, Palumbo PJ, Chu CP: A population-based study of diabetes mortality. Diabetes Care 1985, 8: 224-229. 10.2337/diacare.8.3.224CrossRefPubMed
27.
go back to reference Jougla E, Papoz L, Balkau B, Maguin P, Hatton F: Death certificate coding practices related to diabetes in European countries--the "EURODIAB Subarea C" Study. Int J Epidemiol 1992, 21: 343-351. 10.1093/ije/21.2.343CrossRefPubMed Jougla E, Papoz L, Balkau B, Maguin P, Hatton F: Death certificate coding practices related to diabetes in European countries--the "EURODIAB Subarea C" Study. Int J Epidemiol 1992, 21: 343-351. 10.1093/ije/21.2.343CrossRefPubMed
28.
go back to reference Lu TH, Hsu PY, Bjorkenstam C, Anderson RN: Certifying diabetes-related cause-of-death: a comparison of inappropriate certification statements in Sweden, Taiwan and the USA. Diabetologia 2006, 49: 2878-2881. 10.1007/s00125-006-0470-6CrossRefPubMed Lu TH, Hsu PY, Bjorkenstam C, Anderson RN: Certifying diabetes-related cause-of-death: a comparison of inappropriate certification statements in Sweden, Taiwan and the USA. Diabetologia 2006, 49: 2878-2881. 10.1007/s00125-006-0470-6CrossRefPubMed
29.
go back to reference Murray CJL, Dias RH, Kulkarni SC, Lozano R, Stevens GA, Ezzati M: Improving the comparability of diabetes mortality statistics in the U.S. and Mexico. Diabetes Care 2008, 31: 451-458.CrossRefPubMed Murray CJL, Dias RH, Kulkarni SC, Lozano R, Stevens GA, Ezzati M: Improving the comparability of diabetes mortality statistics in the U.S. and Mexico. Diabetes Care 2008, 31: 451-458.CrossRefPubMed
30.
go back to reference Hunt R, Barr P: Errors in the certification of neonatal death. J Paediatr Child Health 2000, 36: 498-501. 10.1046/j.1440-1754.2000.00556.xCrossRefPubMed Hunt R, Barr P: Errors in the certification of neonatal death. J Paediatr Child Health 2000, 36: 498-501. 10.1046/j.1440-1754.2000.00556.xCrossRefPubMed
32.
go back to reference Lakkireddy DR, Basarakodu KR, Vacek JL, Kondur AK, Ramachandruni SK, Esterbrooks DJ, Markert RJ, Gowda MS: Improving death certificate completion: a trial of two training interventions. J Gen Intern Med 2007, 22: 544-548. 10.1007/s11606-006-0071-6CrossRefPubMedPubMedCentral Lakkireddy DR, Basarakodu KR, Vacek JL, Kondur AK, Ramachandruni SK, Esterbrooks DJ, Markert RJ, Gowda MS: Improving death certificate completion: a trial of two training interventions. J Gen Intern Med 2007, 22: 544-548. 10.1007/s11606-006-0071-6CrossRefPubMedPubMedCentral
Metadata
Title
Assessing quality of medical death certification: Concordance between gold standard diagnosis and underlying cause of death in selected Mexican hospitals
Authors
Bernardo Hernández
Dolores Ramírez-Villalobos
Minerva Romero
Sara Gómez
Charles Atkinson
Rafael Lozano
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2011
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/1478-7954-9-38

Other articles of this Issue 1/2011

Population Health Metrics 1/2011 Go to the issue