Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

The existence of standard-biased mortality ratios due to death certificate misclassification - a simulation study based on a true story

Author: Andreas Deckert

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Mortality statistics are used to compare health status of populations; optimally, they base on individual death certificates. However, determining cause of death is error-prone. E.g. cardiovascular disease (CVD) death determination is characterized by sensitivity (SE) and specificity (SP) lower than 85 %. Furthermore, differential misclassification may be present in case of homogenous target populations. We investigate the bias of standardized mortality ratios (SMR), based on real-world data.

Methods

CVD mortality of 6378 ethnic German repatriates was assessed and the SMR calculated. Non-differential age-dependent misclassification was introduced into data by scenarios of equal SE and SP in a range of 0.7 to 0.85. The bias between originally reported and actual SMR was calculated for each pair of values. Additionally, four differential misclassification scenarios were simulated, reflecting two extreme scenarios of both quality criteria varied in the cohort but fixed to either higher or lower in the reference, and two scenarios of crossed criteria values.

Results

In case of non-differential misclassification the bias is always towards the null-hypothesis. The lowest bias was 13.5 % (SE, SP = 0.85 constantly), the maximum bias was 40 % (SP = 0.7). However, in case of differential misclassification the observed SMR can be on the wrong track. If SP is high but SE low in the cohort, negative bias up to −10 % can occur. In case SE is low but SP is high in the reference, the bias remains always positive. In the opposite case plus SP is high in the cohort, the bias can reach −30 %.

Conclusion

SMR values are always biased due to the diagnostic test character of death determination. In majority of epidemiological studies the bias should be towards the null-hypothesis (non-differential misclassification). However, caution is needed in case of differential misclassification, possibly experienced in studies on homogenous subgroups, and in large prospective cohorts with specifically trained personnel.
Literature
1.
go back to reference Phillips DE, AbouZahr C, Lopez AD, Mikkelsen L, de Savigny D, Lozano R, et al. Are well functioning civil registration and vital statistics systems associated with better health outcomes? [published online ahead of print May 2005]. Lancet. doi:10.1016/S0140-6736(15)60172-6 Phillips DE, AbouZahr C, Lopez AD, Mikkelsen L, de Savigny D, Lozano R, et al. Are well functioning civil registration and vital statistics systems associated with better health outcomes? [published online ahead of print May 2005]. Lancet. doi:10.​1016/​S0140-6736(15)60172-6
3.
go back to reference Kreienbrock L, Schach S. In: Moltmann UG, editor. Epidemiologische Methoden. (German). 4th ed. Heidelberg: Spektrum Akademischer Verlag; 2005. Kreienbrock L, Schach S. In: Moltmann UG, editor. Epidemiologische Methoden. (German). 4th ed. Heidelberg: Spektrum Akademischer Verlag; 2005.
4.
go back to reference Andersson P, Leppert J. Men of low socio-economic and educational level possess pronounced deficient knowledge about the risk factors related to coronary heart disease. J Cardiovasc Risk. 2001;8(6):371–7.PubMed Andersson P, Leppert J. Men of low socio-economic and educational level possess pronounced deficient knowledge about the risk factors related to coronary heart disease. J Cardiovasc Risk. 2001;8(6):371–7.PubMed
5.
go back to reference Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. [published online ahead of print May 2005]. Lancet. doi:10.1016/S0140-6736(15)60171-4 Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. [published online ahead of print May 2005]. Lancet. doi:10.​1016/​S0140-6736(15)60171-4
7.
go back to reference Stehbens W. An appraisal of the epidemic rise of coronary heart disease and its decline. Lancet. 1987;329(8533):606–11.CrossRef Stehbens W. An appraisal of the epidemic rise of coronary heart disease and its decline. Lancet. 1987;329(8533):606–11.CrossRef
8.
go back to reference Surján G. Questions on validity of International Classification of Diseases-coded diagnoses. Int J Med Inform. 1999;54(2):77–95.CrossRefPubMed Surján G. Questions on validity of International Classification of Diseases-coded diagnoses. Int J Med Inform. 1999;54(2):77–95.CrossRefPubMed
10.
go back to reference Jedrychowski W, Mróz E, Wiernikowski A, Flak E. Validity study on the certification and coding of underlying causes of death for the mortality statistic. Przegl Epidemiol. 2001;55(3):313–22.PubMed Jedrychowski W, Mróz E, Wiernikowski A, Flak E. Validity study on the certification and coding of underlying causes of death for the mortality statistic. Przegl Epidemiol. 2001;55(3):313–22.PubMed
11.
go back to reference Lloyd-Jones DM, Martin DO, Larson MG, Levy D. Accuracy of death certificates for coding coronary heart disease as the cause of death. Ann Intern Med. 1998;129:1020–6.CrossRefPubMed Lloyd-Jones DM, Martin DO, Larson MG, Levy D. Accuracy of death certificates for coding coronary heart disease as the cause of death. Ann Intern Med. 1998;129:1020–6.CrossRefPubMed
12.
go back to reference Modelmog D, Rahlenbeck S, Trichopoulos D. Accuracy of death certificates: a population-based, complete-coverage, one-year autopsy study in East Germany. Cancer Causes Control. 1992;3(6):541–6.CrossRefPubMed Modelmog D, Rahlenbeck S, Trichopoulos D. Accuracy of death certificates: a population-based, complete-coverage, one-year autopsy study in East Germany. Cancer Causes Control. 1992;3(6):541–6.CrossRefPubMed
13.
go back to reference Deckert A, Winkler V, Meisinger C, Heier M, Becher H. Myocardial infarction incidence and ischemic heart disease mortality: overall and trend results in repatriates, Germany. Eur J Public Health. 2013;24(1):127–33. doi:10.1093/eurpub/ckt058.CrossRefPubMed Deckert A, Winkler V, Meisinger C, Heier M, Becher H. Myocardial infarction incidence and ischemic heart disease mortality: overall and trend results in repatriates, Germany. Eur J Public Health. 2013;24(1):127–33. doi:10.​1093/​eurpub/​ckt058.CrossRefPubMed
14.
go back to reference Becher H, Razum O, Kyobutungi C, Laki J, Ott JJ, Ronellenfitsch U, et al. Mortality of immigrants from the Former Soviet Union: Results of a cohort study. Dtsch Aerzteblatt. 2007;104:1655–61. Becher H, Razum O, Kyobutungi C, Laki J, Ott JJ, Ronellenfitsch U, et al. Mortality of immigrants from the Former Soviet Union: Results of a cohort study. Dtsch Aerzteblatt. 2007;104:1655–61.
16.
go back to reference Winkler V. Specific aspects of the health profile of German migrants from the Former Soviet Union [PhD thesis]. University of Heidelberg, Institute of Public Health. 2008. Winkler V. Specific aspects of the health profile of German migrants from the Former Soviet Union [PhD thesis]. University of Heidelberg, Institute of Public Health. 2008.
17.
go back to reference Deckert A. Myocardial infarction incidence, cardiovascular disease, and external cause mortality pattern among German repatriates: the impact of factual circumstances [PhD thesis]. University of Heidelberg. 2013. Deckert A. Myocardial infarction incidence, cardiovascular disease, and external cause mortality pattern among German repatriates: the impact of factual circumstances [PhD thesis]. University of Heidelberg. 2013.
18.
go back to reference Hammer GP. Makros zur Berechnung von Personenjahren in epidemiologischen Studien. (German). In: Ortseifen HR C, editor. KSFE 2011 - Proceedings der 15. Konferenz der SAS-Anwender in Forschung und Entwicklung. Aachen: Shaker Verlag; 2011. p. 223–32. Hammer GP. Makros zur Berechnung von Personenjahren in epidemiologischen Studien. (German). In: Ortseifen HR C, editor. KSFE 2011 - Proceedings der 15. Konferenz der SAS-Anwender in Forschung und Entwicklung. Aachen: Shaker Verlag; 2011. p. 223–32.
20.
go back to reference Kyobutungi C. Ethnic German Immigrant from the Former Soviet Union: Mortality from External Causes and Cancers [PhD thesis]. University of Heidelberg. 2008. Kyobutungi C. Ethnic German Immigrant from the Former Soviet Union: Mortality from External Causes and Cancers [PhD thesis]. University of Heidelberg. 2008.
Metadata
Title
The existence of standard-biased mortality ratios due to death certificate misclassification - a simulation study based on a true story
Author
Andreas Deckert
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0112-8

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue