Skip to main content
Top
Published in: BMC Public Health 1/2013

Open Access 01-12-2013 | Research article

Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-report

Authors: Elizabeth Muggah, Erin Graves, Carol Bennett, Douglas G Manuel

Published in: BMC Public Health | Issue 1/2013

Login to get access

Abstract

Background

Health administrative data is increasingly being used for chronic disease surveillance. This study explored agreement between administrative and survey data for ascertainment of seven key chronic diseases, using individually linked data from a large population of individuals in Ontario, Canada.

Methods

All adults who completed any one of three cycles of the Canadian Community Health Survey (2001, 2003 or 2005) and agreed to have their responses linked to provincial health administrative data were included. The sample population included 85,549 persons. Previously validated case definitions for myocardial infarction, asthma, diabetes, chronic lung disease, stroke, hypertension and congestive heart failure based on hospital and physician billing codes were used to identify cases in health administrative data and these were compared with self-report of each disease from the survey. Concordance was measured using the Kappa statistic, percent positive and negative agreement and prevalence estimates.

Results

Agreement using the Kappa statistic was good or very good (kappa range: 0.66-0.80) for diabetes and hypertension, moderate for myocardial infarction and asthma and poor or fair (kappa range: 0.29-0.36) for stroke, congestive heart failure and COPD. Prevalence was higher in health administrative data for all diseases except stroke and myocardial infarction. Health Utilities Index scores were higher for cases identified by health administrative data compared with self-reported data for some chronic diseases (acute myocardial infarction, stroke, heart failure), suggesting that administrative data may pick up less severe cases.

Conclusions

In the general population, discordance between self-report and administrative data was large for many chronic diseases, particularly disease with low prevalence, and differences were not easily explained by individual and disease characteristics.
Appendix
Available only for authorised users
Literature
1.
go back to reference Alwan A, Armstrong T, Bettcher D, Branca F, Chisholm D, Ezzati M, et al: Global status report on non-communicable diseases 2010. 2010, World Health: Organization Alwan A, Armstrong T, Bettcher D, Branca F, Chisholm D, Ezzati M, et al: Global status report on non-communicable diseases 2010. 2010, World Health: Organization
2.
go back to reference Manuel DG, Rosella LC, Stukel TA: Importance of accurately identifying disease in studies using electronic health records. BMJ. 2010, 341: c4226-10.1136/bmj.c4226.CrossRefPubMed Manuel DG, Rosella LC, Stukel TA: Importance of accurately identifying disease in studies using electronic health records. BMJ. 2010, 341: c4226-10.1136/bmj.c4226.CrossRefPubMed
3.
go back to reference Lix LM, Yogendran MS, Leslie WD, Shaw SY, Baumgartner R, Bowman C, et al: Using multiple data features improved the validity of osteoporosis case ascertainment from administrative databases. J Clin Epidemiol. 2008, 61 (12): 1250-1260. 10.1016/j.jclinepi.2008.02.002.CrossRefPubMed Lix LM, Yogendran MS, Leslie WD, Shaw SY, Baumgartner R, Bowman C, et al: Using multiple data features improved the validity of osteoporosis case ascertainment from administrative databases. J Clin Epidemiol. 2008, 61 (12): 1250-1260. 10.1016/j.jclinepi.2008.02.002.CrossRefPubMed
4.
go back to reference Lix LM, Yogendran MS, Shaw SY, Targownick LE, Jones J, Bataineh O: Comparing administrative and survey data for ascertaining cases of irritable bowel syndrome: a population-based investigation. BMC Health Serv Res. 2010, 10 (1): 31-10.1186/1472-6963-10-31.CrossRefPubMedPubMedCentral Lix LM, Yogendran MS, Shaw SY, Targownick LE, Jones J, Bataineh O: Comparing administrative and survey data for ascertaining cases of irritable bowel syndrome: a population-based investigation. BMC Health Serv Res. 2010, 10 (1): 31-10.1186/1472-6963-10-31.CrossRefPubMedPubMedCentral
5.
go back to reference Saczynski JS, Andrade SE, Harrold LR, Tjia T, Cutrona SL, Dodd KS, et al: A systematic review of validated methods for identifying heart failure using administrative data. Pharmacoepidem Drug Safe. 2012, 21: 129-140. 10.1002/pds.2313.CrossRef Saczynski JS, Andrade SE, Harrold LR, Tjia T, Cutrona SL, Dodd KS, et al: A systematic review of validated methods for identifying heart failure using administrative data. Pharmacoepidem Drug Safe. 2012, 21: 129-140. 10.1002/pds.2313.CrossRef
6.
go back to reference Andrade SE, Harrold LR, Tjia T, Cutrona SL, Saczynski JS, Dodd KS, et al: A systematic review of validated methods for identifying cerebrovascular accident or transient ischemic attack using administrative data. Pharmacoepidem Drug Safe. 2012, 21: 100-128. 10.1002/pds.2312.CrossRef Andrade SE, Harrold LR, Tjia T, Cutrona SL, Saczynski JS, Dodd KS, et al: A systematic review of validated methods for identifying cerebrovascular accident or transient ischemic attack using administrative data. Pharmacoepidem Drug Safe. 2012, 21: 100-128. 10.1002/pds.2312.CrossRef
7.
go back to reference Gershon AS, Wang C, Guan J, Vasilevska-Ristovska J, Cicutto L, To T: Identifying individuals with physcian diagnosed COPD in health administrative databases. COPD: J Chron Obstruct Pulmon Dis. 2009, 6 (5): 388-394. 10.1080/15412550903140865.CrossRef Gershon AS, Wang C, Guan J, Vasilevska-Ristovska J, Cicutto L, To T: Identifying individuals with physcian diagnosed COPD in health administrative databases. COPD: J Chron Obstruct Pulmon Dis. 2009, 6 (5): 388-394. 10.1080/15412550903140865.CrossRef
8.
go back to reference Tu K, Campbell NRC, Chen ZL, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Med. 2007, 1 (1): e18-PubMedPubMedCentral Tu K, Campbell NRC, Chen ZL, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Med. 2007, 1 (1): e18-PubMedPubMedCentral
9.
go back to reference Singh JA: Accuracy of veterans affairs databases for diagnoses of chronic diseases. Prev Chronic Dis. 2009, 6 (4): A126-Epub 2009 Sep 15PubMedPubMedCentral Singh JA: Accuracy of veterans affairs databases for diagnoses of chronic diseases. Prev Chronic Dis. 2009, 6 (4): A126-Epub 2009 Sep 15PubMedPubMedCentral
10.
go back to reference Lix LM, Yogendran MS, Shaw SY, Burchill C, Metge C, Bond R: Population-based data sources for chronic disease surveillance. Chronic Dis Can. 2008, 29 (1): 31-38.PubMed Lix LM, Yogendran MS, Shaw SY, Burchill C, Metge C, Bond R: Population-based data sources for chronic disease surveillance. Chronic Dis Can. 2008, 29 (1): 31-38.PubMed
11.
go back to reference Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LP: Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc. 2004, 52 (1): 123-127. 10.1111/j.1532-5415.2004.52021.x.CrossRefPubMed Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LP: Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc. 2004, 52 (1): 123-127. 10.1111/j.1532-5415.2004.52021.x.CrossRefPubMed
12.
go back to reference Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ: Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004, 57 (10): 1096-1103. 10.1016/j.jclinepi.2004.04.005.CrossRefPubMed Okura Y, Urban LH, Mahoney DW, Jacobsen SJ, Rodeheffer RJ: Agreement between self-report questionnaires and medical record data was substantial for diabetes, hypertension, myocardial infarction and stroke but not for heart failure. J Clin Epidemiol. 2004, 57 (10): 1096-1103. 10.1016/j.jclinepi.2004.04.005.CrossRefPubMed
13.
go back to reference Feeny D, Torrance G, Furlong W: Health utilities index. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilder B. 1996, Philadelphia: Lippincott-Raven, 2 Feeny D, Torrance G, Furlong W: Health utilities index. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilder B. 1996, Philadelphia: Lippincott-Raven, 2
16.
go back to reference Tu JV, Austin P, Naylor CD, Iron K, Zhang H: Chapter 5 - acute myocardial infarction outcomes in Ontario. Cardiovascular Health and Services in Ontario: An ICES Atlas. Edited by: Naylor CD, Slaughter PM. 1999, Toronto: Institute for Clinical Evaluative Sciences, 83-110. Tu JV, Austin P, Naylor CD, Iron K, Zhang H: Chapter 5 - acute myocardial infarction outcomes in Ontario. Cardiovascular Health and Services in Ontario: An ICES Atlas. Edited by: Naylor CD, Slaughter PM. 1999, Toronto: Institute for Clinical Evaluative Sciences, 83-110.
17.
go back to reference Hux JE, Ivis F, Flintoft V, Bica A: Diabetes in ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25 (3): 512-516. 10.2337/diacare.25.3.512.CrossRefPubMed Hux JE, Ivis F, Flintoft V, Bica A: Diabetes in ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25 (3): 512-516. 10.2337/diacare.25.3.512.CrossRefPubMed
18.
go back to reference Guttmann A, Nakhla M, Henderson M, To T, Daneman D, Cauch-Dudek K, et al: Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes. 2010, 11 (2): 122-128. 10.1111/j.1399-5448.2009.00539.x.CrossRefPubMed Guttmann A, Nakhla M, Henderson M, To T, Daneman D, Cauch-Dudek K, et al: Validation of a health administrative data algorithm for assessing the epidemiology of diabetes in Canadian children. Pediatr Diabetes. 2010, 11 (2): 122-128. 10.1111/j.1399-5448.2009.00539.x.CrossRefPubMed
19.
go back to reference Iron K, Lu H, Manuel D, Henry D, Gershon A: Using linked health administrative data to assess the clinical and healthcare system impact of chronic diseases in Ontario. Healthcare quarterly (Toronto, Ont ). 2011, 14 (3): 23-CrossRef Iron K, Lu H, Manuel D, Henry D, Gershon A: Using linked health administrative data to assess the clinical and healthcare system impact of chronic diseases in Ontario. Healthcare quarterly (Toronto, Ont ). 2011, 14 (3): 23-CrossRef
20.
go back to reference Feeny D, Torrance G, Furlong W: Health utilities index - chapter 26. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilder B. 1996, Philadelphia: Lippincott-Raven, 2 Feeny D, Torrance G, Furlong W: Health utilities index - chapter 26. Quality of life and pharmacoeconomics in clinical trials. Edited by: Spilder B. 1996, Philadelphia: Lippincott-Raven, 2
22.
go back to reference Carter K, Barber PA, Shaw C: How does self-reported history of stroke compare to hospitalization data in a population-based survey in New Zealand?. Stroke. 2010, 41 (11): 2678-2680. 10.1161/STROKEAHA.110.598268.CrossRefPubMed Carter K, Barber PA, Shaw C: How does self-reported history of stroke compare to hospitalization data in a population-based survey in New Zealand?. Stroke. 2010, 41 (11): 2678-2680. 10.1161/STROKEAHA.110.598268.CrossRefPubMed
23.
go back to reference Leys D, Lucas C, Devos D, Mounier-Vehier F, Godefroy O, Pruvo JP: Misdiagnoses in 1,250 consecutive patients admitted to an acute stroke unit. Cerebrovasc Dis. 1997, 7 (Suppl 5): 284-288. Leys D, Lucas C, Devos D, Mounier-Vehier F, Godefroy O, Pruvo JP: Misdiagnoses in 1,250 consecutive patients admitted to an acute stroke unit. Cerebrovasc Dis. 1997, 7 (Suppl 5): 284-288.
24.
go back to reference Rosamond WD, Sprafka JM, McGovern PG, Nelson M, Luepker RV: Validation of self-reported history of acute myocardial infarction: experience of the Minnesota heart survey registry. Epidemiology. 1996, 6 (1): 67-69. 10.1016/1047-2797(95)00095-X.CrossRef Rosamond WD, Sprafka JM, McGovern PG, Nelson M, Luepker RV: Validation of self-reported history of acute myocardial infarction: experience of the Minnesota heart survey registry. Epidemiology. 1996, 6 (1): 67-69. 10.1016/1047-2797(95)00095-X.CrossRef
25.
go back to reference Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A: Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011, 64 (8): 821-829. 10.1016/j.jclinepi.2010.10.006.CrossRefPubMed Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A: Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011, 64 (8): 821-829. 10.1016/j.jclinepi.2010.10.006.CrossRefPubMed
26.
go back to reference Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009, 1: 21(9)- Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H: Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009, 1: 21(9)-
Metadata
Title
Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-report
Authors
Elizabeth Muggah
Erin Graves
Carol Bennett
Douglas G Manuel
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2013
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-13-16

Other articles of this Issue 1/2013

BMC Public Health 1/2013 Go to the issue