Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

Validating self-report of diabetes use by participants in the 45 and up study: a record linkage study

Authors: Elizabeth Jean Comino, Duong Thuy Tran, Marion Haas, Jeff Flack, Bin Jalaludin, Louisa Jorm, Mark Fort Harris

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

Prevalence studies usually depend on self-report of disease status in survey data or administrative data collections and may over- or under-estimate disease prevalence. The establishment of a linked data collection provided an opportunity to explore the accuracy and completeness of capture of information about diabetes in survey and administrative data collections.

Methods

Baseline questionnaire data at recruitment to the 45 and Up Study was obtained for 266,848 adults aged 45 years and over sampled from New South Wales, Australia in 2006–2009, and linked to administrative data about hospitalisation from the Admitted Patient Data Collection (APDC) for 2000–2009, claims for medical services (MBS) and pharmaceuticals (PBS) from Medicare Australia data for 2004–2009. Diabetes status was determined from response to a question ‘Has a doctor EVER told you that you have diabetes’ (n = 23,981) and augmented by examination of free text fields about diagnosis (n = 119) or use of insulin (n = 58). These data were used to identify the sub-group with type 1 diabetes. We explored the agreement between self-report of diabetes, identification of diabetes diagnostic codes in APDC data, claims for glycosylated haemoglobin (HbA1c) in MBS data, and claims for dispensed medication (oral hyperglycaemic agents and insulin) in PBS data.

Results

Most participants with diabetes were identified in APDC data if admitted to hospital (79.3%), in MBS data with at least one claim for HbA1c testing (84.7%; 73.4% if 2 tests claimed) or in PBS data through claim for diabetes medication (71.4%). Using these alternate data collections as an imperfect ‘gold standard’ we calculated sensitivities of 83.7% for APDC, 63.9% (80.5% for two tests) for MBS, and 96.6% for PBS data and specificities of 97.7%, 98.4% and 97.1% respectively. The lower sensitivity for HbA1c may reflect the use of this test to screen for diabetes suggesting that it is less useful in identifying people with diabetes without additional information. Kappa values were 0.80, 0.70 and 0.80 for APDC, MBS and PBS respectively reflecting the large population sample under consideration. Compared to APDC, there was poor agreement about identifying type 1 diabetes status.

Conclusions

Self-report of diagnosis augmented with free text data indicating diabetes as a chronic condition and/or use of insulin among medications used was able to identify participants with diabetes with high sensitivity and specificity compared to available administrative data collections.
Appendix
Available only for authorised users
Literature
1.
go back to reference Australian Bureau of Statistics: National health survey: users’ Guide - electronic Australia ABS Catalogue number: 4363.0.55.001. 2009, Canberra: ABS Australian Bureau of Statistics: National health survey: users’ Guide - electronic Australia ABS Catalogue number: 4363.0.55.001. 2009, Canberra: ABS
2.
go back to reference Dunstan D, Zammit P, Welborn TA, Cameron AJ, Shaw J, de Courten M, Jolley D, McCarty DJ: The Australian Diabetes, Obesity and Lifestyle Study (AusDiab:) methods and response rates. Diabetes Res Clin Pract. 2002, 57 (2): 119-129. 10.1016/S0168-8227(02)00025-6.CrossRefPubMed Dunstan D, Zammit P, Welborn TA, Cameron AJ, Shaw J, de Courten M, Jolley D, McCarty DJ: The Australian Diabetes, Obesity and Lifestyle Study (AusDiab:) methods and response rates. Diabetes Res Clin Pract. 2002, 57 (2): 119-129. 10.1016/S0168-8227(02)00025-6.CrossRefPubMed
3.
go back to reference Centre for Epidemiology and Research: The health of the people of New South Wales - Report of the Chief Health Officer. Summary Report, 2010. Volume 2012. 2010, Sydney: NSW Department of Health Centre for Epidemiology and Research: The health of the people of New South Wales - Report of the Chief Health Officer. Summary Report, 2010. Volume 2012. 2010, Sydney: NSW Department of Health
4.
go back to reference Chittleborough CR, Baldock KL, Phillips PJ, Taylor AW, North West Adelaide Health Study T: Achievement of management targets associated with incident and long-term diagnosed diabetes among a representative population sample. Diabetes Res Clin Pract. 2010, 88 (3): 322-327. 10.1016/j.diabres.2010.02.007.CrossRefPubMed Chittleborough CR, Baldock KL, Phillips PJ, Taylor AW, North West Adelaide Health Study T: Achievement of management targets associated with incident and long-term diagnosed diabetes among a representative population sample. Diabetes Res Clin Pract. 2010, 88 (3): 322-327. 10.1016/j.diabres.2010.02.007.CrossRefPubMed
5.
go back to reference Chittleborough CR, Grant JF, Phillips PJ, Taylor AW: The increasing prevalence of diabetes in South Australia: the relationship with population ageing and obesity. Public Health. 2007, 121 (2): 92-99. 10.1016/j.puhe.2006.09.017.CrossRefPubMed Chittleborough CR, Grant JF, Phillips PJ, Taylor AW: The increasing prevalence of diabetes in South Australia: the relationship with population ageing and obesity. Public Health. 2007, 121 (2): 92-99. 10.1016/j.puhe.2006.09.017.CrossRefPubMed
6.
go back to reference Cricelli C, Mazzaglia G, Samani F, Marchi M, Sabatini A, Nardi R, Ventriglia G, Caputi AP: Prevalence estimates for chronic diseases in Italy: exploring the differences between self-report and primary care databases. J Public Health Med. 2003, 25 (3): 254-257. 10.1093/pubmed/fdg060.CrossRefPubMed Cricelli C, Mazzaglia G, Samani F, Marchi M, Sabatini A, Nardi R, Ventriglia G, Caputi AP: Prevalence estimates for chronic diseases in Italy: exploring the differences between self-report and primary care databases. J Public Health Med. 2003, 25 (3): 254-257. 10.1093/pubmed/fdg060.CrossRefPubMed
8.
go back to reference National Centre for Classification in Health: The International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM)-Fifth Edition-Tabular list of diseases and Alphabetic index of diseases. 2006, Sydney: National Centre for Classification in Health, Faculty of Health Sciences, The University of Sydney National Centre for Classification in Health: The International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM)-Fifth Edition-Tabular list of diseases and Alphabetic index of diseases. 2006, Sydney: National Centre for Classification in Health, Faculty of Health Sciences, The University of Sydney
9.
go back to reference Dunstan D, Zimmet P, Welborn T, Sicree R, Armstrong T, Atkins R, Cameron A, et al: Diabetes and Associated Disorders in Australia - 2000. The Accelerating Epidemic. The Australian Diabetes, Obesity and Lifestyle Study (AusDiab). 2001, Melbourne: International Diabetes Institute Dunstan D, Zimmet P, Welborn T, Sicree R, Armstrong T, Atkins R, Cameron A, et al: Diabetes and Associated Disorders in Australia - 2000. The Accelerating Epidemic. The Australian Diabetes, Obesity and Lifestyle Study (AusDiab). 2001, Melbourne: International Diabetes Institute
10.
go back to reference Australian Institute of Health and Welfare (AIHW): Diabetes prevalence in Australia: an assessment of national data sources. Diabetes series no 14 Cat No CVD 46. 2009, Canberra: AIHW Australian Institute of Health and Welfare (AIHW): Diabetes prevalence in Australia: an assessment of national data sources. Diabetes series no 14 Cat No CVD 46. 2009, Canberra: AIHW
11.
go back to reference Banks E, Redman S, Jorm L, Armstrong B, Bauman A, Beard J, Beral V, Byles J, Corbett S, Cumming R, et al: Cohort profile: the 45 and up study. Int J Epidemiol. 2008, 37 (5): 941-947.CrossRefPubMed Banks E, Redman S, Jorm L, Armstrong B, Bauman A, Beard J, Beral V, Byles J, Corbett S, Cumming R, et al: Cohort profile: the 45 and up study. Int J Epidemiol. 2008, 37 (5): 941-947.CrossRefPubMed
12.
go back to reference Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA: Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011, 28 (4): 424-427. 10.1111/j.1464-5491.2011.03238.x.CrossRefPubMed Amed S, Vanderloo SE, Metzger D, Collet JP, Reimer K, McCrea P, Johnson JA: Validation of diabetes case definitions using administrative claims data. Diabet Med. 2011, 28 (4): 424-427. 10.1111/j.1464-5491.2011.03238.x.CrossRefPubMed
13.
go back to reference Beckles GL, Williamson DF, Brown AF, Gregg EW, Karter AJ, Kim C, Dudley RA, Safford MM, Stevens MR, Thompson TJ: Agreement between self-reports and medical records was only fair in a cross-sectional study of performance of annual eye examinations among adults with diabetes in managed care. Med Care. 2007, 45 (9): 876-883. 10.1097/MLR.0b013e3180ca95fa.CrossRefPubMed Beckles GL, Williamson DF, Brown AF, Gregg EW, Karter AJ, Kim C, Dudley RA, Safford MM, Stevens MR, Thompson TJ: Agreement between self-reports and medical records was only fair in a cross-sectional study of performance of annual eye examinations among adults with diabetes in managed care. Med Care. 2007, 45 (9): 876-883. 10.1097/MLR.0b013e3180ca95fa.CrossRefPubMed
15.
go back to reference Harris P, Mann L, Phillips P, Bolger-Harris H, Webster C: Diabetes management in general practice 2011/12. 2011, Sydney: Diabetes Australia, 17 Harris P, Mann L, Phillips P, Bolger-Harris H, Webster C: Diabetes management in general practice 2011/12. 2011, Sydney: Diabetes Australia, 17
16.
go back to reference Powers AC: Diabetes mellitus [electronic resource]. Harrison’s principles of internal medicine. Volume 17th edition. Edited by: Kasper D L HTR. 2008, New York: McGraw-Hill Publishing, 2275-2304. Powers AC: Diabetes mellitus [electronic resource]. Harrison’s principles of internal medicine. Volume 17th edition. Edited by: Kasper D L HTR. 2008, New York: McGraw-Hill Publishing, 2275-2304.
17.
go back to reference Centre for Health Record Linkage: The first three years 2006–07 to 2008–09. 2009, Sydney: Centre for Health Record Linkage (CHeReL) Centre for Health Record Linkage: The first three years 2006–07 to 2008–09. 2009, Sydney: Centre for Health Record Linkage (CHeReL)
18.
go back to reference Cumming R: Assessing the quality of measurement: validity and reliability. Handbook of Public Heatlh Methods. Edited by: Kerr C, Taylor R, Heard G. 1998, Sydney: The McGraw-Hill Cpmpanies, inc Cumming R: Assessing the quality of measurement: validity and reliability. Handbook of Public Heatlh Methods. Edited by: Kerr C, Taylor R, Heard G. 1998, Sydney: The McGraw-Hill Cpmpanies, inc
19.
go back to reference Fleiss J: Statistical methods for rates and proportions. 1981, New York: John Wiley & Sons, 2 Fleiss J: Statistical methods for rates and proportions. 1981, New York: John Wiley & Sons, 2
20.
go back to reference Mealing N, Banks E, Jorm LR, Steel DG, Clements MS, Rogers KD: Investigation of relative risk estimates from studies of the same population with contrasting response rates and designs. BMC Med Res Methodol. 2010, 10: 26-10.1186/1471-2288-10-26.CrossRefPubMedPubMedCentral Mealing N, Banks E, Jorm LR, Steel DG, Clements MS, Rogers KD: Investigation of relative risk estimates from studies of the same population with contrasting response rates and designs. BMC Med Res Methodol. 2010, 10: 26-10.1186/1471-2288-10-26.CrossRefPubMedPubMedCentral
21.
go back to reference CATI Technical Reference Group: Population Health Monitoring and Surveillance: Question Development Background Paper. Diabetes in Australia. 2003, Canberra National Public Health Partnership. Department of Human Services CATI Technical Reference Group: Population Health Monitoring and Surveillance: Question Development Background Paper. Diabetes in Australia. 2003, Canberra National Public Health Partnership. Department of Human Services
Metadata
Title
Validating self-report of diabetes use by participants in the 45 and up study: a record linkage study
Authors
Elizabeth Jean Comino
Duong Thuy Tran
Marion Haas
Jeff Flack
Bin Jalaludin
Louisa Jorm
Mark Fort Harris
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-481

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue