Top

BMC Medical Research Methodology

Published in:

Open Access 01-12-2019 | Leg Pain | Research article

The agreement between chronic diseases reported by patients and derived from administrative data in patients undergoing joint arthroplasty

Authors: Bélène Podmore, Andrew Hutchings, Sujith Konan, Jan van der Meulen

Published in: BMC Medical Research Methodology | Issue 1/2019

Abstract

Background

This study examined the agreement between patient-reported chronic diseases and hospital administrative records in hip or knee arthroplasty patients in England.

Methods

Survey data reported by 676,428 patients for the English Patient Reported Outcome Measures (PROMs) programme was linked to hospital administrative data. Sensitivity and specificity of 11 patient-reported chronic diseases were estimated with hospital administrative data as reference standard.

Results

Specificity was high (> 90%) for all 11 chronic diseases. However, sensitivity varied by disease with the highest found for ‘diabetes’ (87.5%) and ‘high blood pressure’ (74.3%) and lowest for ‘kidney disease’ (18.8%) and ‘leg pain due to poor circulation’ (26.1%). Sensitivity was increased for diseases that were given as specific examples in the questionnaire (e.g. ‘parkinson’s disease’ (65.6%) and ‘multiple sclerosis’ (69.5%), compared to ‘diseases of the nervous system’ (20.9%)).

Conclusions

Patients can give information about the presence of chronic diseases that is consistent with chronic diseases derived from hospital administrative data if the description in the patient questionnaire is precise and if the disease is familiar to most patients and has significant impact on their life. Such patient questionnaires need to be validated before they are used for research and service evaluation projects.

Available only for authorised users

Ronksley PE, Tsai WH, Quan H, et al. Data enhancement for co-morbidity measurement among patients referred for sleep diagnostic testing: an observational study. BMC Med Res Methodol. 2009;9(1):50. https://doi.org/10.1186/1471-2288-9-50.CrossRefPubMedPubMedCentral

Henderson T, Shepheard J, Sundararajan V. Quality of diagnosis and procedure coding in ICD-10 administrative data. Med Care. 2006;44(11):1011–9. https://doi.org/10.1097/01.mlr.0000228018.48783.34.CrossRefPubMed

Andrew H, Jenny N, Kirstin GF, et al. Factors associated with non-response in routine use of patient reported outcome measures after elective surgery in England. Health Qual Life Outcomes. 2012;10:34. https://doi.org/10.1186/1477-7525-10-34.CrossRef

Organisation, World Health, The world health report 2002: reducing risks, promoting healthy life. 2002: Geneva.

Muggah E, Graves E, Bennett C, et al. Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-report. BMC Public Health. 2013;13:16. https://doi.org/10.1186/1471-2458-13-16.CrossRefPubMedPubMedCentral

Kim YY, Park JH, Kang HJ, et al. Level of agreement and factors associated with discrepancies between Nationwide medical history questionnaires and hospital claims data. J Prev Med Public Health. 2017;50(5):294–302. https://doi.org/10.3961/jpmph.17.024.CrossRefPubMedPubMedCentral

Singh JA. Accuracy of veterans affairs databases for diagnoses of chronic diseases. Prev Chronic Dis. 2009;6(4):A126.PubMedPubMedCentral

Susser SR, McCusker J, Belzile E. Comorbidity information in older patients at an emergency visit: self-report vs. administrative data had poor agreement but similar predictive validity. J Clin Epidemiol. 2008;61(5):511–5. https://doi.org/10.1016/j.jclinepi.2007.07.009.CrossRefPubMed

Norris CM, Ghali WA, Knudtson ML, et al. Dealing with missing data in observational health care outcomes analyses. J Clin Epidemiol. 2000;54. https://doi.org/10.1016/s0895-4356(99)00181-x.

10.

Faris PD, Ghali WA, Brant R, et al. Alberta provincial program for outcome assessment in coronary heart disease. Multiple imputation versus data enhancement for dealing with missing data in observational health outcome analyses. J Clin Epidemiol. 2002;55. https://doi.org/10.1016/s0895-4356(01)00433-4.

11.

Lix L, Yogendran M, Burchill C, et al. Defining and validating chronic diseases: an administrative data approach. Winnipeg: Manitoba Centre for Health Policy; 2006.

12.

Digital, NHS. Patient reported outcome measures (PROMs). 2017; Available from: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/patient-reported-outcome-measures-proms.

13.

Digital, NHS. Hospital Episode Statistics 2018; Available from: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/hospital-episode-statistics.

14.

Armitage JN, van der Meulen JH. Identifying co-morbidity in surgical patients using administrative data with the Royal College of surgeons Charlson score. Br J Surg. 2010;97(5):772–81. https://doi.org/10.1002/bjs.6930.CrossRefPubMed

15.

Quan H, Sundaratajan V, Halfon P, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43. https://doi.org/10.1097/01.mlr.0000182534.19832.83.

16.

Elixhauser AE, Steiner C, Harris R, et al. Comorbidity measures for use with administrative data. Med Care. 1998;36. https://doi.org/10.1097/00005650-199801000-00004.

17.

Sharabiani MTA, Aylin P, Bottle A. Systematic review of comorbidity indices for administrative data. Med Care. 2012;50(12):1109–18. https://doi.org/10.1097/MLR.0b013e31825f64d0.CrossRef

18.

Yurkovich M, Avina-Zubieta JA, Thomas J, et al. A systematic review identifies valid comorbidity indices derived from administrative health data. J Clin Epidemiol. 2015;68(1):3–14. https://doi.org/10.1016/j.jclinepi.2014.09.010.CrossRefPubMed

19.

Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33. https://doi.org/10.2307/2529310.

20.

Zhang JX, Iwashyna TJ, Christakis NA. The performance of different lookback periods and sources of information for Charlson comorbidity adjustment in Medicare claims. Med Care. 1999;37:1128–39. https://doi.org/10.1097/00005650-199911000-00005.CrossRefPubMed

21.

Preen DB, Holman CD, Spilsbury K, et al. Length of comorbidity lookback period affected regression model performance of administrative health data. J Clin Epidemiol. 2006;59(9):940–6. https://doi.org/10.1016/j.jclinepi.2005.12.013.CrossRefPubMed

22.

Li P, Kim MM, Doshi JA. Comparison of the performance of the CMS hierarchical condition category (CMS-HCC) risk adjuster with the Charlson and Elixhauser comorbidity measures in predicting mortality. BMC Health Serv Res. 2010;10:245. https://doi.org/10.1186/1472-6963-10-245.CrossRefPubMedPubMedCentral

23.

Jackson CA, Mishra GD, Tooth L, et al. Moderate agreement between self-reported stroke and hospital-recorded stroke in two cohorts of Australian women: a validation study. BMC Med Res Methodol. 2015;15:7. https://doi.org/10.1186/1471-2288-15-7.CrossRefPubMedPubMedCentral

24.

Carter K, Barber PA, Shaw C. How does self-reported history of stroke compare to hospitalization data in a population-based survey in New Zealand? Stroke. 2010;41(11):2678–80. https://doi.org/10.1161/strokeaha.110.598268.CrossRefPubMed

25.

Navin Cristina TJ, Stewart Williams JA, Parkinson L, et al. Identification of diabetes, heart disease, hypertension and stroke in mid- and older-aged women: comparing self-report and administrative hospital data records. Geriatr Gerontol Int. 2016;16(1):95–102. https://doi.org/10.1111/ggi.12442.CrossRefPubMed

26.

Bayliss EA, Ellis JL, Steiner JF. Subjective assessments of comorbidity correlate with quality of life health outcomes: initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes. 2005;3(1):51. https://doi.org/10.1186/1477-7525-3-51.CrossRefPubMedPubMedCentral

27.

Lix LM, Yogendran MS, Shaw SY, et al. Population-based data sources for chronic disease surveillance. Chronic Dis Can. 2008;29(1):31–8.PubMed

28.

Dreinhofer KE, Dieppe P, Sturmer T, et al. Indications for total hip replacement: comparison of assessments of orthopaedic surgeons and referring physicians. Ann Rheum Dis. 2006;65(10):1346–50. https://doi.org/10.1136/ard.2005.047811.CrossRefPubMedPubMedCentral

29.

Vach W. The dependence of Cohen's kappa on the prevalence does not matter. J Clin Epidemiol. 2005;58(7):655–61. https://doi.org/10.1016/j.jclinepi.2004.02.021.CrossRefPubMed

30.

Benchimol EI, Manuel DG, To, T, et al. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64(8):821–9. https://doi.org/10.1016/j.jclinepi.2010.10.006.CrossRefPubMed

31.

Chen G, Faris P, Hemmelgarn B, et al. Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009;9:5. https://doi.org/10.1186/1471-2288-9-5.CrossRefPubMedPubMedCentral

32.

Brenner, Hermann And Gefeller, Olaf, Variation of sensitivity, specificity, likelihood ratios and predictive values with diseases prevalence. Stat Med, 1998. 16(9): p. 981–991 DOI: https://doi.org/10.1002/(SICI)1097-0258(19970515)16:9<981::AID-SIM510>3.0.CO;2-N.CrossRef

Title: The agreement between chronic diseases reported by patients and derived from administrative data in patients undergoing joint arthroplasty
Authors: Bélène Podmore
Andrew Hutchings
Sujith Konan
Jan van der Meulen
Publication date: 01-12-2019
Publisher: BioMed Central
Keywords: Leg Pain
Leg Pain
Published in: BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI: https://doi.org/10.1186/s12874-019-0729-5

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

The agreement between chronic diseases reported by patients and derived from administrative data in patients undergoing joint arthroplasty

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2019

Unweighted regression models perform better than weighted regression techniques for respondent-driven sampling data: results from a simulation study

Additive-multiplicative hazards regression models for interval-censored semi-competing risks data with missing intermediate events

Explainable statistical learning in public health for policy development: the case of real-world suicide data

Reducing defects in the datasets of clinical research studies: conformance with data quality metrics

Multi-cohort modeling strategies for scalable globally accessible prostate cancer risk tools

Outcomes of two randomized controlled trials, employing participants recruited through Mechanical Turk, of Internet interventions targeting unhealthy alcohol use