Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Validity of the RAI-MDS for ascertaining diabetes and comorbid conditions in long-term care facility residents

Authors: Lisa M Lix, Lin Yan, David Blackburn, Nianping Hu, Verena Schneider-Lindner, Gary F Teare

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

This study assessed the validity of the Resident Assessment Instrument Minimum Data Set (RAI-MDS) Version 2.0 for diagnoses of diabetes and comorbid conditions in residents of long-term care facilities (LTCFs).

Methods

Hospital inpatient, outpatient physician billing, RAI-MDS, and population registry data for 1997 to 2011 from Saskatchewan, Canada were used to ascertain cases of diabetes and 12 comorbid conditions. Prevalence estimates were calculated for both RAI-MDS and administrative health data. Sensitivity, specificity, and positive and negative predictive values (PPV and NPV) were calculated using population-based administrative health data as the validation data source. Cohen’s κ was used to estimate agreement between the two data sources.

Results

23,217 LTCF residents were in the diabetes case ascertainment cohort. Diabetes prevalence was 25.3% in administrative health data and 21.9% in RAI-MDS data. Overall sensitivity of a RAI-MDS diabetes diagnoses was 0.79 (95% CI: 0.79, 0.80) and the PPV was 0.92 (95% CI: 0.91, 0.92), when compared to administrative health data. Sensitivity of the RAI-MDS for ascertaining comorbid conditions ranged from 0.21 for osteoporosis to 0.92 for multiple sclerosis; specificity was high for most conditions.

Conclusions

RAI-MDS clinical assessment data are sensitive to ascertain diabetes cases in LTCF populations when compared to administrative health data. For many comorbid conditions, RAI-MDS data have low validity when compared to administrative data. Risk-adjustment measures based on these comorbidities might not produce consistent results for RAI-MDS and administrative health data, which could affect the conclusions of studies about health outcomes and quality of care across facilities.
Appendix
Available only for authorised users
Literature
1.
go back to reference Clement M, Leung F: Diabetes and the frail elderly in long-term care. Can J Diab. 2009, 33: 114-121. 10.1016/S1499-2671(09)32008-0.CrossRef Clement M, Leung F: Diabetes and the frail elderly in long-term care. Can J Diab. 2009, 33: 114-121. 10.1016/S1499-2671(09)32008-0.CrossRef
2.
go back to reference Travis SS, Buchanan RJ, Wang S, Kim M: Analyses of nursing home residents with diabetes at admission. J Am Med Dir Assoc. 2004, 5: 320-327. 10.1016/S1525-8610(04)70021-3.CrossRefPubMed Travis SS, Buchanan RJ, Wang S, Kim M: Analyses of nursing home residents with diabetes at admission. J Am Med Dir Assoc. 2004, 5: 320-327. 10.1016/S1525-8610(04)70021-3.CrossRefPubMed
3.
go back to reference Dybicz SB, Thompson S, Molotsky S, Stuart B: Prevalence of diabetes and the burden of comorbid conditions among elderly nursing home residents. Am J Geriatr Pharmacother. 2011, 9: 212-223. 10.1016/j.amjopharm.2011.05.001.CrossRefPubMed Dybicz SB, Thompson S, Molotsky S, Stuart B: Prevalence of diabetes and the burden of comorbid conditions among elderly nursing home residents. Am J Geriatr Pharmacother. 2011, 9: 212-223. 10.1016/j.amjopharm.2011.05.001.CrossRefPubMed
4.
go back to reference Metge C, Grymonpre R, Dahl M, Yogendran M: Pharmaceutical use among older adults: using administrative data to examine medication-related issues. Can J Aging. 2012, 24: 81-95.CrossRef Metge C, Grymonpre R, Dahl M, Yogendran M: Pharmaceutical use among older adults: using administrative data to examine medication-related issues. Can J Aging. 2012, 24: 81-95.CrossRef
5.
go back to reference Crystal S, Gaboda D, Lucas J, Gerhard T, Chakravarty S: Assessing medication exposures and outcomes in the frail elderly: assessing research challenges in nursing home pharmacotherapy. Med Care. 2010, 48: S23-S31.CrossRefPubMed Crystal S, Gaboda D, Lucas J, Gerhard T, Chakravarty S: Assessing medication exposures and outcomes in the frail elderly: assessing research challenges in nursing home pharmacotherapy. Med Care. 2010, 48: S23-S31.CrossRefPubMed
6.
go back to reference Mor V, Intrator O, Unruh MA, Cai S: Temporal and geographic variation in the validity and internal consistency of the nursing home resident assessment minimum data Set 2.0. BMC Health Serv Res. 2011, 11: 78-10.1186/1472-6963-11-78.CrossRefPubMedPubMedCentral Mor V, Intrator O, Unruh MA, Cai S: Temporal and geographic variation in the validity and internal consistency of the nursing home resident assessment minimum data Set 2.0. BMC Health Serv Res. 2011, 11: 78-10.1186/1472-6963-11-78.CrossRefPubMedPubMedCentral
7.
go back to reference Wodchis WP, Naglie G, Teare GF: Validating diagnostic information on the minimum data set in Ontario hospital-based long-term care. Med Care. 2008, 46: 882-887. 10.1097/MLR.0b013e3181789471.CrossRefPubMed Wodchis WP, Naglie G, Teare GF: Validating diagnostic information on the minimum data set in Ontario hospital-based long-term care. Med Care. 2008, 46: 882-887. 10.1097/MLR.0b013e3181789471.CrossRefPubMed
8.
go back to reference Downey W, Beck C, McNutt M, Stang M, Osei W, Nichol J: Health databases in Saskatchewan. Pharmacoepidemiology. Edited by: Strom BL. 2000, New York: Wiley, 325-345. 3CrossRef Downey W, Beck C, McNutt M, Stang M, Osei W, Nichol J: Health databases in Saskatchewan. Pharmacoepidemiology. Edited by: Strom BL. 2000, New York: Wiley, 325-345. 3CrossRef
9.
go back to reference Rawson NS, Malcolm E: Validity of the recording of ischaemic heart disease and chronic obstructive pulmonary disease in the Saskatchewan health care datafiles. Stat Med. 1995, 14: 2627-2643. 10.1002/sim.4780142404.CrossRefPubMed Rawson NS, Malcolm E: Validity of the recording of ischaemic heart disease and chronic obstructive pulmonary disease in the Saskatchewan health care datafiles. Stat Med. 1995, 14: 2627-2643. 10.1002/sim.4780142404.CrossRefPubMed
10.
go back to reference Rawson NS, D’Arcy C: Assessing the validity of diagnostic information in administrative health care utilization data: experience in Saskatchewan. Pharmacoepidemiol Drug Saf. 1998, 7: 389-398. 10.1002/(SICI)1099-1557(199811/12)7:6<389::AID-PDS380>3.0.CO;2-S.CrossRefPubMed Rawson NS, D’Arcy C: Assessing the validity of diagnostic information in administrative health care utilization data: experience in Saskatchewan. Pharmacoepidemiol Drug Saf. 1998, 7: 389-398. 10.1002/(SICI)1099-1557(199811/12)7:6<389::AID-PDS380>3.0.CO;2-S.CrossRefPubMed
11.
go back to reference Rawson NS, Malcolm E, D’Arcy C: Reliability of the recording of schizophrenia and depressive disorder in the Saskatchewan health care datafiles. Soc Psychiatry Psychiatr Epidemiol. 1997, 32: 191-199. 10.1007/BF00788238.CrossRefPubMed Rawson NS, Malcolm E, D’Arcy C: Reliability of the recording of schizophrenia and depressive disorder in the Saskatchewan health care datafiles. Soc Psychiatry Psychiatr Epidemiol. 1997, 32: 191-199. 10.1007/BF00788238.CrossRefPubMed
12.
go back to reference Edouard L, Rawson NS: Reliability of the recording of hysterectomy in the Saskatchewan health care system. Br J Obstet Gynaecol. 1996, 103: 891-897. 10.1111/j.1471-0528.1996.tb09908.x.CrossRefPubMed Edouard L, Rawson NS: Reliability of the recording of hysterectomy in the Saskatchewan health care system. Br J Obstet Gynaecol. 1996, 103: 891-897. 10.1111/j.1471-0528.1996.tb09908.x.CrossRefPubMed
13.
go back to reference Canadian Diabetes Association and Diabete Quebec: Diabetes: Canada at the tipping point - charting a new path. 2010, Toronto, ON: Canadian Diabetes Association Canadian Diabetes Association and Diabete Quebec: Diabetes: Canada at the tipping point - charting a new path. 2010, Toronto, ON: Canadian Diabetes Association
14.
go back to reference Young TK, Roos NP, Hammerstrand KM: Estimated burden of diabetes-mellitus in Manitoba according to health-insurance claims: a pilot study. Can Med Assoc J. 1991, 144: 318-324. Young TK, Roos NP, Hammerstrand KM: Estimated burden of diabetes-mellitus in Manitoba according to health-insurance claims: a pilot study. Can Med Assoc J. 1991, 144: 318-324.
15.
go back to reference St Germaine-Smith C, Metcalfe A, Pringsheim T, Roberts JI, Beck CA, Hemmelgarn BR, et al: Recommendations for optimal ICD codes to study neurologic conditions: a systematic review. Neurology. 2012, 79: 1049-1055. 10.1212/WNL.0b013e3182684707.CrossRefPubMedPubMedCentral St Germaine-Smith C, Metcalfe A, Pringsheim T, Roberts JI, Beck CA, Hemmelgarn BR, et al: Recommendations for optimal ICD codes to study neurologic conditions: a systematic review. Neurology. 2012, 79: 1049-1055. 10.1212/WNL.0b013e3182684707.CrossRefPubMedPubMedCentral
16.
go back to reference Kim SY, Servi A, Polinski JM, Mogun H, Weinblatt ME, Katz JN, et al: Validation of rheumatoid arthritis diagnoses in health care utilization data. Arthritis Res Ther. 2011, 13: R32-10.1186/ar3260.CrossRefPubMedPubMedCentral Kim SY, Servi A, Polinski JM, Mogun H, Weinblatt ME, Katz JN, et al: Validation of rheumatoid arthritis diagnoses in health care utilization data. Arthritis Res Ther. 2011, 13: R32-10.1186/ar3260.CrossRefPubMedPubMedCentral
17.
go back to reference Rector TS, Wickstrom SL, Shah M, Thomas Greeenlee N, Rheault P, Rogowski J, et al: Specificity and sensitivity of claims-based algorithms for identifying members of Medicare plus choice health plans that have chronic medical conditions. Health Serv Res. 2004, 39: 1839-1858. 10.1111/j.1475-6773.2004.00321.x.CrossRefPubMedPubMedCentral Rector TS, Wickstrom SL, Shah M, Thomas Greeenlee N, Rheault P, Rogowski J, et al: Specificity and sensitivity of claims-based algorithms for identifying members of Medicare plus choice health plans that have chronic medical conditions. Health Serv Res. 2004, 39: 1839-1858. 10.1111/j.1475-6773.2004.00321.x.CrossRefPubMedPubMedCentral
18.
go back to reference Wilchesky M, Tamblyn RM, Huang A: Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004, 57: 131-141. 10.1016/S0895-4356(03)00246-4.CrossRefPubMed Wilchesky M, Tamblyn RM, Huang A: Validation of diagnostic codes within medical services claims. J Clin Epidemiol. 2004, 57: 131-141. 10.1016/S0895-4356(03)00246-4.CrossRefPubMed
19.
go back to reference Lacasse Y, Montori VM, Lanthier C, Maltis F: The validity of diagnosing chronic obstructive pulmonary disease from a large administrative database. Can Respir J. 2005, 12: 251-256.CrossRefPubMed Lacasse Y, Montori VM, Lanthier C, Maltis F: The validity of diagnosing chronic obstructive pulmonary disease from a large administrative database. Can Respir J. 2005, 12: 251-256.CrossRefPubMed
20.
go back to reference Lix LM, Azimaee M, Acan B, Caetano P, Morin S, Metge C, et al: Osteoporosis-related fracture case definitions for administrative data. BMC Public Health Res. 2012, 12: 301-10.1186/1471-2458-12-301.CrossRef Lix LM, Azimaee M, Acan B, Caetano P, Morin S, Metge C, et al: Osteoporosis-related fracture case definitions for administrative data. BMC Public Health Res. 2012, 12: 301-10.1186/1471-2458-12-301.CrossRef
21.
go back to reference Quan H, Khan N, Hemmelgarn BR, Tu K, Chen G, Campbell N, et al: Validation of a case definition to define hypertension using administrative data. Hypertension. 2009, 54: 1423-1428. 10.1161/HYPERTENSIONAHA.109.139279.CrossRefPubMed Quan H, Khan N, Hemmelgarn BR, Tu K, Chen G, Campbell N, et al: Validation of a case definition to define hypertension using administrative data. Hypertension. 2009, 54: 1423-1428. 10.1161/HYPERTENSIONAHA.109.139279.CrossRefPubMed
22.
go back to reference Tu K, Campbell NRC, Chen Z-L, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Medicine. 2007, 1: E3-E5. Tu K, Campbell NRC, Chen Z-L, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Medicine. 2007, 1: E3-E5.
23.
go back to reference Lix LM, Yogendran M, Leslie WD, Shaw SY, Baumgartner R, Bowman C, et al: Using multiple data features improved the validity of osteoporosis case ascertainment from administrative data. J Clin Epidemiol. 2008, 61: 1250-1260. 10.1016/j.jclinepi.2008.02.002.CrossRefPubMed Lix LM, Yogendran M, Leslie WD, Shaw SY, Baumgartner R, Bowman C, et al: Using multiple data features improved the validity of osteoporosis case ascertainment from administrative data. J Clin Epidemiol. 2008, 61: 1250-1260. 10.1016/j.jclinepi.2008.02.002.CrossRefPubMed
24.
go back to reference Leslie WD, Lix LM, Yogendran MS: Validation of a case definition for osteoporosis disease surveillance. Osteoporos Int. 2010, 22: 37-46.CrossRefPubMed Leslie WD, Lix LM, Yogendran MS: Validation of a case definition for osteoporosis disease surveillance. Osteoporos Int. 2010, 22: 37-46.CrossRefPubMed
25.
go back to reference Andrade SE, Harrold LR, Tjia J, Cutrona SL, Saczynski JS, Dodd KS, et al: A systematic review of validated methods for identifying cerebrovascular accident or transient ischemic attack using administrative data. Pharmacoepidemiol Drug Saf. 2012, 21 (Suppl 1): 100-128.CrossRefPubMedPubMedCentral Andrade SE, Harrold LR, Tjia J, Cutrona SL, Saczynski JS, Dodd KS, et al: A systematic review of validated methods for identifying cerebrovascular accident or transient ischemic attack using administrative data. Pharmacoepidemiol Drug Saf. 2012, 21 (Suppl 1): 100-128.CrossRefPubMedPubMedCentral
26.
go back to reference Roos NP, Mustard CA: Variation in health and health care use by socio-economic status in Winnipeg, Canada: the system works well? Yes and no. Milbank Q. 1997, 75: 89-111. 10.1111/1468-0009.00045.CrossRefPubMedPubMedCentral Roos NP, Mustard CA: Variation in health and health care use by socio-economic status in Winnipeg, Canada: the system works well? Yes and no. Milbank Q. 1997, 75: 89-111. 10.1111/1468-0009.00045.CrossRefPubMedPubMedCentral
27.
go back to reference Altman DG: Practical statistics for medical research. 2001, London: Chapman & Hall Altman DG: Practical statistics for medical research. 2001, London: Chapman & Hall
28.
go back to reference SAS Institute Inc: SAS/STAT 9.3 User’s Guide. 2010, Cary, NC: SAS Institute Inc, 2 SAS Institute Inc: SAS/STAT 9.3 User’s Guide. 2010, Cary, NC: SAS Institute Inc, 2
29.
go back to reference Feldman SM, Rosen R, DeStasio J: Status of diabetes management in the nursing home setting in 2008: a retrospective chart review and epidemiology study of diabetic nursing home residents and nursing home initiatives in diabetes management. J Am Med Dir Assoc. 2009, 10: 354-360. 10.1016/j.jamda.2009.02.010.CrossRefPubMed Feldman SM, Rosen R, DeStasio J: Status of diabetes management in the nursing home setting in 2008: a retrospective chart review and epidemiology study of diabetic nursing home residents and nursing home initiatives in diabetes management. J Am Med Dir Assoc. 2009, 10: 354-360. 10.1016/j.jamda.2009.02.010.CrossRefPubMed
30.
go back to reference Berlowitz DR, Brandeis GH, Morris JN, Ash AS, Anderson JJ, Kader B, et al: Deriving a risk-adjustment model for pressure ulcer development using the minimum data set. J Am Geriatr Soc. 2001, 49: 866-871. 10.1046/j.1532-5415.2001.49175.x.CrossRefPubMed Berlowitz DR, Brandeis GH, Morris JN, Ash AS, Anderson JJ, Kader B, et al: Deriving a risk-adjustment model for pressure ulcer development using the minimum data set. J Am Geriatr Soc. 2001, 49: 866-871. 10.1046/j.1532-5415.2001.49175.x.CrossRefPubMed
31.
go back to reference Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al: An evaluation of data quality in Canada’s Continuing Care Reporting System (CCRS): Secondary analyses of Ontario data submitted between 1996 and 2011. BMC Med Inform Decis Mak. 2013, 13: 27-10.1186/1472-6947-13-27.CrossRefPubMedPubMedCentral Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al: An evaluation of data quality in Canada’s Continuing Care Reporting System (CCRS): Secondary analyses of Ontario data submitted between 1996 and 2011. BMC Med Inform Decis Mak. 2013, 13: 27-10.1186/1472-6947-13-27.CrossRefPubMedPubMedCentral
32.
go back to reference Canadian Institute for Health Information: Data quality documentation, continuing care reporting system, 2011–2012. 2012, Ottawa, ON: Canadian Institute for Health Information Canadian Institute for Health Information: Data quality documentation, continuing care reporting system, 2011–2012. 2012, Ottawa, ON: Canadian Institute for Health Information
33.
go back to reference Lash TL, Mor V, Wieland D, Ferrucci L, Satariano W, Silliman RA: Methodology, design, and analytic techniques to address measurement of comorbid disease. J Gerontol A Biol Sci Med Sci. 2007, 62: 281-285. 10.1093/gerona/62.3.281.CrossRefPubMedPubMedCentral Lash TL, Mor V, Wieland D, Ferrucci L, Satariano W, Silliman RA: Methodology, design, and analytic techniques to address measurement of comorbid disease. J Gerontol A Biol Sci Med Sci. 2007, 62: 281-285. 10.1093/gerona/62.3.281.CrossRefPubMedPubMedCentral
Metadata
Title
Validity of the RAI-MDS for ascertaining diabetes and comorbid conditions in long-term care facility residents
Authors
Lisa M Lix
Lin Yan
David Blackburn
Nianping Hu
Verena Schneider-Lindner
Gary F Teare
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-17

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue