Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

Evaluation of data quality of interRAI assessments in home and community care

Authors: Sophie E. Hogeveen, Jonathan Chen, John P. Hirdes

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

The aim of this project is to describe the quality of assessment data regularly collected in home and community, with techniques adapted from an evaluation of the quality of long-term care data in Canada.

Methods

Data collected using the Resident Assessment Instrument – Home Care (RAI-HC) in Ontario and British Columbia (BC) as well as the interRAI Community Health Assessment (CHA) in Ontario were analyzed using descriptive statistics, Pearson’s r correlation, and Cronbach’s alpha in order to assess trends in population characteristics, convergent validity, and scale reliability.

Results

Results indicate that RAI-HC data from Ontario and BC behave in a consistent manner, with stable trends in internal consistency providing evidence of good reliability (alpha values range from 0.72-0.94, depending on the scale and province). The associations between various scales, such as those reflecting functional status and cognition, were found to be as expected and stable over time within each setting (r values range from 0.42-0.45 in Ontario and 0.41-0.43 in BC). These trends in convergent validity demonstrate that constructs in the data behave as they should, providing evidence of good data quality. In most cases, CHA data quality matches that of RAI-HC data quality and shows evidence of good validity and reliability. The findings are comparable to the findings observed in the evaluation of data from the long-term care sector.

Conclusions

Despite an increasingly complex client population in the home and community care sectors, the results from this work indicate that data collected using the RAI-HC and the CHA are of an overall quality that may be trusted when used to inform decision-making at the organizational- or policy-level. High quality data and information are vital when used to inform steps taken to improve quality of care and enhance quality of life. This work also provides evidence that a method used to evaluate the quality of data obtained in the long-term care setting may be used to evaluate the quality of data obtained through community-based measures.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al. An evaluation of data quality in Canada’s continuing care reporting system (CCRS): secondary analyses of Ontario data submitted between 1996 and 2011. BMC Med Inform Decis Mak. 2013;13:27. doi:10.1186/1472-6947-13-27.CrossRefPubMedPubMedCentral Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al. An evaluation of data quality in Canada’s continuing care reporting system (CCRS): secondary analyses of Ontario data submitted between 1996 and 2011. BMC Med Inform Decis Mak. 2013;13:27. doi:10.​1186/​1472-6947-13-27.CrossRefPubMedPubMedCentral
4.
go back to reference Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. 2008;25:213–4.CrossRefPubMed Majeed A, Car J, Sheikh A. Accuracy and completeness of electronic patient records in primary care. Fam Pract. 2008;25:213–4.CrossRefPubMed
7.
go back to reference Hirdes JP, Fries BE, Morris JN, Ikegami N, Zimmerman D, Dalby DM, et al. Home care quality indicators (HCQIs) based on the MDS-HC. Gerontologist. 2004;44:665–79.CrossRefPubMed Hirdes JP, Fries BE, Morris JN, Ikegami N, Zimmerman D, Dalby DM, et al. Home care quality indicators (HCQIs) based on the MDS-HC. Gerontologist. 2004;44:665–79.CrossRefPubMed
9.
go back to reference Phillips C, Morris J. The potential for using administrative and clinical data to analyze outcomes for cognitively impaired: an assessment of the minimum data set for nursing homes. Alzheimer Dis Assoc Disord. 1997;11(Supplement 6):162–7.PubMed Phillips C, Morris J. The potential for using administrative and clinical data to analyze outcomes for cognitively impaired: an assessment of the minimum data set for nursing homes. Alzheimer Dis Assoc Disord. 1997;11(Supplement 6):162–7.PubMed
11.
go back to reference Morris JN, Fries BE, Steel K, Ikegami N, Bernabei R, Carpenter GI, et al. Comprehensive clinical assessment in community setting: applicability of the MDS-HC. J Am Geriatr Soc. 1997;45:1017–24.CrossRefPubMed Morris JN, Fries BE, Steel K, Ikegami N, Bernabei R, Carpenter GI, et al. Comprehensive clinical assessment in community setting: applicability of the MDS-HC. J Am Geriatr Soc. 1997;45:1017–24.CrossRefPubMed
12.
go back to reference Carpenter I, Hirdes JP. Using interRAI assessment systems to measure and maintain quality of long-term care. In: A good life in old age? Monitoring and improving quality in long-term care. Paris: OECD Publishing; 2013. p. 93–140. Carpenter I, Hirdes JP. Using interRAI assessment systems to measure and maintain quality of long-term care. In: A good life in old age? Monitoring and improving quality in long-term care. Paris: OECD Publishing; 2013. p. 93–140.
13.
go back to reference Canadian Home Care Association. Portraits of home Care in Canada. 2013. Canadian Home Care Association. Portraits of home Care in Canada. 2013.
14.
go back to reference Hirdes JP, Ljunggren G, Morris JN, Frijters DHM, Finne Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.CrossRefPubMedPubMedCentral Hirdes JP, Ljunggren G, Morris JN, Frijters DHM, Finne Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.CrossRefPubMedPubMedCentral
15.
go back to reference Hirdes JP, Poss JW, Mitchell L, Korngut L, Heckman G. Use of the interRAI CHESS scale to predict mortality among persons with neurological conditions in three care settings. PLoS One. 2014;9:e99066. Hirdes JP, Poss JW, Mitchell L, Korngut L, Heckman G. Use of the interRAI CHESS scale to predict mortality among persons with neurological conditions in three care settings. PLoS One. 2014;9:e99066.
16.
go back to reference Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C, et al. Minimum Data Set for Home Care: A valid instrument to assess frail older people living in the community. Med Care. 2016;38:1184–90. Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C, et al. Minimum Data Set for Home Care: A valid instrument to assess frail older people living in the community. Med Care. 2016;38:1184–90.
17.
go back to reference Gray LC, Berg K, Fries BE, Henrard J-C, Hirdes JP, Steel K, et al. Sharing clinical information across care settings: the birth of an integrated assessment system. BMC Health Serv Res. 2009;9:71.CrossRefPubMedPubMedCentral Gray LC, Berg K, Fries BE, Henrard J-C, Hirdes JP, Steel K, et al. Sharing clinical information across care settings: the birth of an integrated assessment system. BMC Health Serv Res. 2009;9:71.CrossRefPubMedPubMedCentral
19.
go back to reference Morris JN, Fries BE, Mehr DR, Hawes C, Phillips C, Mor V, et al. MDS cognitive performance scale. J Gerontol Med Sci. 1994;49:M174–82.CrossRef Morris JN, Fries BE, Mehr DR, Hawes C, Phillips C, Mor V, et al. MDS cognitive performance scale. J Gerontol Med Sci. 1994;49:M174–82.CrossRef
22.
23.
go back to reference Hirdes JP, Poss JW, Curtin-Telegdi N. The method for assigning priority levels (MAPLe): a new decision-support system for allocating home care resources. BMC Med. 2008;6:9.CrossRefPubMedPubMedCentral Hirdes JP, Poss JW, Curtin-Telegdi N. The method for assigning priority levels (MAPLe): a new decision-support system for allocating home care resources. BMC Med. 2008;6:9.CrossRefPubMedPubMedCentral
24.
25.
go back to reference Morris JN, Carpenter I, Berg K, Jones RN. Outcome measures for use with home care clients. Can J Aging / La Rev Can du Vieil. 2000;19(Supplement S2):87–105.CrossRef Morris JN, Carpenter I, Berg K, Jones RN. Outcome measures for use with home care clients. Can J Aging / La Rev Can du Vieil. 2000;19(Supplement S2):87–105.CrossRef
27.
go back to reference Armstrong JJ, Stolee P, Hirdes JP, Poss JW. Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. 2010;39:755–8.CrossRefPubMed Armstrong JJ, Stolee P, Hirdes JP, Poss JW. Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. 2010;39:755–8.CrossRefPubMed
29.
go back to reference Poss JW, Hirdes JP, Fries BE, McKillop I, Chase M. Validation of resource utilization groups version III for home care (RUG-III/HC): evidence from a Canadian home care jurisdiction. Med Care. 2008;46:380–7. doi:10.1097/MLR.0b013e31815c3b6c\r00005650-200804000-00007.CrossRefPubMed Poss JW, Hirdes JP, Fries BE, McKillop I, Chase M. Validation of resource utilization groups version III for home care (RUG-III/HC): evidence from a Canadian home care jurisdiction. Med Care. 2008;46:380–7. doi:10.1097/MLR.0b013e31815c3b6c\r00005650-200804000-00007.CrossRefPubMed
30.
go back to reference Bjorkgren MA, Fries BE, Shugarman LR. A RUG-III case-mix system for home care. Can J Aging / La Rev Can du Vieil. 2000;19(Supplement S2):106–25.CrossRef Bjorkgren MA, Fries BE, Shugarman LR. A RUG-III case-mix system for home care. Can J Aging / La Rev Can du Vieil. 2000;19(Supplement S2):106–25.CrossRef
Metadata
Title
Evaluation of data quality of interRAI assessments in home and community care
Authors
Sophie E. Hogeveen
Jonathan Chen
John P. Hirdes
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0547-9

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue