Skip to main content
Top
Published in: BMC Health Services Research 1/2008

Open Access 01-12-2008 | Research article

Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system

Authors: John P Hirdes, Gunnar Ljunggren, John N Morris, Dinnus HM Frijters, Harriet Finne Soveri, Len Gray, Magnus Björkgren, Reudi Gilgen

Published in: BMC Health Services Research | Issue 1/2008

Login to get access

Abstract

Background

A multi-domain suite of instruments has been developed by the interRAI research collaborative to support assessment and care planning in mental health, aged care and disability services. Each assessment instrument comprises items common to other instruments and specialized items exclusive to that instrument. This study examined the reliability of the items from five instruments supporting home care, long term care, mental health, palliative care and post-acute care.

Methods

Paired assessments on 783 individuals across 12 nations were completed within 72 hours of each other by trained assessors who were blinded to the others' assessment. Reliability was tested using weighted kappa coefficients.

Results

The overall kappa mean value for 161 items which are common to 2 or more instruments was 0.75. The kappa mean value for specialized items varied among instruments from 0.63 to 0.73. Over 60% of items scored greater than 0.70.

Conclusion

The vast majority of items exceeded standard cut-offs for acceptable reliability, with only modest variation among instruments. The overall performance of these instruments showed that the interRAI suite has substantial reliability according to conventional cut-offs for interpreting the kappa statistic. The results indicate that interRAI items retain reliability when used across care settings, paving the way for cross domain application of the instruments as part of an integrated health information system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jonsson PV, Finne-Soveri H, Jensdottir AB, Ljunggren G, Bucht G, Grue EV, Noro A, Bjornson J, Jonsen E, Schroll M: Co-morbidity and functional limitation in older patients underreported in medical records in Nordic Acute Care Hospitals when compared with the MDS-AC instrument [1]. Age and Ageing. 2006, 35 (4): 434-10.1093/ageing/afj060.CrossRefPubMed Jonsson PV, Finne-Soveri H, Jensdottir AB, Ljunggren G, Bucht G, Grue EV, Noro A, Bjornson J, Jonsen E, Schroll M: Co-morbidity and functional limitation in older patients underreported in medical records in Nordic Acute Care Hospitals when compared with the MDS-AC instrument [1]. Age and Ageing. 2006, 35 (4): 434-10.1093/ageing/afj060.CrossRefPubMed
2.
go back to reference Hirdes JP, Fries BE, Morris JN, Steel K, Mor V, Frijters D, LaBine S, Schalm C, Stones MJ, Teare G, Smith T, Marhaba M, Perez E, Jonsson P: Integrated health information systems based on the RAI/MDS series of instruments. Healthcare management forum. 1999, 12 (4): 30.CrossRefPubMed Hirdes JP, Fries BE, Morris JN, Steel K, Mor V, Frijters D, LaBine S, Schalm C, Stones MJ, Teare G, Smith T, Marhaba M, Perez E, Jonsson P: Integrated health information systems based on the RAI/MDS series of instruments. Healthcare management forum. 1999, 12 (4): 30.CrossRefPubMed
3.
go back to reference Carpenter GI: Accuracy, validity and reliability in assessment and in evaluation of services for older people: The role of the interRAI MDS assessment system. Age and Ageing. 2006, 35 (4): 327-10.1093/ageing/afl038.CrossRefPubMed Carpenter GI: Accuracy, validity and reliability in assessment and in evaluation of services for older people: The role of the interRAI MDS assessment system. Age and Ageing. 2006, 35 (4): 327-10.1093/ageing/afl038.CrossRefPubMed
4.
go back to reference Morris JN, Hawes C, Fries BE, Phillips CD, Mor V, Katz S, Murphy K, Drugovich ML, Friedlob AS: Designing the national resident assessment instrument for nursing homes. Gerontologist. 1990, 30 (3): 293-307.CrossRefPubMed Morris JN, Hawes C, Fries BE, Phillips CD, Mor V, Katz S, Murphy K, Drugovich ML, Friedlob AS: Designing the national resident assessment instrument for nursing homes. Gerontologist. 1990, 30 (3): 293-307.CrossRefPubMed
5.
go back to reference Fries BE, Schroll M, Hawes C, Gilgen R, Jonsson PV, Park P: Approaching cross-national comparisons of nursing home residents. Age Ageing. 1997, 26 Suppl 2: 13-18.CrossRefPubMed Fries BE, Schroll M, Hawes C, Gilgen R, Jonsson PV, Park P: Approaching cross-national comparisons of nursing home residents. Age Ageing. 1997, 26 Suppl 2: 13-18.CrossRefPubMed
6.
go back to reference Morris JN, Fries BE, Steel K, Ikegami N, Bernabei R, Carpenter GI, Gilgen R, Hirdes JP, Topinkova E: Comprehensive clinical assessment in community setting: applicability of the MDS-HC. J Am Geriatr Soc. 1997, 45 (8): 1017-1024.CrossRefPubMed Morris JN, Fries BE, Steel K, Ikegami N, Bernabei R, Carpenter GI, Gilgen R, Hirdes JP, Topinkova E: Comprehensive clinical assessment in community setting: applicability of the MDS-HC. J Am Geriatr Soc. 1997, 45 (8): 1017-1024.CrossRefPubMed
7.
go back to reference Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C, Gambassi G, Lattanzio F, Bernabei R: Minimum data set for home care: A valid instrument to assess frail older people living in the community. Medical Care. 2000, 38 (12): 1184-1190. 10.1097/00005650-200012000-00005.CrossRefPubMed Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C, Gambassi G, Lattanzio F, Bernabei R: Minimum data set for home care: A valid instrument to assess frail older people living in the community. Medical Care. 2000, 38 (12): 1184-1190. 10.1097/00005650-200012000-00005.CrossRefPubMed
8.
go back to reference Carpenter I, Gambassi G, Topinkova E, Schroll M, Finne-Soveri H, Henrard JC, Garms-Homolova V, Jonsson P, Frijters D, Ljunggren G, Sørbye LW, Wagner C, Onder G, Pedone C, Bernabei R: Community care in Europe. The Aged in Home Care project (AdHOC). Aging Clin Exp Res. 2004, 16 (4): 259-269.CrossRefPubMed Carpenter I, Gambassi G, Topinkova E, Schroll M, Finne-Soveri H, Henrard JC, Garms-Homolova V, Jonsson P, Frijters D, Ljunggren G, Sørbye LW, Wagner C, Onder G, Pedone C, Bernabei R: Community care in Europe. The Aged in Home Care project (AdHOC). Aging Clin Exp Res. 2004, 16 (4): 259-269.CrossRefPubMed
9.
go back to reference Hirdes JP, Marhaba M, Smith TF, Clyburn L, Mitchell L, Lemick RA, Telegdi NC, Perez E, Prendergast P, Rabinowitz T, Yamauchi K: Development of the Resident Assessment Instrument – Mental Health (RAI-MH). Hospital quarterly. 2000, 4 (2): 44.PubMed Hirdes JP, Marhaba M, Smith TF, Clyburn L, Mitchell L, Lemick RA, Telegdi NC, Perez E, Prendergast P, Rabinowitz T, Yamauchi K: Development of the Resident Assessment Instrument – Mental Health (RAI-MH). Hospital quarterly. 2000, 4 (2): 44.PubMed
10.
go back to reference Hirdes JP, Smith TF, Rabinowitz T, Yamauchi K, Perez E, Telegdi NC, Prendergast P, Morris JN, Ikegami N, Phillips CD, Fries BE: The Resident Assessment Instrument-Mental Health (RAI-MH): Inter-Rater Reliability and Convergent Validity. Journal of Behavioral Health Services and Research. 2002, 29 (4): 419-432. 10.1007/BF02287348.CrossRefPubMed Hirdes JP, Smith TF, Rabinowitz T, Yamauchi K, Perez E, Telegdi NC, Prendergast P, Morris JN, Ikegami N, Phillips CD, Fries BE: The Resident Assessment Instrument-Mental Health (RAI-MH): Inter-Rater Reliability and Convergent Validity. Journal of Behavioral Health Services and Research. 2002, 29 (4): 419-432. 10.1007/BF02287348.CrossRefPubMed
11.
go back to reference Carpenter GI, Teare GF, Steel K, Berg K, Murphy K, Bjornson J, Jonsson PV, Hirdes JP: A new assessment for elders admitted to acute care: Reliability of the MDS-AC. Aging (Milano). 2001, 13 (4): 316-330. Carpenter GI, Teare GF, Steel K, Berg K, Murphy K, Bjornson J, Jonsson PV, Hirdes JP: A new assessment for elders admitted to acute care: Reliability of the MDS-AC. Aging (Milano). 2001, 13 (4): 316-330.
12.
go back to reference Jonsson PV, Finne-Soveri H, Jensdottir AB, Ljunggren G, Bucht G, Grue EV, Noro A, Bjornson J, Jonsen E, Schroll M: Co-morbidity and functional limitation in older patients underreported in medical records in Nordic Acute Care Hospitals when compared with the MDS-AC instrument [1]. Age and Ageing. 2006, 35 (4): 434-10.1093/ageing/afj060.CrossRefPubMed Jonsson PV, Finne-Soveri H, Jensdottir AB, Ljunggren G, Bucht G, Grue EV, Noro A, Bjornson J, Jonsen E, Schroll M: Co-morbidity and functional limitation in older patients underreported in medical records in Nordic Acute Care Hospitals when compared with the MDS-AC instrument [1]. Age and Ageing. 2006, 35 (4): 434-10.1093/ageing/afj060.CrossRefPubMed
13.
go back to reference Gindin J, Walter-Ginzburg A, Geitzen M, Epstein S, Levi S, Landi F, Bernabei R: Predictors of Rehabilitation Outcomes: A Comparison of Israeli and Italian Geriatric Post-Acute Care (PAC) Facilities Using the Minimum Data Set (MDS). Journal of the American Medical Directors Association. 2007, 8 (4): 233-10.1016/j.jamda.2006.12.032.CrossRefPubMed Gindin J, Walter-Ginzburg A, Geitzen M, Epstein S, Levi S, Landi F, Bernabei R: Predictors of Rehabilitation Outcomes: A Comparison of Israeli and Italian Geriatric Post-Acute Care (PAC) Facilities Using the Minimum Data Set (MDS). Journal of the American Medical Directors Association. 2007, 8 (4): 233-10.1016/j.jamda.2006.12.032.CrossRefPubMed
14.
go back to reference Steel K, Ljunggren G, Topinkova E, Morris JN, Vitale C, Parzuchowski J, Nonemaker S, Frijters DH, Rabinowitz T, Murphy KM, Ribbe MW, Fries BE: The RAI-PC: An assessment instrument for palliative care in all settings. American Journal of Hospice and Palliative Medicine. 2003, 20 (3): 211-219. 10.1177/104990910302000311.CrossRefPubMed Steel K, Ljunggren G, Topinkova E, Morris JN, Vitale C, Parzuchowski J, Nonemaker S, Frijters DH, Rabinowitz T, Murphy KM, Ribbe MW, Fries BE: The RAI-PC: An assessment instrument for palliative care in all settings. American Journal of Hospice and Palliative Medicine. 2003, 20 (3): 211-219. 10.1177/104990910302000311.CrossRefPubMed
15.
go back to reference Hawes C, Morris JN, Phillips CD, Mor V, Fries BE, Nonemaker S: Reliability estimates for the minimum data set for nursing home resident assessment and care screening (MDS). Gerontologist. 1995, 35 (2): 172.CrossRefPubMed Hawes C, Morris JN, Phillips CD, Mor V, Fries BE, Nonemaker S: Reliability estimates for the minimum data set for nursing home resident assessment and care screening (MDS). Gerontologist. 1995, 35 (2): 172.CrossRefPubMed
16.
go back to reference Morris JN, Nonemaker S, Murphy K, Hawes C, Fries BE, Mor V, Phillips C: A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. 1997, 45 (8): 1011-1016.CrossRefPubMed Morris JN, Nonemaker S, Murphy K, Hawes C, Fries BE, Mor V, Phillips C: A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. 1997, 45 (8): 1011-1016.CrossRefPubMed
17.
go back to reference Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL: Pain in U.S. nursing homes: Validating a pain scale for the Minimum Data Set. Gerontologist. 2001, 41 (2): 173-179.CrossRefPubMed Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL: Pain in U.S. nursing homes: Validating a pain scale for the Minimum Data Set. Gerontologist. 2001, 41 (2): 173-179.CrossRefPubMed
18.
go back to reference Koehler M, Rabinowitz T, Hirdes J, Stones M, Carpenter GI, Fries BE, Morris JN, Jones RN: Measuring depression in nursing home residents with the MDS and GDS: An observational psychometric study. BMC Geriatrics. 2005, 5. Koehler M, Rabinowitz T, Hirdes J, Stones M, Carpenter GI, Fries BE, Morris JN, Jones RN: Measuring depression in nursing home residents with the MDS and GDS: An observational psychometric study. BMC Geriatrics. 2005, 5.
19.
go back to reference Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J: Inter-rater reliability of nursing home quality indicators in the U.S. BMC Health Services Research. 2003, 3: 1-10.1186/1472-6963-3-20.CrossRef Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J: Inter-rater reliability of nursing home quality indicators in the U.S. BMC Health Services Research. 2003, 3: 1-10.1186/1472-6963-3-20.CrossRef
20.
go back to reference Morris JN, Jones RN, Fries BE, Hirdes JP: Convergent validity of minimum data set-based performance quality indicators in postacute care settings. American Journal of Medical Quality. 2004, 19 (6): 242-10.1177/106286060401900603.CrossRefPubMed Morris JN, Jones RN, Fries BE, Hirdes JP: Convergent validity of minimum data set-based performance quality indicators in postacute care settings. American Journal of Medical Quality. 2004, 19 (6): 242-10.1177/106286060401900603.CrossRefPubMed
21.
go back to reference Hawes C, Fries BE, James ML, Guihan M: Prospects and pitfalls: Use of the RAI-HC assessment by the Department of Veterans Affairs for home care clients. Gerontologist. 2007, 47 (3): 378-387.CrossRefPubMed Hawes C, Fries BE, James ML, Guihan M: Prospects and pitfalls: Use of the RAI-HC assessment by the Department of Veterans Affairs for home care clients. Gerontologist. 2007, 47 (3): 378-387.CrossRefPubMed
22.
go back to reference Gray LC, Bernabei R, Berg K, Finne-Soveri H, Fries BE, Hirdes JP, Jonsson PV, Morris JN, Steel K, Arino-Blasco S: Standardizing Assessment of Elderly People in Acute Care: The interRAI Acute Care Instrument. J Am Geriatr Soc. 2008 Gray LC, Bernabei R, Berg K, Finne-Soveri H, Fries BE, Hirdes JP, Jonsson PV, Morris JN, Steel K, Arino-Blasco S: Standardizing Assessment of Elderly People in Acute Care: The interRAI Acute Care Instrument. J Am Geriatr Soc. 2008
23.
go back to reference Martin LR, Hirdes JP, Fries BE, Smith TF: Development and psychometric properties of an assessment for persons with ID-the interRAI ID. Journal of Policy and Practice in Intellectual Disabilities. 2007, 4 (1): 23-29. 10.1111/j.1741-1130.2006.00094.x.CrossRef Martin LR, Hirdes JP, Fries BE, Smith TF: Development and psychometric properties of an assessment for persons with ID-the interRAI ID. Journal of Policy and Practice in Intellectual Disabilities. 2007, 4 (1): 23-29. 10.1111/j.1741-1130.2006.00094.x.CrossRef
24.
go back to reference Fleiss JL: Statistical methods for rates and proportions. 1981, New York: John Wiley & Sons, 2 Fleiss JL: Statistical methods for rates and proportions. 1981, New York: John Wiley & Sons, 2
25.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
26.
go back to reference Morris JN, Fries BE, Mehr DR, Hawes C, Phillips C, Mor V, Lipsitz LA: MDS Cognitive Performance Scale. J Gerontol. 1994, 49 (4): M174-182.CrossRefPubMed Morris JN, Fries BE, Mehr DR, Hawes C, Phillips C, Mor V, Lipsitz LA: MDS Cognitive Performance Scale. J Gerontol. 1994, 49 (4): M174-182.CrossRefPubMed
27.
go back to reference Morris JN, Fries BE, Morris SA: Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999, 54 (11): M546-553.CrossRefPubMed Morris JN, Fries BE, Morris SA: Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999, 54 (11): M546-553.CrossRefPubMed
28.
go back to reference Fries BE, Morris JN, Bernabei R, Finne-Soveri H, Hirdes J: Rethinking the Resident Assessment Protocols. J Am Geriatr Soc. 2007, 55 (7): 1139-1140. 10.1111/j.1532-5415.2007.01207.x.CrossRefPubMed Fries BE, Morris JN, Bernabei R, Finne-Soveri H, Hirdes J: Rethinking the Resident Assessment Protocols. J Am Geriatr Soc. 2007, 55 (7): 1139-1140. 10.1111/j.1532-5415.2007.01207.x.CrossRefPubMed
29.
go back to reference Kuziemsky CE, Lau F: A comparative analysis of computer based hospice palliative care datasets in Canada. BMC Pall Care. 2008, 7: 6-10.1186/1472-684X-7-6.CrossRef Kuziemsky CE, Lau F: A comparative analysis of computer based hospice palliative care datasets in Canada. BMC Pall Care. 2008, 7: 6-10.1186/1472-684X-7-6.CrossRef
30.
go back to reference Harris MR, Chute CG, Harvell J, White A, Moore T: Toward a National Health Information Infrastructure: A Key Strategy for Improving Quality in Long Term Care. Office of the Assistant Secretary of Planning and Evaluation. 2003 Harris MR, Chute CG, Harvell J, White A, Moore T: Toward a National Health Information Infrastructure: A Key Strategy for Improving Quality in Long Term Care. Office of the Assistant Secretary of Planning and Evaluation. 2003
Metadata
Title
Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system
Authors
John P Hirdes
Gunnar Ljunggren
John N Morris
Dinnus HM Frijters
Harriet Finne Soveri
Len Gray
Magnus Björkgren
Reudi Gilgen
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2008
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-8-277

Other articles of this Issue 1/2008

BMC Health Services Research 1/2008 Go to the issue