Skip to main content
Top
Published in: BMC Geriatrics 1/2012

Open Access 01-12-2012 | Research article

Comparing frailty measures in their ability to predict adverse outcome among older residents of assisted living

Authors: David B Hogan, Elizabeth A Freiheit, Laurel A Strain, Scott B Patten, Heidi N Schmaltz, Darryl Rolfson, Colleen J Maxwell

Published in: BMC Geriatrics | Issue 1/2012

Login to get access

Abstract

Background

Few studies have directly compared the competing approaches to identifying frailty in more vulnerable older populations. We examined the ability of two versions of a frailty index (43 vs. 83 items), the Cardiovascular Health Study (CHS) frailty criteria, and the CHESS scale to accurately predict the occurrence of three outcomes among Assisted Living (AL) residents followed over one year.

Methods

The three frailty measures and the CHESS scale were derived from assessment items completed among 1,066 AL residents (aged 65+) participating in the Alberta Continuing Care Epidemiological Studies (ACCES). Adjusted risks of one-year mortality, hospitalization and long-term care placement were estimated for those categorized as frail or pre-frail compared with non-frail (or at high/intermediate vs. low risk on CHESS). The area under the ROC curve (AUC) was calculated for select models to assess the predictive accuracy of the different frailty measures and CHESS scale in relation to the three outcomes examined.

Results

Frail subjects defined by the three approaches and those at high risk for decline on CHESS showed a statistically significant increased risk for death and long-term care placement compared with those categorized as either not frail or at low risk for decline. The risk estimates for hospitalization associated with the frailty measures and CHESS were generally weaker with one of the frailty indices (43 items) showing no significant association. For death and long-term care placement, the addition of frailty (however derived) or CHESS significantly improved on the AUC obtained with a model including only age, sex and co-morbidity, though the magnitude of improvement was sometimes small. The different frailty/risk models did not differ significantly from each other in predicting mortality or hospitalization; however, one of the frailty indices (83 items) showed significantly better performance over the other measures in predicting long-term care placement.

Conclusions

Using different approaches, varying degrees of frailty were detected within the AL population. The various approaches to defining frailty were generally more similar than dissimilar with regard to predictive accuracy with some exceptions. The clinical implications and opportunities of detecting frailty in more vulnerable older adults require further investigation.
Literature
1.
go back to reference Golant SM: Do impaired older persons with health care needs occupy US assisted living facilities? An analysis of six national studies. J Gerontol B Psychol Sci Soc Sci. 2004, 59B (2): S68-S79.CrossRef Golant SM: Do impaired older persons with health care needs occupy US assisted living facilities? An analysis of six national studies. J Gerontol B Psychol Sci Soc Sci. 2004, 59B (2): S68-S79.CrossRef
4.
go back to reference Zimmerman S, Sloane PD, Eckert JK, Gruber-Baldini AL, Morgan LA, Hebel JR, Magaziner J, Stearns SC, Chen CK: How good is assisted living? Findings and implications from an outcomes study. J Gerontol B Psychol Sci Soc Sci. 2005, 60 (4): S195-S204. 10.1093/geronb/60.4.S195.CrossRefPubMed Zimmerman S, Sloane PD, Eckert JK, Gruber-Baldini AL, Morgan LA, Hebel JR, Magaziner J, Stearns SC, Chen CK: How good is assisted living? Findings and implications from an outcomes study. J Gerontol B Psychol Sci Soc Sci. 2005, 60 (4): S195-S204. 10.1093/geronb/60.4.S195.CrossRefPubMed
5.
go back to reference Becker M, Boaz T, Andel R, Demuth A: Predictors of avoidable hospitalizations among assisted living residents. J Am Med Dir Assoc. 2012, 13 (4): 355-359. 10.1016/j.jamda.2011.02.001.CrossRefPubMed Becker M, Boaz T, Andel R, Demuth A: Predictors of avoidable hospitalizations among assisted living residents. J Am Med Dir Assoc. 2012, 13 (4): 355-359. 10.1016/j.jamda.2011.02.001.CrossRefPubMed
6.
go back to reference Bergman H, Ferrucci L, Guralnik J, Hogan DB, Hummel S, Karunananthan S, Wolfson C: Frailty: an emerging research and clinical paradigm-issues and controversies. J Gerontol A Biol Sci Med Sci. 2007, 62A (7): 731-737.CrossRef Bergman H, Ferrucci L, Guralnik J, Hogan DB, Hummel S, Karunananthan S, Wolfson C: Frailty: an emerging research and clinical paradigm-issues and controversies. J Gerontol A Biol Sci Med Sci. 2007, 62A (7): 731-737.CrossRef
7.
go back to reference Rockwood K, Abeysundera MJ, Mitnitski A: How should we grade frailty in nursing home patients?. J Am Med Dir Assoc. 2007, 8 (9): 595-603. 10.1016/j.jamda.2007.07.012.CrossRefPubMed Rockwood K, Abeysundera MJ, Mitnitski A: How should we grade frailty in nursing home patients?. J Am Med Dir Assoc. 2007, 8 (9): 595-603. 10.1016/j.jamda.2007.07.012.CrossRefPubMed
8.
go back to reference Mitnitski AB, Mogilner AJ, Rockwood K: Accumulation of deficits as a proxy measure of aging. The Scientific World. 2001, 1: 323-336.CrossRef Mitnitski AB, Mogilner AJ, Rockwood K: Accumulation of deficits as a proxy measure of aging. The Scientific World. 2001, 1: 323-336.CrossRef
9.
go back to reference Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, McBurnie MA, Cardiovascular Health Study Collaborative Research Group: Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001, 56 (3): M146-M156. 10.1093/gerona/56.3.M146.CrossRefPubMed Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, McBurnie MA, Cardiovascular Health Study Collaborative Research Group: Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001, 56 (3): M146-M156. 10.1093/gerona/56.3.M146.CrossRefPubMed
10.
go back to reference Armstrong JJ, Stolee P, Hirdes JP, Poss JW: Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. 2010, 39 (6): 755-758. 10.1093/ageing/afq121.CrossRefPubMed Armstrong JJ, Stolee P, Hirdes JP, Poss JW: Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. 2010, 39 (6): 755-758. 10.1093/ageing/afq121.CrossRefPubMed
11.
go back to reference Hirdes JP, Frijters D, Teare G: The MDS CHESS Scale: a new measure to predict mortality in the institutionalized older people. J Am Geriatr Soc. 2003, 51 (1): 96-100. 10.1034/j.1601-5215.2002.51017.x.CrossRefPubMed Hirdes JP, Frijters D, Teare G: The MDS CHESS Scale: a new measure to predict mortality in the institutionalized older people. J Am Geriatr Soc. 2003, 51 (1): 96-100. 10.1034/j.1601-5215.2002.51017.x.CrossRefPubMed
12.
go back to reference Mor V, Intractor O, Unruh MA, Cai S: Temporal and geographic variation in the validity and internal consistency of the Nursing Home Resident Assessment Minimum Data Set 2.0. BMC Health Serv Res. 2011, 11: 78-10.1186/1472-6963-11-78.CrossRefPubMedPubMedCentral Mor V, Intractor O, Unruh MA, Cai S: Temporal and geographic variation in the validity and internal consistency of the Nursing Home Resident Assessment Minimum Data Set 2.0. BMC Health Serv Res. 2011, 11: 78-10.1186/1472-6963-11-78.CrossRefPubMedPubMedCentral
13.
go back to reference Tjam EY, Heckman GA, Smith S, Arai B, Hirdes J, Poss J, McKelvie RS: Predicting heart failure mortality in frail seniors: comparing the NYHA functional classification with the Resident Assessment Instrument (RAI) 2.0. Int J Cardiol. 2012, 155: 75-80. 10.1016/j.ijcard.2011.01.031.CrossRefPubMed Tjam EY, Heckman GA, Smith S, Arai B, Hirdes J, Poss J, McKelvie RS: Predicting heart failure mortality in frail seniors: comparing the NYHA functional classification with the Resident Assessment Instrument (RAI) 2.0. Int J Cardiol. 2012, 155: 75-80. 10.1016/j.ijcard.2011.01.031.CrossRefPubMed
14.
go back to reference Freiheit EA, Hogan DB, Strain LA, Schmaltz HN, Patten SB, Eliasziw M, Maxwell CJ: Operationalizing frailty among older residents of assisted living facilities. BMC Geriatr. 2011, 11: 23-10.1186/1471-2318-11-23.CrossRefPubMedPubMedCentral Freiheit EA, Hogan DB, Strain LA, Schmaltz HN, Patten SB, Eliasziw M, Maxwell CJ: Operationalizing frailty among older residents of assisted living facilities. BMC Geriatr. 2011, 11: 23-10.1186/1471-2318-11-23.CrossRefPubMedPubMedCentral
15.
go back to reference Hawes C, Phillips C, Morris JN, Nonemaker S, Berg K, Bjorkgren M, Fries BE, Frijters D, Gilgen R, Gray L, Henrard JC, Hirdes JP, Ljunggren G, Steel K, Zimmerman D: User’s guide for the interRAI-AL. 2006, Washington, DC: interRAI Hawes C, Phillips C, Morris JN, Nonemaker S, Berg K, Bjorkgren M, Fries BE, Frijters D, Gilgen R, Gray L, Henrard JC, Hirdes JP, Ljunggren G, Steel K, Zimmerman D: User’s guide for the interRAI-AL. 2006, Washington, DC: interRAI
16.
go back to reference Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K: A standard procedure for creating a frailty index. BMC Geriatr. 2008, 8: 24-10.1186/1471-2318-8-24.CrossRefPubMedPubMedCentral Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K: A standard procedure for creating a frailty index. BMC Geriatr. 2008, 8: 24-10.1186/1471-2318-8-24.CrossRefPubMedPubMedCentral
17.
go back to reference Rockwood K, Mitnitski A: Frailty in relation to the accumulation of deficits. J Gerontol A Biol Sci Med Sci. 2007, 62 (7): 722-727. 10.1093/gerona/62.7.722.CrossRefPubMed Rockwood K, Mitnitski A: Frailty in relation to the accumulation of deficits. J Gerontol A Biol Sci Med Sci. 2007, 62 (7): 722-727. 10.1093/gerona/62.7.722.CrossRefPubMed
18.
go back to reference Kulminski AM, Ukraintseva SV, Kulminskaya IV, Arbeev KG, Land K, Yashin AI: Cumulative deficits better characterize susceptibility to death in elderly people than pheonotypic frailty: lessons from the Cardiovascular Health Study. J Am Geriatr Soc. 2008, 56: 898-903. 10.1111/j.1532-5415.2008.01656.x.CrossRefPubMedPubMedCentral Kulminski AM, Ukraintseva SV, Kulminskaya IV, Arbeev KG, Land K, Yashin AI: Cumulative deficits better characterize susceptibility to death in elderly people than pheonotypic frailty: lessons from the Cardiovascular Health Study. J Am Geriatr Soc. 2008, 56: 898-903. 10.1111/j.1532-5415.2008.01656.x.CrossRefPubMedPubMedCentral
19.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
20.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43: 1130-1139. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43: 1130-1139. 10.1097/01.mlr.0000182534.19832.83.CrossRefPubMed
21.
go back to reference Hartmaier SL, Sloane PD, Guess HA, Koch GG, Mitchell CM, Phillips CD: Validation of the minimum data set cognitive performance scale: agreement with the mini-mental state examination. J Gerontol A Biol Sci Med Sci. 1995, 50A (2): M128-M133. 10.1093/gerona/50A.2.M128.CrossRef Hartmaier SL, Sloane PD, Guess HA, Koch GG, Mitchell CM, Phillips CD: Validation of the minimum data set cognitive performance scale: agreement with the mini-mental state examination. J Gerontol A Biol Sci Med Sci. 1995, 50A (2): M128-M133. 10.1093/gerona/50A.2.M128.CrossRef
22.
go back to reference Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C: Development of a Minimum Data Set-based depression rating scale for use in nursing homes. Age Ageing. 2000, 29: 165-172. 10.1093/ageing/29.2.165.CrossRefPubMed Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C: Development of a Minimum Data Set-based depression rating scale for use in nursing homes. Age Ageing. 2000, 29: 165-172. 10.1093/ageing/29.2.165.CrossRefPubMed
23.
go back to reference Morris JN, Fries BE, Morris SA: Scaling ADLs with the MDS. J Gerontol A Biol Sci Med Sci. 1999, 54 (11): M546-M553. 10.1093/gerona/54.11.M546.CrossRefPubMed Morris JN, Fries BE, Morris SA: Scaling ADLs with the MDS. J Gerontol A Biol Sci Med Sci. 1999, 54 (11): M546-M553. 10.1093/gerona/54.11.M546.CrossRefPubMed
24.
go back to reference Fleiss JL, Cohen J, Everitt BS: Large sample standard errors of kappa and weighted kappa. Psychol Bull. 1969, 72 (5): 323-327.CrossRef Fleiss JL, Cohen J, Everitt BS: Large sample standard errors of kappa and weighted kappa. Psychol Bull. 1969, 72 (5): 323-327.CrossRef
25.
go back to reference Fleiss JL, Levin B, Paik MC: Statistical Methods for Rates and Proportions. 2003, New York: John Wiley & Sons, 3CrossRef Fleiss JL, Levin B, Paik MC: Statistical Methods for Rates and Proportions. 2003, New York: John Wiley & Sons, 3CrossRef
26.
go back to reference Delong ER, Delong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988, 44 (3): 837-845. 10.2307/2531595.CrossRefPubMed Delong ER, Delong DM, Clarke-Pearson DL: Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988, 44 (3): 837-845. 10.2307/2531595.CrossRefPubMed
27.
go back to reference Akobeng AK: Understanding diagnostic tests 3: receiver operating characteristic curves. Acta Paediatr. 2007, 96: 644-647. 10.1111/j.1651-2227.2006.00178.x.CrossRefPubMed Akobeng AK: Understanding diagnostic tests 3: receiver operating characteristic curves. Acta Paediatr. 2007, 96: 644-647. 10.1111/j.1651-2227.2006.00178.x.CrossRefPubMed
28.
go back to reference Giuliani CA, Gruber-Baldini AL, Park NS, Schrodt LA, Rokoske F, Sloane PD, Zimmerman S: Physical performance characteristics of assisted living residents and risk for adverse health outcomes. Gerontologist. 2008, 48: 203-212. 10.1093/geront/48.2.203.CrossRefPubMedPubMedCentral Giuliani CA, Gruber-Baldini AL, Park NS, Schrodt LA, Rokoske F, Sloane PD, Zimmerman S: Physical performance characteristics of assisted living residents and risk for adverse health outcomes. Gerontologist. 2008, 48: 203-212. 10.1093/geront/48.2.203.CrossRefPubMedPubMedCentral
29.
go back to reference McGinn T, Wyler PC, Newman TB, Keitz S, Leipzig R, Guyatt G, for the Evidence-Based Medicine Teaching Tips Working Group: Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic). CMAJ. 2004, 171 (11): 1369-1373.CrossRefPubMedPubMedCentral McGinn T, Wyler PC, Newman TB, Keitz S, Leipzig R, Guyatt G, for the Evidence-Based Medicine Teaching Tips Working Group: Tips for learners of evidence-based medicine: 3. measures of observer variability (kappa statistic). CMAJ. 2004, 171 (11): 1369-1373.CrossRefPubMedPubMedCentral
30.
go back to reference Rockwood K, Mitnitski A, Song X, Steen B, Skoog I: Long-term risks of death and institutionalization of elderly people in relation to deficit accumulation at age 70. J Am Geriatr Soc. 2006, 54: 975-979. 10.1111/j.1532-5415.2006.00738.x.CrossRefPubMed Rockwood K, Mitnitski A, Song X, Steen B, Skoog I: Long-term risks of death and institutionalization of elderly people in relation to deficit accumulation at age 70. J Am Geriatr Soc. 2006, 54: 975-979. 10.1111/j.1532-5415.2006.00738.x.CrossRefPubMed
31.
go back to reference Buntinx F, Niclaes L, Suetens C, Jans B, Mertens R, Van den Akker M: Evaluation of Charlson’s comorbidity index in elderly living in nursing homes. J Clin Epidemiol. 2002, 55 (11): 1144-1147. 10.1016/S0895-4356(02)00485-7.CrossRefPubMed Buntinx F, Niclaes L, Suetens C, Jans B, Mertens R, Van den Akker M: Evaluation of Charlson’s comorbidity index in elderly living in nursing homes. J Clin Epidemiol. 2002, 55 (11): 1144-1147. 10.1016/S0895-4356(02)00485-7.CrossRefPubMed
32.
go back to reference Dobbs D, Meng H, Hyer K, Volicer L: The influence of hospice use on nursing home and hospital use in assisted living among dual-eligible enrollees. J Am Med Dir Assoc. 2012, 13 (2): 189.e9-189.e13. 10.1016/j.jamda.2011.06.001.CrossRef Dobbs D, Meng H, Hyer K, Volicer L: The influence of hospice use on nursing home and hospital use in assisted living among dual-eligible enrollees. J Am Med Dir Assoc. 2012, 13 (2): 189.e9-189.e13. 10.1016/j.jamda.2011.06.001.CrossRef
33.
go back to reference Epstein AM, Jha AK, Orav EJ: The relationship between hospital admission rates and rehospitalizations. N Engl J Med. 2011, 365: 2287-2295. 10.1056/NEJMsa1101942.CrossRefPubMed Epstein AM, Jha AK, Orav EJ: The relationship between hospital admission rates and rehospitalizations. N Engl J Med. 2011, 365: 2287-2295. 10.1056/NEJMsa1101942.CrossRefPubMed
34.
go back to reference Taylor HL, Jacobs DR, Shucker B, Knudsen J, Leon AS, Debacker G: A questionnaire for the assessment of leisure time physical activities. J Chronic Dis. 1978, 31: 741-755. 10.1016/0021-9681(78)90058-9.CrossRefPubMed Taylor HL, Jacobs DR, Shucker B, Knudsen J, Leon AS, Debacker G: A questionnaire for the assessment of leisure time physical activities. J Chronic Dis. 1978, 31: 741-755. 10.1016/0021-9681(78)90058-9.CrossRefPubMed
35.
go back to reference Orme JG, Reis J, Herz EJ: Factorial and discriminate validity of the Center for Epidemiological Studies Depression (CES-D) scale. J Clin Psychol. 1986, 42 (1): 28-33. 10.1002/1097-4679(198601)42:1<28::AID-JCLP2270420104>3.0.CO;2-T.CrossRefPubMed Orme JG, Reis J, Herz EJ: Factorial and discriminate validity of the Center for Epidemiological Studies Depression (CES-D) scale. J Clin Psychol. 1986, 42 (1): 28-33. 10.1002/1097-4679(198601)42:1<28::AID-JCLP2270420104>3.0.CO;2-T.CrossRefPubMed
Metadata
Title
Comparing frailty measures in their ability to predict adverse outcome among older residents of assisted living
Authors
David B Hogan
Elizabeth A Freiheit
Laurel A Strain
Scott B Patten
Heidi N Schmaltz
Darryl Rolfson
Colleen J Maxwell
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2012
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/1471-2318-12-56

Other articles of this Issue 1/2012

BMC Geriatrics 1/2012 Go to the issue