Skip to main content
Top
Published in: BMC Geriatrics 1/2019

Open Access 01-12-2019 | Care | Research article

Accessing the discriminatory performance of FRAIL-NH in two-class and three-class frailty and examining its agreement with the frailty index among nursing home residents in mainland China

Authors: Feng Ge, Weiwei Liu, Minhui Liu, Siyuan Tang, Yongjin Lu, Tianxue Hou

Published in: BMC Geriatrics | Issue 1/2019

Login to get access

Abstract

Background

FRAIL-NH has been commonly used to assess frailty in nursing home residents and validated in many ethnic populations; however, it has not been validated in mainland China, where such an assessment tool is lacking. This study aimed to (1) assess the discriminatory performance of FRAIL-NH in two-class frailty (non-frail+ pre-frail vs. frail) and three-class frailty (non-frail vs. pre-frail vs. frail), based on the Frailty Index (FI), (2) determine the appropriate cutoff points for FRAIL-NH that distinguish two-class and three-class frailty, and (3) examine the agreement in classification between FRAIL-NH and FI.

Methods

A cross-sectional study of 302 residents aged 60 years or older from six nursing homes in Changsha was conducted. The FRAIL-NH scale and 34-item FI were used to measure frailty. Two-way and three-way receiver operating characteristic (ROC) curves were used to estimate the performance of FRAIL-NH. Cohen’s Kappa statistics were used to examine the agreement between these two measures.

Results

The agreement between FRAIL-NH and FI ranged from 0.33 to 0.55. Regardless of what FI cutoff points were based on, the volume under the ROC surface (VUS) for FRAIL-NH from the three-way ROC were higher than the VUS of a useless test (1/6), and the area under the ROC curve (AUC) for FRAIL-NH from the two-way ROC were higher than the clinically meaningless value (0.5). When using FI cutoff points of 0.20 for pre-frail and 0.45 for frail, FRAIL-NH cutoff points of 1 and 9 in classifying three-class frailty had the highest VUS and the largest correct classification rates. Whichever FI was chosen, the performance of FRAIL-NH in distinguishing between pre-frailty and frailty, and between non-frailty and pre-frailty was equivalent. According to FRAIL-NH, the proportion of individuals with frailty misclassified as pre-frailty was higher than that of individuals with non-frailty misclassified as pre-frailty.

Conclusion

FRAIL-NH can be used as a preliminary frailty screening tool in nursing homes in mainland China. FI should be further used especially for those classified as pre-frailty by FRAIL-NH. It is not advisable to simply combine adjacent two classes of FRAIL-NH to create a new frailty variable in research settings.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hou XL, J G, Wu CX, Bai DX, Xiang YP, Li X, et al. Prevalence and factors associated with frailty among institutional older adults. Chin J Nurs. 2018;53:88–93. Hou XL, J G, Wu CX, Bai DX, Xiang YP, Li X, et al. Prevalence and factors associated with frailty among institutional older adults. Chin J Nurs. 2018;53:88–93.
2.
go back to reference Si X, Jin R, Qiao X-X, Tian X, Liu XY, Dong L, et al. The reliability and validity test of the Chinese version of Tilburg frailty scale for the institutional older adults. Chin J Gerontol. 2018;38:4046–9. Si X, Jin R, Qiao X-X, Tian X, Liu XY, Dong L, et al. The reliability and validity test of the Chinese version of Tilburg frailty scale for the institutional older adults. Chin J Gerontol. 2018;38:4046–9.
3.
go back to reference Liu X-X, Hu J. The effects of an intervention on physical activity among nursing home residents in Wuhan. China J Gerontol Nurs. 2015;41:30–40.CrossRef Liu X-X, Hu J. The effects of an intervention on physical activity among nursing home residents in Wuhan. China J Gerontol Nurs. 2015;41:30–40.CrossRef
4.
go back to reference Kojima G. Prevalence of frailty in nursing homes : a systematic review and meta-analysis. J Am Med Dir Assoc. 2018;16:940–5.CrossRef Kojima G. Prevalence of frailty in nursing homes : a systematic review and meta-analysis. J Am Med Dir Assoc. 2018;16:940–5.CrossRef
5.
go back to reference Blodgett J, Theou O, Kirkland S, Andreou P, Rockwood K. Frailty in NHANES: comparing the frailty index and phenotype. Arch Gerontol Geriatr. 2015;60:464–70.CrossRef Blodgett J, Theou O, Kirkland S, Andreou P, Rockwood K. Frailty in NHANES: comparing the frailty index and phenotype. Arch Gerontol Geriatr. 2015;60:464–70.CrossRef
6.
go back to reference De Silva TR, Theou O, Vellas B, Cesari M, Visvanathan R. Frailty screening ( FRAIL-NH ) and mortality in French nursing homes : results from the incidence of pneumonia and related consequences in nursing home residents study. J Am Med Dir Assoc. 2018;19:411–4.CrossRef De Silva TR, Theou O, Vellas B, Cesari M, Visvanathan R. Frailty screening ( FRAIL-NH ) and mortality in French nursing homes : results from the incidence of pneumonia and related consequences in nursing home residents study. J Am Med Dir Assoc. 2018;19:411–4.CrossRef
7.
go back to reference Theou O, Tan ECK, Bell JS, Emery T, Robson L, Morley JE, et al. Frailty levels in residential aged care facilities measured using the frailty index and FRAIL-NH scale. J Am Geriatr Soc. 2016;64:e207–12.CrossRef Theou O, Tan ECK, Bell JS, Emery T, Robson L, Morley JE, et al. Frailty levels in residential aged care facilities measured using the frailty index and FRAIL-NH scale. J Am Geriatr Soc. 2016;64:e207–12.CrossRef
8.
go back to reference Martínez-Velilla N, Herce PA, Herrero ÁC, Gutiérrez-Valencia M, De Asteasu MS, Mateos AS, et al. Heterogeneity of different tools for detecting the prevalence of frailty in nursing homes: feasibility and meaning of different approaches. J Am Med Dir Assoc. 2017;18:898.e1–8.CrossRef Martínez-Velilla N, Herce PA, Herrero ÁC, Gutiérrez-Valencia M, De Asteasu MS, Mateos AS, et al. Heterogeneity of different tools for detecting the prevalence of frailty in nursing homes: feasibility and meaning of different approaches. J Am Med Dir Assoc. 2017;18:898.e1–8.CrossRef
9.
go back to reference Gobbens Robbert JJ, Assen Marcel ALMV, Luijkx Katrien G, Maria Th WS, Schols Jos MGA. The Tilburg frailty Indicator: psychometric properties. J Am Med Dir Assoc. 2010;11:344–55.CrossRef Gobbens Robbert JJ, Assen Marcel ALMV, Luijkx Katrien G, Maria Th WS, Schols Jos MGA. The Tilburg frailty Indicator: psychometric properties. J Am Med Dir Assoc. 2010;11:344–55.CrossRef
10.
go back to reference Rockwood K, Song X, Macknight C, Bergman H, Hogan DB, Mcdowell I, et al. A global clinical measure of fitness and frailty in elderly people. C Can Med Assoc J. 2005;173:489–95.CrossRef Rockwood K, Song X, Macknight C, Bergman H, Hogan DB, Mcdowell I, et al. A global clinical measure of fitness and frailty in elderly people. C Can Med Assoc J. 2005;173:489–95.CrossRef
11.
go back to reference Kaehr EW, Pape LC, Malmstrom TK, Morley JE. FRAIL-NH predicts outcomes in long term care. J Nutr Health Aging. 2016;20:192–8.CrossRef Kaehr EW, Pape LC, Malmstrom TK, Morley JE. FRAIL-NH predicts outcomes in long term care. J Nutr Health Aging. 2016;20:192–8.CrossRef
12.
go back to reference Kaehr E, Visvanathan R, Malmstrom TK, Mb JEM. Frailty in nursing homes: the FRAIL-NH scale. J Am Med Dir Assoc. 2015;16:87–9.CrossRef Kaehr E, Visvanathan R, Malmstrom TK, Mb JEM. Frailty in nursing homes: the FRAIL-NH scale. J Am Med Dir Assoc. 2015;16:87–9.CrossRef
13.
go back to reference Luo H, Lum TYS, Wong GHY, Kwan JSK, Tang JYM, Chi I. Predicting adverse health outcomes in nursing homes : a 9-year longitudinal study and development of the FRAIL-minimum data set (MDS) quick screening tool. J Am Med Dir Assoc. 2018;16:1042–7.CrossRef Luo H, Lum TYS, Wong GHY, Kwan JSK, Tang JYM, Chi I. Predicting adverse health outcomes in nursing homes : a 9-year longitudinal study and development of the FRAIL-minimum data set (MDS) quick screening tool. J Am Med Dir Assoc. 2018;16:1042–7.CrossRef
14.
go back to reference Luo J, Xiong C. DiagTest3Grp: an R package for analyzing diagnostic tests with three ordinal groups. J Stat Softw. 2012;51:1–24.CrossRef Luo J, Xiong C. DiagTest3Grp: an R package for analyzing diagnostic tests with three ordinal groups. J Stat Softw. 2012;51:1–24.CrossRef
15.
go back to reference Ma L, Tang Z, Zhang L, Sun F, Li Y. Prevalence of frailty and associated factors in the community- dwelling population of China. J Am Geriatr Soc. 2018;66:559–64.CrossRef Ma L, Tang Z, Zhang L, Sun F, Li Y. Prevalence of frailty and associated factors in the community- dwelling population of China. J Am Geriatr Soc. 2018;66:559–64.CrossRef
16.
go back to reference Dent E, Kowal P, Hoogendijk EO. Frailty measurement in research and clinical practice: a review. Eur J Intern Med. 2016;31:3–10.CrossRef Dent E, Kowal P, Hoogendijk EO. Frailty measurement in research and clinical practice: a review. Eur J Intern Med. 2016;31:3–10.CrossRef
17.
go back to reference Theou O, Brothers TD, Mitnitski A, Rockwood K. Operationalization of frailty using eight commonly used scales and comparison of their ability to predict all-cause mortality. J Am Geriatr Soc. 2013;61:1537–51.CrossRef Theou O, Brothers TD, Mitnitski A, Rockwood K. Operationalization of frailty using eight commonly used scales and comparison of their ability to predict all-cause mortality. J Am Geriatr Soc. 2013;61:1537–51.CrossRef
18.
go back to reference Chong E, Ho E, Baldevarona-llego J, Mb MC, Wu L, Tay L. Frailty in hospitalized older adults : comparing different frailty measures in predicting short- and long-term patient outcomes. J Am Med Dir Assoc. 2019;19:450–457.e3.CrossRef Chong E, Ho E, Baldevarona-llego J, Mb MC, Wu L, Tay L. Frailty in hospitalized older adults : comparing different frailty measures in predicting short- and long-term patient outcomes. J Am Med Dir Assoc. 2019;19:450–457.e3.CrossRef
19.
go back to reference Drost DP, Van Munster BC. Discriminative value of frailty screening instruments in end-stage renal disease. Clin Kidney J. 2016;9:606–10.CrossRef Drost DP, Van Munster BC. Discriminative value of frailty screening instruments in end-stage renal disease. Clin Kidney J. 2016;9:606–10.CrossRef
20.
go back to reference Toosizadeh N, Wendel C, Hsu CH, Zamrini E, Mohler J. Frailty assessment in older adults using upper-extremity function: index development. BMC Geriatr. 2017;17:1–7.CrossRef Toosizadeh N, Wendel C, Hsu CH, Zamrini E, Mohler J. Frailty assessment in older adults using upper-extremity function: index development. BMC Geriatr. 2017;17:1–7.CrossRef
21.
go back to reference Aguayo GA, Donneau AF, Vaillant MT, Schritz A, Franco OH, Stranges S, et al. Agreement between 35 published frailty scores in the general population. Am J Epidemiol. 2017;186:1–15.CrossRef Aguayo GA, Donneau AF, Vaillant MT, Schritz A, Franco OH, Stranges S, et al. Agreement between 35 published frailty scores in the general population. Am J Epidemiol. 2017;186:1–15.CrossRef
22.
go back to reference Thompson MQ, Theou O, Yu S, Adams RJ, Tucker GR, Visvanathan R. Frailty prevalence and factors associated with the frailty phenotype and frailty index: findings from the north West Adelaide health study. Australas J Ageing. 2017;37:120–6.CrossRef Thompson MQ, Theou O, Yu S, Adams RJ, Tucker GR, Visvanathan R. Frailty prevalence and factors associated with the frailty phenotype and frailty index: findings from the north West Adelaide health study. Australas J Ageing. 2017;37:120–6.CrossRef
23.
go back to reference Schoufour JD, Echteld MA, Evenhuis HM. Comparing two frailty concepts among older people with intellectual disabilities. Eur J Ageing. 2017;14:63–79.CrossRef Schoufour JD, Echteld MA, Evenhuis HM. Comparing two frailty concepts among older people with intellectual disabilities. Eur J Ageing. 2017;14:63–79.CrossRef
24.
go back to reference Zhu Y, Liu Z, Wang Y, Wang Z, Shi J, Xie X, et al. Agreement between the frailty index and phenotype and their associations with falls and overnight hospitalizations. Arch Gerontol Geriatr. 2016;66:161–5.CrossRef Zhu Y, Liu Z, Wang Y, Wang Z, Shi J, Xie X, et al. Agreement between the frailty index and phenotype and their associations with falls and overnight hospitalizations. Arch Gerontol Geriatr. 2016;66:161–5.CrossRef
25.
go back to reference Ge F, Liu M, Tang S, Lu Y, Szanton SL. Assessing frailty in Chinese nursing home older adults: a comparison between the FRAIL-NH scale and frailty index. J Nutr Health Aging. 2019;23:291–8.CrossRef Ge F, Liu M, Tang S, Lu Y, Szanton SL. Assessing frailty in Chinese nursing home older adults: a comparison between the FRAIL-NH scale and frailty index. J Nutr Health Aging. 2019;23:291–8.CrossRef
26.
go back to reference Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K. A standard procedure for creating a frailty index. BMC Geriatr. 2008;24:1–10. Searle SD, Mitnitski A, Gahbauer EA, Gill TM, Rockwood K. A standard procedure for creating a frailty index. BMC Geriatr. 2008;24:1–10.
27.
go back to reference Hoover M, Rotermann M, Sanmartin C, Bernier J. Validation of an index to estimate the prevalence of frailty among community-dwelling seniors. Heal Reports. 2013;24:10–7. Hoover M, Rotermann M, Sanmartin C, Bernier J. Validation of an index to estimate the prevalence of frailty among community-dwelling seniors. Heal Reports. 2013;24:10–7.
28.
go back to reference Song X, Mitnitski A, Rockwood K. Prevalence and 10-year outcomes of frailty in older adults in relation to deficit accumulation. J Am Geriatr Soc. 2010;58:681–7.CrossRef Song X, Mitnitski A, Rockwood K. Prevalence and 10-year outcomes of frailty in older adults in relation to deficit accumulation. J Am Geriatr Soc. 2010;58:681–7.CrossRef
29.
go back to reference Saum KU, Dieffenbach AK, Müller H, Holleczek B, Hauer K, Brenner H. Frailty prevalence and 10-year survival in community-dwelling older adults: results from the ESTHER cohort study. Eur J Epidemiol. 2014;29:171–9.CrossRef Saum KU, Dieffenbach AK, Müller H, Holleczek B, Hauer K, Brenner H. Frailty prevalence and 10-year survival in community-dwelling older adults: results from the ESTHER cohort study. Eur J Epidemiol. 2014;29:171–9.CrossRef
30.
go back to reference Linden A. Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis. J Eval Clin Pract. 2010;12:132–9.CrossRef Linden A. Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis. J Eval Clin Pract. 2010;12:132–9.CrossRef
31.
go back to reference Nakas CT, Yiannoutsos CT. Ordered multiple-class ROC analysis with continuous measurements. Stat Med. 2004;23:3437–49.CrossRef Nakas CT, Yiannoutsos CT. Ordered multiple-class ROC analysis with continuous measurements. Stat Med. 2004;23:3437–49.CrossRef
32.
go back to reference Karakaya J, Akin S, Karagaoglu E, Gurlek A. The performance of hemoglobin A1c against fasting plasma glucose and oral glucose tolerance test in detecting prediabetes and diabetes. J Res Med Sci. 2014;19:1051–7.PubMedPubMedCentral Karakaya J, Akin S, Karagaoglu E, Gurlek A. The performance of hemoglobin A1c against fasting plasma glucose and oral glucose tolerance test in detecting prediabetes and diabetes. J Res Med Sci. 2014;19:1051–7.PubMedPubMedCentral
33.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef
34.
go back to reference Huang Zh-P. Mental health literacy of residents in Changsha, Xi’an, and Wuxi. Central South University; 2011. Huang Zh-P. Mental health literacy of residents in Changsha, Xi’an, and Wuxi. Central South University; 2011.
35.
go back to reference Wang P. The influence of the social participation of the urban elderly on their spiritual life satisfaction: taking Changsha city as an example. Central South University; 2012. Wang P. The influence of the social participation of the urban elderly on their spiritual life satisfaction: taking Changsha city as an example. Central South University; 2012.
Metadata
Title
Accessing the discriminatory performance of FRAIL-NH in two-class and three-class frailty and examining its agreement with the frailty index among nursing home residents in mainland China
Authors
Feng Ge
Weiwei Liu
Minhui Liu
Siyuan Tang
Yongjin Lu
Tianxue Hou
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Geriatrics / Issue 1/2019
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-019-1314-9

Other articles of this Issue 1/2019

BMC Geriatrics 1/2019 Go to the issue