Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

Validation of the JEN frailty index in the National Long-Term Care Survey community population: identifying functionally impaired older adults from claims data

Authors: Bruce Kinosian, Darryl Wieland, Xiliang Gu, Eric Stallard, Ciaran S. Phibbs, Orna Intrator

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Use of a claims-based index to identify persons with physical function impairment and at risk for long-term institutionalization would facilitate population health and comparative effectiveness research. The JEN Frailty Index [JFI] is comprised of diagnosis domains representing impairments and multimorbid clusters with high long-term institutionalization [LTI] risk. We test the index’s discrimination of activities-of-daily-living [ADL] dependency and 1-year LTI and mortality in a nationally representative sample of over 12,000 Medicare beneficiaries, and compare long-term community survival stratified by ADL and JFI.

Methods

2004 U.S. National Long-Term Care Survey data were linked to Medicare, Minimum Data Set, Veterans Health Administration files and vital statistics. ADL dependencies, JFI score, age and sex were measured at baseline survey. ADL and JFI groups were cross-tabulated generating likelihood ratios and classification statistics. Logistic regression compared discrimination (areas under receiver operating characteristic curves), multivariable calibration and accuracy of the JFI and, separately, ADLs, in predicting 1-year outcomes. Hall-Wellner bands facilitated contrasts of JFI- and ADL-stratified 5-year community survival.

Results

Likelihood ratios rose evenly across JFI risk categories. Areas under the curves of functional dependency at ≥3 and ≥ 2 for JFI, age and sex models were 0.807 [95% c.i.: 0.795, 0.819] and 0.812 [0.801, 0.822], respectively. The area under the LTI curve for JFI and age (0.781 [0.747, 0.815]) discriminated less well than the ADL-based model (0.829 [0.799, 0.860]). Community survival separated by JFI strata was comparable to ADL strata.

Conclusions

The JEN Frailty Index with demographic covariates is a valid claims-based measure of concurrent activities-of-daily-living impairments and future long-term institutionalization risk in older populations lacking functional information.
Appendix
Available only for authorised users
Footnotes
1
Difference due to 198 exclusions of prevalent NH/LTI cases at baseline interview and deaths in the first quarter of follow-up.
 
2
Sensitivity (sens) and specificity (spec) as percentages with 95% confidence intervals; P/NPV = positive and negative predictive values.
 
3
The AUC indicates the discrimination of the prediction model; the Hosmer-Lemeshow χ2 is a measure of the fit of data to the model, or calibration (higher p-values of the statistic indicating better calibration); the Brier score and pseudo-R2 assess overall performance (Brier scores range from 0 to 1, lower scores indicating better performance).
 
4
Excludes prevalent LTI cases and deaths.
 
5
Cohort denominator includes persons who died in first quarter. All subjects were followed through the third quarter of the fifth year.
 
Literature
1.
go back to reference Collard RM, Boter H, Schoevers RA, et al. Prevalence of frailty in community-dwelling older persons: a systematic review. J Am Geriatr Soc. 2012;60:1487–92.CrossRef Collard RM, Boter H, Schoevers RA, et al. Prevalence of frailty in community-dwelling older persons: a systematic review. J Am Geriatr Soc. 2012;60:1487–92.CrossRef
2.
go back to reference Clegg A, Young J, Illife S, et al. Frailty in elderly people. Lancet. 2013;381:752–62.CrossRef Clegg A, Young J, Illife S, et al. Frailty in elderly people. Lancet. 2013;381:752–62.CrossRef
3.
go back to reference Morley JE, Vellas B, Abellan van Kan G, et al. Frailty consensus: a call to action. JAMDA. 2013;14:392–7.PubMed Morley JE, Vellas B, Abellan van Kan G, et al. Frailty consensus: a call to action. JAMDA. 2013;14:392–7.PubMed
4.
go back to reference Buta BJ, Walston JD, Godino JG, et al. Frailty assessment instruments: systematic characterization of the uses and contexts of highly-cited instruments. Ageing Res Rev. 2016;26:53–61.CrossRef Buta BJ, Walston JD, Godino JG, et al. Frailty assessment instruments: systematic characterization of the uses and contexts of highly-cited instruments. Ageing Res Rev. 2016;26:53–61.CrossRef
5.
go back to reference Wieland D, Ferrucci L. Multidimensional geriatric assessment: Back to the future. J Gerontol A Biol Sci Med Sci. 2008;63:272–4.CrossRef Wieland D, Ferrucci L. Multidimensional geriatric assessment: Back to the future. J Gerontol A Biol Sci Med Sci. 2008;63:272–4.CrossRef
6.
go back to reference Kautter J, Ingber M, Pope G. Medicare risk adjustment for the frail elderly. Health Care Financ Rev. 2008;30(2):83–93.PubMedPubMedCentral Kautter J, Ingber M, Pope G. Medicare risk adjustment for the frail elderly. Health Care Financ Rev. 2008;30(2):83–93.PubMedPubMedCentral
7.
go back to reference Rockwood K. Screening for grades of frailty using electronic health records: where do we go from here? Age Ageing. 2016;45:328–9.CrossRef Rockwood K. Screening for grades of frailty using electronic health records: where do we go from here? Age Ageing. 2016;45:328–9.CrossRef
8.
go back to reference Kan HJ, Kharrazi H, Leff B, et al. Defining and assessing geriatric risk factors and associated health care utilization among older adults using claims and electronic health records. Med Care. 2018;56:233–9.CrossRef Kan HJ, Kharrazi H, Leff B, et al. Defining and assessing geriatric risk factors and associated health care utilization among older adults using claims and electronic health records. Med Care. 2018;56:233–9.CrossRef
9.
go back to reference JEN Associates. MassHealth senior care options program evaluation: pre-SCO enrollment period and post-SCO enrollment CY2005 nursing home entry rate and frailty level comparisons. Boston: Massachusetts Executive Office of Health and Human Services; 2008. JEN Associates. MassHealth senior care options program evaluation: pre-SCO enrollment period and post-SCO enrollment CY2005 nursing home entry rate and frailty level comparisons. Boston: Massachusetts Executive Office of Health and Human Services; 2008.
10.
go back to reference JEN Associates. Massachusetts PACE evaluation: nursing home residency summary report. Boston: Massachusetts Executive Office of Health and Human Services; 2014. JEN Associates. Massachusetts PACE evaluation: nursing home residency summary report. Boston: Massachusetts Executive Office of Health and Human Services; 2014.
11.
go back to reference De Jonge E, Jamshed K, Gilden D, et al. Effects of home-based primary care on Medicare costs in high-risk elders. J Am Geriatr Soc. 2014;62:1825–31.CrossRef De Jonge E, Jamshed K, Gilden D, et al. Effects of home-based primary care on Medicare costs in high-risk elders. J Am Geriatr Soc. 2014;62:1825–31.CrossRef
13.
go back to reference JEN Associates. A brief introduction to the JEN frailty index (video). Online: www.jen.com. Accessed 2 May 2016. JEN Associates. A brief introduction to the JEN frailty index (video). Online: www.​jen.​com. Accessed 2 May 2016.
15.
go back to reference Kinosian B, Stallard E, Wieland D. Projected use of long term care services by enrolled veterans. Gerontologist. 2007;47:356–64.CrossRef Kinosian B, Stallard E, Wieland D. Projected use of long term care services by enrolled veterans. Gerontologist. 2007;47:356–64.CrossRef
16.
go back to reference Intrator O, Grabowski D, Zinn J, et al. Hospitalizations of nursing home residents: the effects of states’ Medicaid payment and bed-hold policies. Health Serv Res. 2007;42(4):1651–71.CrossRef Intrator O, Grabowski D, Zinn J, et al. Hospitalizations of nursing home residents: the effects of states’ Medicaid payment and bed-hold policies. Health Serv Res. 2007;42(4):1651–71.CrossRef
18.
go back to reference Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology. 2010;21(1):128–38.CrossRef Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology. 2010;21(1):128–38.CrossRef
19.
go back to reference Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997;16(9):965–80.CrossRef Hosmer DW, Hosmer T, Le Cessie S, Lemeshow S. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997;16(9):965–80.CrossRef
20.
go back to reference Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26(6):565–74.CrossRef Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26(6):565–74.CrossRef
21.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing areas under two or more correlated receiver operating characteristic curves: a non-parametric approach. Biometrics. 1988;44:837–45.CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing areas under two or more correlated receiver operating characteristic curves: a non-parametric approach. Biometrics. 1988;44:837–45.CrossRef
22.
go back to reference Demler OV, Pencina MJ, D’Agostino RB. Misuse of DeLong test to compare AUCs for nested models. Stat Med. 2012;31:2577–87.CrossRef Demler OV, Pencina MJ, D’Agostino RB. Misuse of DeLong test to compare AUCs for nested models. Stat Med. 2012;31:2577–87.CrossRef
24.
go back to reference Groff AC, Colla CH, Lee TH. Days spent at home—a patient-centered goal and outcome. N Engl J Med. 2016;375:1610–3.CrossRef Groff AC, Colla CH, Lee TH. Days spent at home—a patient-centered goal and outcome. N Engl J Med. 2016;375:1610–3.CrossRef
25.
go back to reference Drubbel I, de Wit NJ, Bleijenberg N, et al. Prediction of adverse health outcomes in older people using a frailty index based on routine primary care data. J Gerontol A Biol Sci Med Sci. 2013;68:301–8.CrossRef Drubbel I, de Wit NJ, Bleijenberg N, et al. Prediction of adverse health outcomes in older people using a frailty index based on routine primary care data. J Gerontol A Biol Sci Med Sci. 2013;68:301–8.CrossRef
26.
go back to reference Clegg A, Bates C, Young J, et al. Development and validation of an electronic frailty index using routine primary care electronic health record data. Age Ageing. 2016;45:353–60.CrossRef Clegg A, Bates C, Young J, et al. Development and validation of an electronic frailty index using routine primary care electronic health record data. Age Ageing. 2016;45:353–60.CrossRef
27.
go back to reference Faurot KR, Funk MJ, Pate V, et al. Using claims data to predict dependency in activities of daily living as a proxy for frailty. Pharmacoepidemiol Drug Saf. 2015;24:59–66.CrossRef Faurot KR, Funk MJ, Pate V, et al. Using claims data to predict dependency in activities of daily living as a proxy for frailty. Pharmacoepidemiol Drug Saf. 2015;24:59–66.CrossRef
28.
go back to reference Segal JB, Chang H-Y, Du Y, et al. Development of a claims-based frailty indicator anchored to a well-established frailty phenotype. Med Care. 2017;55:716–22.CrossRef Segal JB, Chang H-Y, Du Y, et al. Development of a claims-based frailty indicator anchored to a well-established frailty phenotype. Med Care. 2017;55:716–22.CrossRef
30.
go back to reference Kim DH, Schneeweiss S, Glynn RJ, et al. Measuring frailty in Medicare data: development and validation of a claims-based frailty index. J Gerontol A Biol Sci Med Sci. 2018;73:280–7. Kim DH, Schneeweiss S, Glynn RJ, et al. Measuring frailty in Medicare data: development and validation of a claims-based frailty index. J Gerontol A Biol Sci Med Sci. 2018;73:280–7.
31.
go back to reference Kim DH, Schneeweiss S. Measuring frailty using claims data for pharmacoepidemiologic studies of mortality in older adults: evidence and recommendations. Pharmacoepidemiol Drug Saf. 2014;23:891–901.CrossRef Kim DH, Schneeweiss S. Measuring frailty using claims data for pharmacoepidemiologic studies of mortality in older adults: evidence and recommendations. Pharmacoepidemiol Drug Saf. 2014;23:891–901.CrossRef
32.
go back to reference Searle SD, Mitnitski A, Gahbauer EA, et al. A standard procedure for creating a frailty index. BMC Geriatr. 2008;8:24.CrossRef Searle SD, Mitnitski A, Gahbauer EA, et al. A standard procedure for creating a frailty index. BMC Geriatr. 2008;8:24.CrossRef
33.
go back to reference Fried LP, Tangen CM, Walston J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Med Sci. 2001;56:M145–56.CrossRef Fried LP, Tangen CM, Walston J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Med Sci. 2001;56:M145–56.CrossRef
Metadata
Title
Validation of the JEN frailty index in the National Long-Term Care Survey community population: identifying functionally impaired older adults from claims data
Authors
Bruce Kinosian
Darryl Wieland
Xiliang Gu
Eric Stallard
Ciaran S. Phibbs
Orna Intrator
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3689-2

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue