Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research Article

Development and validation of classifiers and variable subsets for predicting nursing home admission

Authors: Mikko Nuutinen, Riikka-Leena Leskelä, Ella Suojalehto, Anniina Tirronen, Vesa Komssi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

In previous years a substantial number of studies have identified statistically important predictors of nursing home admission (NHA). However, as far as we know, the analyses have been done at the population-level. No prior research has analysed the prediction accuracy of a NHA model for individuals.

Methods

This study is an analysis of 3056 longer-term home care customers in the city of Tampere, Finland. Data were collected from the records of social and health service usage and RAI-HC (Resident Assessment Instrument - Home Care) assessment system during January 2011 and September 2015. The aim was to find out the most efficient variable subsets to predict NHA for individuals and validate the accuracy. The variable subsets of predicting NHA were searched by sequential forward selection (SFS) method, a variable ranking metric and the classifiers of logistic regression (LR), support vector machine (SVM) and Gaussian naive Bayes (GNB). The validation of the results was guaranteed using randomly balanced data sets and cross-validation. The primary performance metrics for the classifiers were the prediction accuracy and AUC (average area under the curve).

Results

The LR and GNB classifiers achieved 78% accuracy for predicting NHA. The most important variables were RAI MAPLE (Method for Assigning Priority Levels), functional impairment (RAI IADL, Activities of Daily Living), cognitive impairment (RAI CPS, Cognitive Performance Scale), memory disorders (diagnoses G30-G32 and F00-F03) and the use of community-based health-service and prior hospital use (emergency visits and periods of care).

Conclusion

The accuracy of the classifier for individuals was high enough to convince the officials of the city of Tampere to integrate the predictive model based on the findings of this study as a part of home care information system. Further work need to be done to evaluate variables that are modifiable and responsive to interventions.
Literature
1.
go back to reference Hajek A, Brettschneider C, Lange C, Posselt T, Wiese B, Steinmann S, Weyerer S, Werle J, Pentzek M, Fuchs A, Stein J, Luck T, Bickel H, Mösch E, Wagner M, Jessen F, Maier W, Scherer M, Riedel-Heller SG, König HH, Group AS. Longitudinal predictors of institutionalization in old age. PLoS ONE. 2015; 10(12):1–11. doi:10.1371/journal.pone.0144203.CrossRef Hajek A, Brettschneider C, Lange C, Posselt T, Wiese B, Steinmann S, Weyerer S, Werle J, Pentzek M, Fuchs A, Stein J, Luck T, Bickel H, Mösch E, Wagner M, Jessen F, Maier W, Scherer M, Riedel-Heller SG, König HH, Group AS. Longitudinal predictors of institutionalization in old age. PLoS ONE. 2015; 10(12):1–11. doi:10.​1371/​journal.​pone.​0144203.CrossRef
3.
go back to reference Gnjidic D, Stanaway F, Cumming R, Waite L, Blyth F, Naganathan V, Handelsman DJ, Le Couteur DG. Mild cognitive impairment predicts institutionalization among older men: A population-based cohort study. PLoS ONE. 2012; 7(9):1–8. doi:10.1371/journal.pone.0046061.CrossRef Gnjidic D, Stanaway F, Cumming R, Waite L, Blyth F, Naganathan V, Handelsman DJ, Le Couteur DG. Mild cognitive impairment predicts institutionalization among older men: A population-based cohort study. PLoS ONE. 2012; 7(9):1–8. doi:10.​1371/​journal.​pone.​0046061.CrossRef
4.
go back to reference Eska K, Graessel E, Donath C, Schwarzkopf L, Lauterberg J, Holle R. Predictors of institutionalization of dementia patients in mild and moderate stages: A 4-year prospective analysis. Dement Geriatr Cogn Disord Extra. 2013; 3(1):426–45. doi:10.1159/000355079.CrossRef Eska K, Graessel E, Donath C, Schwarzkopf L, Lauterberg J, Holle R. Predictors of institutionalization of dementia patients in mild and moderate stages: A 4-year prospective analysis. Dement Geriatr Cogn Disord Extra. 2013; 3(1):426–45. doi:10.​1159/​000355079.CrossRef
5.
go back to reference Luppa M, Luck T, Matschinger H, König HH, Riedel-Heller SG. Predictors of nursing home admission of individuals without a dementia diagnosis before admission - results from the leipzig longitudinal study of the aged (leila 75+). BMC Health Serv Res. 2010; 10(1):1–8. doi:10.1186/1472-6963-10-186.CrossRef Luppa M, Luck T, Matschinger H, König HH, Riedel-Heller SG. Predictors of nursing home admission of individuals without a dementia diagnosis before admission - results from the leipzig longitudinal study of the aged (leila 75+). BMC Health Serv Res. 2010; 10(1):1–8. doi:10.​1186/​1472-6963-10-186.CrossRef
8.
go back to reference Dramé M, Lang P, Jolly D, Narbey D, Mahmoudi R, Lanièce I, Somme D, Gauvain J, Heitz D, Voisin T, de Wazières B, Gonthier R, Ankri J, Saint-Jean O, Jeandel C, Couturier P, Blanchard F, Novella J. Nursing home admission in elderly subjects with dementia: predictive factors and future challenges. J Am Med Dir Assoc. 2013; 13:17–20. doi:10.1016/j.jamda.2011.03.002. Dramé M, Lang P, Jolly D, Narbey D, Mahmoudi R, Lanièce I, Somme D, Gauvain J, Heitz D, Voisin T, de Wazières B, Gonthier R, Ankri J, Saint-Jean O, Jeandel C, Couturier P, Blanchard F, Novella J. Nursing home admission in elderly subjects with dementia: predictive factors and future challenges. J Am Med Dir Assoc. 2013; 13:17–20. doi:10.​1016/​j.​jamda.​2011.​03.​002.
11.
go back to reference von Bonsdorff M, Rantanen T, Laukkanen P, Suutama T, Heikkinen E. Mobility limitations and cognitive deficits as predictors of institutionalization among community-dwelling older people. Gerontology. 2006; 52(6):359–65. doi:10.1159/000094985.CrossRefPubMed von Bonsdorff M, Rantanen T, Laukkanen P, Suutama T, Heikkinen E. Mobility limitations and cognitive deficits as predictors of institutionalization among community-dwelling older people. Gerontology. 2006; 52(6):359–65. doi:10.​1159/​000094985.CrossRefPubMed
12.
go back to reference Chen C, Naidoo N, Er B, Cheong A, Fong NP, Tay CY, Chan KM, Tan BY, Menon E, Ee CH, Lee KK, Ng YS, Teo YY, Koh GCH. Factors associated with nursing home placement of all patients admitted for inpatient rehabilitation in singapore community hospitals from 1996 to 2005: A disease stratified analysis. PLoS ONE. 2013; 8(12):1–11. doi:10.1371/journal.pone.0082697.CrossRef Chen C, Naidoo N, Er B, Cheong A, Fong NP, Tay CY, Chan KM, Tan BY, Menon E, Ee CH, Lee KK, Ng YS, Teo YY, Koh GCH. Factors associated with nursing home placement of all patients admitted for inpatient rehabilitation in singapore community hospitals from 1996 to 2005: A disease stratified analysis. PLoS ONE. 2013; 8(12):1–11. doi:10.​1371/​journal.​pone.​0082697.CrossRef
13.
go back to reference Wergeland J, Selbæk G, Bergh S, Soederhamn U, Kirkevold.Predictors for nursing home admission and death among community-dwelling people 70 years and older who receive domiciliary care. Dement Geriatr Cogn Disord Extra. 2015; 5:320–9. doi:10.1159/000437382.CrossRef Wergeland J, Selbæk G, Bergh S, Soederhamn U, Kirkevold.Predictors for nursing home admission and death among community-dwelling people 70 years and older who receive domiciliary care. Dement Geriatr Cogn Disord Extra. 2015; 5:320–9. doi:10.​1159/​000437382.CrossRef
16.
17.
go back to reference Morris J, Fries B, Bernabei R, Steel K, Ikegami N, Carpenter I, Gilgen R, DuPasquier J, Frijters D, Henrard J, Hirdes J, Belleville-Taylor P, Berg K, Björkgren M, Gray I, Hawes C, Ljunggren G, Nonemaker S, Phillips C, Zimmerman D. interRAI Home Care (HC) Assessment Form and User’s Manual. USA: interRAI; 2009. Morris J, Fries B, Bernabei R, Steel K, Ikegami N, Carpenter I, Gilgen R, DuPasquier J, Frijters D, Henrard J, Hirdes J, Belleville-Taylor P, Berg K, Björkgren M, Gray I, Hawes C, Ljunggren G, Nonemaker S, Phillips C, Zimmerman D. interRAI Home Care (HC) Assessment Form and User’s Manual. USA: interRAI; 2009.
19.
go back to reference Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning. New York: Springer; 2009.CrossRef Hastie T, Tibshirani R, Friedman J. The Elements of Statistical Learning. New York: Springer; 2009.CrossRef
20.
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E. Scikit-learn: Machine Learning in Python. J Mach Learn Res. 2011; 12:2825–830. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E. Scikit-learn: Machine Learning in Python. J Mach Learn Res. 2011; 12:2825–830.
22.
go back to reference McCullagh P, Nelder JA. Generalized Linear Models, (Second Edition). London: London: Chapman & Hall; 1989, p. 500.CrossRef McCullagh P, Nelder JA. Generalized Linear Models, (Second Edition). London: London: Chapman & Hall; 1989, p. 500.CrossRef
23.
go back to reference Zhang H. The optimality of naive bayes In: Barr V, Markov Z, editors. Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference (FLAIRS 2004). Palo Alto: AAAI Press: 2004. Zhang H. The optimality of naive bayes In: Barr V, Markov Z, editors. Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference (FLAIRS 2004). Palo Alto: AAAI Press: 2004.
26.
go back to reference Cheng L, Zhu M, Poss JW, Hirdes JP, Glenny C, Stolee P. Opinion versus practice regarding the use of rehabilitation services in home care: an investigation using machine learning algorithms. BMC Med Inform Decis Mak. 2015; 15(1):1–11. doi:10.1186/s12911-015-0203-1.CrossRef Cheng L, Zhu M, Poss JW, Hirdes JP, Glenny C, Stolee P. Opinion versus practice regarding the use of rehabilitation services in home care: an investigation using machine learning algorithms. BMC Med Inform Decis Mak. 2015; 15(1):1–11. doi:10.​1186/​s12911-015-0203-1.CrossRef
31.
go back to reference Wilcox R. Basic Statistics: Understanding Conventional Methods and Modern Insights. New York: Oxford University Press; 2009. Wilcox R. Basic Statistics: Understanding Conventional Methods and Modern Insights. New York: Oxford University Press; 2009.
32.
go back to reference Roelen CA, Bültmann U, van Rhenen W, van der Klink JJ, Twisk JW, Heymans MW. External validation of two prediction models identifying employees at risk of high sickness absence: cohort study with 1-year follow-up. BMC Public Health. 2013; 13(1):1–8. doi:10.1186/1471-2458-13-105.CrossRef Roelen CA, Bültmann U, van Rhenen W, van der Klink JJ, Twisk JW, Heymans MW. External validation of two prediction models identifying employees at risk of high sickness absence: cohort study with 1-year follow-up. BMC Public Health. 2013; 13(1):1–8. doi:10.​1186/​1471-2458-13-105.CrossRef
34.
go back to reference Hirdes J, Poss J, Curtin-Telegdi N. The method for assigning priority levels (maple): A new decision-support system for allocating home care resources. BMC Med. 2008; 6(1):1–11. doi:10.1186/1741-7015-6-9.CrossRef Hirdes J, Poss J, Curtin-Telegdi N. The method for assigning priority levels (maple): A new decision-support system for allocating home care resources. BMC Med. 2008; 6(1):1–11. doi:10.​1186/​1741-7015-6-9.CrossRef
36.
39.
go back to reference Donnelly NA, Hickey A, Burns A, Murphy P, Doyle F. Systematic review and meta-analysis of the impact of carer stress on subsequent institutionalisation of community-dwelling older people. PLoS ONE. 2015; 10(6):1–19. doi:10.1371/journal.pone.0128213.CrossRef Donnelly NA, Hickey A, Burns A, Murphy P, Doyle F. Systematic review and meta-analysis of the impact of carer stress on subsequent institutionalisation of community-dwelling older people. PLoS ONE. 2015; 10(6):1–19. doi:10.​1371/​journal.​pone.​0128213.CrossRef
Metadata
Title
Development and validation of classifiers and variable subsets for predicting nursing home admission
Authors
Mikko Nuutinen
Riikka-Leena Leskelä
Ella Suojalehto
Anniina Tirronen
Vesa Komssi
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0442-4

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue