Skip to main content
Top
Published in: BMC Geriatrics 1/2018

Open Access 01-12-2018 | Research Article

Deep learning based low-cost high-accuracy diagnostic framework for dementia using comprehensive neuropsychological assessment profiles

Authors: Hyun-Soo Choi, Jin Yeong Choe, Hanjoo Kim, Ji Won Han, Yeon Kyung Chi, Kayoung Kim, Jongwoo Hong, Taehyun Kim, Tae Hui Kim, Sungroh Yoon, Ki Woong Kim

Published in: BMC Geriatrics | Issue 1/2018

Login to get access

Abstract

Background

The conventional scores of the neuropsychological batteries are not fully optimized for diagnosing dementia despite their variety and abundance of information. To achieve low-cost high-accuracy diagnose performance for dementia using a neuropsychological battery, a novel framework is proposed using the response profiles of 2666 cognitively normal elderly individuals and 435 dementia patients who have participated in the Korean Longitudinal Study on Cognitive Aging and Dementia (KLOSCAD).

Methods

The key idea of the proposed framework is to propose a cost-effective and precise two-stage classification procedure that employed Mini Mental Status Examination (MMSE) as a screening test and the KLOSCAD Neuropsychological Assessment Battery as a diagnostic test using deep learning. In addition, an evaluation procedure of redundant variables is introduced to prevent performance degradation. A missing data imputation method is also presented to increase the robustness by recovering information loss. The proposed deep neural networks (DNNs) architecture for the classification is validated through rigorous evaluation in comparison with various classifiers.

Results

The k-nearest-neighbor imputation has been induced according to the proposed framework, and the proposed DNNs for two stage classification show the best accuracy compared to the other classifiers. Also, 49 redundant variables were removed, which improved diagnostic performance and suggested the potential of simplifying the assessment. Using this two-stage framework, we could get 8.06% higher diagnostic accuracy of dementia than MMSE alone and 64.13% less cost than KLOSCAD-N alone.

Conclusion

The proposed framework could be applied to general dementia early detection programs to improve robustness, preciseness, and cost-effectiveness.
Literature
2.
go back to reference Seo EH, Lee DY, Lee JH, Choo I, Kim JW, Kim SG, Park S, Shin JH, Do YJ, Yoon JC, Jhoo JH, Kim KW, Woo JI. Total scores of the cerad neuropsychological assessment battery: validation for mild cognitive impairment and dementia patients with diverse etiologies. Am J Geriatr Psychiatry. 2010; 18(9):801–9. https://doi.org/10.1097/JGP.0b013e3181cab764.CrossRef Seo EH, Lee DY, Lee JH, Choo I, Kim JW, Kim SG, Park S, Shin JH, Do YJ, Yoon JC, Jhoo JH, Kim KW, Woo JI. Total scores of the cerad neuropsychological assessment battery: validation for mild cognitive impairment and dementia patients with diverse etiologies. Am J Geriatr Psychiatry. 2010; 18(9):801–9. https://​doi.​org/​10.​1097/​JGP.​0b013e3181cab764​.CrossRef
7.
go back to reference Iavindrasana J, Cohen G, Depeursinge A, Müller H., Meyer R, Geissbuhler A. Clinical data mining: a review. IMIA Yearbook 2009: Closing the Loops in Biomedical Informatics. 2009; 18:121–33. Iavindrasana J, Cohen G, Depeursinge A, Müller H., Meyer R, Geissbuhler A. Clinical data mining: a review. IMIA Yearbook 2009: Closing the Loops in Biomedical Informatics. 2009; 18:121–33.
8.
go back to reference Han J, Kamber M, Pei J. Data Mining: Concepts and Techniques. 3rd ed.San Francisco: Morgan Kaufmann Publishers Inc.; 2011. Han J, Kamber M, Pei J. Data Mining: Concepts and Techniques. 3rd ed.San Francisco: Morgan Kaufmann Publishers Inc.; 2011.
12.
go back to reference Kwon S, Yoon S. Deepcci: End-to-end deep learning for chemical-chemical interaction prediction. ACM-BCB ’17. In: Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology,and Health Informatics. New York: ACM: 2017. p. 203–12. https://doi.org/10.1145/3107411.3107451. Kwon S, Yoon S. Deepcci: End-to-end deep learning for chemical-chemical interaction prediction. ACM-BCB ’17. In: Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology,and Health Informatics. New York: ACM: 2017. p. 203–12. https://​doi.​org/​10.​1145/​3107411.​3107451.
14.
go back to reference Lee B, Baek J, Park S, Yoon S. deeptarget: End-to-end learning framework for microrna target prediction using deep recurrent neural networks. BCB ’16. In: Proceedings of the 7th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. New York: ACM: 2016. p. 434–42. https://doi.org/10.1145/2975167.2975212. Lee B, Baek J, Park S, Yoon S. deeptarget: End-to-end learning framework for microrna target prediction using deep recurrent neural networks. BCB ’16. In: Proceedings of the 7th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. New York: ACM: 2016. p. 434–42. https://​doi.​org/​10.​1145/​2975167.​2975212.
17.
go back to reference Leighty RE. Statistical and data mining methodologies for behavioral analysis in transgenic mouse models of alzheimer’s disease: Parallels with human ad evaluation. 2009. Graduate Theses and Dissertations. https://scholarcommons.usf.edu/etd/3872. Leighty RE. Statistical and data mining methodologies for behavioral analysis in transgenic mouse models of alzheimer’s disease: Parallels with human ad evaluation. 2009. Graduate Theses and Dissertations. https://​scholarcommons.​usf.​edu/​etd/​3872.​
18.
go back to reference Maroco J, Silva D, Rodrigues A, Guerreiro M, Santana I, de Mendonca A. Data mining methods in the prediction of dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests. BMC Res Notes. 2011; 4:299. https://doi.org/10.1186/1756-0500-4-299.CrossRef Maroco J, Silva D, Rodrigues A, Guerreiro M, Santana I, de Mendonca A. Data mining methods in the prediction of dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests. BMC Res Notes. 2011; 4:299. https://​doi.​org/​10.​1186/​1756-0500-4-299.CrossRef
19.
go back to reference Lemos L. A data mining approach to predict conversion from mild cognitive impairment to alzheimer’s disease. 2012. Thesis. Lemos L. A data mining approach to predict conversion from mild cognitive impairment to alzheimer’s disease. 2012. Thesis.
21.
go back to reference Lee JH, Lee KU, Lee DY, Kim KW, Jhoo JH, Kim JH, Lee KH, Kim SY, Han SH, Woo JI. Development of the korean version of the consortium to establish a registry for alzheimer’s disease assessment packet (cerad-k): clinical and neuropsychological assessment batteries. J Gerontol B Psychol Sci Soc Sci. 2002; 57(1):47–53.CrossRef Lee JH, Lee KU, Lee DY, Kim KW, Jhoo JH, Kim JH, Lee KH, Kim SY, Han SH, Woo JI. Development of the korean version of the consortium to establish a registry for alzheimer’s disease assessment packet (cerad-k): clinical and neuropsychological assessment batteries. J Gerontol B Psychol Sci Soc Sci. 2002; 57(1):47–53.CrossRef
22.
23.
go back to reference Morris JC. The clinical dementia rating (cdr): current version and scoring rules. Neurology. 1993; 43(11):2412–4.CrossRef Morris JC. The clinical dementia rating (cdr): current version and scoring rules. Neurology. 1993; 43(11):2412–4.CrossRef
25.
go back to reference Wechsler D. Wechsler Memory Scale-Revised. New York: Psychological Corporation; 1987. Wechsler D. Wechsler Memory Scale-Revised. New York: Psychological Corporation; 1987.
26.
27.
go back to reference Royall DR, Cordes JA, Polk M. Clox: an executive clock drawing task. J Neurol Neurosurg Psychiatry. 1998; 64(5):588–94.CrossRef Royall DR, Cordes JA, Polk M. Clox: an executive clock drawing task. J Neurol Neurosurg Psychiatry. 1998; 64(5):588–94.CrossRef
28.
go back to reference Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB. Missing value estimation methods for dna microarrays. Bioinformatics. 2001; 17(6):520–5.CrossRef Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB. Missing value estimation methods for dna microarrays. Bioinformatics. 2001; 17(6):520–5.CrossRef
35.
go back to reference Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: A simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014; 15:1929–58. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: A simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014; 15:1929–58.
36.
go back to reference Ioffe S, Szegedy C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of Machine Learning Research. vol 37 In: Bach F, Blei D, editors. Proceedings of the 32nd International Conference on Machine Learning. Lille: PMLR: 2015. p. 448–46. http://proceedings.mlr.press/v37/ioffe15.html. Ioffe S, Szegedy C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of Machine Learning Research. vol 37 In: Bach F, Blei D, editors. Proceedings of the 32nd International Conference on Machine Learning. Lille: PMLR: 2015. p. 448–46. http://​proceedings.​mlr.​press/​v37/​ioffe15.​html.
39.
go back to reference Freund Y, Schapire RE. Experiments with a new boosting algorithm. In: ICML: 1996. p. 148–56. Freund Y, Schapire RE. Experiments with a new boosting algorithm. In: ICML: 1996. p. 148–56.
40.
go back to reference Breiman L. Bagging predictors. Mach Learn. 1996; 24(2):123–40. Breiman L. Bagging predictors. Mach Learn. 1996; 24(2):123–40.
42.
go back to reference Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995; 20(3):273–97. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995; 20(3):273–97.
43.
go back to reference McCullagh P. Generalized linear models. Eur J Oper Res. 1984; 16(3):285–92.CrossRef McCullagh P. Generalized linear models. Eur J Oper Res. 1984; 16(3):285–92.CrossRef
44.
go back to reference Chang C-C, Lin C-J. Libsvm: A library for support vector machines. ACM Trans Intell Syst Technol (TIST). 2011; 2(3):27. Chang C-C, Lin C-J. Libsvm: A library for support vector machines. ACM Trans Intell Syst Technol (TIST). 2011; 2(3):27.
45.
go back to reference Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH. The weka data mining software: an update. ACM SIGKDD Explor Newsl. 2009; 11(1):10–8.CrossRef Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH. The weka data mining software: an update. ACM SIGKDD Explor Newsl. 2009; 11(1):10–8.CrossRef
46.
go back to reference Brown G, Pocock A, Zhao M-J, Luján M.Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J Mach Learn Res. 2012; 13(1):27–66. Brown G, Pocock A, Zhao M-J, Luján M.Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J Mach Learn Res. 2012; 13(1):27–66.
47.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988:837–45.CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988:837–45.CrossRef
48.
go back to reference Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC. The mini-international neuropsychiatric interview (m.i.n.i.): the development and validation of a structured diagnostic psychiatric interview for dsm-iv and icd-10. J Clin Psychiatry. 1998; 59 Suppl 20:22–333457.PubMed Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, Hergueta T, Baker R, Dunbar GC. The mini-international neuropsychiatric interview (m.i.n.i.): the development and validation of a structured diagnostic psychiatric interview for dsm-iv and icd-10. J Clin Psychiatry. 1998; 59 Suppl 20:22–333457.PubMed
49.
go back to reference Association AP. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington: American Psychiatric Association; 1994. Association AP. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington: American Psychiatric Association; 1994.
50.
go back to reference Kim JW, Lee DY, Seo EH, Sohn BK, Park S, Choo I, Youn J, Jhoo JH, Kim KW, Woo JI. Improvement of dementia screening accuracy of mini-mental state examination by education-adjustment and supplementation of frontal assessment battery performance. J Korean Med Sci. 2013; 28(10):1522–8.CrossRef Kim JW, Lee DY, Seo EH, Sohn BK, Park S, Choo I, Youn J, Jhoo JH, Kim KW, Woo JI. Improvement of dementia screening accuracy of mini-mental state examination by education-adjustment and supplementation of frontal assessment battery performance. J Korean Med Sci. 2013; 28(10):1522–8.CrossRef
52.
go back to reference Samek W, Wiegand T, Müller K. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. CoRR abs/1708.08296. 2017. http://arxiv.org/abs/1708.08296. Samek W, Wiegand T, Müller K. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. CoRR abs/1708.08296. 2017. http://​arxiv.​org/​abs/​1708.​08296.​
Metadata
Title
Deep learning based low-cost high-accuracy diagnostic framework for dementia using comprehensive neuropsychological assessment profiles
Authors
Hyun-Soo Choi
Jin Yeong Choe
Hanjoo Kim
Ji Won Han
Yeon Kyung Chi
Kayoung Kim
Jongwoo Hong
Taehyun Kim
Tae Hui Kim
Sungroh Yoon
Ki Woong Kim
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2018
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-018-0915-z

Other articles of this Issue 1/2018

BMC Geriatrics 1/2018 Go to the issue