Skip to main content
Top
Published in: BMC Psychiatry 1/2018

Open Access 01-12-2018 | Research article

A new device-aided cognitive function test, User eXperience-Trail Making Test (UX-TMT), sensitively detects neuropsychological performance in patients with dementia and Parkinson’s disease

Authors: Naomi Kokubo, Yuma Yokoi, Yuji Saitoh, Miho Murata, Kazushi Maruo, Yoshitake Takebayashi, Issei Shinmei, Sadanobu Yoshimoto, Masaru Horikoshi

Published in: BMC Psychiatry | Issue 1/2018

Login to get access

Abstract

Background

A newer generation neuropsychological tests can take advantage of touch screen and mobile technology. We have developed a new Android application termed “User eXperience-Trail Making Test (UX-TMT)” for neurocognitive assessment and training. This study investigated the utility, including the reliability and the validity, of the UX-TMT as a screening test for cognitive decline in adults.

Methods

A total of 84 individuals aged 27–86 years were divided into three groups; healthy controls ([HC] n = 29), people with Parkinson’s disease (PD; n = 28), and people with mild cognitive impairment (MCI) and dementia (MCI&D; n = 27). We examined the distributions of the scores and the time required, and the effects of age and group on these distributions. We analyzed internal consistency and convergent validity in all samples and applied receiver operator characteristic (ROC) analysis to determine a cutoff score that could differentiate the MCI & D group from the HC group.

Results

97.6% of the participants completed all of the tasks, and the average total test time required for UX-TMT was 428.8 (± 109.1) s in the HC, 542.0 (± 168.7) s in the PD, and 777.5 (± 256.1) s in the MCI&D groups, respectively. The MCI&D group showed significantly lower UX-TMT scores and longer total time in completing the task than the HC group. In an ROC analysis, a score of 21 showed high sensitivity (.83) and specificity (.92), and the UX-TMT score plus age improved sensitivity to .96. Additionally, the UX-TMT scores showed significant correlation with the Mini-Mental State Examination (Japanese version) scores (r = .77, p = .001), and Cronbach’s alpha (.71–.83) indicated acceptable internal consistency.

Conclusion

The UX-TMT demonstrated high reliability and validity to detect cognitive decline in Japanese adults, highlighting its utility as a screening tool for epidemiological and clinical research.
Literature
1.
go back to reference United Nations: World population aging 2015. ISBN: 978-92-1-057854-7. United Nations: World population aging 2015. ISBN: 978-92-1-057854-7.
3.
go back to reference Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and meta-analysis. Alzheimers Dement. 2013;9:63–75.CrossRefPubMed Prince M, Bryce R, Albanese E, Wimo A, Ribeiro W, Ferri CP. The global prevalence of dementia: a systematic review and meta-analysis. Alzheimers Dement. 2013;9:63–75.CrossRefPubMed
4.
go back to reference Ferencz B, Gerristen L. Genetics and underlying pathology of dementia. Neuropsychol Rev. 2015;25:113–24.CrossRefPubMed Ferencz B, Gerristen L. Genetics and underlying pathology of dementia. Neuropsychol Rev. 2015;25:113–24.CrossRefPubMed
5.
go back to reference Adams HHH, Bruijn RFAG, Hofman A, Uitterlinden AG, Duijn CM, Vernooij MW, Koudstaal PJ, Ikram MA. Genetic risk of neurodegenerative diseases is associated with mild cognitive impairment and conversion to dementia. Alzheimers Dement. 2015;11:1277–85.CrossRefPubMed Adams HHH, Bruijn RFAG, Hofman A, Uitterlinden AG, Duijn CM, Vernooij MW, Koudstaal PJ, Ikram MA. Genetic risk of neurodegenerative diseases is associated with mild cognitive impairment and conversion to dementia. Alzheimers Dement. 2015;11:1277–85.CrossRefPubMed
6.
go back to reference Aerts L, Heffernan M, Kochan NA, Crawford JD, Draper B, Trollor JN, Sachdev PS, Brodaty H. Effects of MCI subtype and reversion on progression to dementia in a community sample. Neurology. 2017;88:1–8.CrossRef Aerts L, Heffernan M, Kochan NA, Crawford JD, Draper B, Trollor JN, Sachdev PS, Brodaty H. Effects of MCI subtype and reversion on progression to dementia in a community sample. Neurology. 2017;88:1–8.CrossRef
7.
go back to reference Petersen RS, Caraccio B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214–28.CrossRefPubMedPubMedCentral Petersen RS, Caraccio B, Brayne C, Gauthier S, Jelic V, Fratiglioni L. Mild cognitive impairment: a concept in evolution. J Intern Med. 2014;275(3):214–28.CrossRefPubMedPubMedCentral
8.
go back to reference Cheng YW, Chen TF, Chiu MJ. From mild cognitive impairment to subjective cognitive decline: conceptual and methodological evolution. Neuropsychiatr Dis Treat. 2017;13:491–8.CrossRefPubMedPubMedCentral Cheng YW, Chen TF, Chiu MJ. From mild cognitive impairment to subjective cognitive decline: conceptual and methodological evolution. Neuropsychiatr Dis Treat. 2017;13:491–8.CrossRefPubMedPubMedCentral
9.
go back to reference Dorsey ER, Constantinescu R, Thompson JP, Biglan KM, Holloway RG, Kieburtz K, Marshall FJ, Ravina BM, Schifitto G, Siderowf A, Tanner CM. Projected number of people with parkinson disease in the most populous nations, 2005 through 2030. Neurology. 2007;68:384–6.CrossRefPubMed Dorsey ER, Constantinescu R, Thompson JP, Biglan KM, Holloway RG, Kieburtz K, Marshall FJ, Ravina BM, Schifitto G, Siderowf A, Tanner CM. Projected number of people with parkinson disease in the most populous nations, 2005 through 2030. Neurology. 2007;68:384–6.CrossRefPubMed
10.
go back to reference Aarsland D, Creese B, Politis M, Chaudhuri KR, Ffytche DH, Weintraub D, et al. Cognitive decline in Parkinson disease. Nat Rev Neurol. 2017;13(4):217–31.CrossRefPubMedPubMedCentral Aarsland D, Creese B, Politis M, Chaudhuri KR, Ffytche DH, Weintraub D, et al. Cognitive decline in Parkinson disease. Nat Rev Neurol. 2017;13(4):217–31.CrossRefPubMedPubMedCentral
11.
go back to reference Litvan I, Goldman JG, Troster AI, Schmand BA, Weintraub D, Petersen RC, Mollenhauer B, Aarsland D, Kulisevsky J, Rodriguez-Oroz MC, Burn DJ, Barker RA, Murat E. Diagnostic criteria for mild cognitive impairment in Parkinson’s disease: movement disorder society task force guidelines. Mov Disord. 2012;27(3):349–56.CrossRefPubMedPubMedCentral Litvan I, Goldman JG, Troster AI, Schmand BA, Weintraub D, Petersen RC, Mollenhauer B, Aarsland D, Kulisevsky J, Rodriguez-Oroz MC, Burn DJ, Barker RA, Murat E. Diagnostic criteria for mild cognitive impairment in Parkinson’s disease: movement disorder society task force guidelines. Mov Disord. 2012;27(3):349–56.CrossRefPubMedPubMedCentral
12.
go back to reference Hoogland J, Boel JA, de Bie RMA, Geskus RB, Schmand BA, Dalrymple-Alford JC, Marras C, Adler CH, Goldman JG, Troster AI, Burn DJ, Litvan I, Geurtsen GJ. Mild Cognitive Impairment as a risk factor for parkinson’s disease dementia. 2017;32(7):1056–1065. Hoogland J, Boel JA, de Bie RMA, Geskus RB, Schmand BA, Dalrymple-Alford JC, Marras C, Adler CH, Goldman JG, Troster AI, Burn DJ, Litvan I, Geurtsen GJ. Mild Cognitive Impairment as a risk factor for parkinson’s disease dementia. 2017;32(7):1056–1065.
13.
go back to reference Emre M, Arsland D, Brown R, Burn DJ, Duyckaerts C, Mizuno Y, Broe GA, Cummings J, Dickson DW, Gauthier S, Goldman J, Goetz C, Korczyn A, Lass A, Levy R, Litvan I, McKeith I, Olanow W, Poewe W, Quinn N, Sampaio C, Tolosa E, Dubois B. Clinical diagnostic criteria for dementia associated with Parkinson’s disease. Mov Disord. 2007;22(12):1689–707.CrossRefPubMed Emre M, Arsland D, Brown R, Burn DJ, Duyckaerts C, Mizuno Y, Broe GA, Cummings J, Dickson DW, Gauthier S, Goldman J, Goetz C, Korczyn A, Lass A, Levy R, Litvan I, McKeith I, Olanow W, Poewe W, Quinn N, Sampaio C, Tolosa E, Dubois B. Clinical diagnostic criteria for dementia associated with Parkinson’s disease. Mov Disord. 2007;22(12):1689–707.CrossRefPubMed
14.
go back to reference Pedersen KF, Larsen JP, Tysnes OB, Alves G. Natural course of mild cognitive impairment in Parkinson disease. Neurology. 2017;88:767–74.CrossRefPubMed Pedersen KF, Larsen JP, Tysnes OB, Alves G. Natural course of mild cognitive impairment in Parkinson disease. Neurology. 2017;88:767–74.CrossRefPubMed
15.
go back to reference Brookmeyer R, Johnson E, Graham KZ, Arrighi HM. Forecasting the global burden of Alzheimer’s disease. Alzheimers Dement. 2007;3:186–91.CrossRefPubMed Brookmeyer R, Johnson E, Graham KZ, Arrighi HM. Forecasting the global burden of Alzheimer’s disease. Alzheimers Dement. 2007;3:186–91.CrossRefPubMed
16.
go back to reference Baumgart M, Snyder HM, Carrillo MC, Sam F, Kim H, Johns H. Summary of the evidence on risk factors for cognitive decline and dementia: a population-based perspective. Alzheimers Dement. 2015;11(6):718–26.CrossRefPubMed Baumgart M, Snyder HM, Carrillo MC, Sam F, Kim H, Johns H. Summary of the evidence on risk factors for cognitive decline and dementia: a population-based perspective. Alzheimers Dement. 2015;11(6):718–26.CrossRefPubMed
17.
go back to reference Ngandu T, Lehtisalo J, Solomon A, Levalahti E, Ahtiluoto S, Antikainen R, Backman L, Hanninen T, Jula A, Laatikainen T, Lindstorm J, Mangialasche F, Paajanen T, Pajala S, Peltonen M, Rauramaa R, Stigsdotter-Neely A, Stranberg T, Tuomilehto J, Soininen H, Kivipelto M. A 2 year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet. 2015;385(9984):2255–63.CrossRefPubMed Ngandu T, Lehtisalo J, Solomon A, Levalahti E, Ahtiluoto S, Antikainen R, Backman L, Hanninen T, Jula A, Laatikainen T, Lindstorm J, Mangialasche F, Paajanen T, Pajala S, Peltonen M, Rauramaa R, Stigsdotter-Neely A, Stranberg T, Tuomilehto J, Soininen H, Kivipelto M. A 2 year multidomain intervention of diet, exercise, cognitive training, and vascular risk monitoring versus control to prevent cognitive decline in at-risk elderly people (FINGER): a randomised controlled trial. Lancet. 2015;385(9984):2255–63.CrossRefPubMed
18.
go back to reference Svenningsson P, Westman E, Bllard C, Aarsland D. Cognitive impairment in patients with Parkinson's disease: diagnosis, biomarkers, and treatment. Lancet Neurol. 2012;11:697–707.CrossRefPubMed Svenningsson P, Westman E, Bllard C, Aarsland D. Cognitive impairment in patients with Parkinson's disease: diagnosis, biomarkers, and treatment. Lancet Neurol. 2012;11:697–707.CrossRefPubMed
19.
go back to reference Leung IHK, Walton CC, Lewis SJG, Valenzuela M, Lampit A. Cognitive training in Parkinson disease: a systematic review and meta-analysis. Neurology. 2015;85(21):1843–51.CrossRefPubMedPubMedCentral Leung IHK, Walton CC, Lewis SJG, Valenzuela M, Lampit A. Cognitive training in Parkinson disease: a systematic review and meta-analysis. Neurology. 2015;85(21):1843–51.CrossRefPubMedPubMedCentral
20.
go back to reference Honda M, Hashimoto K, Miyamura K, Goto H, Abo M. Validity and reliability of a computerized cognitive assessment tool ‘higher brain functional balancer’ for healthy elderly people. Jpn. J Cogn Neurosci. 2010;12(3–4):191–7. Honda M, Hashimoto K, Miyamura K, Goto H, Abo M. Validity and reliability of a computerized cognitive assessment tool ‘higher brain functional balancer’ for healthy elderly people. Jpn. J Cogn Neurosci. 2010;12(3–4):191–7.
21.
go back to reference Onoda K, Hamano T, Nabika Y, Aoyama A, Takayoshi H, Nakagawa T, Ishihara M, Mitaki S, Yamaguchi T, Oguro H, Shiwaku K, Yamaguchi S. Validation of a new mass screening tool for cognitive impairment: cognitive assessment for dementia, iPad version. Clin Interv Aging. 2013;8:353–60.CrossRefPubMedPubMedCentral Onoda K, Hamano T, Nabika Y, Aoyama A, Takayoshi H, Nakagawa T, Ishihara M, Mitaki S, Yamaguchi T, Oguro H, Shiwaku K, Yamaguchi S. Validation of a new mass screening tool for cognitive impairment: cognitive assessment for dementia, iPad version. Clin Interv Aging. 2013;8:353–60.CrossRefPubMedPubMedCentral
28.
go back to reference Kokubo N, Atsumi R, Kawakubo R, Goto K, Shibata N, Taira M, Morohoshi S, Yoshimoto S Asano K, Aoki H. Development of android application “user eXperience-trail making test: UX-TMT” for the neurocognitive assessment and training through medicine engineering collaboration. In: The 1st annual meeting for cognitive enhancement in psychiatric disorders; 2015. in Japanese. Kokubo N, Atsumi R, Kawakubo R, Goto K, Shibata N, Taira M, Morohoshi S, Yoshimoto S Asano K, Aoki H. Development of android application “user eXperience-trail making test: UX-TMT” for the neurocognitive assessment and training through medicine engineering collaboration. In: The 1st annual meeting for cognitive enhancement in psychiatric disorders; 2015. in Japanese.
29.
go back to reference Melnick ER, Hess EP, Guo G, Breslin M, Lopez K, Pavlo AJ, Abujarad F, Powsner SM, Post LA. Patient-centered decision support: formative usability evaluation of integrated clinical decision support with a patient decision aid for minor head injury in the emergency department. J Med Internet Res. 2017;19(5):e174.CrossRefPubMedPubMedCentral Melnick ER, Hess EP, Guo G, Breslin M, Lopez K, Pavlo AJ, Abujarad F, Powsner SM, Post LA. Patient-centered decision support: formative usability evaluation of integrated clinical decision support with a patient decision aid for minor head injury in the emergency department. J Med Internet Res. 2017;19(5):e174.CrossRefPubMedPubMedCentral
32.
go back to reference Sugishita M, Hemmi I, Takeuchi T. Reexamination of the validity and reliability of the Japanese version of the mini-mental state examination (MMSE-J). Japanese Journal of Cognitive Neuroscience. 2016;18:168–83. (in Japanese) Sugishita M, Hemmi I, Takeuchi T. Reexamination of the validity and reliability of the Japanese version of the mini-mental state examination (MMSE-J). Japanese Journal of Cognitive Neuroscience. 2016;18:168–83. (in Japanese)
33.
go back to reference Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.CrossRefPubMed Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.CrossRefPubMed
34.
go back to reference Suzuki H, Fujiwara Y. Development of the Japanese version of Montreal cognitive assessment (MoCA) and the utility. Japanese Journal of Geriatric Psychiatry. 2010;21(2):198–202. (in Japanese) Suzuki H, Fujiwara Y. Development of the Japanese version of Montreal cognitive assessment (MoCA) and the utility. Japanese Journal of Geriatric Psychiatry. 2010;21(2):198–202. (in Japanese)
35.
go back to reference Ware J Jr, Kosinski M, Keller SD. A 12-item short form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–33.CrossRefPubMed Ware J Jr, Kosinski M, Keller SD. A 12-item short form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–33.CrossRefPubMed
36.
go back to reference Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.CrossRefPubMed Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54:1063–70.CrossRefPubMed
37.
go back to reference Kawahito J, Ohtsuka Y, Kaida K, Nakata A. Reliability and validity of the Japanese version of 20-item positive and negative affect schedule. Hiroshima psychological research. 2011;11:225–40. (in Japanese) Kawahito J, Ohtsuka Y, Kaida K, Nakata A. Reliability and validity of the Japanese version of 20-item positive and negative affect schedule. Hiroshima psychological research. 2011;11:225–40. (in Japanese)
39.
go back to reference Seelye A, Mattek N, Reynolds C, Sharma N, Wild K, Kaye J. The Survey for Memory, Attention, and Reaction Time (SMART): A Brief Online Personal Computing Based Cognitive Assessment for Healthy Aging and Mild Cognitive Impairment. Abstract ID: a18921. London: Alzheimer’s Association International Conference; 2017. https://www.alz.org/aaic/about/london.asp Seelye A, Mattek N, Reynolds C, Sharma N, Wild K, Kaye J. The Survey for Memory, Attention, and Reaction Time (SMART): A Brief Online Personal Computing Based Cognitive Assessment for Healthy Aging and Mild Cognitive Impairment. Abstract ID: a18921. London: Alzheimer’s Association International Conference; 2017. https://​www.​alz.​org/​aaic/​about/​london.​asp
40.
41.
go back to reference Pedraza O, Clark JH, O’Bryant SE, Smith GE, Ivnik RJ, Graff-Radforf NR, Willis FB, Petersen RC, Lucas JA. Diagnostic validity of age- and education-corrections for the mini-mental state examination (MMSE) in African American elders. J Am Geriatr Soc. 2012;60(2):328–31.CrossRefPubMed Pedraza O, Clark JH, O’Bryant SE, Smith GE, Ivnik RJ, Graff-Radforf NR, Willis FB, Petersen RC, Lucas JA. Diagnostic validity of age- and education-corrections for the mini-mental state examination (MMSE) in African American elders. J Am Geriatr Soc. 2012;60(2):328–31.CrossRefPubMed
42.
go back to reference Piccinin AM, Terrera GM, Clouston S, Reynolds CA, Thorvaldsson V, Deary IJ, Deeg DJH, Johansson B, Mackinnon A, Spiro A III, Starr JM, Skoog I, Hofer SM. Coordinated analysis of age, sex, and education effects on change in MMSE scores. Psychological Sciences and Social Sciences. 2013;68(3):374–90.CrossRefPubMed Piccinin AM, Terrera GM, Clouston S, Reynolds CA, Thorvaldsson V, Deary IJ, Deeg DJH, Johansson B, Mackinnon A, Spiro A III, Starr JM, Skoog I, Hofer SM. Coordinated analysis of age, sex, and education effects on change in MMSE scores. Psychological Sciences and Social Sciences. 2013;68(3):374–90.CrossRefPubMed
43.
go back to reference Freitas S, Simone MR, Alves L, Santana I. The relevance of sociodemographic and health variables on MMSE normative data. Applied Neuropsychology: Adult. 2015;22:311–9.CrossRef Freitas S, Simone MR, Alves L, Santana I. The relevance of sociodemographic and health variables on MMSE normative data. Applied Neuropsychology: Adult. 2015;22:311–9.CrossRef
44.
go back to reference Zawadka-Kunikowska M, Zalewski P, Klawe JJ, Pawlak J, Tafil-Klawe M, Kedziora-Kornatowska K, Newton JL. Age-related changes in cognitive function and postural control in Parkinson's disease. Aging Clin Exp Res. 2014;26:505–10.CrossRefPubMed Zawadka-Kunikowska M, Zalewski P, Klawe JJ, Pawlak J, Tafil-Klawe M, Kedziora-Kornatowska K, Newton JL. Age-related changes in cognitive function and postural control in Parkinson's disease. Aging Clin Exp Res. 2014;26:505–10.CrossRefPubMed
45.
go back to reference Hauser RA, Stocchi F, Rascol O, Huyck SB, Capece R, Ho TW, Sklar P, Lines C, Michelson D, Hewitt D. Preladenant as an adjunctive therapy with levodopa in parkinson disease. Two randomized clinical trials and lessons learned. JAMA neurol. 2015;72(12):1491–500.CrossRefPubMed Hauser RA, Stocchi F, Rascol O, Huyck SB, Capece R, Ho TW, Sklar P, Lines C, Michelson D, Hewitt D. Preladenant as an adjunctive therapy with levodopa in parkinson disease. Two randomized clinical trials and lessons learned. JAMA neurol. 2015;72(12):1491–500.CrossRefPubMed
46.
go back to reference Ahmad F, Jhajj AK, Stewart DE, Burghardt M, Bierman AS. Single item measures of self-rated mental health: a scoping review. BMC Health Serv Res. 2014;14:398.CrossRefPubMedPubMedCentral Ahmad F, Jhajj AK, Stewart DE, Burghardt M, Bierman AS. Single item measures of self-rated mental health: a scoping review. BMC Health Serv Res. 2014;14:398.CrossRefPubMedPubMedCentral
47.
go back to reference Jenkins A, Lindsay S, Eslambolchilar P, Thornton IM, Tales A. Administering cognitive tests through touch screen tablet devices: potential issues. J Alzheimers Dis. 2016;54(3):1169–82.CrossRefPubMed Jenkins A, Lindsay S, Eslambolchilar P, Thornton IM, Tales A. Administering cognitive tests through touch screen tablet devices: potential issues. J Alzheimers Dis. 2016;54(3):1169–82.CrossRefPubMed
Metadata
Title
A new device-aided cognitive function test, User eXperience-Trail Making Test (UX-TMT), sensitively detects neuropsychological performance in patients with dementia and Parkinson’s disease
Authors
Naomi Kokubo
Yuma Yokoi
Yuji Saitoh
Miho Murata
Kazushi Maruo
Yoshitake Takebayashi
Issei Shinmei
Sadanobu Yoshimoto
Masaru Horikoshi
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2018
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-018-1795-7

Other articles of this Issue 1/2018

BMC Psychiatry 1/2018 Go to the issue