Skip to main content
Top
Published in: European Radiology 11/2023

12-05-2023 | Alzheimer's Disease | Neuro

Development and validation of an automatic classification algorithm for the diagnosis of Alzheimer’s disease using a high-performance interpretable deep learning network

Authors: Ho Young Park, Woo Hyun Shim, Chong Hyun Suh, Hwon Heo, Hyun Woo Oh, Jinyoung Kim, Jinkyeong Sung, Jae-Sung Lim, Jae-Hong Lee, Ho Sung Kim, Sang Joon Kim

Published in: European Radiology | Issue 11/2023

Login to get access

Abstract

Objectives

To develop and validate an automatic classification algorithm for diagnosing Alzheimer’s disease (AD) or mild cognitive impairment (MCI).

Methods and materials

This study evaluated a high-performance interpretable network algorithm (TabNet) and compared its performance with that of XGBoost, a widely used classifier. Brain segmentation was performed using a commercially approved software. TabNet and XGBoost were trained on the volumes or radiomics features of 102 segmented regions for classifying subjects into AD, MCI, or cognitively normal (CN) groups. The diagnostic performances of the two algorithms were compared using areas under the curves (AUCs). Additionally, 20 deep learning–based AD signature areas were investigated.

Results

Between December 2014 and March 2017, 161 AD, 153 MCI, and 306 CN cases were enrolled. Another 120 AD, 90 MCI, and 141 CN cases were included for the internal validation. Public datasets were used for external validation. TabNet with volume features had an AUC of 0.951 (95% confidence interval [CI], 0.947–0.955) for AD vs CN, which was similar to that of XGBoost (0.953 [95% CI, 0.951–0.955], p = 0.41). External validation revealed the similar performances of two classifiers using volume features (0.871 vs. 0.871, p = 0.86). Likewise, two algorithms showed similar performances with one another in classifying MCI. The addition of radiomics data did not improve the performance of TabNet. TabNet and XGBoost focused on the same 13/20 regions of interest, including the hippocampus, inferior lateral ventricle, and entorhinal cortex.

Conclusions

TabNet shows high performance in AD classification and detailed interpretation of the selected regions.

Clinical relevance statement

Using a high-performance interpretable deep learning network, the automatic classification algorithm assisted in accurate Alzheimer’s disease detection using 3D T1-weighted brain MRI and detailed interpretation of the selected regions.

Key Points

• MR volumetry data revealed that TabNet had a high diagnostic performance in differentiating Alzheimer’s disease (AD) from cognitive normal cases, which was comparable with that of XGBoost.
• The addition of radiomics data to the volume data did not improve the diagnostic performance of TabNet.
• Both TabNet and XGBoost selected the clinically meaningful regions of interest in AD, including the hippocampus, inferior lateral ventricle, and entorhinal cortex.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nichols E, Szoeke CE, Vollset SE et al (2019) Global, regional, and national burden of Alzheimer’s disease and other dementias, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol 18:88–106CrossRef Nichols E, Szoeke CE, Vollset SE et al (2019) Global, regional, and national burden of Alzheimer’s disease and other dementias, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol 18:88–106CrossRef
2.
go back to reference Albert MS, DeKosky ST, Dickson D et al (2011) The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:270–279CrossRefPubMedPubMedCentral Albert MS, DeKosky ST, Dickson D et al (2011) The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:270–279CrossRefPubMedPubMedCentral
3.
go back to reference Dubois B, Feldman HH, Jacova C et al (2007) Research criteria for the diagnosis of Alzheimer’s disease: revising the NINCDS–ADRDA criteria. Lancet Neurol 6:734–746CrossRefPubMed Dubois B, Feldman HH, Jacova C et al (2007) Research criteria for the diagnosis of Alzheimer’s disease: revising the NINCDS–ADRDA criteria. Lancet Neurol 6:734–746CrossRefPubMed
4.
go back to reference McKhann GM, Knopman DS, Chertkow H et al (2011) The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:263–269CrossRefPubMedPubMedCentral McKhann GM, Knopman DS, Chertkow H et al (2011) The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:263–269CrossRefPubMedPubMedCentral
5.
go back to reference Fink HA, Linskens EJ, Silverman PC et al (2020) Accuracy of biomarker testing for neuropathologically defined Alzheimer disease in older adults with dementia: a systematic review. Ann Intern Med 172:669–677CrossRefPubMed Fink HA, Linskens EJ, Silverman PC et al (2020) Accuracy of biomarker testing for neuropathologically defined Alzheimer disease in older adults with dementia: a systematic review. Ann Intern Med 172:669–677CrossRefPubMed
6.
7.
go back to reference Suh C, Shim W, Kim S et al (2020) Development and validation of a deep learning–based automatic brain segmentation and classification algorithm for Alzheimer disease using 3D T1-weighted volumetric images. AJNR Am J Neuroradiol 41:2227–2234 Suh C, Shim W, Kim S et al (2020) Development and validation of a deep learning–based automatic brain segmentation and classification algorithm for Alzheimer disease using 3D T1-weighted volumetric images. AJNR Am J Neuroradiol 41:2227–2234
8.
go back to reference Arık SO, Pfister T (2020) Tabnet: attentive interpretable tabular learning. arXiv:190807442v5 Arık SO, Pfister T (2020) Tabnet: attentive interpretable tabular learning. arXiv:190807442v5
10.
go back to reference Jack CR Jr, Albert MS, Knopman DS et al (2011) Introduction to the recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:257–262 Jack CR Jr, Albert MS, Knopman DS et al (2011) Introduction to the recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement 7:257–262
12.
go back to reference Fischl B (2012) FreeSurfer. Neuroimage 62:774–781 Fischl B (2012) FreeSurfer. Neuroimage 62:774–781
13.
go back to reference Van Griethuysen JJ, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Can Res 77:e104–e107CrossRef Van Griethuysen JJ, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Can Res 77:e104–e107CrossRef
14.
go back to reference Shwartz-Ziv R, Armon A (2022) Tabular data: deep learning is not all you need. Inf Fusion 81:84–90CrossRef Shwartz-Ziv R, Armon A (2022) Tabular data: deep learning is not all you need. Inf Fusion 81:84–90CrossRef
15.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRefPubMed DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRefPubMed
17.
go back to reference Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc Ser B (Methodol) 57:289–300 Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc Ser B (Methodol) 57:289–300
19.
go back to reference Kong H-J (2019) Managing unstructured big data in healthcare system. Healthc Inform Res 25:1–2 Kong H-J (2019) Managing unstructured big data in healthcare system. Healthc Inform Res 25:1–2
20.
go back to reference Jo T, Nho K, Saykin AJ (2019) Deep learning in Alzheimer’s disease: diagnostic classification and prognostic prediction using neuroimaging data. Front Aging Neurosci 20(11):220CrossRef Jo T, Nho K, Saykin AJ (2019) Deep learning in Alzheimer’s disease: diagnostic classification and prognostic prediction using neuroimaging data. Front Aging Neurosci 20(11):220CrossRef
21.
go back to reference Yang H, Xu H, Li Q et al (2019) Study of brain morphology change in Alzheimer’s disease and amnestic mild cognitive impairment compared with normal controls. Gen Psychiatry 32(2):e100005 Yang H, Xu H, Li Q et al (2019) Study of brain morphology change in Alzheimer’s disease and amnestic mild cognitive impairment compared with normal controls. Gen Psychiatry 32(2):e100005
22.
go back to reference Poulin SP, Dautoff R, Morris JC, Barrett LF, Dickerson BC, AsDN I (2011) Amygdala atrophy is prominent in early Alzheimer’s disease and relates to symptom severity. Psychiatry Res Neuroimaging 194:7–13CrossRef Poulin SP, Dautoff R, Morris JC, Barrett LF, Dickerson BC, AsDN I (2011) Amygdala atrophy is prominent in early Alzheimer’s disease and relates to symptom severity. Psychiatry Res Neuroimaging 194:7–13CrossRef
23.
go back to reference Choi JD, Moon Y, Kim H-J, Yim Y, Lee S, Moon W-J (2022) Choroid plexus volume and permeability at brain MRI within the Alzheimer disease clinical spectrum. Radiology 304(3):635–645CrossRefPubMed Choi JD, Moon Y, Kim H-J, Yim Y, Lee S, Moon W-J (2022) Choroid plexus volume and permeability at brain MRI within the Alzheimer disease clinical spectrum. Radiology 304(3):635–645CrossRefPubMed
24.
go back to reference Schippers MC, Bruinsma B, Gaastra M et al (2017) Deep brain stimulation of the nucleus accumbens core affects trait impulsivity in a baseline-dependent manner. Front Behav Neurosci 11:52CrossRefPubMedPubMedCentral Schippers MC, Bruinsma B, Gaastra M et al (2017) Deep brain stimulation of the nucleus accumbens core affects trait impulsivity in a baseline-dependent manner. Front Behav Neurosci 11:52CrossRefPubMedPubMedCentral
25.
go back to reference Pievani M, Bocchetta M, Boccardi M et al (2013) Striatal morphology in early-onset and late-onset Alzheimer’s disease: a preliminary study. Neurobiol Aging 34:1728–1739CrossRefPubMed Pievani M, Bocchetta M, Boccardi M et al (2013) Striatal morphology in early-onset and late-onset Alzheimer’s disease: a preliminary study. Neurobiol Aging 34:1728–1739CrossRefPubMed
26.
go back to reference Nie X, Sun Y, Wan S et al (2017) Subregional structural alterations in hippocampus and nucleus accumbens correlate with the clinical impairment in patients with Alzheimer’s disease clinical spectrum: parallel combining volume and vertex-based approach. Front Neurol 8:399CrossRefPubMedPubMedCentral Nie X, Sun Y, Wan S et al (2017) Subregional structural alterations in hippocampus and nucleus accumbens correlate with the clinical impairment in patients with Alzheimer’s disease clinical spectrum: parallel combining volume and vertex-based approach. Front Neurol 8:399CrossRefPubMedPubMedCentral
27.
go back to reference Feng Q, Ding Z (2020) MRI radiomics classification and prediction in Alzheimer’s disease and mild cognitive impairment: a review. Curr Alzheimer Res 17:297–309CrossRefPubMed Feng Q, Ding Z (2020) MRI radiomics classification and prediction in Alzheimer’s disease and mild cognitive impairment: a review. Curr Alzheimer Res 17:297–309CrossRefPubMed
28.
go back to reference Ranjbar S, Velgos SN, Dueck AC, Geda YE, Mitchell JR, AsDN I (2019) Brain MR radiomics to differentiate cognitive disorders. J Neuropsychiatry Clin Neurosci 31:210–219CrossRefPubMedPubMedCentral Ranjbar S, Velgos SN, Dueck AC, Geda YE, Mitchell JR, AsDN I (2019) Brain MR radiomics to differentiate cognitive disorders. J Neuropsychiatry Clin Neurosci 31:210–219CrossRefPubMedPubMedCentral
29.
go back to reference Achterberg HC, van der Lijn F, den Heijer T et al (2014) Hippocampal shape is predictive for the development of dementia in a normal, elderly population. Hum Brain Mapp 35:2359–2371CrossRefPubMed Achterberg HC, van der Lijn F, den Heijer T et al (2014) Hippocampal shape is predictive for the development of dementia in a normal, elderly population. Hum Brain Mapp 35:2359–2371CrossRefPubMed
30.
go back to reference Sørensen L, Igel C, Liv Hansen N et al (2016) Early detection of Alzheimer’s disease using M RI hippocampal texture. Hum Brain Mapp 37:1148–1161CrossRefPubMed Sørensen L, Igel C, Liv Hansen N et al (2016) Early detection of Alzheimer’s disease using M RI hippocampal texture. Hum Brain Mapp 37:1148–1161CrossRefPubMed
31.
go back to reference Won SY, Park YW, Park M, Ahn SS, Kim J, Lee S-K (2020) Quality reporting of radiomics analysis in mild cognitive impairment and Alzheimer’s disease: a roadmap for moving forward. Korean J Radiol 21:1345–1354CrossRefPubMedPubMedCentral Won SY, Park YW, Park M, Ahn SS, Kim J, Lee S-K (2020) Quality reporting of radiomics analysis in mild cognitive impairment and Alzheimer’s disease: a roadmap for moving forward. Korean J Radiol 21:1345–1354CrossRefPubMedPubMedCentral
32.
33.
go back to reference Ferreira D, Verhagen C, Hernández-Cabrera JA et al (2017) Distinct subtypes of Alzheimer’s disease based on patterns of brain atrophy: longitudinal trajectories and clinical applications. Sci Rep 7:1–13CrossRef Ferreira D, Verhagen C, Hernández-Cabrera JA et al (2017) Distinct subtypes of Alzheimer’s disease based on patterns of brain atrophy: longitudinal trajectories and clinical applications. Sci Rep 7:1–13CrossRef
Metadata
Title
Development and validation of an automatic classification algorithm for the diagnosis of Alzheimer’s disease using a high-performance interpretable deep learning network
Authors
Ho Young Park
Woo Hyun Shim
Chong Hyun Suh
Hwon Heo
Hyun Woo Oh
Jinyoung Kim
Jinkyeong Sung
Jae-Sung Lim
Jae-Hong Lee
Ho Sung Kim
Sang Joon Kim
Publication date
12-05-2023
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 11/2023
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-023-09708-8

Other articles of this Issue 11/2023

European Radiology 11/2023 Go to the issue