Skip to main content
Top
Published in: Journal of NeuroVirology 1/2021

01-02-2021 | Magnetic Resonance Imaging

Machine learning prediction of neurocognitive impairment among people with HIV using clinical and multimodal magnetic resonance imaging data

Authors: Yunan Xu, Yizi Lin, Ryan P. Bell, Sheri L. Towe, John M. Pearson, Tauseef Nadeem, Cliburn Chan, Christina S. Meade

Published in: Journal of NeuroVirology | Issue 1/2021

Login to get access

Abstract

Diagnosis of HIV-associated neurocognitive impairment (NCI) continues to be a clinical challenge. The purpose of this study was to develop a prediction model for NCI among people with HIV using clinical- and magnetic resonance imaging (MRI)-derived features. The sample included 101 adults with chronic HIV disease. NCI was determined using a standardized neuropsychological testing battery comprised of seven domains. MRI features included gray matter volume from high-resolution anatomical scans and white matter integrity from diffusion-weighted imaging. Clinical features included demographics, substance use, and routine laboratory tests. Least Absolute Shrinkage and Selection Operator Logistic regression was used to perform variable selection on MRI features. These features were subsequently used to train a support vector machine (SVM) to predict NCI. Three different classification tasks were performed: one used only clinical features; a second used only selected MRI features; a third used both clinical and selected MRI features. Model performance was evaluated by area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity with a tenfold cross-validation. The SVM classifier that combined selected MRI with clinical features outperformed the model using clinical features or MRI features alone (AUC: 0.83 vs. 0.62 vs. 0.79; accuracy: 0.80 vs. 0.65 vs. 0.72; sensitivity: 0.86 vs. 0.85 vs. 0.86; specificity: 0.71 vs. 0.37 vs. 0.52). Our results provide preliminary evidence that combining clinical and MRI features can increase accuracy in predicting NCI and could be developed as a potential tool for NCI diagnosis in HIV clinical practice.
Appendix
Available only for authorised users
Literature
go back to reference Andersson JLR, Jenkinson M, Smith S (2007) Non-linear Registration, aka Spatial Normalisation, in FMIRB Analysis Group Technical Reports. Oxford Centre for Functional MRI of the Brain: Oxford, United Kingdom. Andersson JLR, Jenkinson M, Smith S (2007) Non-linear Registration, aka Spatial Normalisation, in FMIRB Analysis Group Technical Reports. Oxford Centre for Functional MRI of the Brain: Oxford, United Kingdom.
go back to reference Benton A, Hamsher K, Sivan A (1983) Multilingual Aphasia Examination, 3rd edn. AJA Associates, Iowa City, IA Benton A, Hamsher K, Sivan A (1983) Multilingual Aphasia Examination, 3rd edn. AJA Associates, Iowa City, IA
go back to reference Brandt J, Benedict RHB (2001) Hopkins Verbal Learning Test—revised professional manual. Psychological Assessment Resources Inc, Lutz, FL Brandt J, Benedict RHB (2001) Hopkins Verbal Learning Test—revised professional manual. Psychological Assessment Resources Inc, Lutz, FL
go back to reference Chichetto NE, Kundu S, Freiberg MS, Butt AA, Crystal S, So-Armah KA, Cook RL, Braithwaite RS, Fiellin DA, Khan MR, Bryant KJ, Gaither JR, Barve SS, Crothers K, Bedimo RJ, Warner AL, Tindle HA, Veterans Aging Cohort S (2019) Association of Syndemic Unhealthy Alcohol Use, Cigarette Use, and Depression With All-Cause Mortality Among Adults Living With and Without HIV Infection: Veterans Aging Cohort Study. Open Forum Infect Dis, 6(6), ofz188. https://doi.org/10.1093/ofid/ofz188 Chichetto NE, Kundu S, Freiberg MS, Butt AA, Crystal S, So-Armah KA, Cook RL, Braithwaite RS, Fiellin DA, Khan MR, Bryant KJ, Gaither JR, Barve SS, Crothers K, Bedimo RJ, Warner AL, Tindle HA, Veterans Aging Cohort S (2019) Association of Syndemic Unhealthy Alcohol Use, Cigarette Use, and Depression With All-Cause Mortality Among Adults Living With and Without HIV Infection: Veterans Aging Cohort Study. Open Forum Infect Dis, 6(6), ofz188. https://​doi.​org/​10.​1093/​ofid/​ofz188
go back to reference Chockanathan U, AM DS, Abidin AZ, Schifitto G, Wismuller A (2018) Identification and functional characterization of HIV-associated neurocognitive disorders with large-scale Granger causality analysis on resting-state functional MRI. Proc SPIE Int Soc Opt Eng, 10575. https://doi.org/10.1117/12.2293888 Chockanathan U, AM DS, Abidin AZ, Schifitto G, Wismuller A (2018) Identification and functional characterization of HIV-associated neurocognitive disorders with large-scale Granger causality analysis on resting-state functional MRI. Proc SPIE Int Soc Opt Eng, 10575. https://​doi.​org/​10.​1117/​12.​2293888
go back to reference Diehr MC, Cherner M, Wolfson TJ, Miller SW, Grant I, Heaton RK (2003) The 50 and 100-item short forms of the Paced Auditory Serial Addition Task (PASAT): demographically corrected norms and comparisons with the full PASAT in normal and clinical samples. J Clin Exp Neuropsychol 25(4):571–585. https://doi.org/10.1076/jcen.25.4.571.13876 Diehr MC, Cherner M, Wolfson TJ, Miller SW, Grant I, Heaton RK (2003) The 50 and 100-item short forms of the Paced Auditory Serial Addition Task (PASAT): demographically corrected norms and comparisons with the full PASAT in normal and clinical samples. J Clin Exp Neuropsychol 25(4):571–585. https://​doi.​org/​10.​1076/​jcen.​25.​4.​571.​13876
go back to reference Douaud G, Smith S, Jenkinson M, Behrens T, Johansen-Berg H, Vickers J, James S, Voets N, Watkins K, Matthews PM, James A (2007) Anatomically related grey and white matter abnormalities in adolescent-onset schizophrenia. Brain 130(9):2375–2386CrossRef Douaud G, Smith S, Jenkinson M, Behrens T, Johansen-Berg H, Vickers J, James S, Voets N, Watkins K, Matthews PM, James A (2007) Anatomically related grey and white matter abnormalities in adolescent-onset schizophrenia. Brain 130(9):2375–2386CrossRef
go back to reference DSouza AM, Abidin AZ, Chockanathan U, Wismüller A (2018) Regional autonomy changes in resting-state functional MRI in patients with HIV associated neurocognitive disorder. Paper presented at the Medical Imaging 2018: Image Processing. DSouza AM, Abidin AZ, Chockanathan U, Wismüller A (2018) Regional autonomy changes in resting-state functional MRI in patients with HIV associated neurocognitive disorder. Paper presented at the Medical Imaging 2018: Image Processing.
go back to reference Dyrba M, Barkhof F, Fellgiebel A, Filippi M, Hausner L, Hauenstein K, Kirste T, Teipel SJ, Group ES (2015) Predicting prodromal Alzheimer’s disease in subjects with mild cognitive impairment using machine learning classification of multimodal multicenter diffusion-tensor and magnetic resonance imaging data. J Neuroimaging 25(5):738–747. https://doi.org/10.1111/jon.12214CrossRefPubMed Dyrba M, Barkhof F, Fellgiebel A, Filippi M, Hausner L, Hauenstein K, Kirste T, Teipel SJ, Group ES (2015) Predicting prodromal Alzheimer’s disease in subjects with mild cognitive impairment using machine learning classification of multimodal multicenter diffusion-tensor and magnetic resonance imaging data. J Neuroimaging 25(5):738–747. https://​doi.​org/​10.​1111/​jon.​12214CrossRefPubMed
go back to reference Golden CJ (1978) Stroop Color and Word Test. Stoelting, Chicago, IL Golden CJ (1978) Stroop Color and Word Test. Stoelting, Chicago, IL
go back to reference Golden CJ, Freshwater SM (2002) The Stroop color and word test: a manual for clinical and experimental uses. Stoelting, Chicago, IL Golden CJ, Freshwater SM (2002) The Stroop color and word test: a manual for clinical and experimental uses. Stoelting, Chicago, IL
go back to reference Good CD, Johnsrude IS, Ashburner J Richard, Henson NA, Friston KJ, Frackowiak RSJ (2001) A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains. NeuroImage 14(1):21–36CrossRef Good CD, Johnsrude IS, Ashburner J Richard, Henson NA, Friston KJ, Frackowiak RSJ (2001) A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains. NeuroImage 14(1):21–36CrossRef
go back to reference Heaton RK, Clifford DB, Franklin DR Jr, Woods SP, Ake C, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Rivera-Mindt M, Vigil OR, Taylor MJ, Collier AC, Marra CM, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Jernigan TL, Wong J, Grant I, Group C (2010) HIV associated neurocognitive disorders persist in the era of potent antiretroviral therapy CHARTER. Study Neurology 75(23):2087–2096. https://doi.org/10.1212/WNL.0b013e318200d727CrossRefPubMed Heaton RK, Clifford DB, Franklin DR Jr, Woods SP, Ake C, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Rivera-Mindt M, Vigil OR, Taylor MJ, Collier AC, Marra CM, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Jernigan TL, Wong J, Grant I, Group C (2010) HIV associated neurocognitive disorders persist in the era of potent antiretroviral therapy CHARTER. Study Neurology 75(23):2087–2096. https://​doi.​org/​10.​1212/​WNL.​0b013e318200d727​CrossRefPubMed
go back to reference Heaton RK, Grant I, Butters N, White DA, Kirson D, Atkinson JH, McCutchan JA, Taylor MJ, Kelly MD, Ellis RJ et al (1995) The HNRC 500--neuropsychology of HIV infection at different disease stages. HIV Neurobehavioral Research Center. J Int Neuropsychol Soc, 1(3):231–251. https://doi.org/10.1017/s1355617700000230 Heaton RK, Grant I, Butters N, White DA, Kirson D, Atkinson JH, McCutchan JA, Taylor MJ, Kelly MD, Ellis RJ et al (1995) The HNRC 500--neuropsychology of HIV infection at different disease stages. HIV Neurobehavioral Research Center. J Int Neuropsychol Soc, 1(3):231–251. https://​doi.​org/​10.​1017/​s135561770000023​0
go back to reference Heaton RK, Kirson D, Velin RA, IGRO Grant, Group H (1994) The utility of clinical ratings for detecting cognitive change in HIV infection. Neuropsychology of HIV infection (pp. 188–206). New York: Oxford University. Heaton RK, Kirson D, Velin RA, IGRO Grant, Group H (1994) The utility of clinical ratings for detecting cognitive change in HIV infection. Neuropsychology of HIV infection (pp. 188–206). New York: Oxford University.
go back to reference Heaton RK, Miller SW, Taylor MJ, Grant I (2004) Revised comprehensive norms for an expanded halstead-reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources Inc, Lutz, FL Heaton RK, Miller SW, Taylor MJ, Grant I (2004) Revised comprehensive norms for an expanded halstead-reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources Inc, Lutz, FL
go back to reference Heaton RK, Psychological Assessment Resources I (2004) Revised comprehensive norms for an expanded Halstead-Reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources, Professional Manual Heaton RK, Psychological Assessment Resources I (2004) Revised comprehensive norms for an expanded Halstead-Reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources, Professional Manual
go back to reference Jones DK (2008) Tractography gone wild: probabilistic fibre tracking using the wild bootstrap with diffusion tensor MRI. IEEE Trans Med Imaging 27(9):1268–1274CrossRef Jones DK (2008) Tractography gone wild: probabilistic fibre tracking using the wild bootstrap with diffusion tensor MRI. IEEE Trans Med Imaging 27(9):1268–1274CrossRef
go back to reference Klove H (1963) Grooved Pegboard. Lafayette Instruments, Lafayette, IN Klove H (1963) Grooved Pegboard. Lafayette Instruments, Lafayette, IN
go back to reference Kumar S, Himanshu D, Tandon R, Atam V, Sawlani KK, Verma SK (2019) Prevalence of HIV Associated neurocognitive disorder using modified Mini Mental State Examination and its correlation with CD4 counts and anti-retroviral therapy. J Assoc Physicians India 67(4):47–51PubMed Kumar S, Himanshu D, Tandon R, Atam V, Sawlani KK, Verma SK (2019) Prevalence of HIV Associated neurocognitive disorder using modified Mini Mental State Examination and its correlation with CD4 counts and anti-retroviral therapy. J Assoc Physicians India 67(4):47–51PubMed
go back to reference Reitan RM, Wolfson D (1993) The Halstead-Reitan neuropsychological test battery: theory and clinical interpretation, 2nd edn. Neuropsycholgy Press, Tucson, AZ Reitan RM, Wolfson D (1993) The Halstead-Reitan neuropsychological test battery: theory and clinical interpretation, 2nd edn. Neuropsycholgy Press, Tucson, AZ
go back to reference Santos GMA, Locatelli I, Metral M, Calmy A, Lecompte TD, Nadin I, Hauser C, Cusini A, Hasse B, Kovari H, Tarr P, Stoeckle M, Fux C, Di Benedetto C, Schmid P, Darling KEA, Du Pasquier R, Cavassini M, Neurocognitive Assessment in the, M., & Aging Cohort Study, G (2019) Cross-Sectional and Cumulative Longitudinal Central Nervous System Penetration Effectiveness Scores Are Not Associated With Neurocognitive Impairment in a Well Treated Aging Human Immunodeficiency Virus-Positive Population in Switzerland. Open Forum Infect Dis, 6(7), ofz277. https://doi.org/10.1093/ofid/ofz277 Santos GMA, Locatelli I, Metral M, Calmy A, Lecompte TD, Nadin I, Hauser C, Cusini A, Hasse B, Kovari H, Tarr P, Stoeckle M, Fux C, Di Benedetto C, Schmid P, Darling KEA, Du Pasquier R, Cavassini M, Neurocognitive Assessment in the, M., & Aging Cohort Study, G (2019) Cross-Sectional and Cumulative Longitudinal Central Nervous System Penetration Effectiveness Scores Are Not Associated With Neurocognitive Impairment in a Well Treated Aging Human Immunodeficiency Virus-Positive Population in Switzerland. Open Forum Infect Dis, 6(7), ofz277. https://​doi.​org/​10.​1093/​ofid/​ofz277
go back to reference Smith RE, Tournier J-D, Calamante F, Connelly A (2012) Anatomically-constrained tractography: improved diffusion MRI streamlines tractography through effective use of anatomical information. NeuroImage 62(3):1924–1938CrossRef Smith RE, Tournier J-D, Calamante F, Connelly A (2012) Anatomically-constrained tractography: improved diffusion MRI streamlines tractography through effective use of anatomical information. NeuroImage 62(3):1924–1938CrossRef
go back to reference Stern RA, White T (2009) NAB Digits Forward/Digits Backward Test: Professional Manual. Lutz, FL: Psychological Assessment Resources, Inc. (PAR) Stern RA, White T (2009) NAB Digits Forward/Digits Backward Test: Professional Manual. Lutz, FL: Psychological Assessment Resources, Inc. (PAR)
go back to reference Tang Z, Liu Z, Li R, Yang X, Cui X, Wang S, Yu D, Li H, Dong E, Tian J (2017b) Identifying the white matter impairments among ART-naïve HIV patients: a multivariate pattern analysis of DTI data. Eur Radiol 27(10):4153–4162CrossRef Tang Z, Liu Z, Li R, Yang X, Cui X, Wang S, Yu D, Li H, Dong E, Tian J (2017b) Identifying the white matter impairments among ART-naïve HIV patients: a multivariate pattern analysis of DTI data. Eur Radiol 27(10):4153–4162CrossRef
go back to reference Tate JP, Sterne JAC, Justice AC, Veterans Cohort Collaboration Study and the Antiretroviral Therapy Cohort Collaboration (2019) Albumin, white blood cell count, and body mass index improve discrimination of mortality in HIV-positive individuals. AIDS 33(5):903–912. https://doi.org/10.1097/QAD.0000000000002140 Tate JP, Sterne JAC, Justice AC, Veterans Cohort Collaboration Study and the Antiretroviral Therapy Cohort Collaboration (2019) Albumin, white blood cell count, and body mass index improve discrimination of mortality in HIV-positive individuals. AIDS 33(5):903–912. https://​doi.​org/​10.​1097/​QAD.​0000000000002140​
go back to reference Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, Gee JC (2010) N4ITK: improved N3 bias correction. IEEE Trans Med Imaging 29(6):1310CrossRef Tustison NJ, Avants BB, Cook PA, Zheng Y, Egan A, Yushkevich PA, Gee JC (2010) N4ITK: improved N3 bias correction. IEEE Trans Med Imaging 29(6):1310CrossRef
go back to reference Underwood J, De Francesco D, Leech R, Sabin CA, Winston A, Pharmacokinetic and Clinical Observations in PeoPle Over fifty (2018) Medicalising normality? Using a simulated dataset to assess the performance of different diagnostic criteria of HIV-associated cognitive impairment. PLoS One, 13(4), e0194760. https://doi.org/10.1371/journal.pone.0194760 Underwood J, De Francesco D, Leech R, Sabin CA, Winston A, Pharmacokinetic and Clinical Observations in PeoPle Over fifty (2018) Medicalising normality? Using a simulated dataset to assess the performance of different diagnostic criteria of HIV-associated cognitive impairment. PLoS One, 13(4), e0194760. https://​doi.​org/​10.​1371/​journal.​pone.​0194760
Metadata
Title
Machine learning prediction of neurocognitive impairment among people with HIV using clinical and multimodal magnetic resonance imaging data
Authors
Yunan Xu
Yizi Lin
Ryan P. Bell
Sheri L. Towe
John M. Pearson
Tauseef Nadeem
Cliburn Chan
Christina S. Meade
Publication date
01-02-2021
Publisher
Springer International Publishing
Published in
Journal of NeuroVirology / Issue 1/2021
Print ISSN: 1355-0284
Electronic ISSN: 1538-2443
DOI
https://doi.org/10.1007/s13365-020-00930-4

Other articles of this Issue 1/2021

Journal of NeuroVirology 1/2021 Go to the issue