Skip to main content
Top
Published in: Journal of NeuroVirology 3/2017

01-06-2017

A comparison of the sensitivity, stability, and reliability of three diagnostic schemes for HIV-associated neurocognitive disorders

Authors: Savanna M. Tierney, David P. Sheppard, Victoria M. Kordovski, Marika P. Faytell, Gunes Avci, Steven Paul Woods

Published in: Journal of NeuroVirology | Issue 3/2017

Login to get access

Abstract

HIV-associated neurocognitive disorders (HAND) occur in approximately 50% of HIV-infected individuals, yet available diagnostic criteria yield varying prevalence rates. This study examined the frequency, reliability, and sensitivity to everyday functioning problems of three HAND diagnostic criteria (DSM-5, Frascati, Gisslén). Participants included 361 adults with HIV disease and 199 seronegative adults. Neurocognitive status as defined by each of the three diagnostic systems was determined via a comprehensive neuropsychological battery. Everyday functioning was evaluated through self-report and clinician ratings. Results of logistic regressions revealed an association of HIV serostatus with Frascati-defined neurocognitive impairment (p = .027, OR = 1.7[1.1, 2.7]), but not DSM-5 or Gisslén-defined criteria (ps > .05). Frascati and DSM-5 criteria demonstrated agreement on 71% of observations, Frascati and Gisslén showed agreement on 80%, and DSM-5 and Gisslén criteria showed agreement on 46%, though reliability across the three criteria was poor. Only Frascati-defined neurocognitive impairment significantly predicted everyday functioning problems (p = .002, OR = 2.3[1.4, 3.8]). However, when both neurocognitive and complaint criteria were considered, the DSM-5 guidelines demonstrated significant relationships to everyday functioning, serostatus, and also increased reliability overtime compared to neurocognitive criteria alone (all ps < .05). A subset (n = 118) of the HIV+ group was assessed again after 14.0 (2.2) months. DSM-5 criteria evidenced significantly higher rates of incident neurocognitive disorder compared to both Frascati (p = .003) and Gisslén (p = .021) guidelines, while there were fewer remitting neurocognitive disorder diagnoses when Gisslén criteria were applied to the study sample compared to Frascati (p = .04). Future studies should aim to identify gold standard biological markers (e.g., neuropathology) and clinical outcomes associated with specific diagnostic criteria.
Literature
go back to reference Al-Khindi T, Zakzanis KK, Van Gorp WG (2011) Does antiretroviral therapy improve HIV-associated cognitive impairment? A quantitative review of the literature. JINS 17(6):9–56 Al-Khindi T, Zakzanis KK, Van Gorp WG (2011) Does antiretroviral therapy improve HIV-associated cognitive impairment? A quantitative review of the literature. JINS 17(6):9–56
go back to reference American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. Author, Washington DCCrossRef American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. Author, Washington DCCrossRef
go back to reference Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, Clifford DB, Cinque P, Epstein LG, Goodkin K, Gisslén M, Grant I, Heaton RK, Joseph J, Marder K, Marra CM, McArthur JC, Nunn M, Price RW, Pulliam L, Robertson KR, Sacktor N, Valcour V, Wojna VE (2007) Updated research nosology for HIV-associated neurocognitive disorders. Neurology 69:1789–1799. doi:10.1212/01.WNL.0000287431.88658.8b CrossRefPubMedPubMedCentral Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, Clifford DB, Cinque P, Epstein LG, Goodkin K, Gisslén M, Grant I, Heaton RK, Joseph J, Marder K, Marra CM, McArthur JC, Nunn M, Price RW, Pulliam L, Robertson KR, Sacktor N, Valcour V, Wojna VE (2007) Updated research nosology for HIV-associated neurocognitive disorders. Neurology 69:1789–1799. doi:10.​1212/​01.​WNL.​0000287431.​88658.​8b CrossRefPubMedPubMedCentral
go back to reference Army Individual Test Battery (1944) Manual of directions and scoring. War Department, Adjutant General’s Office, Washington, DC Army Individual Test Battery (1944) Manual of directions and scoring. War Department, Adjutant General’s Office, Washington, DC
go back to reference Chan P, Brew BJ (2014) HIV associated neurocognitive disorders in the modern antiviral treatment era: prevalence, characteristics, biomarkers, and effects of treatment. Current HIV/AIDS Reports 1(3):317–324CrossRef Chan P, Brew BJ (2014) HIV associated neurocognitive disorders in the modern antiviral treatment era: prevalence, characteristics, biomarkers, and effects of treatment. Current HIV/AIDS Reports 1(3):317–324CrossRef
go back to reference Culbertson WC, Zillmer EA (1999) The tower of London, Drexel University, research version: examiner’s manual. Multi-Health Systems, North Tonawanda Culbertson WC, Zillmer EA (1999) The tower of London, Drexel University, research version: examiner’s manual. Multi-Health Systems, North Tonawanda
go back to reference Delis DC, Kramer JH, Kaplan E, Ober BA (2000) The California verbal learning test, 2nd edn. The Psychological Corporation, San Antonio Delis DC, Kramer JH, Kaplan E, Ober BA (2000) The California verbal learning test, 2nd edn. The Psychological Corporation, San Antonio
go back to reference Gandhi NS, Skolasky RL, Peters KB, Moxley RT IV, Creighton J, Roosa HV et al (2011) A comparison of performance-based measures of function in HIV-associated neurocognitive disorders. J Neurovirol 17(2):159–165CrossRefPubMedPubMedCentral Gandhi NS, Skolasky RL, Peters KB, Moxley RT IV, Creighton J, Roosa HV et al (2011) A comparison of performance-based measures of function in HIV-associated neurocognitive disorders. J Neurovirol 17(2):159–165CrossRefPubMedPubMedCentral
go back to reference Gisslén M, Price RW, Nilsson S (2011) The definition of HIV-associated neurocognitive disorders: are we overestimating the real prevalence? BMC Infect Dis 11:356CrossRefPubMedPubMedCentral Gisslén M, Price RW, Nilsson S (2011) The definition of HIV-associated neurocognitive disorders: are we overestimating the real prevalence? BMC Infect Dis 11:356CrossRefPubMedPubMedCentral
go back to reference Grant I, Franklin DR, Deutsch R, Woods SP, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Collier AC, Marra CM, Clifford DB, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Smith DM, Heaton RK, CHARTER Group (2014) Asymptomatic HIV-associated neurocognitive impairment increases risk for symptomatic decline. Neurology 82:2055–2062. doi:10.1212/WNL.0000000000000492 CrossRefPubMedPubMedCentral Grant I, Franklin DR, Deutsch R, Woods SP, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Collier AC, Marra CM, Clifford DB, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Smith DM, Heaton RK, CHARTER Group (2014) Asymptomatic HIV-associated neurocognitive impairment increases risk for symptomatic decline. Neurology 82:2055–2062. doi:10.​1212/​WNL.​0000000000000492​ CrossRefPubMedPubMedCentral
go back to reference Heaton RK, Marcotte TD, Mindt MR, Sadek J, Moore DJ, Bentley H, McCutchan JA, Reicks C, Grant I, HNRC Group (2004a) The impact of HIV-associated neuropsychological impairment on everyday functioning. J Int Neuropsychol Soc 10:317–331. doi:10.1017/S1355617704102130 CrossRefPubMed Heaton RK, Marcotte TD, Mindt MR, Sadek J, Moore DJ, Bentley H, McCutchan JA, Reicks C, Grant I, HNRC Group (2004a) The impact of HIV-associated neuropsychological impairment on everyday functioning. J Int Neuropsychol Soc 10:317–331. doi:10.​1017/​S135561770410213​0 CrossRefPubMed
go back to reference Heaton RK, Miller SW, Taylor MJ, Grant I (2004b) Revised comprehensive norms for an expanded Halstead-Reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources, Inc., Odessa, FL Heaton RK, Miller SW, Taylor MJ, Grant I (2004b) Revised comprehensive norms for an expanded Halstead-Reitan battery: demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources, Inc., Odessa, FL
go back to reference Heaton RK, Clifford DB, Franklin DR, Woods SP, Ake C, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Rivera-Mindt M, Vigil OR, Taylor MJ, Collier AC, Marra CM, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Jernigan TL, Wong J, Grant I, CHARTER Group (2010) HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER study. Neurology 75:2087–2096. doi:10.1212/WNL.0b013e318200d727 CrossRefPubMedPubMedCentral Heaton RK, Clifford DB, Franklin DR, Woods SP, Ake C, Vaida F, Ellis RJ, Letendre SL, Marcotte TD, Atkinson JH, Rivera-Mindt M, Vigil OR, Taylor MJ, Collier AC, Marra CM, Gelman BB, McArthur JC, Morgello S, Simpson DM, McCutchan JA, Abramson I, Gamst A, Fennema-Notestine C, Jernigan TL, Wong J, Grant I, CHARTER Group (2010) HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER study. Neurology 75:2087–2096. doi:10.​1212/​WNL.​0b013e318200d727​ CrossRefPubMedPubMedCentral
go back to reference Heaton, RK, Franklin, DR, Ellis, RJ, McCutchan, JA, Letendre, SL, Leblanc, S, Corkran, SH, Duarte, NA, Clifford, DB, Woods, SP, Collier, AC, Marra, CM, Morgello, S, Mindt, MR, Taylor, MJ, Marcotte, TD, Atkinson, JH, Wolfson, T, Gelman, BB, McArthur, JC, Simpson, DM, Abramson, I, Gamst, A, Fennema-Notestine, C, Jernigan, TL, Wong, J, Grant I, CHARTER Group, HNRC Group (2011). HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: differences in rates, nature, and predictors. J Neurovirol, 17, 3–16. doi: 10.1007/s13365-010-0006-1. Heaton, RK, Franklin, DR, Ellis, RJ, McCutchan, JA, Letendre, SL, Leblanc, S, Corkran, SH, Duarte, NA, Clifford, DB, Woods, SP, Collier, AC, Marra, CM, Morgello, S, Mindt, MR, Taylor, MJ, Marcotte, TD, Atkinson, JH, Wolfson, T, Gelman, BB, McArthur, JC, Simpson, DM, Abramson, I, Gamst, A, Fennema-Notestine, C, Jernigan, TL, Wong, J, Grant I, CHARTER Group, HNRC Group (2011). HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: differences in rates, nature, and predictors. J Neurovirol, 17, 3–16. doi: 10.​1007/​s13365-010-0006-1.
go back to reference Hinkin CH, Castellon SA, Durvasula RS, Hardy DJ, Lam MN, Mason KI, Stefaniak M (2002) Medication adherence among HIV+ adults: effects of cognitive dysfunction and regimen complexity. Neurology 59:1944–1950CrossRefPubMedPubMedCentral Hinkin CH, Castellon SA, Durvasula RS, Hardy DJ, Lam MN, Mason KI, Stefaniak M (2002) Medication adherence among HIV+ adults: effects of cognitive dysfunction and regimen complexity. Neurology 59:1944–1950CrossRefPubMedPubMedCentral
go back to reference Janssen RS, Cornblath DR, Epstein LG et al (1991) Nomenclature and research case definitions for neurological manifestations of human immunodeficiency virus type-1 (HIV-1) infection. Report of a working Group of the American Academy of neurology AIDS task force. Neurology 41:778–785CrossRef Janssen RS, Cornblath DR, Epstein LG et al (1991) Nomenclature and research case definitions for neurological manifestations of human immunodeficiency virus type-1 (HIV-1) infection. Report of a working Group of the American Academy of neurology AIDS task force. Neurology 41:778–785CrossRef
go back to reference Kaplan E, Goodglass H, Weintraub S (1983) Boston naming test. Lea & Febiger, Philadelphia Kaplan E, Goodglass H, Weintraub S (1983) Boston naming test. Lea & Febiger, Philadelphia
go back to reference Karnofsky DA, Burchenal JH (1949) The clinical evaluation of chemo-therapeutic agents in cancer. In: Maclead CM (ed) Evaluation of chemotherapeutic agents. Columbia University Press, New York, pp 191–205 Karnofsky DA, Burchenal JH (1949) The clinical evaluation of chemo-therapeutic agents in cancer. In: Maclead CM (ed) Evaluation of chemotherapeutic agents. Columbia University Press, New York, pp 191–205
go back to reference Kløve H (1963) Grooved pegboard. Lafayette Instruments, Indiana Kløve H (1963) Grooved pegboard. Lafayette Instruments, Indiana
go back to reference Lawton MP, Brody EM (1969) Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 9:179–186CrossRefPubMed Lawton MP, Brody EM (1969) Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 9:179–186CrossRefPubMed
go back to reference McNair DM, Lorr M, Droppleman LF (1981) Profile of mood states. Educational and Industrial Testing Service, San Diego, CA McNair DM, Lorr M, Droppleman LF (1981) Profile of mood states. Educational and Industrial Testing Service, San Diego, CA
go back to reference Meyer AC, Boscardin WJ, Kwasa JK, Price RW (2013) Is it time to rethink how neuropsychological tests are used to diagnose mild forms of HIV-associated neurocognitive disorders? Impact of false-positive rates on prevalence and power. Neuroepidemiology 41:208–216CrossRefPubMedPubMedCentral Meyer AC, Boscardin WJ, Kwasa JK, Price RW (2013) Is it time to rethink how neuropsychological tests are used to diagnose mild forms of HIV-associated neurocognitive disorders? Impact of false-positive rates on prevalence and power. Neuroepidemiology 41:208–216CrossRefPubMedPubMedCentral
go back to reference Obermeit LC, Beltran J, Casaletto KB, Franklin DR, Letendre S, Ellis R, Fennema-Notestine C, Vaida F, Collier AC, Marra CM, Clifford D, Gelman B, Sacktor N, Morgello S, Simpson D, McCutchan JA, Grant I, Heaton RK; CNS HIV Anti-Retroviral Therapy Effects Research (CHARTER) Group (2016). Evaluating the accuracy of self-report for the diagnosis of HIV associated neurocognitive disorder (HAND): defining "symptomatic" versus "asymptomatic" HAND. J Neurovirol. [Epub ahead of print] PubMed Obermeit LC, Beltran J, Casaletto KB, Franklin DR, Letendre S, Ellis R, Fennema-Notestine C, Vaida F, Collier AC, Marra CM, Clifford D, Gelman B, Sacktor N, Morgello S, Simpson D, McCutchan JA, Grant I, Heaton RK; CNS HIV Anti-Retroviral Therapy Effects Research (CHARTER) Group (2016). Evaluating the accuracy of self-report for the diagnosis of HIV associated neurocognitive disorder (HAND): defining "symptomatic" versus "asymptomatic" HAND. J Neurovirol. [Epub ahead of print] PubMed
go back to reference Piatt AL, Fields JA, Paolo AM, Tröster AI (1999) Action (verb naming) fluency as an executive function measure: convergent and divergent evidence of validity. Neuropsychologia 37:1499–1503CrossRefPubMed Piatt AL, Fields JA, Paolo AM, Tröster AI (1999) Action (verb naming) fluency as an executive function measure: convergent and divergent evidence of validity. Neuropsychologia 37:1499–1503CrossRefPubMed
go back to reference Psychological Corporation (1997) WAIS-III and WMS-III technical manual. Author, San Antonio, TX Psychological Corporation (1997) WAIS-III and WMS-III technical manual. Author, San Antonio, TX
go back to reference Psychological Corporation (2001) Manual for the Wechsler test of adult reading (WTAR). Author, San Antonio Psychological Corporation (2001) Manual for the Wechsler test of adult reading (WTAR). Author, San Antonio
go back to reference Robertson KR, Smurzynski M, Parsons TD, Wu K, Bosch RJ, Wu J et al (2007) The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS 21(14):1915–1921CrossRefPubMed Robertson KR, Smurzynski M, Parsons TD, Wu K, Bosch RJ, Wu J et al (2007) The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS 21(14):1915–1921CrossRefPubMed
go back to reference Sevigny JJ, Albert SM, McDermott MP, Schifitto G, McArthur JC, Sacktor N et al (2007) An evaluation of neurocognitive status and markers of immune activation as predictors of time to death in advanced HIV infection. Arch Neurol 64:97–102CrossRefPubMed Sevigny JJ, Albert SM, McDermott MP, Schifitto G, McArthur JC, Sacktor N et al (2007) An evaluation of neurocognitive status and markers of immune activation as predictors of time to death in advanced HIV infection. Arch Neurol 64:97–102CrossRefPubMed
go back to reference Sheppard DP, Woods SP, Bondi MW, Gilbert PE, Massman PJ, Doyle KL (2015) Does older age confer an increased risk of incident neurocognitive disorders among persons living with HIV disease? Clin Neuropsychol 29:656–677CrossRefPubMedPubMedCentral Sheppard DP, Woods SP, Bondi MW, Gilbert PE, Massman PJ, Doyle KL (2015) Does older age confer an increased risk of incident neurocognitive disorders among persons living with HIV disease? Clin Neuropsychol 29:656–677CrossRefPubMedPubMedCentral
go back to reference Simioni, S, Cavassini, M, Annoni, J, Rimbault Abraham, A, Bourquin, I, Schiffer, V. Du Pasquier, RA (2010). Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS (London, England), 24(9), 1243 Simioni, S, Cavassini, M, Annoni, J, Rimbault Abraham, A, Bourquin, I, Schiffer, V. Du Pasquier, RA (2010). Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS (London, England), 24(9), 1243
go back to reference Su T, Schouten J, Geurtsen GJ, Wit FW, Stolte IG, Prins M, Portegies P, Caan MWA, Reiss P, Majoie CB, Schmand BA, AGE HIV Cohort Study Group (2015) Multivariate normative comparison, a novel method for more reliably detecting cognitive impairment in HIV infection. AIDS 29:547–557. doi:10.1097/QAD.0000000000000573 PubMed Su T, Schouten J, Geurtsen GJ, Wit FW, Stolte IG, Prins M, Portegies P, Caan MWA, Reiss P, Majoie CB, Schmand BA, AGE HIV Cohort Study Group (2015) Multivariate normative comparison, a novel method for more reliably detecting cognitive impairment in HIV infection. AIDS 29:547–557. doi:10.​1097/​QAD.​0000000000000573​ PubMed
go back to reference Wechsler D (1997) Wechsler memory scale-third edition. The Psychological Corporation, San Antonio, TX Wechsler D (1997) Wechsler memory scale-third edition. The Psychological Corporation, San Antonio, TX
go back to reference Woods SP, Morgan EE, Dawson M, Scott JC, Grant I, HNRC Group (2006) Action (verb) fluency predicts dependence in instrumental activities of daily living in persons infected with HIV-1. J Clin Exp Neuropsychol 28:1030–1042. doi:10.1080/13803390500350985 CrossRef Woods SP, Morgan EE, Dawson M, Scott JC, Grant I, HNRC Group (2006) Action (verb) fluency predicts dependence in instrumental activities of daily living in persons infected with HIV-1. J Clin Exp Neuropsychol 28:1030–1042. doi:10.​1080/​1380339050035098​5 CrossRef
go back to reference World Health Organization (1998). Composite international diagnostic interview. World Health Organization; Geneva, Switzerland (CIDI, version 2.1) World Health Organization (1998). Composite international diagnostic interview. World Health Organization; Geneva, Switzerland (CIDI, version 2.1)
Metadata
Title
A comparison of the sensitivity, stability, and reliability of three diagnostic schemes for HIV-associated neurocognitive disorders
Authors
Savanna M. Tierney
David P. Sheppard
Victoria M. Kordovski
Marika P. Faytell
Gunes Avci
Steven Paul Woods
Publication date
01-06-2017
Publisher
Springer International Publishing
Published in
Journal of NeuroVirology / Issue 3/2017
Print ISSN: 1355-0284
Electronic ISSN: 1538-2443
DOI
https://doi.org/10.1007/s13365-016-0510-z

Other articles of this Issue 3/2017

Journal of NeuroVirology 3/2017 Go to the issue