Skip to main content
Top
Published in: Alzheimer's Research & Therapy 1/2017

Open Access 01-12-2017 | Research

Digitally translated Self-Administered Gerocognitive Examination (eSAGE): relationship with its validated paper version, neuropsychological evaluations, and clinical assessments

Authors: Douglas W. Scharre, Shu ing Chang, Haikady N. Nagaraja, Nicole E. Vrettos, Robert A. Bornstein

Published in: Alzheimer's Research & Therapy | Issue 1/2017

Login to get access

Abstract

Background

The original paper Self-Administered Gerocognitive Examination (SAGE) is a valid and reliable cognitive assessment tool used to identify individuals with mild cognitive impairment (MCI) or early dementia. We evaluated identical test questions in a digital format (eSAGE) made for tablet use with the goals of calibrating it against SAGE and establishing its association with other neuropsychological tests and clinical assessments of cognitive impairment.

Methods

Subjects aged 50 and over who had taken SAGE were recruited from community and clinic settings. Subjects were randomly selected to participate in a clinical evaluation including neuropsychological evaluations. SAGE and eSAGE were administered using a crossover design. Subjects were identified as dementia, MCI, or normal based on standard clinical criteria. Associations were investigated using Spearman correlations, linear regression, and sensitivity and specificity measures.

Results

Of the 426 subjects screened, 66 completed the evaluation. eSAGE score correlation to a battery of neuropsychological tests was 0.73 (p < 0.0001) with no significant difference between the paper and digital format. Spearman correlation of SAGE versus eSAGE was 0.88 (p < 0.0001), and they are related by the formula: eSAGE score = –1.05 + 0.99 × SAGE score. Since the slope is very close to 1 (p = 0.86) there is strong evidence that the scaling is identical between eSAGE and SAGE, with no scale bias. Overall, eSAGE scores are lower by an average of 1.21 and the decrease is statistically significant (p < 0.0001). For those subjects familiar with smartphones or tablets (one measure of digital proficiency), eSAGE scores are lower by an average of 0.83 points (p = 0.029). With a score 16 and higher being classified as normal, eSAGE had 90% specificity and 71% sensitivity in detecting those with cognitive impairment from normal subjects.

Conclusions

Tablet-based eSAGE shows a strong association with the validated paper SAGE and a neuropsychological battery. It shows no scale bias compared to SAGE. Both have the advantage of self-administration, brevity, four interchangeable forms, and high sensitivity and specificity in detecting cognitive impairment from normal subjects. Their potential widespread availability will be a major factor in overcoming the many obstacles in identifying early cognitive changes.

Trial registration

ClinicalTrials.gov, NCT02544074. Registered on 18 March 2015.
Literature
4.
go back to reference Lopez OL, Jagust WJ, DeKosky ST, Becker JT, Fitzpatrick A, Dulberg C, et al. Prevalence and classification of mild cognitive impairment in the Cardiovascular Health Study Cognition Study. Arch Neurol. 2003. doi:10.1001/archneur.60.10.1385. Lopez OL, Jagust WJ, DeKosky ST, Becker JT, Fitzpatrick A, Dulberg C, et al. Prevalence and classification of mild cognitive impairment in the Cardiovascular Health Study Cognition Study. Arch Neurol. 2003. doi:10.​1001/​archneur.​60.​10.​1385.
5.
go back to reference Petersen RC, Roberts RO, Knopman DS, Geda YE, Cha RH, Pankratz VS, et al. The Mayo Clinic Study of Aging: prevalence of mild cognitive impairment is higher in men. Neurology. 2010. doi:10.1212/WNL.0b013e3181f11d85. Petersen RC, Roberts RO, Knopman DS, Geda YE, Cha RH, Pankratz VS, et al. The Mayo Clinic Study of Aging: prevalence of mild cognitive impairment is higher in men. Neurology. 2010. doi:10.​1212/​WNL.​0b013e3181f11d85​.
6.
go back to reference Budd D, Burns LC, Guo Z, L’Italien G, Lapuerta P. Impact of early intervention and disease modification in patients with predementia Alzheimer’s disease: a Markov model simulation. Clinicoecon Outcomes Res. 2011. doi:10.2147/CEOR.S22265.PubMedPubMedCentral Budd D, Burns LC, Guo Z, L’Italien G, Lapuerta P. Impact of early intervention and disease modification in patients with predementia Alzheimer’s disease: a Markov model simulation. Clinicoecon Outcomes Res. 2011. doi:10.​2147/​CEOR.​S22265.PubMedPubMedCentral
7.
go back to reference Farlow M, Anand R, Messina Jr J, Hartman R, Veach J. A 52-week study of the efficacy of rivastigmine in patients with mild to moderately severe Alzheimer’s disease. Eur Neurol. 2000. doi:10.1159/000008243.PubMed Farlow M, Anand R, Messina Jr J, Hartman R, Veach J. A 52-week study of the efficacy of rivastigmine in patients with mild to moderately severe Alzheimer’s disease. Eur Neurol. 2000. doi:10.​1159/​000008243.PubMed
8.
go back to reference Adams M. Routine check-ups and other factors affecting discussions with a health care provider about subjective memory complaints, behavioral risk factor surveillance system, 21 states, 2011. Prev Chronic Dis. 2016. doi:10.5888/pcd13.150471. Adams M. Routine check-ups and other factors affecting discussions with a health care provider about subjective memory complaints, behavioral risk factor surveillance system, 21 states, 2011. Prev Chronic Dis. 2016. doi:10.​5888/​pcd13.​150471.
10.
go back to reference Boustani M, Peterson B, Hanson L, Harris R, Lohr KN, U.S. Preventive Services Task Force. Screening for dementia in primary care: a summary of the evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2003. doi:10.7326/0003-4819-138-11-200306030-00015. Boustani M, Peterson B, Hanson L, Harris R, Lohr KN, U.S. Preventive Services Task Force. Screening for dementia in primary care: a summary of the evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2003. doi:10.​7326/​0003-4819-138-11-200306030-00015.
15.
go back to reference Arlt S, Hornung J, Eichenlaub M, Jahn H, Bullinger M, Peterson C. The patient with dementia, the caregiver and the doctor: cognition, depression and quality of life from three perspectives. Int J Geriatr Psychiatry. 2008. doi:10.1002/gps.1946.PubMed Arlt S, Hornung J, Eichenlaub M, Jahn H, Bullinger M, Peterson C. The patient with dementia, the caregiver and the doctor: cognition, depression and quality of life from three perspectives. Int J Geriatr Psychiatry. 2008. doi:10.​1002/​gps.​1946.PubMed
16.
go back to reference Speechly CM, Bridges-Webb C, Passmore E. The pathway to dementia diagnosis. Med J Aust. 2008;189:487–89.PubMed Speechly CM, Bridges-Webb C, Passmore E. The pathway to dementia diagnosis. Med J Aust. 2008;189:487–89.PubMed
19.
go back to reference Cordell CB, Borson S, Boustani M, Chodosh J, Reuben D, Verghese J, et al. Medicare Detection of Cognitive Impairment Workgroup: Alzheimer’s Association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting. Alzheimers Dement. 2013. doi:10.1016/j.jalz.2012.09.011.PubMed Cordell CB, Borson S, Boustani M, Chodosh J, Reuben D, Verghese J, et al. Medicare Detection of Cognitive Impairment Workgroup: Alzheimer’s Association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting. Alzheimers Dement. 2013. doi:10.​1016/​j.​jalz.​2012.​09.​011.PubMed
26.
go back to reference Folstein MF, Folstein SE, McHugh PR. “Mini-mental state” a practical method for grading the cognitive state of patients for the clinician. J Psychiat Res. 1975. doi:10.1016/0022-3956(75)90026-6. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state” a practical method for grading the cognitive state of patients for the clinician. J Psychiat Res. 1975. doi:10.​1016/​0022-3956(75)90026-6.
28.
29.
go back to reference Kalbe E, Kessler J, Calabrese P, Smith R, Passmore AP, Brand M, et al. DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry. 2004. doi:10.1002/gps.1042.PubMed Kalbe E, Kessler J, Calabrese P, Smith R, Passmore AP, Brand M, et al. DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry. 2004. doi:10.​1002/​gps.​1042.PubMed
30.
go back to reference Lorentz WJ, Scanlan JM, Borson S. Brief screening tests for dementia. Can J Psychiatry. 2002;47:723–33.PubMed Lorentz WJ, Scanlan JM, Borson S. Brief screening tests for dementia. Can J Psychiatry. 2002;47:723–33.PubMed
31.
go back to reference Mendiondo MS, Ashford JW, Kryscio RJ, Schmitt FA. Designing a Brief Alzheimer Screen (BAS). J Alzheimers Dis. 2003;5:391–8.CrossRefPubMed Mendiondo MS, Ashford JW, Kryscio RJ, Schmitt FA. Designing a Brief Alzheimer Screen (BAS). J Alzheimers Dis. 2003;5:391–8.CrossRefPubMed
32.
34.
go back to reference Robert PH, Schuck S, Dubois B, Olié JP, Lépine JP, Gallarda T, et al. Screening for Alzheimer's disease with the short cognitive evaluation battery. Dement Geriatr Cogn Disord. 2003. doi:10.1159/000067971.PubMed Robert PH, Schuck S, Dubois B, Olié JP, Lépine JP, Gallarda T, et al. Screening for Alzheimer's disease with the short cognitive evaluation battery. Dement Geriatr Cogn Disord. 2003. doi:10.​1159/​000067971.PubMed
35.
go back to reference Tariq SH, Tumosa N, Chibnall JT, Perry 3rd MH, Morley JE. Comparison of the Saint Louis University mental status examination and the mini-mental state examination for detecting dementia and mild neurocognitive disorder—a pilot study. Am J Geriatr Psychiatry. 2006. doi:10.1097/01.JGP.0000221510.33817.86.PubMed Tariq SH, Tumosa N, Chibnall JT, Perry 3rd MH, Morley JE. Comparison of the Saint Louis University mental status examination and the mini-mental state examination for detecting dementia and mild neurocognitive disorder—a pilot study. Am J Geriatr Psychiatry. 2006. doi:10.​1097/​01.​JGP.​0000221510.​33817.​86.PubMed
37.
go back to reference Ozer S, Young J, Champ C, Burke M. A systematic review of the diagnostic test accuracy of brief cognitive tests to detect amnestic mild cognitive impairment. Int J Geriatr Psychiatry. 2016. doi:10.1002/gps.4444.PubMed Ozer S, Young J, Champ C, Burke M. A systematic review of the diagnostic test accuracy of brief cognitive tests to detect amnestic mild cognitive impairment. Int J Geriatr Psychiatry. 2016. doi:10.​1002/​gps.​4444.PubMed
38.
go back to reference Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001. doi:10.1212/WNL.56.9.1133 Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001. doi:10.​1212/​WNL.​56.​9.​1133
40.
go back to reference Tang-Wai DF, Knopman DS, Geda YE, Edland SD, Smith GE, Ivnik RJ, et al. Comparison of the short test of mental status and the mini-mental state examination in mild cognitive impairment. Arch Neurol. 2003. doi:10.1001/archneur.60.12.1777.PubMed Tang-Wai DF, Knopman DS, Geda YE, Edland SD, Smith GE, Ivnik RJ, et al. Comparison of the short test of mental status and the mini-mental state examination in mild cognitive impairment. Arch Neurol. 2003. doi:10.​1001/​archneur.​60.​12.​1777.PubMed
41.
go back to reference Xu G, Meyer JS, Thornby J, Chowdhury M, Quach M. Screening for mild cognitive impairment (MCI) utilizing combined mini-mental-cognitive capacity examinations for identifying dementia prodromes. Int J Geriatr Psychiatry. 2002. doi:10.1002/gps.744. Xu G, Meyer JS, Thornby J, Chowdhury M, Quach M. Screening for mild cognitive impairment (MCI) utilizing combined mini-mental-cognitive capacity examinations for identifying dementia prodromes. Int J Geriatr Psychiatry. 2002. doi:10.​1002/​gps.​744.
42.
go back to reference Eichler T, Thyrian JR, Hertel J, Wucherer D, Michalowsky B, Reiner K, et al. Subjective memory impairment: no suitable criteria for case-finding of dementia in primary care. Alzheimers Dement (Amst). 2015. doi:10.1016/j.dadm.2015.02.004. Eichler T, Thyrian JR, Hertel J, Wucherer D, Michalowsky B, Reiner K, et al. Subjective memory impairment: no suitable criteria for case-finding of dementia in primary care. Alzheimers Dement (Amst). 2015. doi:10.​1016/​j.​dadm.​2015.​02.​004.
44.
go back to reference Jorm AF, Jacomb PA. An informant questionnaire on cognitive decline in the elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989. doi:10.1017/S0033291700005742. Jorm AF, Jacomb PA. An informant questionnaire on cognitive decline in the elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989. doi:10.​1017/​S003329170000574​2.
46.
go back to reference Borson S, Scanlan JM, Watanabe J, Tu SP, Lessig M. Improving identification of cognitive impairment in primary care. Int J Geriatr Psychiatry. 2006. doi:10.1002/gps.1470.PubMed Borson S, Scanlan JM, Watanabe J, Tu SP, Lessig M. Improving identification of cognitive impairment in primary care. Int J Geriatr Psychiatry. 2006. doi:10.​1002/​gps.​1470.PubMed
48.
go back to reference Scharre DW, Chang S-I, Murden RA, Lamb J, Beversdorf DQ, Kataki M, et al. Self-administered gerocognitive examination (SAGE): a brief cognitive assessment instrument for mild cognitive impairment (MCI) and early dementia. Alzheimer Dis Assoc Disord. 2010. doi:10.1097/WAD.0b013e3181b03277.PubMed Scharre DW, Chang S-I, Murden RA, Lamb J, Beversdorf DQ, Kataki M, et al. Self-administered gerocognitive examination (SAGE): a brief cognitive assessment instrument for mild cognitive impairment (MCI) and early dementia. Alzheimer Dis Assoc Disord. 2010. doi:10.​1097/​WAD.​0b013e3181b03277​.PubMed
51.
go back to reference Darby DG, Pietrzak RH, Fredrickson J, Woodward M, Moore L, Fredrickson A, et al. Intraindividual cognitive decline using a brief computerized cognitive screening test. Alzheimers Dement. 2012. doi:10.1016/j.jalz.2010.12.009. Darby DG, Pietrzak RH, Fredrickson J, Woodward M, Moore L, Fredrickson A, et al. Intraindividual cognitive decline using a brief computerized cognitive screening test. Alzheimers Dement. 2012. doi:10.​1016/​j.​jalz.​2010.​12.​009.
55.
go back to reference Tierney MC, Lermer MA. Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. J Alzheimers Dis. 2010. doi:10.3233/JAD-2010-091672. Tierney MC, Lermer MA. Computerized cognitive assessment in primary care to identify patients with suspected cognitive impairment. J Alzheimers Dis. 2010. doi:10.​3233/​JAD-2010-091672.
56.
go back to reference Tierney MC, Naglie G, Upshur R, Moineddin R, Charles J, Jaakkimainen L. Feasibility and validity of the self-administered computerized assessment of mild cognitive impairment with older primary care patients. Alzheimer Dis & Assoc Disord. 2014. doi:10.1097/WAD.0000000000000036. Tierney MC, Naglie G, Upshur R, Moineddin R, Charles J, Jaakkimainen L. Feasibility and validity of the self-administered computerized assessment of mild cognitive impairment with older primary care patients. Alzheimer Dis & Assoc Disord. 2014. doi:10.​1097/​WAD.​0000000000000036​.
59.
go back to reference Heaton RK. The Wisconsin Card Sorting Test Manual. Odessa: Psychological Assessment Resources; 1981. Heaton RK. The Wisconsin Card Sorting Test Manual. Odessa: Psychological Assessment Resources; 1981.
60.
go back to reference Benedict RH, Schretlen D, Groninger L, Brandt J. Hopkins Verbal Learning Test- Revised; normative data and analysis of inter-form and test-retest reliability. Clin Neuropsychologist. 1998;12:43–55.CrossRef Benedict RH, Schretlen D, Groninger L, Brandt J. Hopkins Verbal Learning Test- Revised; normative data and analysis of inter-form and test-retest reliability. Clin Neuropsychologist. 1998;12:43–55.CrossRef
62.
go back to reference Wechsler D. Wechsler adult intelligence scale III administration and scoring manual. San Antonio: The Psychological Corporation; 1997. Wechsler D. Wechsler adult intelligence scale III administration and scoring manual. San Antonio: The Psychological Corporation; 1997.
63.
go back to reference Kaplan E, Goodglass H, Weintraub S. Boston naming test. Philadelphia: Lea & Febiger; 1983. Kaplan E, Goodglass H, Weintraub S. Boston naming test. Philadelphia: Lea & Febiger; 1983.
64.
go back to reference Benton AL, Hamsher K. Multilingual aphasia examination. Iowa City: University of Iowa Press; 1978. Benton AL, Hamsher K. Multilingual aphasia examination. Iowa City: University of Iowa Press; 1978.
65.
go back to reference Spreen O, Strauss E. A Compendium of neuropsychological tests: administrations, norms, and commentary. 2nd ed. Oxford: Oxford University Press; 1998. Spreen O, Strauss E. A Compendium of neuropsychological tests: administrations, norms, and commentary. 2nd ed. Oxford: Oxford University Press; 1998.
66.
go back to reference Heaton RK, Miller SW, Taylor MJ, Grant I. Revised comprehensive norms for an expanded Halstead-Reitan battery. Odessa: Psychological Assessment Resources; 2004. Heaton RK, Miller SW, Taylor MJ, Grant I. Revised comprehensive norms for an expanded Halstead-Reitan battery. Odessa: Psychological Assessment Resources; 2004.
67.
go back to reference Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi DA, Gombein J. The neuropsychiatric inventory: comprehensive assessment of psychopathology in dementia. Neurology. 1994. doi:10.1212/WNL.44.12.2308. Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi DA, Gombein J. The neuropsychiatric inventory: comprehensive assessment of psychopathology in dementia. Neurology. 1994. doi:10.​1212/​WNL.​44.​12.​2308.
68.
go back to reference Galasko D, Bennett D, Sano M, Ernesto C, Thomas R, Grundman M, et al. An inventory to assess activities of daily living for clinical trials in Alzheimer’s disease. The Alzheimer’s disease cooperative study. Alzheimer Dis Assoc Disord. 1997;11 Suppl 2:S33–9.CrossRefPubMed Galasko D, Bennett D, Sano M, Ernesto C, Thomas R, Grundman M, et al. An inventory to assess activities of daily living for clinical trials in Alzheimer’s disease. The Alzheimer’s disease cooperative study. Alzheimer Dis Assoc Disord. 1997;11 Suppl 2:S33–9.CrossRefPubMed
70.
go back to reference American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). 4th ed. Washington, DC: American Psychiatric Association Press; 1994. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). 4th ed. Washington, DC: American Psychiatric Association Press; 1994.
77.
go back to reference Kraemer HC, Moritz DJ, Yesavage J. Adjusting mini-mental state examination scores for age and educational level to screen for dementia: correcting bias or reducing validity? Int Psychogeriatr. 1998. doi:10.1017/S1041610298005134.PubMed Kraemer HC, Moritz DJ, Yesavage J. Adjusting mini-mental state examination scores for age and educational level to screen for dementia: correcting bias or reducing validity? Int Psychogeriatr. 1998. doi:10.​1017/​S104161029800513​4.PubMed
Metadata
Title
Digitally translated Self-Administered Gerocognitive Examination (eSAGE): relationship with its validated paper version, neuropsychological evaluations, and clinical assessments
Authors
Douglas W. Scharre
Shu ing Chang
Haikady N. Nagaraja
Nicole E. Vrettos
Robert A. Bornstein
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Alzheimer's Research & Therapy / Issue 1/2017
Electronic ISSN: 1758-9193
DOI
https://doi.org/10.1186/s13195-017-0269-3

Other articles of this Issue 1/2017

Alzheimer's Research & Therapy 1/2017 Go to the issue