Skip to main content
Top
Published in: BMC Neurology 1/2005

Open Access 01-12-2005 | Research article

Validation of multi-stage telephone-based identification of cognitive impairment and dementia

Authors: Valerie C Crooks, Linda Clark, Diana B Petitti, Helena Chui, Vicki Chiu

Published in: BMC Neurology | Issue 1/2005

Login to get access

Abstract

Background

Many types of research on dementia and cognitive impairment require large sample sizes. Detailed in-person assessment using batteries of neuropyschologic testing is expensive. This study evaluates whether a brief telephone cognitive assessment strategy can reliably classify cognitive status when compared to an in-person "gold-standard" clinical assessment.

Methods

The gold standard assessment of cognitive status was conducted at the University of Southern California Alzheimer Disease Research Center (USC ADRC). It involved an examination of patients with a memory complaint by a neurologist or psychiatrist specializing in cognitive disorders and administration of a battery of neuropsychologic tests. The method being evaluated was a multi-staged assessment using the Telephone Interview of Cognitive Status-modified (TICSm) with patients and the Telephone Dementia Questionnaire (TDQ) with a proxy. Elderly male and female patients who had received the gold standard in-person assessment were asked to also undergo the telephone assessment. The unweighted kappa statistic was calculated to compare the gold standard and the multistage telephone assessment methods. Sensitivity for classification with dementia and specificity for classification as normal were also calculated.

Results

Of 50 patients who underwent the gold standard assessment and were referred for telephone assessment, 38 (76%) completed the TICS. The mean age was 78.1 years and 26 (68%) were female. When comparing the gold standard assessment and the telephone method for classifying subjects as having dementia or no dementia, the sensitivity of the telephone method was 0.83 (95% confidence interval 0.36, 1.00), the specificity was 1.00 (95% confidence interval 0.89,1.00). Kappa was 0.89 (95% confidence interval 0.69, 1.000). Considering a gold-standard assessment of age-associated memory impairment as cognitive impairment, the sensitivity of the telephone approach is 0.38 (95% confidence interval 0.09, 0.76) specificity 0.96 (CI 0.45, 0.89) and kappa 0.61 (CI 0.37, 0.85).

Conclusion

Use of a telephone interview to identify people with dementia or cognitive impairment is a promising and relatively inexpensive strategy for identifying potential participants in intervention and clinical research studies and for classifying subjects in epidemiologic studies.
Literature
1.
go back to reference Gifford DR, Cummings JL: Evaluating dementia screening tests: methodologic standards to rate their performance. Editorial. Neurology. 1999, 52: 224-227.CrossRefPubMed Gifford DR, Cummings JL: Evaluating dementia screening tests: methodologic standards to rate their performance. Editorial. Neurology. 1999, 52: 224-227.CrossRefPubMed
2.
go back to reference Gallo JJ, Breitner JC: Alzheimer's disease in the NAS-NRC Registry of aging twin veterans, IV. Performance characteristics of a two-stage telephone screening procedure for Alzheimer's dementia. Psychol Med. 1995, 25: 1211-1219.CrossRefPubMed Gallo JJ, Breitner JC: Alzheimer's disease in the NAS-NRC Registry of aging twin veterans, IV. Performance characteristics of a two-stage telephone screening procedure for Alzheimer's dementia. Psychol Med. 1995, 25: 1211-1219.CrossRefPubMed
3.
go back to reference Zandi PP, Carlson MV, Plassman BL, Welsh-Bohmer KA, Steffens DC, Breitner JCS: Hormone replacement therapy and the incidence of Alzheimer Disease in older women the Cache County Study. JAMA. 2002, 288: 2123-2129. 10.1001/jama.288.17.2123.CrossRefPubMed Zandi PP, Carlson MV, Plassman BL, Welsh-Bohmer KA, Steffens DC, Breitner JCS: Hormone replacement therapy and the incidence of Alzheimer Disease in older women the Cache County Study. JAMA. 2002, 288: 2123-2129. 10.1001/jama.288.17.2123.CrossRefPubMed
4.
go back to reference Welsh KA, Breitner JCS, Magruder-Habib KM: Detection of dementia in the elderly using telephone screening of cognitive status. Neuropsychiatry Neuropsychol Behav Neurol. 1993, 6: 103-110. Welsh KA, Breitner JCS, Magruder-Habib KM: Detection of dementia in the elderly using telephone screening of cognitive status. Neuropsychiatry Neuropsychol Behav Neurol. 1993, 6: 103-110.
5.
go back to reference Plassman BL, Newman TT, Welsh KA, Helms M, Breitner JCS: Properties of the telephone Interview for Cognitive Status: application in epidemiological and longitudinal studies. Neuropsychiatry Neuropsychol Behav Neurol. 1994, 7: 235-241. Plassman BL, Newman TT, Welsh KA, Helms M, Breitner JCS: Properties of the telephone Interview for Cognitive Status: application in epidemiological and longitudinal studies. Neuropsychiatry Neuropsychol Behav Neurol. 1994, 7: 235-241.
6.
go back to reference Silverman JM, Breitner JC, Mohs RC, Davis KL: Reliability of the family history method in genetic studies of Alzheimer's disease and related dementias. Am J Psychiatry. 1986, 143: 1279-1282.CrossRefPubMed Silverman JM, Breitner JC, Mohs RC, Davis KL: Reliability of the family history method in genetic studies of Alzheimer's disease and related dementias. Am J Psychiatry. 1986, 143: 1279-1282.CrossRefPubMed
7.
go back to reference McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM: Clinical diagnosis of Alzheimer's disease: Report of the NINCDS-ADRDA work group under the auspices of the Department of Health and Human Services Task Force on Alzheimer's disease. Neurology. 1984, 34: 939-944.CrossRefPubMed McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM: Clinical diagnosis of Alzheimer's disease: Report of the NINCDS-ADRDA work group under the auspices of the Department of Health and Human Services Task Force on Alzheimer's disease. Neurology. 1984, 34: 939-944.CrossRefPubMed
8.
go back to reference Folstein MF, Folstein SE, McHugh PR: "Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975, 12: 189-98. 10.1016/0022-3956(75)90026-6.CrossRefPubMed Folstein MF, Folstein SE, McHugh PR: "Mini-mental state": a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975, 12: 189-98. 10.1016/0022-3956(75)90026-6.CrossRefPubMed
9.
go back to reference Brandt J, Spencer M, Folstein M: The Telephone Interview for Cognitive Status. Neuropsychiatry, Neuropsychol Behav Neurol. 1998, 1: 111-117. Brandt J, Spencer M, Folstein M: The Telephone Interview for Cognitive Status. Neuropsychiatry, Neuropsychol Behav Neurol. 1998, 1: 111-117.
10.
go back to reference De Jager CA, Budge MM, Clarke R: Utility of TICS-m for the assessment of cognitive function in older adults. Int J Geriatr Psychiatry. 2003, 18: 318-24. 10.1002/gps.830.CrossRefPubMed De Jager CA, Budge MM, Clarke R: Utility of TICS-m for the assessment of cognitive function in older adults. Int J Geriatr Psychiatry. 2003, 18: 318-24. 10.1002/gps.830.CrossRefPubMed
11.
go back to reference Buckwalter JG, Crooks VC, Petitti DB: A psychometric analysis of a computer-assisted administration of the Telephone Interview for Cognitive Status-modified. J Clin and Exp Neuropsychol. 2002, 24: 168-175.CrossRef Buckwalter JG, Crooks VC, Petitti DB: A psychometric analysis of a computer-assisted administration of the Telephone Interview for Cognitive Status-modified. J Clin and Exp Neuropsychol. 2002, 24: 168-175.CrossRef
12.
go back to reference Beeri MS, Werner P, Davidson M, Schmindler J, Silverman J: Validation of the modified telephone interview for cognitive status (TICS-m) in Hebrew. Int J Geriatr Psychiatry. 2003, 18: 381-6. 10.1002/gps.840.CrossRefPubMed Beeri MS, Werner P, Davidson M, Schmindler J, Silverman J: Validation of the modified telephone interview for cognitive status (TICS-m) in Hebrew. Int J Geriatr Psychiatry. 2003, 18: 381-6. 10.1002/gps.840.CrossRefPubMed
13.
go back to reference Kawas C, Segal J, Stewart WF, Corrada M, Thal LJ: A validation study of the dementia questionnaire. Arch Neurol. 1994, 51: 901-906.CrossRefPubMed Kawas C, Segal J, Stewart WF, Corrada M, Thal LJ: A validation study of the dementia questionnaire. Arch Neurol. 1994, 51: 901-906.CrossRefPubMed
14.
go back to reference Li G, Aryan M, Silverman JM, Haroutunian V, Perl DP, Birstein S, Lantz M, Marin DB, Mohs RC, Davis KL: The validity of the family history method for identifying Alzheimer disease. Arch Neurol. 1997, 54: 634-640.CrossRefPubMed Li G, Aryan M, Silverman JM, Haroutunian V, Perl DP, Birstein S, Lantz M, Marin DB, Mohs RC, Davis KL: The validity of the family history method for identifying Alzheimer disease. Arch Neurol. 1997, 54: 634-640.CrossRefPubMed
15.
go back to reference Ellis RJ, Jan K, Kawas C, Koller WC, Lyons KE, Jeste DV, Hansen LA, Thal L: Diagnostic validity of the dementia questionnaire for Alzheimer disease. Arch Neurol. 1998, 55: 360-5. 10.1001/archneur.55.3.360.CrossRefPubMed Ellis RJ, Jan K, Kawas C, Koller WC, Lyons KE, Jeste DV, Hansen LA, Thal L: Diagnostic validity of the dementia questionnaire for Alzheimer disease. Arch Neurol. 1998, 55: 360-5. 10.1001/archneur.55.3.360.CrossRefPubMed
16.
go back to reference Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York, John Wiley & Sons, 2 Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York, John Wiley & Sons, 2
17.
go back to reference CYTEL Software Corporation: StatXact 5. 2001, Cambridge, MA, CYTEL Software Corporation CYTEL Software Corporation: StatXact 5. 2001, Cambridge, MA, CYTEL Software Corporation
18.
go back to reference Luis CA, Lowenstein DA, Acevedo A, Barker WW, Duara R: Mild cognitive impairment: directions for future research. Neurology. 2003, 61: 438-44.CrossRefPubMed Luis CA, Lowenstein DA, Acevedo A, Barker WW, Duara R: Mild cognitive impairment: directions for future research. Neurology. 2003, 61: 438-44.CrossRefPubMed
19.
go back to reference DeCarli C: Mild cognitive impairment: prevalence, prognosis, aetiology, and treatment. Lancet Neurol. 2003, 2: 15-21. 10.1016/S1474-4422(03)00262-X.CrossRefPubMed DeCarli C: Mild cognitive impairment: prevalence, prognosis, aetiology, and treatment. Lancet Neurol. 2003, 2: 15-21. 10.1016/S1474-4422(03)00262-X.CrossRefPubMed
20.
go back to reference Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST: Practice parameter:early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001, 56: 1133-1142.CrossRefPubMed Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST: Practice parameter:early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001, 56: 1133-1142.CrossRefPubMed
21.
go back to reference Bruscoli M, Lovestone S: Is MCI really just early dementia? A systematic review of conversion studies. Int Psychogeriatr. 2004, 6: 129-40. 10.1017/S1041610204000092.CrossRef Bruscoli M, Lovestone S: Is MCI really just early dementia? A systematic review of conversion studies. Int Psychogeriatr. 2004, 6: 129-40. 10.1017/S1041610204000092.CrossRef
22.
go back to reference Busse A, Bischkopf J, Reidel-Heller SG, Angermeyer MC: Mild cognitive impairment: prevalence and incidence according to different diagnostic criteria. Results of the Leipzig Longitudinal Study of the Aged (LEILA75+). Br J Psychiatry. 2003, 182: 449-54. 10.1192/bjp.182.5.449.CrossRefPubMed Busse A, Bischkopf J, Reidel-Heller SG, Angermeyer MC: Mild cognitive impairment: prevalence and incidence according to different diagnostic criteria. Results of the Leipzig Longitudinal Study of the Aged (LEILA75+). Br J Psychiatry. 2003, 182: 449-54. 10.1192/bjp.182.5.449.CrossRefPubMed
23.
go back to reference Davis HS, Rockwood K: Conceptualization of mild cognitive impairment: a review. Int J Geriatr Psychiatry. 2004, 19: 313-9. 10.1002/gps.1049.CrossRefPubMed Davis HS, Rockwood K: Conceptualization of mild cognitive impairment: a review. Int J Geriatr Psychiatry. 2004, 19: 313-9. 10.1002/gps.1049.CrossRefPubMed
24.
go back to reference Fisk JD, Merry HR, Rockwood K: Variations in case definition affect prevalence but not outcomes of mild cognitive impairment. Neurology. 2003, 61: 1179-84.CrossRefPubMed Fisk JD, Merry HR, Rockwood K: Variations in case definition affect prevalence but not outcomes of mild cognitive impairment. Neurology. 2003, 61: 1179-84.CrossRefPubMed
25.
go back to reference Larrieu S, Letenneur L, Orgogozo JM, Fabrigoule C, Amieva H, Le Carret N, Barberger-Gateau P, Dartigues JF: Incidence and outcome of mild cognitive impairment in a population-based prospective cohort. Neurology. 2002, 59: 1594-9.CrossRefPubMed Larrieu S, Letenneur L, Orgogozo JM, Fabrigoule C, Amieva H, Le Carret N, Barberger-Gateau P, Dartigues JF: Incidence and outcome of mild cognitive impairment in a population-based prospective cohort. Neurology. 2002, 59: 1594-9.CrossRefPubMed
26.
go back to reference Ganguli M, Dodge HH, Shen C, DeKoskey ST: Mild cognitive impairment, amnestic type: an epidemiologic study. Neurology. 2004, 63: 115-21.CrossRefPubMed Ganguli M, Dodge HH, Shen C, DeKoskey ST: Mild cognitive impairment, amnestic type: an epidemiologic study. Neurology. 2004, 63: 115-21.CrossRefPubMed
27.
go back to reference Rothman KJ, Greenland S: Modern Epidemiology. 1998, Philadelphia, PA, Lippincott-Raven, 2 Rothman KJ, Greenland S: Modern Epidemiology. 1998, Philadelphia, PA, Lippincott-Raven, 2
28.
go back to reference Petitti DB, Buckwalter JG, Crooks VC, Chiu V: Prevalence of dementia in users of hormone replacement therapy as defined by prescription data. J Gerontol A Biol Sci Med Sci. 2002, 57: M532-M538.CrossRefPubMed Petitti DB, Buckwalter JG, Crooks VC, Chiu V: Prevalence of dementia in users of hormone replacement therapy as defined by prescription data. J Gerontol A Biol Sci Med Sci. 2002, 57: M532-M538.CrossRefPubMed
Metadata
Title
Validation of multi-stage telephone-based identification of cognitive impairment and dementia
Authors
Valerie C Crooks
Linda Clark
Diana B Petitti
Helena Chui
Vicki Chiu
Publication date
01-12-2005
Publisher
BioMed Central
Published in
BMC Neurology / Issue 1/2005
Electronic ISSN: 1471-2377
DOI
https://doi.org/10.1186/1471-2377-5-8

Other articles of this Issue 1/2005

BMC Neurology 1/2005 Go to the issue