Skip to main content
Top
Published in: Annals of General Psychiatry 1/2019

Open Access 01-12-2019 | Dementia | Primary research

Application of a multidimensional computerized adaptive test for a Clinical Dementia Rating Scale through computer-aided techniques

Authors: Yi-Lien Lee, Kao-Chang Lin, Tsair-Wei Chien

Published in: Annals of General Psychiatry | Issue 1/2019

Login to get access

Abstract

Background

With the increasingly rapid growth of the elderly population, individuals aged 65 years and above now compose 14% of Taiwanese citizens, thereby making Taiwanese society an aged society. A leading factor that affects the elderly population is dementia. A method of precisely and efficiently examining patients with dementia through multidimensional computer adaptive testing (MCAT) to accurately determine the patients’ stage of dementia needs to be developed. This study aimed to develop online MCAT that family members can use on their own computers, tablets, or smartphones to predict the extent of dementia for patients responding to the Clinical Dementia Rating (CDR) instrument.

Methods

The CDR was applied to 366 outpatients in a hospital in Taiwan. MCAT was employed with parameters for items across eight dimensions, and responses were simulated to compare the efficiency and precision between MCAT and non-adaptive testing (NAT). The number of items saved and the estimated person measures was compared between the results of MCAT and NAT, respectively.

Results

MCAT yielded substantially more precise measurements and was considerably more efficient than NAT. MCAT achieved 20.19% (= [53 − 42.3]/53) saving in item length when the measurement differences were less than 5%. Pearson correlation coefficients were highly consistent among the eight domains. The cut-off points for the overall measures were − 1.4, − 0.4, 0.4, and 1.4 logits, which was equivalent to 20% for each portion in percentile scores. Substantially fewer items were answered through MCAT than through NAT without compromising the precision of MCAT.

Conclusions

Developing a website that family members can use on their own computers, tablets, and smartphones to help them perform online screening and prediction of dementia in older adults is useful and manageable.
Appendix
Available only for authorised users
Literature
1.
go back to reference Douzenis A. Frontotemporal dementias: a review. Ann Gen Psychiatry. 2008;7(Suppl 1):S21.CrossRef Douzenis A. Frontotemporal dementias: a review. Ann Gen Psychiatry. 2008;7(Suppl 1):S21.CrossRef
2.
go back to reference Gustavsson A, Svensson M, Allgulander C, Alonso J, Beghi E, Jacobi F, Group CD. Cost of disorders of the brain in Europe 2010. Eur Coll Neuropsychopharmacol. 2011;21(10):718–79.CrossRef Gustavsson A, Svensson M, Allgulander C, Alonso J, Beghi E, Jacobi F, Group CD. Cost of disorders of the brain in Europe 2010. Eur Coll Neuropsychopharmacol. 2011;21(10):718–79.CrossRef
3.
go back to reference Weder ND, Aziz R, Wilkins K, Tampi RR. Frontotemporal dementias: a review. Ann Gen Psychiatry. 2007;6:15.CrossRef Weder ND, Aziz R, Wilkins K, Tampi RR. Frontotemporal dementias: a review. Ann Gen Psychiatry. 2007;6:15.CrossRef
4.
go back to reference Scerri A, Scerri C. Nursing Students’ knowledge and attitudes towards dementia—a Questionnaire Survey. Nurse Educ Today. 2013;33(9):962–8.CrossRef Scerri A, Scerri C. Nursing Students’ knowledge and attitudes towards dementia—a Questionnaire Survey. Nurse Educ Today. 2013;33(9):962–8.CrossRef
5.
go back to reference Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL. A new clinical scale for the staging of dementia. Br J Psychiatry. 1982;140:566–72.CrossRef Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL. A new clinical scale for the staging of dementia. Br J Psychiatry. 1982;140:566–72.CrossRef
6.
go back to reference Lin KN, Liu HC. Clinical Dementia Rating (CDR). Acta Neurologica Taiwanica. 2003;12(3):154–65 (Chinese version). Lin KN, Liu HC. Clinical Dementia Rating (CDR). Acta Neurologica Taiwanica. 2003;12(3):154–65 (Chinese version).
7.
go back to reference Ma SC, Wang HH, Chien TW. A new technique to measure online bullying: online computerized adaptive testing. Ann Gen Psychiatry. 2017;16:26.CrossRef Ma SC, Wang HH, Chien TW. A new technique to measure online bullying: online computerized adaptive testing. Ann Gen Psychiatry. 2017;16:26.CrossRef
8.
go back to reference Ma SC, Chien TW, Wang HH, Li YC, Yui MS. Applying computerized adaptive testing to the negative acts questionnaire-revised: rasch analysis of workplace bullying. J Med Internet Res. 2014;16(2):e50.CrossRef Ma SC, Chien TW, Wang HH, Li YC, Yui MS. Applying computerized adaptive testing to the negative acts questionnaire-revised: rasch analysis of workplace bullying. J Med Internet Res. 2014;16(2):e50.CrossRef
9.
go back to reference Segall DO. Multidimensional adaptive testing. Psychometrika. 1996;61:331–54.CrossRef Segall DO. Multidimensional adaptive testing. Psychometrika. 1996;61:331–54.CrossRef
10.
go back to reference Wang WC, Chen PH. Implementation and measurement efficiency of multidimensional computerized adaptive testing. Appl Psychol Meas. 2004;28(5):295–316.CrossRef Wang WC, Chen PH. Implementation and measurement efficiency of multidimensional computerized adaptive testing. Appl Psychol Meas. 2004;28(5):295–316.CrossRef
11.
go back to reference Chien TW, Wang WC. An online multidimensional computerized adaptive testing (MCAT) module using APP. Rasch Measurement Trans. 2017;31(1):1625–6. Chien TW, Wang WC. An online multidimensional computerized adaptive testing (MCAT) module using APP. Rasch Measurement Trans. 2017;31(1):1625–6.
12.
go back to reference Lin ML, Chen YC, Lin GJ, Chien TW. An analysis of the feasibility of using a computer-aided technique to score the clinical dementia rating scale. J Healthc Manage. 2014;15(4):306–26 (Chinese version). Lin ML, Chen YC, Lin GJ, Chien TW. An analysis of the feasibility of using a computer-aided technique to score the clinical dementia rating scale. J Healthc Manage. 2014;15(4):306–26 (Chinese version).
13.
go back to reference Cedarbaum JM, Jaros M, Hernandez C, Coley N, Andrieu S, Grundman M, Vellas B. Rationale for use of the clinical dementia rating sum of boxes as a primary outcome measure for alzheimer’s disease clinical trials. Alzheimer’s Dementia. 2013;9(1 Suppl):S45–55.CrossRef Cedarbaum JM, Jaros M, Hernandez C, Coley N, Andrieu S, Grundman M, Vellas B. Rationale for use of the clinical dementia rating sum of boxes as a primary outcome measure for alzheimer’s disease clinical trials. Alzheimer’s Dementia. 2013;9(1 Suppl):S45–55.CrossRef
14.
go back to reference Williams MM, Storandt M, Roe CM, Morris JC. Progression of Alzheimer’s disease as measured by clinical dementia rating sum of boxes scores. Alzheimer’s Dementia. 2013;9(1 Suppl):S39–44.CrossRef Williams MM, Storandt M, Roe CM, Morris JC. Progression of Alzheimer’s disease as measured by clinical dementia rating sum of boxes scores. Alzheimer’s Dementia. 2013;9(1 Suppl):S39–44.CrossRef
15.
go back to reference Rasch G. Probabilistic models for some Intelligence and attainment tests. Chicago: University of Chicago Press; 1960. Rasch G. Probabilistic models for some Intelligence and attainment tests. Chicago: University of Chicago Press; 1960.
16.
go back to reference Adams RJ, Wilson MR, Wang WC. The multidimensional random coefficients multinomial logit model. Appl Psychol Meas. 1997;21:1–23.CrossRef Adams RJ, Wilson MR, Wang WC. The multidimensional random coefficients multinomial logit model. Appl Psychol Meas. 1997;21:1–23.CrossRef
17.
go back to reference Berg L. Clinical dementia rating (CDR). Psychopharmacol Bull. 1988;24:637–9.PubMed Berg L. Clinical dementia rating (CDR). Psychopharmacol Bull. 1988;24:637–9.PubMed
18.
go back to reference Morris JC, Ernesto C, Schafer K, Coats M, Leon S, Sano M, Thal LJ, Woodbury P. Clinical dementia rating training and reliability in multicenter studies: the Alzheimer’s disease cooperative study experience. Neurology. 1997;48:1508–10.CrossRef Morris JC, Ernesto C, Schafer K, Coats M, Leon S, Sano M, Thal LJ, Woodbury P. Clinical dementia rating training and reliability in multicenter studies: the Alzheimer’s disease cooperative study experience. Neurology. 1997;48:1508–10.CrossRef
19.
go back to reference Wu ML, Adams RJ, Wilson MR. Acer ConQuest. Melbourne: Australian Council for Educational Research press; 1998. Wu ML, Adams RJ, Wilson MR. Acer ConQuest. Melbourne: Australian Council for Educational Research press; 1998.
20.
go back to reference Wang WC. Recent Developments in Rasch Measurement. Hong Kong: The Hong Kong Institute of Education Press; 2010. Wang WC. Recent Developments in Rasch Measurement. Hong Kong: The Hong Kong Institute of Education Press; 2010.
21.
go back to reference Straus SE, Glasziou P, Richardson WS, Haynes RB. Evidence-based medicine, how to practice and teach EBM. 3rd ed. Edinburgh: Churchill Livingstone; 2005. p. 67–99. Straus SE, Glasziou P, Richardson WS, Haynes RB. Evidence-based medicine, how to practice and teach EBM. 3rd ed. Edinburgh: Churchill Livingstone; 2005. p. 67–99.
22.
go back to reference Liao HF, Yao G, Chienc CC, Cheng LY, Hsiehe WS. Likelihood ratios of multiple cutoff points of the Taipei City Developmental Checklist for Preschoolers, 2nd version. Formosan J Med. 2014;113(3):179–86.CrossRef Liao HF, Yao G, Chienc CC, Cheng LY, Hsiehe WS. Likelihood ratios of multiple cutoff points of the Taipei City Developmental Checklist for Preschoolers, 2nd version. Formosan J Med. 2014;113(3):179–86.CrossRef
23.
go back to reference Fisher W Jr. Reliability, separation, strata statistics. Rasch Meas Trans. 1994;6(3):238. Fisher W Jr. Reliability, separation, strata statistics. Rasch Meas Trans. 1994;6(3):238.
24.
go back to reference Wright BD, Masters GN. Number of person or item strata. Rasch Meas Trans. 2002;16(3):888. Wright BD, Masters GN. Number of person or item strata. Rasch Meas Trans. 2002;16(3):888.
25.
go back to reference Wright BD. Reliability and separation. Rasch Meas Trans. 1996;9(4):472. Wright BD. Reliability and separation. Rasch Meas Trans. 1996;9(4):472.
26.
go back to reference Fisher WP Jr. The cash value of reliability. Rasch Meas Trans. 2008;22(1):1160–3. Fisher WP Jr. The cash value of reliability. Rasch Meas Trans. 2008;22(1):1160–3.
27.
go back to reference Linacre JM. Optimizing rating scale category effectiveness. J Appl Measure. 2002;3(1):85–106. Linacre JM. Optimizing rating scale category effectiveness. J Appl Measure. 2002;3(1):85–106.
28.
go back to reference Maslach C, Schaufeli WB, Leiter MP. Job burnout. Ann Rev Psychol. 2001;52:397–422.CrossRef Maslach C, Schaufeli WB, Leiter MP. Job burnout. Ann Rev Psychol. 2001;52:397–422.CrossRef
29.
go back to reference Smith EV. Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Measur. 2002;3:205–31. Smith EV. Detecting and evaluation the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Measur. 2002;3:205–31.
31.
go back to reference Chien TW, Wang WC, Huang SY, Lai WP, Chow JC. A web-based computerized adaptive testing (CAT) to assess patient perception in hospitalization. J Med Internet Res. 2011;13(3):e61.CrossRef Chien TW, Wang WC, Huang SY, Lai WP, Chow JC. A web-based computerized adaptive testing (CAT) to assess patient perception in hospitalization. J Med Internet Res. 2011;13(3):e61.CrossRef
32.
go back to reference Chien TW, Wu HM, Wang WC, Castillo RV, Chou W. Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation. Health Qual Life Outcomes. 2009;7:39.CrossRef Chien TW, Wu HM, Wang WC, Castillo RV, Chou W. Reduction in patient burdens with graphical computerized adaptive testing on the ADL scale: tool development and simulation. Health Qual Life Outcomes. 2009;7:39.CrossRef
33.
go back to reference Wainer HW, Dorans NJ. Computerized adaptive testing: a primer. Hillsdale: L Erlbaum Associates; 1990. Wainer HW, Dorans NJ. Computerized adaptive testing: a primer. Hillsdale: L Erlbaum Associates; 1990.
34.
go back to reference Embretson S, Reise S, Reise SP. Item response theory for psychologists. Mahwah: L Erlbaum Associates; 2000. Embretson S, Reise S, Reise SP. Item response theory for psychologists. Mahwah: L Erlbaum Associates; 2000.
35.
go back to reference Djaja N, Janda M, Olsen CM, Whiteman DC, Chien TW. Estimating skin cancer risk: evaluating mobile computer-adaptive testing. J Med Internet Res. 2016;18(1):e22.CrossRef Djaja N, Janda M, Olsen CM, Whiteman DC, Chien TW. Estimating skin cancer risk: evaluating mobile computer-adaptive testing. J Med Internet Res. 2016;18(1):e22.CrossRef
Metadata
Title
Application of a multidimensional computerized adaptive test for a Clinical Dementia Rating Scale through computer-aided techniques
Authors
Yi-Lien Lee
Kao-Chang Lin
Tsair-Wei Chien
Publication date
01-12-2019
Publisher
BioMed Central
Keywords
Dementia
Dementia
Published in
Annals of General Psychiatry / Issue 1/2019
Electronic ISSN: 1744-859X
DOI
https://doi.org/10.1186/s12991-019-0228-4

Other articles of this Issue 1/2019

Annals of General Psychiatry 1/2019 Go to the issue