Skip to main content
Top
Published in: BMC Geriatrics 1/2018

Open Access 01-12-2018 | Study protocol

Diagnostic test accuracy of a novel smartphone application for the assessment of attention deficits in delirium in older hospitalised patients: a prospective cohort study protocol

Authors: Lisa-Marie Rutter, Eva Nouzova, David J. Stott, Christopher J. Weir, Valentina Assi, Jennifer H. Barnett, Caoimhe Clarke, Nikki Duncan, Jonathan Evans, Samantha Green, Kirsty Hendry, Meigan McGinlay, Jenny McKeever, Duncan G. Middleton, Stuart Parks, Robert Shaw, Elaine Tang, Tim Walsh, Alexander J. Weir, Elizabeth Wilson, Tara Quasim, Alasdair M.J. MacLullich, Zoë Tieges

Published in: BMC Geriatrics | Issue 1/2018

Login to get access

Abstract

Background

Delirium is a common and serious clinical syndrome which is often missed in routine clinical care. The core cognitive feature is inattention. We developed a novel bedside neuropsychological test for assessing inattention in delirium implemented on a smartphone platform (DelApp). We aim to evaluate the diagnostic performance of the DelApp in a representative cohort of older hospitalised patients.

Methods

This is a prospective study of older non-scheduled hospitalised patients (target n = 500, age ≥ 65), recruited from elderly care and acute orthopaedic wards. Exclusion criteria are: non-English speakers; severe vision or hearing impairment; photosensitive epilepsy.
A structured reference standard delirium assessment based on DSM-5 criteria will be used, which includes a cognitive test battery administered by a trained assessor (Orientation-Memory-Concentration Test, Abbreviated Mental Test-10, Delirium Rating Severity Scale-Revised-98, digit span, months and days backwards, Vigilance A’ test) and assessment of arousal (Observational Scale of Level of Arousal, Richmond Agitation Sedation Scale). Prior change in cognition will be documented using the Informant Questionnaire on Cognitive Decline in the Elderly. Patients will be categorized as delirium (with/without dementia), possible delirium, dementia, no cognitive impairment, or undetermined.
A separate assessor (blinded to diagnosis and assessments) will administer the DelApp index test within 3 h of the reference standard assessment. The DelApp comprises assessment of arousal (score 0-4) and sustained attention (score 0-6), yielding a total score between 0 and 10 (higher score = better performance). Outcomes (length of stay, mortality and discharge location) will be collected at 12 weeks.
We will evaluate a priori cutpoints derived from a previous case-control study. Measures of the accuracy of DelApp will include sensitivity, specificity, positive and negative predictive values, and area under the ROC curve. We plan repeat assessments on up to 4 occasions in a purposive subsample of 30 patients (15 delirium, 15 no delirium) to examine changes over time.

Discussion

This study evaluates the diagnostic test accuracy of a novel smartphone test for delirium in a representative cohort of older hospitalised patients, including those with dementia. DelApp has the potential to be a convenient, objective method of improving delirium assessment for older people in acute care.

Trial registration

Clinical trials.gov, NCT02590796. Registered on 29 Oct 2015. Protocol version 5, dated 25 July 2016.
Appendix
Available only for authorised users
Literature
1.
go back to reference Collins N, Blanchard MR, Tookman A, Sampson EL. Detection of delirium in the acute hospital. Age Ageing. 2010;39(1):131–5.CrossRef Collins N, Blanchard MR, Tookman A, Sampson EL. Detection of delirium in the acute hospital. Age Ageing. 2010;39(1):131–5.CrossRef
2.
go back to reference Siddiqi N, House AO, Holmes JD. Occurrence and outcome of delirium in medical in-patients: a systematic literature review. Age Ageing. 2006;35(4):350–64.CrossRef Siddiqi N, House AO, Holmes JD. Occurrence and outcome of delirium in medical in-patients: a systematic literature review. Age Ageing. 2006;35(4):350–64.CrossRef
3.
go back to reference Ryan DJ, O'Regan NA, Caoimh RO, Clare J, O'Connor M, Leonard M, McFarland J, Tighe S, O'Sullivan K, Trzepacz PT, et al. Delirium in an adult acute hospital population: predictors, prevalence and detection. BMJ Open. 2013;3:1.CrossRef Ryan DJ, O'Regan NA, Caoimh RO, Clare J, O'Connor M, Leonard M, McFarland J, Tighe S, O'Sullivan K, Trzepacz PT, et al. Delirium in an adult acute hospital population: predictors, prevalence and detection. BMJ Open. 2013;3:1.CrossRef
4.
go back to reference Davis DH, Muniz Terrera G, Keage H, Rahkonen T, Oinas M, Matthews FE, Cunningham C, Polvikoski T, Sulkava R, MacLullich AM, et al. Delirium is a strong risk factor for dementia in the oldest-old: a population-based cohort study. Brain. 2012;135(Pt 9):2809–16.CrossRef Davis DH, Muniz Terrera G, Keage H, Rahkonen T, Oinas M, Matthews FE, Cunningham C, Polvikoski T, Sulkava R, MacLullich AM, et al. Delirium is a strong risk factor for dementia in the oldest-old: a population-based cohort study. Brain. 2012;135(Pt 9):2809–16.CrossRef
5.
go back to reference Witlox J, Eurelings LS, de Jonghe JF, Kalisvaart KJ, Eikelenboom P, van Gool WA. Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: a meta-analysis. JAMA. 2010;304(4):443–51.CrossRef Witlox J, Eurelings LS, de Jonghe JF, Kalisvaart KJ, Eikelenboom P, van Gool WA. Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia: a meta-analysis. JAMA. 2010;304(4):443–51.CrossRef
6.
go back to reference MacLullich AM, Beaglehole A, Hall RJ, Meagher DJ. Delirium and long-term cognitive impairment. Int Rev Psychiatry. 2009;21(1):30–42.CrossRef MacLullich AM, Beaglehole A, Hall RJ, Meagher DJ. Delirium and long-term cognitive impairment. Int Rev Psychiatry. 2009;21(1):30–42.CrossRef
7.
go back to reference Partridge JS, Martin FC, Harari D, Dhesi JK. The delirium experience: what is the effect on patients, relatives and staff and what can be done to modify this? Int J Geriatr Psychiatry. 2013;28(8):804–12.CrossRef Partridge JS, Martin FC, Harari D, Dhesi JK. The delirium experience: what is the effect on patients, relatives and staff and what can be done to modify this? Int J Geriatr Psychiatry. 2013;28(8):804–12.CrossRef
8.
go back to reference Leslie DL, Marcantonio ER, Zhang Y, Leo-Summers L, Inouye SK. One-year health care costs associated with delirium in the elderly population. Arch Intern Med. 2008;168(1):27–32.CrossRef Leslie DL, Marcantonio ER, Zhang Y, Leo-Summers L, Inouye SK. One-year health care costs associated with delirium in the elderly population. Arch Intern Med. 2008;168(1):27–32.CrossRef
9.
go back to reference Kakuma R, du Fort GG, Arsenault L, Perrault A, Platt RW, Monette J, Moride Y, Wolfson C. Delirium in older emergency department patients discharged home: effect on survival. J Am Geriatr Soc. 2003;51(4):443–50.CrossRef Kakuma R, du Fort GG, Arsenault L, Perrault A, Platt RW, Monette J, Moride Y, Wolfson C. Delirium in older emergency department patients discharged home: effect on survival. J Am Geriatr Soc. 2003;51(4):443–50.CrossRef
10.
go back to reference Royal College of Psychiatrists: National Audit of Dementia care in general hospitals 2012-13: Second round audit report and update. Edited by Young J, Hood C, Gandesha A, Souza R. London; 2013. Royal College of Psychiatrists: National Audit of Dementia care in general hospitals 2012-13: Second round audit report and update. Edited by Young J, Hood C, Gandesha A, Souza R. London; 2013.
11.
go back to reference National Institute for Health and Clinical Excellence: Delirium: diagnosis, prevention and management. (Clinical Guideline 103) 2010 [on-line]. Available at www.nice.org.uk/CG103 Accessed May 14, 2018. National Institute for Health and Clinical Excellence: Delirium: diagnosis, prevention and management. (Clinical Guideline 103) 2010 [on-line]. Available at www.​nice.​org.​uk/​CG103 Accessed May 14, 2018.
12.
go back to reference Young J, Meagher D, Maclullich A. Cognitive assessment of older people. BMJ. 2011;343:d5042.CrossRef Young J, Meagher D, Maclullich A. Cognitive assessment of older people. BMJ. 2011;343:d5042.CrossRef
13.
go back to reference Brown LJ, Fordyce C, Zaghdani H, Starr JM, MacLullich AM. Detecting deficits of sustained visual attention in delirium. J Neurol Neurosurg Psychiatry. 2011;82(12):1334–40.CrossRef Brown LJ, Fordyce C, Zaghdani H, Starr JM, MacLullich AM. Detecting deficits of sustained visual attention in delirium. J Neurol Neurosurg Psychiatry. 2011;82(12):1334–40.CrossRef
14.
go back to reference Leonard M, O'Connell H, Williams O, Awan F, Exton C, O'Connor M, Adamis D, Dunne C, Cullen W, Meagher DJ. Attention, vigilance and visuospatial function in hospitalized elderly medical patients: relationship to neurocognitive diagnosis. J Psychosom Res. 2016;90:84–90.CrossRef Leonard M, O'Connell H, Williams O, Awan F, Exton C, O'Connor M, Adamis D, Dunne C, Cullen W, Meagher DJ. Attention, vigilance and visuospatial function in hospitalized elderly medical patients: relationship to neurocognitive diagnosis. J Psychosom Res. 2016;90:84–90.CrossRef
15.
go back to reference Lowery DP, Wesnes K, Brewster N, Ballard C. Quantifying the association between computerised measures of attention and confusion assessment method defined delirium: a prospective study of older orthopaedic surgical patients, free of dementia. Int J Geriatr Psychiatry. 2008;23(12):1253–60.CrossRef Lowery DP, Wesnes K, Brewster N, Ballard C. Quantifying the association between computerised measures of attention and confusion assessment method defined delirium: a prospective study of older orthopaedic surgical patients, free of dementia. Int J Geriatr Psychiatry. 2008;23(12):1253–60.CrossRef
16.
go back to reference Guenther U, Weykam J, Andorfer U, Theuerkauf N, Popp J, Ely EW, Putensen C. Implications of objective vs subjective delirium assessment in surgical intensive care patients. Am J Crit Care. 2012;21(1):e12–20.CrossRef Guenther U, Weykam J, Andorfer U, Theuerkauf N, Popp J, Ely EW, Putensen C. Implications of objective vs subjective delirium assessment in surgical intensive care patients. Am J Crit Care. 2012;21(1):e12–20.CrossRef
17.
go back to reference Tieges Z, Brown LJ, Maclullich AM. Objective assessment of attention in delirium: a narrative review. Int J Geriatr Psychiatry. 2014;29(12):1185–97.CrossRef Tieges Z, Brown LJ, Maclullich AM. Objective assessment of attention in delirium: a narrative review. Int J Geriatr Psychiatry. 2014;29(12):1185–97.CrossRef
18.
go back to reference Morandi A, Davis D, Bellelli G, Arora RC, Caplan GA, Kamholz B, Kolanowski A, Fick DM, Kreisel S, MacLullich A, et al. The diagnosis of delirium superimposed on dementia: an emerging challenge. J Am Med Dir Assoc. 2017;18(1):12–8.CrossRef Morandi A, Davis D, Bellelli G, Arora RC, Caplan GA, Kamholz B, Kolanowski A, Fick DM, Kreisel S, MacLullich A, et al. The diagnosis of delirium superimposed on dementia: an emerging challenge. J Am Med Dir Assoc. 2017;18(1):12–8.CrossRef
19.
go back to reference Perry RJ, Hodges JR. Attention and executive deficits in Alzheimer's disease. A critical review. Brain. 1999;122:383–404.CrossRef Perry RJ, Hodges JR. Attention and executive deficits in Alzheimer's disease. A critical review. Brain. 1999;122:383–404.CrossRef
20.
go back to reference Tieges Z, McGrath A, Hall RJ, Maclullich AM. Abnormal level of arousal as a predictor of delirium and inattention: an exploratory study. Am J Geriatr Psychiatry. 2013;21(12):1244–53.CrossRef Tieges Z, McGrath A, Hall RJ, Maclullich AM. Abnormal level of arousal as a predictor of delirium and inattention: an exploratory study. Am J Geriatr Psychiatry. 2013;21(12):1244–53.CrossRef
21.
go back to reference Green C, Hendry K, Wilson ES, Walsh T, Allerhand M, MacLullich AMJ, Tieges Z. A novel computerized test for detecting and monitoring visual attentional deficits and delirium in the ICU. Crit Care Med. 2017;45(7):1224–31.CrossRef Green C, Hendry K, Wilson ES, Walsh T, Allerhand M, MacLullich AMJ, Tieges Z. A novel computerized test for detecting and monitoring visual attentional deficits and delirium in the ICU. Crit Care Med. 2017;45(7):1224–31.CrossRef
22.
go back to reference Tieges Z, Stiobhairt A, Scott K, Suchorab K, Weir A, Parks S, Shenkin S, MacLullich A. Development of a smartphone application for the objective detection of attentional deficits in delirium. Int Psychogeriatr. 2015;27(8):1251–62.CrossRef Tieges Z, Stiobhairt A, Scott K, Suchorab K, Weir A, Parks S, Shenkin S, MacLullich A. Development of a smartphone application for the objective detection of attentional deficits in delirium. Int Psychogeriatr. 2015;27(8):1251–62.CrossRef
23.
go back to reference Nouzova E, Rutter L, Duncan N, Clarke C, Weir C, Evans J, Walsh T, Wilson E, Quasim T, Middleton D et al: Case-control study in 188 older hospitalized patients to assess the diagnostic accuracy of a software application for delirium. European Delirium Association Annual Meeting: 3-4 November 2016; Vilamoura, Portugal. Nouzova E, Rutter L, Duncan N, Clarke C, Weir C, Evans J, Walsh T, Wilson E, Quasim T, Middleton D et al: Case-control study in 188 older hospitalized patients to assess the diagnostic accuracy of a software application for delirium. European Delirium Association Annual Meeting: 3-4 November 2016; Vilamoura, Portugal.
24.
go back to reference Sampson EL, Blanchard MR, Jones L, Tookman A, King M. Dementia in the acute hospital: prospective cohort study of prevalence and mortality. Br J Psychiatry. 2009;195(1):61–6.CrossRef Sampson EL, Blanchard MR, Jones L, Tookman A, King M. Dementia in the acute hospital: prospective cohort study of prevalence and mortality. Br J Psychiatry. 2009;195(1):61–6.CrossRef
25.
go back to reference Katzman R, Brown T, Fuld P, Peck A, Schechter R, Schimmel H. Validation of a short orientation-memory-concentration test of cognitive impairment. Am J Psychiatry. 1983;140(6):734–9.CrossRef Katzman R, Brown T, Fuld P, Peck A, Schechter R, Schimmel H. Validation of a short orientation-memory-concentration test of cognitive impairment. Am J Psychiatry. 1983;140(6):734–9.CrossRef
26.
go back to reference Jitapunkul S, Pillay I, Ebrahim S. The abbreviated mental test: its use and validity. Age Ageing. 1991;20(5):332–6.CrossRef Jitapunkul S, Pillay I, Ebrahim S. The abbreviated mental test: its use and validity. Age Ageing. 1991;20(5):332–6.CrossRef
27.
go back to reference Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.CrossRef Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, Cummings JL, Chertkow H. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.CrossRef
28.
go back to reference Herr K, Spratt KF, Garand L, Li L. Evaluation of the Iowa pain thermometer and other selected pain intensity scales in younger and older adult cohorts using controlled clinical pain: a preliminary study. Pain Med. 2007;8(7):585–600.CrossRef Herr K, Spratt KF, Garand L, Li L. Evaluation of the Iowa pain thermometer and other selected pain intensity scales in younger and older adult cohorts using controlled clinical pain: a preliminary study. Pain Med. 2007;8(7):585–600.CrossRef
29.
go back to reference Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the delirium rating scale-revised-98: comparison with the delirium rating scale and the cognitive test for delirium. J Neuropsychiatry Clin Neurosci. 2001;13(2):229–42.CrossRef Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the delirium rating scale-revised-98: comparison with the delirium rating scale and the cognitive test for delirium. J Neuropsychiatry Clin Neurosci. 2001;13(2):229–42.CrossRef
30.
go back to reference Han JH, Vasilevskis EE, Schnelle JF, Shintani A, Dittus RS, Wilson A, Ely EW. The diagnostic performance of the Richmond agitation sedation scale for detecting delirium in older emergency department patients. Acad Emerg Med. 2015;22(7):878–82.CrossRef Han JH, Vasilevskis EE, Schnelle JF, Shintani A, Dittus RS, Wilson A, Ely EW. The diagnostic performance of the Richmond agitation sedation scale for detecting delirium in older emergency department patients. Acad Emerg Med. 2015;22(7):878–82.CrossRef
31.
go back to reference Jorm AF, Jacomb PA. The informant questionnaire on cognitive decline in the elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989;19(4):1015–22.CrossRef Jorm AF, Jacomb PA. The informant questionnaire on cognitive decline in the elderly (IQCODE): socio-demographic correlates, reliability, validity and some norms. Psychol Med. 1989;19(4):1015–22.CrossRef
32.
go back to reference Jackson TA, MacLullich AM, Gladman JR, Lord JM, Sheehan B. Diagnostic test accuracy of informant-based tools to diagnose dementia in older hospital patients with delirium: a prospective cohort study. Age Ageing. 2016;45(4):505–11.CrossRef Jackson TA, MacLullich AM, Gladman JR, Lord JM, Sheehan B. Diagnostic test accuracy of informant-based tools to diagnose dementia in older hospital patients with delirium: a prospective cohort study. Age Ageing. 2016;45(4):505–11.CrossRef
33.
go back to reference Brouillette RM, Foil H, Fontenot S, Correro A, Allen R, Martin CK, Bruce-Keller AJ, Keller JN. Feasibility, reliability, and validity of a smartphone based application for the assessment of cognitive function in the elderly. PLoS One. 2013;8(6):e65925.CrossRef Brouillette RM, Foil H, Fontenot S, Correro A, Allen R, Martin CK, Bruce-Keller AJ, Keller JN. Feasibility, reliability, and validity of a smartphone based application for the assessment of cognitive function in the elderly. PLoS One. 2013;8(6):e65925.CrossRef
Metadata
Title
Diagnostic test accuracy of a novel smartphone application for the assessment of attention deficits in delirium in older hospitalised patients: a prospective cohort study protocol
Authors
Lisa-Marie Rutter
Eva Nouzova
David J. Stott
Christopher J. Weir
Valentina Assi
Jennifer H. Barnett
Caoimhe Clarke
Nikki Duncan
Jonathan Evans
Samantha Green
Kirsty Hendry
Meigan McGinlay
Jenny McKeever
Duncan G. Middleton
Stuart Parks
Robert Shaw
Elaine Tang
Tim Walsh
Alexander J. Weir
Elizabeth Wilson
Tara Quasim
Alasdair M.J. MacLullich
Zoë Tieges
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2018
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-018-0901-5

Other articles of this Issue 1/2018

BMC Geriatrics 1/2018 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.