Skip to main content
Top
Published in: BMC Medicine 1/2019

Open Access 01-12-2019 | Confusion | Research article

Delirium detection in older acute medical inpatients: a multicentre prospective comparative diagnostic test accuracy study of the 4AT and the confusion assessment method

Authors: Susan D. Shenkin, Christopher Fox, Mary Godfrey, Najma Siddiqi, Steve Goodacre, John Young, Atul Anand, Alasdair Gray, Janet Hanley, Allan MacRaild, Jill Steven, Polly L. Black, Zoë Tieges, Julia Boyd, Jacqueline Stephen, Christopher J. Weir, Alasdair M. J. MacLullich

Published in: BMC Medicine | Issue 1/2019

Login to get access

Abstract

Background

Delirium affects > 15% of hospitalised patients but is grossly underdetected, contributing to poor care. The 4 ‘A’s Test (4AT, www.​the4AT.​com) is a short delirium assessment tool designed for routine use without special training. The primary objective was to assess the accuracy of the 4AT for delirium detection. The secondary objective was to compare the 4AT with another commonly used delirium assessment tool, the Confusion Assessment Method (CAM).

Methods

This was a prospective diagnostic test accuracy study set in emergency departments or acute medical wards involving acute medical patients aged ≥ 70. All those without acutely life-threatening illness or coma were eligible. Patients underwent (1) reference standard delirium assessment based on DSM-IV criteria and (2) were randomised to either the index test (4AT, scores 0–12; prespecified score of > 3 considered positive) or the comparator (CAM; scored positive or negative), in a random order, using computer-generated pseudo-random numbers, stratified by study site, with block allocation. Reference standard and 4AT or CAM assessments were performed by pairs of independent raters blinded to the results of the other assessment.

Results

Eight hundred forty-three individuals were randomised: 21 withdrew, 3 lost contact, 32 indeterminate diagnosis, 2 missing outcome, and 785 were included in the analysis. Mean age was 81.4 (SD 6.4) years. 12.1% (95/785) had delirium by reference standard assessment, 14.3% (56/392) by 4AT, and 4.7% (18/384) by CAM. The 4AT had an area under the receiver operating characteristic curve of 0.90 (95% CI 0.84–0.96). The 4AT had a sensitivity of 76% (95% CI 61–87%) and a specificity of 94% (95% CI 92–97%). The CAM had a sensitivity of 40% (95% CI 26–57%) and a specificity of 100% (95% CI 98–100%).

Conclusions

The 4AT is a short, pragmatic tool which can help improving detection rates of delirium in routine clinical care.

Trial registration

International standard randomised controlled trial number (ISRCTN) 53388093. Date applied 30/05/2014; date assigned 02/06/2014.
Appendix
Available only for authorised users
Literature
1.
go back to reference Reynish EL, Hapca SM, De Souza N, Cvoro V, Donnan PT, Guthrie B. Epidemiology and outcomes of people with dementia, delirium, and unspecified cognitive impairment in the general hospital: prospective cohort study of 10,014 admissions. BMC Med. 2017;15(1):140.PubMedPubMedCentralCrossRef Reynish EL, Hapca SM, De Souza N, Cvoro V, Donnan PT, Guthrie B. Epidemiology and outcomes of people with dementia, delirium, and unspecified cognitive impairment in the general hospital: prospective cohort study of 10,014 admissions. BMC Med. 2017;15(1):140.PubMedPubMedCentralCrossRef
2.
go back to reference Pendlebury ST, Lovett NG, Smith SC, Dutta N, Bendon C, Lloyd-Lavery A, Mehta Z, Rothwell PM. Observational, longitudinal study of delirium in consecutive unselected acute medical admissions: age-specific rates and associated factors, mortality and re-admission. BMJ open. 2015;5(11):e007808.PubMedPubMedCentralCrossRef Pendlebury ST, Lovett NG, Smith SC, Dutta N, Bendon C, Lloyd-Lavery A, Mehta Z, Rothwell PM. Observational, longitudinal study of delirium in consecutive unselected acute medical admissions: age-specific rates and associated factors, mortality and re-admission. BMJ open. 2015;5(11):e007808.PubMedPubMedCentralCrossRef
5.
go back to reference Goldberg SE, Whittamore KH, Harwood RH, Bradshaw LE, Gladman JR, Jones RG. The prevalence of mental health problems among older adults admitted as an emergency to a general hospital. Age Ageing. 2012;41(1):80–6.PubMedCrossRef Goldberg SE, Whittamore KH, Harwood RH, Bradshaw LE, Gladman JR, Jones RG. The prevalence of mental health problems among older adults admitted as an emergency to a general hospital. Age Ageing. 2012;41(1):80–6.PubMedCrossRef
6.
go back to reference The Royal College of Psychiatrists. Who cares wins. London: Royal College of Psychiatrists; 2005. The Royal College of Psychiatrists. Who cares wins. London: Royal College of Psychiatrists; 2005.
7.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association; 2000. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association; 2000.
8.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders: 5th ed. Washington, DC: American Psychiatric Association; 2013. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: 5th ed. Washington, DC: American Psychiatric Association; 2013.
9.
go back to reference Davis DH, Muniz-Terrera G, Keage HA, Stephan BC, Fleming J, Ince PG, Matthews FE, Cunningham C, Ely EW, MacLullich AM, et al. Association of delirium with cognitive decline in late life: a neuropathologic study of 3 population-based cohort studies. JAMA Psychiatry. 2017;74(3):244–51.PubMedPubMedCentralCrossRef Davis DH, Muniz-Terrera G, Keage HA, Stephan BC, Fleming J, Ince PG, Matthews FE, Cunningham C, Ely EW, MacLullich AM, et al. Association of delirium with cognitive decline in late life: a neuropathologic study of 3 population-based cohort studies. JAMA Psychiatry. 2017;74(3):244–51.PubMedPubMedCentralCrossRef
10.
go back to reference MacLullich AMJ, Beaglehole A, Hall RJ, Meagher DJ. Delirium and long-term cognitive impairment. Int Rev Psychiatry. 2009;21(1):30–42.PubMedCrossRef MacLullich AMJ, Beaglehole A, Hall RJ, Meagher DJ. Delirium and long-term cognitive impairment. Int Rev Psychiatry. 2009;21(1):30–42.PubMedCrossRef
11.
go back to reference Witlox J, Eurelings LSM, de Jonghe JFM, Kalisvaart KJ, Eikelenboom P, van Gool WA. Delirium in elderly patients and the risk of postdischarge mortality, institutionalisation, and dementia: a meta-analysis. JAMA. 2010;304(4):443–51.PubMedCrossRef Witlox J, Eurelings LSM, de Jonghe JFM, Kalisvaart KJ, Eikelenboom P, van Gool WA. Delirium in elderly patients and the risk of postdischarge mortality, institutionalisation, and dementia: a meta-analysis. JAMA. 2010;304(4):443–51.PubMedCrossRef
12.
go back to reference Han JH, Shintani A, Eden S, Morandi A, Solberg LM, Schnelle J, Dittus RS, Storrow AB, Ely EW. Delirium in the emergency department: an independent predictor of death within 6 months. Ann Emerg Med. 2010;56(3):244–52 e241.PubMedPubMedCentralCrossRef Han JH, Shintani A, Eden S, Morandi A, Solberg LM, Schnelle J, Dittus RS, Storrow AB, Ely EW. Delirium in the emergency department: an independent predictor of death within 6 months. Ann Emerg Med. 2010;56(3):244–52 e241.PubMedPubMedCentralCrossRef
13.
go back to reference Burton JK, Guthrie B, Hapca SM, Cvoro V, Donnan PT, Reynish EL. Living at home after emergency hospital admission: prospective cohort study in older adults with and without cognitive spectrum disorder. BMC Med. 2018;16(1):231.PubMedPubMedCentralCrossRef Burton JK, Guthrie B, Hapca SM, Cvoro V, Donnan PT, Reynish EL. Living at home after emergency hospital admission: prospective cohort study in older adults with and without cognitive spectrum disorder. BMC Med. 2018;16(1):231.PubMedPubMedCentralCrossRef
14.
go back to reference Partridge JS, Martin FC, Harari D, Dhesi JK. The delirium experience: what is the effect on patients, relatives and staff and what can be done to modify this? Int J Geriatr Psychiatry. 2013;28(8):804–12.PubMedCrossRef Partridge JS, Martin FC, Harari D, Dhesi JK. The delirium experience: what is the effect on patients, relatives and staff and what can be done to modify this? Int J Geriatr Psychiatry. 2013;28(8):804–12.PubMedCrossRef
15.
go back to reference Martins S, Pinho E, Correia R, Moreira E, Lopes L, Paiva JA, Azevedo L, Fernandes L. What effect does delirium have on family and nurses of older adult patients? Ageing Ment Health. 2018;22(7):903–11.CrossRef Martins S, Pinho E, Correia R, Moreira E, Lopes L, Paiva JA, Azevedo L, Fernandes L. What effect does delirium have on family and nurses of older adult patients? Ageing Ment Health. 2018;22(7):903–11.CrossRef
16.
go back to reference Racine AM, D’Aquila M, Schmitt EM, Gallagher J, Marcantonio ER, Jones RN, Inouye SK, Schulman-Green D, Group BS. Delirium burden in patients and family caregivers: development and testing of new instruments. Gerontologist. 2019;59(2):327–37.CrossRef Racine AM, D’Aquila M, Schmitt EM, Gallagher J, Marcantonio ER, Jones RN, Inouye SK, Schulman-Green D, Group BS. Delirium burden in patients and family caregivers: development and testing of new instruments. Gerontologist. 2019;59(2):327–37.CrossRef
17.
go back to reference Collins N, Blanchard MR, Tookman A, Sampson EL. Detection of delirium in the acute hospital. Age Ageing. 2010;39(1):131–5.PubMedCrossRef Collins N, Blanchard MR, Tookman A, Sampson EL. Detection of delirium in the acute hospital. Age Ageing. 2010;39(1):131–5.PubMedCrossRef
18.
go back to reference Han JH, Zimmerman EE, Cutler N, Schnelle J, Morandi A, Dittus RS, Storrow AB, Ely EW. Delirium in older emergency department patients: recognition, risk factors, and psychomotor subtypes. Acad Emerg Med. 2009;16(3):193–200.PubMedPubMedCentralCrossRef Han JH, Zimmerman EE, Cutler N, Schnelle J, Morandi A, Dittus RS, Storrow AB, Ely EW. Delirium in older emergency department patients: recognition, risk factors, and psychomotor subtypes. Acad Emerg Med. 2009;16(3):193–200.PubMedPubMedCentralCrossRef
19.
go back to reference Traynor V, Cordato N, Burns P, Xu Y, Britten N, Duncan K, DeVries L, McKinnon C. Is delirium being detected in emergency? Australas J Ageing. 2016;35(1):54–7.PubMedCrossRef Traynor V, Cordato N, Burns P, Xu Y, Britten N, Duncan K, DeVries L, McKinnon C. Is delirium being detected in emergency? Australas J Ageing. 2016;35(1):54–7.PubMedCrossRef
20.
go back to reference Bellelli G, Nobili A, Annoni G, Morandi A, Djade CD, Meagher DJ, Maclullich AM, Davis D, Mazzone A, Tettamanti M, et al. Under-detection of delirium and impact of neurocognitive deficits on in-hospital mortality among acute geriatric and medical wards. Eur J Intern Med. 2015;26(9):696–704.PubMedCrossRef Bellelli G, Nobili A, Annoni G, Morandi A, Djade CD, Meagher DJ, Maclullich AM, Davis D, Mazzone A, Tettamanti M, et al. Under-detection of delirium and impact of neurocognitive deficits on in-hospital mortality among acute geriatric and medical wards. Eur J Intern Med. 2015;26(9):696–704.PubMedCrossRef
21.
go back to reference Stelmokas J, Gabel N, Flaherty JM, Rayson K, Tran K, Anderson JR, Bieliauskas LA. Delirium detection and impact of comorbid health conditions in a post-acute rehabilitation hospital setting. PLoS One. 2016;11(11):e0166754.PubMedPubMedCentralCrossRef Stelmokas J, Gabel N, Flaherty JM, Rayson K, Tran K, Anderson JR, Bieliauskas LA. Delirium detection and impact of comorbid health conditions in a post-acute rehabilitation hospital setting. PLoS One. 2016;11(11):e0166754.PubMedPubMedCentralCrossRef
22.
go back to reference Davis D, MacLullich A. Understanding barriers to delirium care: a multicentre survey of knowledge and attitudes among UK junior doctors. Age Ageing. 2009;38(5):559–63.PubMedCrossRef Davis D, MacLullich A. Understanding barriers to delirium care: a multicentre survey of knowledge and attitudes among UK junior doctors. Age Ageing. 2009;38(5):559–63.PubMedCrossRef
23.
go back to reference Fisher JM, Gordon AL, MacLullich AM, Tullo E, Davis DH, Blundell A, Field RH, Teodorczuk A. Towards an understanding of why undergraduate teaching about delirium does not guarantee gold-standard practice--results from a UK national survey. Age Ageing. 2015;44(1):166–70.PubMedCrossRef Fisher JM, Gordon AL, MacLullich AM, Tullo E, Davis DH, Blundell A, Field RH, Teodorczuk A. Towards an understanding of why undergraduate teaching about delirium does not guarantee gold-standard practice--results from a UK national survey. Age Ageing. 2015;44(1):166–70.PubMedCrossRef
25.
go back to reference Bellelli G, Morandi A, Davis DH, Mazzola P, Turco R, Gentile S, Ryan T, Cash H, Guerini F, Torpilliesi T, et al. Validation of the 4AT, a new instrument for rapid delirium screening: a study in 234 hospitalised older people. Age Ageing. 2014;43(4):496–502.PubMedPubMedCentralCrossRef Bellelli G, Morandi A, Davis DH, Mazzola P, Turco R, Gentile S, Ryan T, Cash H, Guerini F, Torpilliesi T, et al. Validation of the 4AT, a new instrument for rapid delirium screening: a study in 234 hospitalised older people. Age Ageing. 2014;43(4):496–502.PubMedPubMedCentralCrossRef
27.
go back to reference Shenkin SD, Fox C, Godfrey M, Siddiqi N, Goodacre S, Young J, Anand A, Grey A, Smith J, Ryan T, et al. Protocol for validation of the 4AT, a rapid screening tool for delirium: a multicentre prospective diagnostic test accuracy study. BMJ Open. 2018;8(2):e015572.PubMedPubMedCentralCrossRef Shenkin SD, Fox C, Godfrey M, Siddiqi N, Goodacre S, Young J, Anand A, Grey A, Smith J, Ryan T, et al. Protocol for validation of the 4AT, a rapid screening tool for delirium: a multicentre prospective diagnostic test accuracy study. BMJ Open. 2018;8(2):e015572.PubMedPubMedCentralCrossRef
28.
go back to reference Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990;113(12):941–8.CrossRefPubMed Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990;113(12):941–8.CrossRefPubMed
29.
go back to reference Tieges Z, McGrath A, Hall RJ, Maclullich AM. Abnormal level of arousal as a predictor of delirium and inattention: an exploratory study. Am J Geriatr Psychiatry. 2013;21(12):1244–53.PubMedCrossRef Tieges Z, McGrath A, Hall RJ, Maclullich AM. Abnormal level of arousal as a predictor of delirium and inattention: an exploratory study. Am J Geriatr Psychiatry. 2013;21(12):1244–53.PubMedCrossRef
30.
go back to reference Chester JG, Harrington MB, Rudolph JL, Grp VADW. Serial administration of a modified Richmond agitation and sedation scale for delirium screening. J Hosp Med. 2012;7(5):450–3.PubMedCrossRef Chester JG, Harrington MB, Rudolph JL, Grp VADW. Serial administration of a modified Richmond agitation and sedation scale for delirium screening. J Hosp Med. 2012;7(5):450–3.PubMedCrossRef
31.
go back to reference Yates C, Stanley N, Cerejeira JM, Jay R, Mukaetova-Ladinska EB. Screening instruments for delirium in older people with an acute medical illness. Age Ageing. 2009;38(2):235–7.PubMedCrossRef Yates C, Stanley N, Cerejeira JM, Jay R, Mukaetova-Ladinska EB. Screening instruments for delirium in older people with an acute medical illness. Age Ageing. 2009;38(2):235–7.PubMedCrossRef
32.
go back to reference European Delirum Association, American Delirium Society. The DSM-5 criteria, level of arousal and delirium diagnosis: inclusiveness is safer. BMC Med. 2014;12:141.CrossRef European Delirum Association, American Delirium Society. The DSM-5 criteria, level of arousal and delirium diagnosis: inclusiveness is safer. BMC Med. 2014;12:141.CrossRef
33.
go back to reference Lees R, Corbet S, Johnston C, Moffitt E, Shaw G, Quinn TJ. Test accuracy of short screening tests for diagnosis of delirium or cognitive impairment in an acute stroke unit setting. Stroke. 2013;44(11):3078–83.PubMedCrossRef Lees R, Corbet S, Johnston C, Moffitt E, Shaw G, Quinn TJ. Test accuracy of short screening tests for diagnosis of delirium or cognitive impairment in an acute stroke unit setting. Stroke. 2013;44(11):3078–83.PubMedCrossRef
34.
go back to reference Kuladee S, Prachason T. Development and validation of the Thai version of the 4 ‘A’s Test for delirium screening in hospitalised elderly patients with acute medical illnesses. Neuropsychiatr Dis Treat. 2016;12:437–43.PubMedPubMedCentralCrossRef Kuladee S, Prachason T. Development and validation of the Thai version of the 4 ‘A’s Test for delirium screening in hospitalised elderly patients with acute medical illnesses. Neuropsychiatr Dis Treat. 2016;12:437–43.PubMedPubMedCentralCrossRef
35.
go back to reference Hendry K, Quinn TJ, Evans J, Scortichini V, Miller H, Burns J, Cunnington A, Stott DJ. Evaluation of delirium screening tools in geriatric medical inpatients: a diagnostic test accuracy study. Age Ageing. 2016;45(6):832–7.PubMedCrossRef Hendry K, Quinn TJ, Evans J, Scortichini V, Miller H, Burns J, Cunnington A, Stott DJ. Evaluation of delirium screening tools in geriatric medical inpatients: a diagnostic test accuracy study. Age Ageing. 2016;45(6):832–7.PubMedCrossRef
36.
go back to reference De J, Wand AP, Smerdely PI, Hunt GE. Validating the 4A’s test in screening for delirium in a culturally diverse geriatric inpatient population. Int J Geriatr Psychiatry. 2017;32(12):1322–239.PubMedCrossRef De J, Wand AP, Smerdely PI, Hunt GE. Validating the 4A’s test in screening for delirium in a culturally diverse geriatric inpatient population. Int J Geriatr Psychiatry. 2017;32(12):1322–239.PubMedCrossRef
37.
go back to reference Infante MT, Pardini M, Balestrino M, Finocchi C, Malfatto L, Bellelli G, Mancardi GL, Gandolfo C, Serrati C. Delirium in the acute phase after stroke: comparison between methods of detection. Neurol Sci. 2017;38(6):1101–4.PubMedCrossRef Infante MT, Pardini M, Balestrino M, Finocchi C, Malfatto L, Bellelli G, Mancardi GL, Gandolfo C, Serrati C. Delirium in the acute phase after stroke: comparison between methods of detection. Neurol Sci. 2017;38(6):1101–4.PubMedCrossRef
38.
go back to reference O’Sullivan D, Brady N, Manning E, O’Shea E, O’Grady S, O’Regan N, Timmons S. Validation of the 6-Item Cognitive Impairment Test and the 4AT test for combined delirium and dementia screening in older emergency department attendees. Age Ageing. 2018;47(1):61–8.PubMedCrossRef O’Sullivan D, Brady N, Manning E, O’Shea E, O’Grady S, O’Regan N, Timmons S. Validation of the 6-Item Cognitive Impairment Test and the 4AT test for combined delirium and dementia screening in older emergency department attendees. Age Ageing. 2018;47(1):61–8.PubMedCrossRef
39.
go back to reference Saller T, MacLullich A, Schaher T, Crispin A, Neitzert R, Schule C, Von Dossow V, Hofmann-Kiefer KF: Validation study of the 4 ‘A’s Test (4AT) for delirium detection in post-anaesthesia care. Anaesthesia 2019,[Epub]. Saller T, MacLullich A, Schaher T, Crispin A, Neitzert R, Schule C, Von Dossow V, Hofmann-Kiefer KF: Validation study of the 4 ‘A’s Test (4AT) for delirium detection in post-anaesthesia care. Anaesthesia 2019,[Epub].
40.
go back to reference Inouye SK. The Short Confusion Assessment Method (Short CAM): training manual and coding guide. Boston: Hospital Elder Life Program; 2014. Inouye SK. The Short Confusion Assessment Method (Short CAM): training manual and coding guide. Boston: Hospital Elder Life Program; 2014.
42.
go back to reference Wei LA, Fearing MA, Sternberg EJ, Inouye SK. The Confusion Assessment Method: a systematic review of current usage. J Am Geriatr Soc. 2008;56(5):823–30.PubMedPubMedCentralCrossRef Wei LA, Fearing MA, Sternberg EJ, Inouye SK. The Confusion Assessment Method: a systematic review of current usage. J Am Geriatr Soc. 2008;56(5):823–30.PubMedPubMedCentralCrossRef
43.
go back to reference Wong CL, Holroyd-Leduc J, Simel DL, Straus SE. Does this patient have delirium?: value of bedside instruments. JAMA. 2010;304(7):779–86.PubMedCrossRef Wong CL, Holroyd-Leduc J, Simel DL, Straus SE. Does this patient have delirium?: value of bedside instruments. JAMA. 2010;304(7):779–86.PubMedCrossRef
44.
go back to reference Shi Q, Warren L, Saposnik G, Macdermid JC. Confusion assessment method: a systematic review and meta-analysis of diagnostic accuracy. Neuropsychiatr Dis Treat. 2013;9:1359–70.PubMedPubMedCentralCrossRef Shi Q, Warren L, Saposnik G, Macdermid JC. Confusion assessment method: a systematic review and meta-analysis of diagnostic accuracy. Neuropsychiatr Dis Treat. 2013;9:1359–70.PubMedPubMedCentralCrossRef
45.
go back to reference De J, Wand AP. Delirium screening: a systematic review of delirium screening tools in hospitalised patients. Gerontologist. 2015;55(6):1079–99.PubMedCrossRef De J, Wand AP. Delirium screening: a systematic review of delirium screening tools in hospitalised patients. Gerontologist. 2015;55(6):1079–99.PubMedCrossRef
46.
go back to reference van Velthuijsen EL, Zwakhalen SM, Warnier RM, Mulder WJ, Verhey FR, Kempen GI. Psychometric properties and feasibility of instruments for the detection of delirium in older hospitalised patients: a systematic review. Int J Geriatr Psychiatry. 2016;31(9):974–89.PubMedCrossRef van Velthuijsen EL, Zwakhalen SM, Warnier RM, Mulder WJ, Verhey FR, Kempen GI. Psychometric properties and feasibility of instruments for the detection of delirium in older hospitalised patients: a systematic review. Int J Geriatr Psychiatry. 2016;31(9):974–89.PubMedCrossRef
47.
go back to reference Rockwood K, Cosway S, Stolee P, Kydd D, Carver D, Jarrett P, O’Brien B. Increasing the recognition of delirium in elderly patients. J Am Geriatr Soc. 1994;42(3):252–6.PubMedCrossRef Rockwood K, Cosway S, Stolee P, Kydd D, Carver D, Jarrett P, O’Brien B. Increasing the recognition of delirium in elderly patients. J Am Geriatr Soc. 1994;42(3):252–6.PubMedCrossRef
48.
go back to reference Farrell KR, Ganzini L. Misdiagnosing delirium as depression in medically ill elderly patients. Arch Intern Med. 1995;155(22):2459–64.PubMedCrossRef Farrell KR, Ganzini L. Misdiagnosing delirium as depression in medically ill elderly patients. Arch Intern Med. 1995;155(22):2459–64.PubMedCrossRef
49.
go back to reference Pompei P, Foreman M, Cassel CK, Alessi C, Cox D. Detecting delirium among hospitalised older patients. Arch Intern Med. 1995;155(3):301–7.PubMedCrossRef Pompei P, Foreman M, Cassel CK, Alessi C, Cox D. Detecting delirium among hospitalised older patients. Arch Intern Med. 1995;155(3):301–7.PubMedCrossRef
50.
go back to reference Rolfson DB, McElhaney JE, Jhangri GS, Rockwood K. Validity of the confusion assessment method in detecting postoperative delirium in the elderly. Int Psychogeriatr. 1999;11(4):431–8.PubMedCrossRef Rolfson DB, McElhaney JE, Jhangri GS, Rockwood K. Validity of the confusion assessment method in detecting postoperative delirium in the elderly. Int Psychogeriatr. 1999;11(4):431–8.PubMedCrossRef
51.
go back to reference Fabbri RM, Moreira MA, Garrido R, Almeida OP. Validity and reliability of the Portuguese version of the Confusion Assessment Method (CAM) for the detection of delirium in the elderly. Arq Neuropsiquiatr. 2001;59(2-A):175–9.PubMedCrossRef Fabbri RM, Moreira MA, Garrido R, Almeida OP. Validity and reliability of the Portuguese version of the Confusion Assessment Method (CAM) for the detection of delirium in the elderly. Arq Neuropsiquiatr. 2001;59(2-A):175–9.PubMedCrossRef
52.
go back to reference Laurila JV, Pitkala KH, Strandberg TE, Tilvis RS. Confusion assessment method in the diagnostics of delirium among aged hospital patients: would it serve better in screening than as a diagnostic instrument? Int J Geriatr Psychiatry. 2002;17(12):1112–9.PubMedCrossRef Laurila JV, Pitkala KH, Strandberg TE, Tilvis RS. Confusion assessment method in the diagnostics of delirium among aged hospital patients: would it serve better in screening than as a diagnostic instrument? Int J Geriatr Psychiatry. 2002;17(12):1112–9.PubMedCrossRef
53.
go back to reference Gonzalez M, de Pablo J, Fuente E, Valdes M, Peri JM, Nomdedeu M, Matrai S. Instrument for detection of delirium in general hospitals: adaptation of the confusion assessment method. Psychosomatics. 2004;45(5):426–31.PubMedCrossRef Gonzalez M, de Pablo J, Fuente E, Valdes M, Peri JM, Nomdedeu M, Matrai S. Instrument for detection of delirium in general hospitals: adaptation of the confusion assessment method. Psychosomatics. 2004;45(5):426–31.PubMedCrossRef
54.
go back to reference Gaudreau JD, Gagnon P, Harel F, Tremblay A, Roy MA. Fast, systematic, and continuous delirium assessment in hospitalised patients: the nursing delirium screening scale. J Pain Symptom Manage. 2005;29(4):368–75.PubMedCrossRef Gaudreau JD, Gagnon P, Harel F, Tremblay A, Roy MA. Fast, systematic, and continuous delirium assessment in hospitalised patients: the nursing delirium screening scale. J Pain Symptom Manage. 2005;29(4):368–75.PubMedCrossRef
55.
go back to reference Leung J, Leung V, Leung CM, Pan PC. Clinical utility and validation of two instruments (the Confusion Assessment Method algorithm and the Chinese version of Nursing Delirium Screening Scale) to detect delirium in geriatric inpatients. Gen Hosp Psychiatry. 2008;30(2):171–6.PubMedCrossRef Leung J, Leung V, Leung CM, Pan PC. Clinical utility and validation of two instruments (the Confusion Assessment Method algorithm and the Chinese version of Nursing Delirium Screening Scale) to detect delirium in geriatric inpatients. Gen Hosp Psychiatry. 2008;30(2):171–6.PubMedCrossRef
56.
go back to reference Radtke FM, Franck M, Schneider M, Luetz A, Seeling M, Heinz A, Wernecke KD, Spies CD. Comparison of three scores to screen for delirium in the recovery room. Br J Anaesth. 2008;101(3):338–43.PubMedCrossRef Radtke FM, Franck M, Schneider M, Luetz A, Seeling M, Heinz A, Wernecke KD, Spies CD. Comparison of three scores to screen for delirium in the recovery room. Br J Anaesth. 2008;101(3):338–43.PubMedCrossRef
57.
go back to reference Hestermann U, Backenstrass M, Gekle I, Hack M, Mundt C, Oster P, Thomas C. Validation of a German version of the Confusion Assessment Method for delirium detection in a sample of acute geriatric patients with a high prevalence of dementia. Psychopathology. 2009;42(4):270–6.PubMedCrossRef Hestermann U, Backenstrass M, Gekle I, Hack M, Mundt C, Oster P, Thomas C. Validation of a German version of the Confusion Assessment Method for delirium detection in a sample of acute geriatric patients with a high prevalence of dementia. Psychopathology. 2009;42(4):270–6.PubMedCrossRef
58.
go back to reference Ryan K, Leonard M, Guerin S, Donnelly S, Conroy M, Meagher D. Validation of the confusion assessment method in the palliative care setting. Palliat Med. 2009;23(1):40–5.PubMedCrossRef Ryan K, Leonard M, Guerin S, Donnelly S, Conroy M, Meagher D. Validation of the confusion assessment method in the palliative care setting. Palliat Med. 2009;23(1):40–5.PubMedCrossRef
59.
go back to reference Radtke FM, Franck M, Schust S, Boehme L, Pascher A, Bail HJ, Seeling M, Luetz A, Wernecke KD, Heinz A, et al. A comparison of three scores to screen for delirium on the surgical ward. World J Surg. 2010;34(3):487–94.PubMedCrossRef Radtke FM, Franck M, Schust S, Boehme L, Pascher A, Bail HJ, Seeling M, Luetz A, Wernecke KD, Heinz A, et al. A comparison of three scores to screen for delirium on the surgical ward. World J Surg. 2010;34(3):487–94.PubMedCrossRef
60.
go back to reference Sands MB, Dantoc BP, Hartshorn A, Ryan CJ, Lujic S. Single Question in Delirium (SQiD): testing its efficacy against psychiatrist interview, the Confusion Assessment Method and the Memorial Delirium Assessment Scale. Palliat Med. 2010;24(6):561–5.PubMedCrossRef Sands MB, Dantoc BP, Hartshorn A, Ryan CJ, Lujic S. Single Question in Delirium (SQiD): testing its efficacy against psychiatrist interview, the Confusion Assessment Method and the Memorial Delirium Assessment Scale. Palliat Med. 2010;24(6):561–5.PubMedCrossRef
61.
go back to reference Wongpakaran N, Wongpakaran T, Bookamana P, Pinyopornpanish M, Maneeton B, Lerttrakarnnon P, Uttawichai K, Jiraniramai S. Diagnosing delirium in elderly Thai patients: utilisation of the CAM algorithm. BMC Fam Pract. 2011;12:65.PubMedPubMedCentralCrossRef Wongpakaran N, Wongpakaran T, Bookamana P, Pinyopornpanish M, Maneeton B, Lerttrakarnnon P, Uttawichai K, Jiraniramai S. Diagnosing delirium in elderly Thai patients: utilisation of the CAM algorithm. BMC Fam Pract. 2011;12:65.PubMedPubMedCentralCrossRef
62.
go back to reference Thomas C, Kreisel SH, Oster P, Driessen M, Arolt V, Inouye SK. Diagnosing delirium in older hospitalised adults with dementia: adapting the confusion assessment method to international classification of diseases, tenth revision, diagnostic criteria. J Am Geriatr Soc. 2012;60(8):1471–7.PubMedPubMedCentralCrossRef Thomas C, Kreisel SH, Oster P, Driessen M, Arolt V, Inouye SK. Diagnosing delirium in older hospitalised adults with dementia: adapting the confusion assessment method to international classification of diseases, tenth revision, diagnostic criteria. J Am Geriatr Soc. 2012;60(8):1471–7.PubMedPubMedCentralCrossRef
63.
go back to reference Charoensak S, Thunmanurukkit A, Sittironnarit G, Sartra T. Validity and reliability of the Thai version of the confusion assessment method. J Med Assoc Thai. 2014;97(1):113–7.PubMed Charoensak S, Thunmanurukkit A, Sittironnarit G, Sartra T. Validity and reliability of the Thai version of the confusion assessment method. J Med Assoc Thai. 2014;97(1):113–7.PubMed
64.
go back to reference Lin HS, Eeles E, Pandy S, Pinsker D, Brasch C, Yerkovich S. Screening in delirium: a pilot study of two screening tools, the Simple Query for Easy Evaluation of Consciousness and Simple Question in Delirium. Australas J Ageing. 2015;34(4):259–64.PubMedCrossRef Lin HS, Eeles E, Pandy S, Pinsker D, Brasch C, Yerkovich S. Screening in delirium: a pilot study of two screening tools, the Simple Query for Easy Evaluation of Consciousness and Simple Question in Delirium. Australas J Ageing. 2015;34(4):259–64.PubMedCrossRef
65.
go back to reference Martins S, Lourenco C, Pinto-de-Sousa J, Conceicao F, Paiva JA, Simoes MR, Fernandes L. Validation study of the European Portuguese version of the Confusion Assessment Method (CAM). Int Psychogeriatr. 2015;27(5):777–84.PubMedCrossRef Martins S, Lourenco C, Pinto-de-Sousa J, Conceicao F, Paiva JA, Simoes MR, Fernandes L. Validation study of the European Portuguese version of the Confusion Assessment Method (CAM). Int Psychogeriatr. 2015;27(5):777–84.PubMedCrossRef
66.
go back to reference Smulter N, Lingehall HC, Gustafson Y, Olofsson B, Engstrom KG. Validation of the confusion assessment method in detecting postoperative delirium in cardiac surgery patients. Am J Crit Care. 2015;24(6):480–7.PubMedCrossRef Smulter N, Lingehall HC, Gustafson Y, Olofsson B, Engstrom KG. Validation of the confusion assessment method in detecting postoperative delirium in cardiac surgery patients. Am J Crit Care. 2015;24(6):480–7.PubMedCrossRef
67.
go back to reference Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, Irwig L, Levine D, Reitsma JB, de Vet HC, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.PubMedPubMedCentralCrossRef Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, Irwig L, Levine D, Reitsma JB, de Vet HC, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.PubMedPubMedCentralCrossRef
68.
go back to reference Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the Delirium Rating Scale-revised-98: comparison with the Delirium Rating Scale and the Cognitive Test for Delirium. J Neuropsychiatry Clin Neurosci. 2001;13(2):229–42.PubMedCrossRef Trzepacz PT, Mittal D, Torres R, Kanary K, Norton J, Jimerson N. Validation of the Delirium Rating Scale-revised-98: comparison with the Delirium Rating Scale and the Cognitive Test for Delirium. J Neuropsychiatry Clin Neurosci. 2001;13(2):229–42.PubMedCrossRef
69.
go back to reference Tieges Z, Brown LJ, MacLullich AM. Objective assessment of attention in delirium: a narrative review. Int J Geriatr Psychiatry. 2014;29(12):1185–97.PubMedCrossRef Tieges Z, Brown LJ, MacLullich AM. Objective assessment of attention in delirium: a narrative review. Int J Geriatr Psychiatry. 2014;29(12):1185–97.PubMedCrossRef
70.
go back to reference Tieges Z, Evans JJ, Neufeld KJ, MacLullich AM. The neuropsychology of delirium: advancing the science of delirium assessment. Int J Geriatr Psychiatry. 2018;33(11):1501–11.PubMedCrossRef Tieges Z, Evans JJ, Neufeld KJ, MacLullich AM. The neuropsychology of delirium: advancing the science of delirium assessment. Int J Geriatr Psychiatry. 2018;33(11):1501–11.PubMedCrossRef
71.
go back to reference Richardson SJ, Davis DHJ, Bellelli G, Hasemann W, Meagher D, Kreisel SH, MacLullich AMJ, Cerejeira J, Morandi A. Detecting delirium superimposed on dementia: diagnostic accuracy of a simple combined arousal and attention testing procedure. Int Psychogeriatr. 2017;29(10):1585–93.PubMedCrossRef Richardson SJ, Davis DHJ, Bellelli G, Hasemann W, Meagher D, Kreisel SH, MacLullich AMJ, Cerejeira J, Morandi A. Detecting delirium superimposed on dementia: diagnostic accuracy of a simple combined arousal and attention testing procedure. Int Psychogeriatr. 2017;29(10):1585–93.PubMedCrossRef
72.
go back to reference Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O’Neal PV, Keane KA, Tesoro EP, Elswick RK. The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166(10):1338–44.PubMedCrossRef Sessler CN, Gosnell MS, Grap MJ, Brophy GM, O’Neal PV, Keane KA, Tesoro EP, Elswick RK. The Richmond Agitation-Sedation Scale: validity and reliability in adult intensive care unit patients. Am J Respir Crit Care Med. 2002;166(10):1338–44.PubMedCrossRef
73.
go back to reference Simon SE, Bergmann MA, Jones RN, Murphy KM, Orav EJ, Marcantonio ER. Reliability of a structured assessment for nonclinicians to detect delirium among new admissions to postacute care. J Am Med Dir Assoc. 2006;7(7):412–5.PubMedCrossRef Simon SE, Bergmann MA, Jones RN, Murphy KM, Orav EJ, Marcantonio ER. Reliability of a structured assessment for nonclinicians to detect delirium among new admissions to postacute care. J Am Med Dir Assoc. 2006;7(7):412–5.PubMedCrossRef
74.
go back to reference Hart RP, Levenson JL, Sessler CN, Best AM, Schwartz SM, Rutherford LE. Validation of a cognitive test for delirium in medical ICU patients. Psychosomatics. 1996;37(6):533–46.PubMedCrossRef Hart RP, Levenson JL, Sessler CN, Best AM, Schwartz SM, Rutherford LE. Validation of a cognitive test for delirium in medical ICU patients. Psychosomatics. 1996;37(6):533–46.PubMedCrossRef
75.
go back to reference Tieges Z, Stiobhairt A, Scott K, Suchorab K, Weir A, Parks S, Shenkin S, MacLullich A. Development of a smartphone application for the objective detection of attentional deficits in delirium. Int Psychogeriatr. 2015;27(8):1251–62.PubMedCrossRef Tieges Z, Stiobhairt A, Scott K, Suchorab K, Weir A, Parks S, Shenkin S, MacLullich A. Development of a smartphone application for the objective detection of attentional deficits in delirium. Int Psychogeriatr. 2015;27(8):1251–62.PubMedCrossRef
76.
go back to reference Tang E, Laverty M, Weir A, Wilson ES, Walsh TS, Allerhand M, Parks S, MacLullich AMJ, Tieges Z. Development and feasibility of a smartphone-based test for the objective detection and monitoring of attention impairments in delirium in the ICU. J Crit Care. 2018;48:104–11.PubMedCrossRef Tang E, Laverty M, Weir A, Wilson ES, Walsh TS, Allerhand M, Parks S, MacLullich AMJ, Tieges Z. Development and feasibility of a smartphone-based test for the objective detection and monitoring of attention impairments in delirium in the ICU. J Crit Care. 2018;48:104–11.PubMedCrossRef
77.
go back to reference Rutter LM, Nouzova E, Stott DJ, Weir CJ, Assi V, Barnett JH, Clarke C, Duncan N, Evans J, Green S, et al. Diagnostic test accuracy of a novel smartphone application for the assessment of attention deficits in delirium in older hospitalised patients: a prospective cohort study protocol. BMC Geriatr. 2018;18(1):217.PubMedPubMedCentralCrossRef Rutter LM, Nouzova E, Stott DJ, Weir CJ, Assi V, Barnett JH, Clarke C, Duncan N, Evans J, Green S, et al. Diagnostic test accuracy of a novel smartphone application for the assessment of attention deficits in delirium in older hospitalised patients: a prospective cohort study protocol. BMC Geriatr. 2018;18(1):217.PubMedPubMedCentralCrossRef
78.
go back to reference Neufeld KJ, Nelliot A, Inouye SK, Ely EW, Bienvenu OJ, Lee HB, Needham DM. Delirium diagnosis methodology used in research: a survey-based study. Am J Geriatr Psychiatry. 2014;22(12):1513–21.PubMedPubMedCentralCrossRef Neufeld KJ, Nelliot A, Inouye SK, Ely EW, Bienvenu OJ, Lee HB, Needham DM. Delirium diagnosis methodology used in research: a survey-based study. Am J Geriatr Psychiatry. 2014;22(12):1513–21.PubMedPubMedCentralCrossRef
79.
go back to reference Inouye SK, Foreman MD, Mion LC, Katz KH, Cooney LM. Nurses’ recognition of delirium and its symptoms - comparison of nurse and researcher ratings. Arch Intern Med. 2001;161:2467–73.PubMedCrossRef Inouye SK, Foreman MD, Mion LC, Katz KH, Cooney LM. Nurses’ recognition of delirium and its symptoms - comparison of nurse and researcher ratings. Arch Intern Med. 2001;161:2467–73.PubMedCrossRef
80.
go back to reference Wozniak AW, Colantuoni EJ, Schreiber MP, Neufeld KJ, Needham DM. Corticosteroids and transition to delirium in acute lung injury: multinomial logistic regression analysis accounting for multiple States. Crit Care Med. 2015;43(1):e23–4.PubMedPubMedCentralCrossRef Wozniak AW, Colantuoni EJ, Schreiber MP, Neufeld KJ, Needham DM. Corticosteroids and transition to delirium in acute lung injury: multinomial logistic regression analysis accounting for multiple States. Crit Care Med. 2015;43(1):e23–4.PubMedPubMedCentralCrossRef
81.
go back to reference Todd A, Blackley S, Burton JK, Stott DJ, Ely EW, Tieges Z, MacLullich AMJ, Shenkin SD. Reduced level of arousal and increased mortality in adult acute medical admissions: a systematic review and meta-analysis. BMC Geriatr. 2017;17(1):283.PubMedPubMedCentralCrossRef Todd A, Blackley S, Burton JK, Stott DJ, Ely EW, Tieges Z, MacLullich AMJ, Shenkin SD. Reduced level of arousal and increased mortality in adult acute medical admissions: a systematic review and meta-analysis. BMC Geriatr. 2017;17(1):283.PubMedPubMedCentralCrossRef
82.
go back to reference Bellelli G, Mazzone A, Morandi A, Latronico N, Perego S, Zazzetta S, Mazzola P, Annoni G. The effect of an impaired arousal on short- and long-term mortality of elderly patients admitted to an acute geriatric unit. J Am Med Dir Assoc. 2016;17(3):214–9.PubMedCrossRef Bellelli G, Mazzone A, Morandi A, Latronico N, Perego S, Zazzetta S, Mazzola P, Annoni G. The effect of an impaired arousal on short- and long-term mortality of elderly patients admitted to an acute geriatric unit. J Am Med Dir Assoc. 2016;17(3):214–9.PubMedCrossRef
83.
go back to reference Morandi A, Han JH, Meagher D, Vasilevskis E, Cerejeira J, Hasemann W, MacLullich AM, Annoni G, Trabucchi M, Bellelli G. Detecting delirium superimposed on dementia: evaluation of the diagnostic performance of the Richmond Agitation and Sedation Scale. J Am Med Dir Assoc. 2016;17(9):828–33.PubMedPubMedCentralCrossRef Morandi A, Han JH, Meagher D, Vasilevskis E, Cerejeira J, Hasemann W, MacLullich AM, Annoni G, Trabucchi M, Bellelli G. Detecting delirium superimposed on dementia: evaluation of the diagnostic performance of the Richmond Agitation and Sedation Scale. J Am Med Dir Assoc. 2016;17(9):828–33.PubMedPubMedCentralCrossRef
84.
85.
86.
go back to reference Han JH, Wilson A, Vasilevskis EE, Shintani A, Schnelle JF, Dittus RS, Graves AJ, Storrow AB, Shuster J, Ely EW. Diagnosing delirium in older emergency department patients: validity and reliability of the delirium triage screen and the brief confusion assessment method. Ann Emerg Med. 2013;62(5):457–65.PubMedPubMedCentralCrossRef Han JH, Wilson A, Vasilevskis EE, Shintani A, Schnelle JF, Dittus RS, Graves AJ, Storrow AB, Shuster J, Ely EW. Diagnosing delirium in older emergency department patients: validity and reliability of the delirium triage screen and the brief confusion assessment method. Ann Emerg Med. 2013;62(5):457–65.PubMedPubMedCentralCrossRef
87.
go back to reference Han JH, Wilson A, Vasilevskis EE, Storrow AB, Shintani A, Schnelle J, Graves AJ, Dittus RS, Ely EW. The validation of the emergency department Delirium Triage Screen in older emergency department patients. Ann Emerg Med. 2012;60(4):S29.CrossRef Han JH, Wilson A, Vasilevskis EE, Storrow AB, Shintani A, Schnelle J, Graves AJ, Dittus RS, Ely EW. The validation of the emergency department Delirium Triage Screen in older emergency department patients. Ann Emerg Med. 2012;60(4):S29.CrossRef
88.
go back to reference Marcantonio ER, Ngo LH, O’Connor M, Jones RN, Crane PK, Metzger ED, Inouye SK. 3D-CAM: derivation and validation of a 3-min diagnostic interview for CAM-defined delirium: a cross-sectional diagnostic test study. Ann Int Med. 2014;161(8):554–61.PubMedCrossRef Marcantonio ER, Ngo LH, O’Connor M, Jones RN, Crane PK, Metzger ED, Inouye SK. 3D-CAM: derivation and validation of a 3-min diagnostic interview for CAM-defined delirium: a cross-sectional diagnostic test study. Ann Int Med. 2014;161(8):554–61.PubMedCrossRef
90.
go back to reference Lagarto L, Albuquerque E, Loureiro D, Vieira F, Esteves P, Neves S, Teixeira-Verissimo M, Cerejeira J. Arousal changes and delirium in acute medically-ill male older patients with and without dementia: a prospective study during hospitalisation. Ageing Ment Health. 2018:1–8. [Epub ahead of print] Lagarto L, Albuquerque E, Loureiro D, Vieira F, Esteves P, Neves S, Teixeira-Verissimo M, Cerejeira J. Arousal changes and delirium in acute medically-ill male older patients with and without dementia: a prospective study during hospitalisation. Ageing Ment Health. 2018:1–8. [Epub ahead of print]
91.
go back to reference Han JH, Vasilevskis EE, Schnelle JF, Shintani A, Dittus RS, Wilson A, Ely EW. The diagnostic performance of the Richmond Agitation Sedation Scale for detecting delirium in older emergency department patients. Acad Emerg Med. 2015;22(7):878–82.PubMedPubMedCentralCrossRef Han JH, Vasilevskis EE, Schnelle JF, Shintani A, Dittus RS, Wilson A, Ely EW. The diagnostic performance of the Richmond Agitation Sedation Scale for detecting delirium in older emergency department patients. Acad Emerg Med. 2015;22(7):878–82.PubMedPubMedCentralCrossRef
92.
go back to reference Grossmann FF, Hasemann W, Kressig RW, Bingisser R, Nickel CH. Performance of the modified Richmond Agitation Sedation Scale in identifying delirium in older ED patients. Am J Emerg Med. 2017;35(9):1324–6.PubMedCrossRef Grossmann FF, Hasemann W, Kressig RW, Bingisser R, Nickel CH. Performance of the modified Richmond Agitation Sedation Scale in identifying delirium in older ED patients. Am J Emerg Med. 2017;35(9):1324–6.PubMedCrossRef
Metadata
Title
Delirium detection in older acute medical inpatients: a multicentre prospective comparative diagnostic test accuracy study of the 4AT and the confusion assessment method
Authors
Susan D. Shenkin
Christopher Fox
Mary Godfrey
Najma Siddiqi
Steve Goodacre
John Young
Atul Anand
Alasdair Gray
Janet Hanley
Allan MacRaild
Jill Steven
Polly L. Black
Zoë Tieges
Julia Boyd
Jacqueline Stephen
Christopher J. Weir
Alasdair M. J. MacLullich
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Confusion
Published in
BMC Medicine / Issue 1/2019
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-019-1367-9

Other articles of this Issue 1/2019

BMC Medicine 1/2019 Go to the issue