Skip to main content
Top
Published in: International Journal of Computer Assisted Radiology and Surgery 8/2019

01-08-2019 | Original Article

Cognitive load associations when utilizing auditory display within image-guided neurosurgery

Authors: Joseph Plazak, Daniel A. DiGiovanni, D. Louis Collins, Marta Kersten-Oertel

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 8/2019

Login to get access

Abstract

Purpose

The combination of data visualization and auditory display (e.g., sonification) has been shown to increase accuracy, and reduce perceived difficulty, within 3D navigation tasks. While accuracy within such tasks can be measured in real time, subjective impressions about the difficulty of a task are more elusive to obtain. Prior work utilizing electrophysiology (EEG) has found robust support that cognitive load and working memory can be monitored in real time using EEG data.

Methods

In this study, we replicated a 3D navigation task (within the context of image-guided surgery) while recording data pertaining to participants’ cognitive load through the use of EEG relative alpha-band weighting data. Specifically, 13 subjects navigated a tracked surgical tool to randomly placed 3D virtual locations on a CT cerebral angiography volume while being aided by visual, aural, or both visual and aural feedback. During the study EEG data were captured from the participants, and after the study a NASA TLX questionnaire was filled out by the subjects. In addition to replicating an existing experimental design on auditory display within image-guided neurosurgery, our primary aim sought to determine whether EEG-based markers of cognitive load mirrored subjective ratings of task difficulty

Results

Similar to existing literature, our study found evidence consistent with the hypothesis that auditory display can increase the accuracy of navigating to a specified target. We also found significant differences in cognitive working load across different feedback modalities, but none of which supported the experiments hypotheses. Finally, we found mixed results regarding the relationship between real-time measurements of cognitive workload and a posteriori subjective impressions of task difficulty.

Conclusions

Although we did not find a significant correlation between the subjective and physiological measurements, differences in cognitive working load were found. As well, our study further supports the use of auditory display in image-guided surgery.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hermann T (2008) Taxonomy and definitions for sonification and auditory display. International Community for Auditory Display, Chicago Hermann T (2008) Taxonomy and definitions for sonification and auditory display. International Community for Auditory Display, Chicago
3.
go back to reference Cherry EC (1953) Some experiments on the recognition of speech, with one and with two ears. J Acoust Soc Am 25(5):975–979CrossRef Cherry EC (1953) Some experiments on the recognition of speech, with one and with two ears. J Acoust Soc Am 25(5):975–979CrossRef
4.
go back to reference Hansen C, Black D, Lange C, Rieber F, Lamadé W, Donati M, Hahn HK (2013) Auditory support for resection guidance in navigated liver surgery. Int J Med Robot Comput Assist Surg 9(1):36–43CrossRef Hansen C, Black D, Lange C, Rieber F, Lamadé W, Donati M, Hahn HK (2013) Auditory support for resection guidance in navigated liver surgery. Int J Med Robot Comput Assist Surg 9(1):36–43CrossRef
5.
go back to reference Willems PWA, Noordmans HJ, van Overbeeke JJ, Viergever MA, Tulleken CAF, van der Sprenkel JB (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir 147(2):167–173CrossRefPubMed Willems PWA, Noordmans HJ, van Overbeeke JJ, Viergever MA, Tulleken CAF, van der Sprenkel JB (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir 147(2):167–173CrossRefPubMed
6.
go back to reference Black D, Hansen C, Nabavi A, Kikinis R, Hahn H (2017) A Survey of auditory display in image-guided interventions. Int J Comput Assist Radiol Surg 1–12:1665CrossRef Black D, Hansen C, Nabavi A, Kikinis R, Hahn H (2017) A Survey of auditory display in image-guided interventions. Int J Comput Assist Radiol Surg 1–12:1665CrossRef
7.
go back to reference Bork F, Fuers B, Schneider AK, Pinto F, Graumann C, Navab N (2015) Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 7–12 Bork F, Fuers B, Schneider AK, Pinto F, Graumann C, Navab N (2015) Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality. In: IEEE international symposium on mixed and augmented reality (ISMAR), pp 7–12
8.
go back to reference Wendt F, Zotter F, Frank M, Höldrich R (2017) Auditory distance control using a variable-directivity loudspeaker. Appl Sci 7(7):666CrossRef Wendt F, Zotter F, Frank M, Höldrich R (2017) Auditory distance control using a variable-directivity loudspeaker. Appl Sci 7(7):666CrossRef
9.
go back to reference Anderson EW, Potter KC, Matzen LE, Shepherd JF, Preston GA, Silva CT (2011) A user study of visualization effectiveness using EEG and cognitive load. Comput Graph Forum 30(3):791–800CrossRef Anderson EW, Potter KC, Matzen LE, Shepherd JF, Preston GA, Silva CT (2011) A user study of visualization effectiveness using EEG and cognitive load. Comput Graph Forum 30(3):791–800CrossRef
10.
go back to reference Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv Psychol 52:139–183CrossRef Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv Psychol 52:139–183CrossRef
11.
go back to reference Hankins TC, Wilson GF (1998) A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat Space Environ Med 69(4):360–367PubMed Hankins TC, Wilson GF (1998) A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviat Space Environ Med 69(4):360–367PubMed
12.
go back to reference Naismith LM, Cheung JJ, Ringsted C, Cavalcanti RB (2015) Limitations of subjective cognitive load measures in simulationbased procedural training. Med Educ 49(8):805–814CrossRefPubMed Naismith LM, Cheung JJ, Ringsted C, Cavalcanti RB (2015) Limitations of subjective cognitive load measures in simulationbased procedural training. Med Educ 49(8):805–814CrossRefPubMed
14.
go back to reference Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29:169195CrossRef Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29:169195CrossRef
15.
go back to reference Yuksel BF, Oleson KB, Harrison L, Peck EM, Afergan D, Chang R, Jacob RJ (2016) Learn piano with BACh: an adaptive learning interface that adjusts task difficulty based on brain state. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 5372–5384 Yuksel BF, Oleson KB, Harrison L, Peck EM, Afergan D, Chang R, Jacob RJ (2016) Learn piano with BACh: an adaptive learning interface that adjusts task difficulty based on brain state. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 5372–5384
16.
go back to reference Michels L, Moazami-Goudarzi M, Jeanmonod D, Sarnthein J (2008) EEG alpha distinguishes between cuneal and precuneal activation in working memory. Neuroimage 40(3):1296–1310CrossRefPubMed Michels L, Moazami-Goudarzi M, Jeanmonod D, Sarnthein J (2008) EEG alpha distinguishes between cuneal and precuneal activation in working memory. Neuroimage 40(3):1296–1310CrossRefPubMed
17.
go back to reference Jensen O, Gelfand J, Kounios J, Lisman JE (2002) Oscillations in the alpha band (912 Hz) increase with memory load during retention in a short-term memory task. Cereb Cortex 12(8):877–882CrossRefPubMed Jensen O, Gelfand J, Kounios J, Lisman JE (2002) Oscillations in the alpha band (912 Hz) increase with memory load during retention in a short-term memory task. Cereb Cortex 12(8):877–882CrossRefPubMed
18.
go back to reference Jensen O, Tesche CD (2002) Frontal theta activity in humans increases with memory load in a working memory task. Eur J Neurosci 15(8):1395–1399CrossRefPubMed Jensen O, Tesche CD (2002) Frontal theta activity in humans increases with memory load in a working memory task. Eur J Neurosci 15(8):1395–1399CrossRefPubMed
20.
go back to reference Roux F, Uhlhaas PJ (2014) Working memory and neural oscillations: alphagamma versus thetagamma codes for distinct WM information? Trends Cogn Sci 18(1):16–25CrossRefPubMed Roux F, Uhlhaas PJ (2014) Working memory and neural oscillations: alphagamma versus thetagamma codes for distinct WM information? Trends Cogn Sci 18(1):16–25CrossRefPubMed
21.
go back to reference Drouin S, Kochanowska A, Kersten-Oertel M, Gerard IJ, Zelmann R, De Nigris D, Hall JA, Sinclair D, Petrecca K, Del Maestro R, Collins DLIBIS (2017) An OR ready open-source platform for image-guided neurosurgery. Int J Comput Assist Radiol Surg 12(3):363–378CrossRefPubMed Drouin S, Kochanowska A, Kersten-Oertel M, Gerard IJ, Zelmann R, De Nigris D, Hall JA, Sinclair D, Petrecca K, Del Maestro R, Collins DLIBIS (2017) An OR ready open-source platform for image-guided neurosurgery. Int J Comput Assist Radiol Surg 12(3):363–378CrossRefPubMed
22.
go back to reference Puckette M (1996) Pure data: another integrated computer music environment. In: Proceedings of the second intercollege computer music concerts, pp 37–41 Puckette M (1996) Pure data: another integrated computer music environment. In: Proceedings of the second intercollege computer music concerts, pp 37–41
23.
go back to reference Bencina R (2006) oscpack [computer software] Bencina R (2006) oscpack [computer software]
24.
25.
go back to reference Krigolson OE, Williams CC, Norton A, Hassall CD, Colino FL (2017) Choosing MUSE: validation of a low-cost, portable EEG system for ERP research. Front Neurosci 11:109CrossRefPubMedPubMedCentral Krigolson OE, Williams CC, Norton A, Hassall CD, Colino FL (2017) Choosing MUSE: validation of a low-cost, portable EEG system for ERP research. Front Neurosci 11:109CrossRefPubMedPubMedCentral
26.
go back to reference Negi S, Mitra R (2018) EEG metrics to determine cognitive load and affective states: a pilot study. In: Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers, pp 182–185 Negi S, Mitra R (2018) EEG metrics to determine cognitive load and affective states: a pilot study. In: Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers, pp 182–185
27.
go back to reference Brooke J (1996) SUS—a quick and dirty usability scale. Usability Eval Ind 189(194):4–7 Brooke J (1996) SUS—a quick and dirty usability scale. Usability Eval Ind 189(194):4–7
28.
go back to reference Berkman MI, Karahoca D (2016) Re-assessing the usability metric for user experience (UMUX) scale. J Usability Stud 11(3):89–109 Berkman MI, Karahoca D (2016) Re-assessing the usability metric for user experience (UMUX) scale. J Usability Stud 11(3):89–109
29.
go back to reference Lewis JR, Utesch BS, Maher DE (2013) UMUX-LITE: when there’s no time for the SUS. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2099–2102. ACM Lewis JR, Utesch BS, Maher DE (2013) UMUX-LITE: when there’s no time for the SUS. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 2099–2102. ACM
30.
go back to reference Tomlinson BJ, Noah BE, Walker BN (2018) BUZZ: an auditory interface user experience scale. In: Extended abstracts of the 2018 CHI conference on human factors in computing systems, p LBW096. ACM Tomlinson BJ, Noah BE, Walker BN (2018) BUZZ: an auditory interface user experience scale. In: Extended abstracts of the 2018 CHI conference on human factors in computing systems, p LBW096. ACM
Metadata
Title
Cognitive load associations when utilizing auditory display within image-guided neurosurgery
Authors
Joseph Plazak
Daniel A. DiGiovanni
D. Louis Collins
Marta Kersten-Oertel
Publication date
01-08-2019
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 8/2019
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-019-01970-w

Other articles of this Issue 8/2019

International Journal of Computer Assisted Radiology and Surgery 8/2019 Go to the issue