Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
International Journal of Computer Assisted Radiology and Surgery
Published in: International Journal of Computer Assisted Radiology and Surgery 10/2017

01-10-2017 | Review Article

A Survey of auditory display in image-guided interventions

Authors: David Black, Christian Hansen, Arya Nabavi, Ron Kikinis, Horst Hahn

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 10/2017

Login to get access

Abstract

Purpose

This article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of published systems and outline directions for future investigation.

Methods

We undertook a review of scientific articles on the topic of auditory rendering in image-guided intervention. This includes methods for avoidance of risk structures and instrument placement and manipulation. The review did not include auditory display for status monitoring, for instance in anesthesia.

Results

We identified 15 publications in the course of the search. Most of the literature (60%) investigates the use of auditory display to convey distance of a tracked instrument to an object using proximity or safety margins. The remainder discuss continuous guidance for navigated instrument placement. Four of the articles present clinical evaluations, 11 present laboratory evaluations, and 3 present informal evaluation (2 present both laboratory and clinical evaluations).

Conclusion

Auditory display is a growing field that has been largely neglected in research in image-guided intervention. Despite benefits of auditory displays reported in both the reviewed literature and non-medical fields, adoption in medicine has been slow. Future challenges include increasing interdisciplinary cooperation with auditory display investigators to develop more meaningful auditory display designs and comprehensive evaluations which target the benefits and drawbacks of auditory display in image guidance.
Footnotes
1
Passages from Strauss et al. [14] translated from the original German into English by author DB.
 
2
Musical Instrument Digital Interface, a protocol for electronic musical instrument communication.
 
Literature
1.
Cleary K, Peters T (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:1–433
2.
Mewes A, Hensen B, Wacker F, Hansen C (2017) Touchless interaction with software in interventional radiology and surgery: a systematic literature review. Int J Comput Assist Radiol Surg 12(2):291–305. doi:10.​1007/​s11548-016-1480-6
3.
Hansen C, Black D, Lange C, Rieber F, Lamade W, Donati M, Oldhafer K, Hahn H (2013) Auditory support for resection guidance in navigated liver surgery. Med Robotics Comput Assistg Surg 9(1):36CrossRef
4.
Willems P, Noordmans H, van Overbeeke J, Viergever M, Tulleken C, van der Sprenkel J (2005) The impact of auditory feedback on neuronavigation. Acta Neurochir 147:167–173CrossRefPubMed
5.
Bork F, Fuerst B, Schneider A, Pinto F, Graumann C, Navab N (2015) Auditory and visio-temporal distance coding for 3-dimensional perception in medical augmented reality. In: Proceedings of 2015 IEEE international symposium on mixed and augmented reality (ISMAR), pp 7–12
6.
Kramer G, Walker B, Bonebright T, Cook P, Flowers J, Miner N, Neuhoff J, Bargar R, Barrass S, BErger J, Evreinov G, Fitch W, Grhn M, Handel S, Kaper H, Levkowitz H, Lodha S, Shinn-Cunningham B, Simoni M, Tipei S (1999) The sonification report: status of the field and research agenda. Report prepared for the national science foundation by members of the international community for auditory display
7.
Sanderson P, Watson M, Russell W (2005) Advanced patient monitoring displays: tools for continuous informing. Anesth Analg 101:161168CrossRef
8.
Black D, Al Issawi J, Hansen C, Rieder C, Hahn HK (2013) Auditory support for navigated radiofrequency ablation. In: Proceedings of CURAC-Deutsche Gesellschaft fr Computer-und Roboterassistierte Chirurgie, p 3033
9.
10.
Cho B, Oka M, Matsumoto N, Ouchida R, Hong J, Hashizume M (2013) Warning navigation system using realtime safe region monitoring for otologic surgery. Int J Comput Assist Radiol Surg 8:395–405CrossRefPubMed
11.
Cho B, Matsumoto N, Komune s, Hashizume M (2014) A surgical navigation system for guiding exact cochleostomy using auditory feedback: a clinical feasibility study. BioMed Res Int 2014:769659CrossRefPubMedPubMedCentral
12.
Dixon B, Daly M, Chan H, Vescan A, Witterick I, Irish J (2014) Augmented real-time navigation with critical structure proximity alerts for endoscopic skull base surgery. Laryngoscope 124:853–859CrossRefPubMed
13.
Kitagawa M, Dokko D, Okamura A, Yuh D (2005) Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. Thorac Cardiovasc Surg 129(1):151–158CrossRef
14.
Strauß G, Schaller S, Zaminer B, Heininger S, Hofer M, Manzey D, Meixensberger J, Dietz S, Luth T (2010) Klinische Erfahrungen mit einem Kollisionswarnsystem. HNO 59:470479
15.
Voormolen E, Woerdeman P, van Stralen M, Noordmans H, Viergever M, Regli L, van der Sprenkel J (2012) Validation of exposure visualization and audible distance emission for navigated temporal bone drilling in phantoms. PLoS ONE 7:e41262CrossRefPubMedPubMedCentral
16.
Wegner K, Karron DB (1997) Surgical navigation using audio feedback. In: Morgan K, Hoffman H, Stredney D, Weghorst S (eds) Medicine meets virtual reality. IOS Press, Amsterdam, pp 450–458
17.
Wegner K (1998) Surgical navigation system and method using audio feedback. In: 5th international conference on auditory display
18.
Woerdeman P, Willems P, Noordmans H, van der Sprenkel J (2009) Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. Neurosurgery 110:257–262CrossRef
19.
Luz M, Manzey D, Modemann S, Strauss G (2014) Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons. Ergonomics 2015 58(3):383–393
20.
Walker B, Nees M (2011) Theory of sonification. In: Hermann T, Hunt A, Neuhoff J (eds) Handbook of sonification. Academic Press, New York, pp 9–31
21.
22.
Speeth S (1961) Seismometer sounds. J Acoust Soc Am 33:909916
23.
24.
Brock D, Stroup J, Ballas J (2002) Using an auditory display to manage attention in a dual task, multiscreen environment. In: Proceedings of 8th international conference on auditory display, pp 177–180
25.
Saue S (2000) A model for interaction in exploratory sonification displays. In: 6th international conference on auditory display, pp 105–110
26.
27.
Furmanski C, Azuma R, Daily M (2002) Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information. In: Proceedings of the international symposium on mixed and augmented reality, p 215
28.
Lewis C (1982) Using the “thinking aloud” method in cognitive interface design. IBM Research Report RC-9265
29.
Hart S (2006) NASA-task load index (NASA-TLX); 20 years later. In: Human factors and ergonomics society 50th annual meeting, pp 904–908
30.
Miller R, Eriksson L, Fleisher L, Wiener-Kronish J, Cohen N, Young W (2015) Anesthesia. Elsevier, Amsterdam
31.
Allen K, Blascovich J (1994) Effects of music on cardiovascular reactivity among surgeons. J Am Med Assoc 272(11):882–884CrossRef
32.
George S, Ahmed S, Mammen K, John G (2011) Influence of music on operation theatre staff. Anaesthesiol Clin Pharmacol 27(3):354–357CrossRef
33.
Moorthy K, Munz Y, Undre S, Darzi A (2004) Objective evaluation of the effect of noise on the performance of a complex laparoscopic task. Surgery 136(1):25–30 (discussion 31)
34.
Edworthy J, Loxley S, Dennis I (1991) Improving auditory warning design: relationship between warning sound parameters and perceived urgency. Hum Factors 33(2):205–231CrossRefPubMed
35.
Mondor T, Finley G (2003) The perceived urgency of auditory warning alarms used in the hospital operating room is inappropriate. Can J Anesth 50(3):221–228CrossRefPubMed
36.
Haerle S, Daly M, Chan H, Vescan A, Witterick I, Gentili F, Zadeh G, Kucharczyk W, Irish J (2015) Localized intraoperative virtual endoscopy (LIVE) for surgical guidance in 16 skull base patients. Otolaryngol Head Neck Surg 152:165–171
37.
Parseihian G, Gondre C, Aramaki M, Ystad S, Kronland-Martinet R (2016) Comparison and evaluation of sonification strategies for guidance tasks. IEEE Trans Multimed 18(4):674–686
38.
Arnolli MM, Hanumara NC, Franken M, Brouwer DM, Broeders IA (2015) An overview of systems for CT and MRI guided percutaneous needle placement in the thorax and abdomen. Med Robotics Comput Assist Surg 11(4):458–475CrossRef
39.
Banz V, Mller PC, Tinguely P, Inderbitzin D, Ribes D, Peterhans M, Candinas D, Weber S (2016) Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery. Langenbeck’s Arch Surg 401(4):495–502CrossRef
40.
Burgner J, Rucker D, Gilbert H, Swaney P, Russell P, Weaver K, Webster R (2013) A telerobotic system for transnasal surgery. IEEE ASME Trans Mechatron 19(3):996–1006CrossRefPubMedPubMedCentral
Metadata
Title
A Survey of auditory display in image-guided interventions
Authors
David Black
Christian Hansen
Arya Nabavi
Ron Kikinis
Horst Hahn
Publication date
01-10-2017
Publisher
Springer International Publishing
Published in
International Journal of Computer Assisted Radiology and Surgery / Issue 10/2017
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-017-1547-z

Other articles of this Issue 10/2017

International Journal of Computer Assisted Radiology and Surgery 10/2017 Go to the issue

Original Article

Feature fusion for lung nodule classification

Original Article

3D Boolean operations in virtual surgical planning

Original Article

A computationally efficient method for hand–eye calibration

Original Article

Automatic classification of lung nodules on MDCT images with the temporal subtraction technique

Original Article

3D intra-operative ultrasound and MR image guidance: pursuing an ultrasound-based management of brainshift to enhance neuronavigation

Original Article

Statistical shape modelling to aid surgical planning: associations between surgical parameters and head shapes following spring-assisted cranioplasty