Skip to main content
Top
Published in: Surgical Endoscopy 2/2013

01-02-2013

Surgeons blinded by enhanced navigation: the effect of augmented reality on attention

Authors: Benjamin J. Dixon, Michael J. Daly, Harley Chan, Allan D. Vescan, Ian J. Witterick, Jonathan C. Irish

Published in: Surgical Endoscopy | Issue 2/2013

Login to get access

Abstract

Background

Advanced image-guidance systems allowing presentation of three-dimensional navigational data in real time are being developed enthusiastically for many medical procedures. Other industries, including aviation and the military, have noted that shifting attention toward such compelling assistance has detrimental effects. Using the detection rate of unexpected findings, we assess whether inattentional blindness is significant in a surgical context and evaluate the impact of on-screen navigational cuing with augmented reality.

Methods

Surgeons and trainees performed an endoscopic navigation exercise on a cadaveric specimen. The subjects were randomized to either a standard endoscopic view (control) or an AR view consisting of an endoscopic video fused with anatomic contours. Two unexpected findings were presented in close proximity to the target point: one critical complication and one foreign body (screw). Task completion time, accuracy, and recognition of findings were recorded.

Results

Detection of the complication was 0/15 in the AR group versus 7/17 in the control group (p = 0.008). Detection of the screw was 1/15 (AR) and 7/17 (control) (p = 0.041). Recognition of either finding was 12/17 for the control group and 1/15 for the AR group (p < 0.001). Accuracy was greater for the AR group than for the control group, with the median distance from the target point measuring respectively 2.10 mm (interquartile range [IQR], 1.29–2.37) and 4.13 (IQR, 3.11–7.39) (p < 0.001).

Conclusion

Inattentional blindness was evident in both groups. Although more accurate, the AR group was less likely to identify significant unexpected findings clearly within view. Advanced navigational displays may increase precision, but strategies to mitigate attentional costs need further investigation to allow safe implementation.
Literature
1.
go back to reference Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142PubMedCrossRef Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142PubMedCrossRef
2.
go back to reference Strauss G, Koulechov K, Rottger S, Bahner J, Trantakis C, Hofer M, Korb W, Burgert O, Meixensberger J, Manzey D, Dietz A, Luth T (2006) Evaluation of a navigation system for ENT with surgical efficiency criteria. Laryngoscope 116:564–572PubMedCrossRef Strauss G, Koulechov K, Rottger S, Bahner J, Trantakis C, Hofer M, Korb W, Burgert O, Meixensberger J, Manzey D, Dietz A, Luth T (2006) Evaluation of a navigation system for ENT with surgical efficiency criteria. Laryngoscope 116:564–572PubMedCrossRef
3.
go back to reference Nithiananthan S, Brock KK, Daly MJ, Chan H, Irish JC, Siewerdsen JH (2009) Demons deformable registration for CBCT-guided procedures in the head and neck: convergence and accuracy. Med Phys 36:4755–4764PubMedCrossRef Nithiananthan S, Brock KK, Daly MJ, Chan H, Irish JC, Siewerdsen JH (2009) Demons deformable registration for CBCT-guided procedures in the head and neck: convergence and accuracy. Med Phys 36:4755–4764PubMedCrossRef
4.
go back to reference Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985PubMedCrossRef Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985PubMedCrossRef
5.
go back to reference Cheung CL, Wedlake C, Moore J, Pautler SE, Peters TM (2010) Fused video and ultrasound images for minimally invasive partial nephrectomy: a phantom study. Med Image Comput Comput Assist Interv 13(Pt 3):408–415PubMed Cheung CL, Wedlake C, Moore J, Pautler SE, Peters TM (2010) Fused video and ultrasound images for minimally invasive partial nephrectomy: a phantom study. Med Image Comput Comput Assist Interv 13(Pt 3):408–415PubMed
6.
go back to reference Siewerdsen JH, Daly MJ, Chan H, Nithiananthan S, Hamming N, Brock KK, Irish JC (2009) High-performance intraoperative cone-beam CT on a mobile C-arm: an integrated system for guidance of head and neck surgery. Proc SPIE 7261(1):72610JCrossRef Siewerdsen JH, Daly MJ, Chan H, Nithiananthan S, Hamming N, Brock KK, Irish JC (2009) High-performance intraoperative cone-beam CT on a mobile C-arm: an integrated system for guidance of head and neck surgery. Proc SPIE 7261(1):72610JCrossRef
7.
go back to reference Daly MJ, Chan H, Nithiananthan S, Qiu J, Barker E, Bachar G, Dixon BJ, Irish JC, Siewerdsen JH (2011) Clinical implementation of intraoperative cone-beam CT in head and neck surgery. Proc SPIE 7964:796426 Daly MJ, Chan H, Nithiananthan S, Qiu J, Barker E, Bachar G, Dixon BJ, Irish JC, Siewerdsen JH (2011) Clinical implementation of intraoperative cone-beam CT in head and neck surgery. Proc SPIE 7964:796426
8.
go back to reference Daly MJ, Chan H, Prisman E, Vescan A, Nithiananthan S, Qiu J, Weersink R, Irish JC, Siewerdsen JH (2010) Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures. Proc SPIE 7625:762503CrossRef Daly MJ, Chan H, Prisman E, Vescan A, Nithiananthan S, Qiu J, Weersink R, Irish JC, Siewerdsen JH (2010) Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures. Proc SPIE 7625:762503CrossRef
9.
go back to reference Azuma RT (1997) A survey of augmented reality. In presence: teleoperators and virtual environments 4:355–385 Azuma RT (1997) A survey of augmented reality. In presence: teleoperators and virtual environments 4:355–385
10.
go back to reference Teber D, Guven S, Simpfendorfer T, Baumhauer M, Guven EO, Yencilek F, Gozen AS, Rassweiler J (2009) Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56:332–338PubMedCrossRef Teber D, Guven S, Simpfendorfer T, Baumhauer M, Guven EO, Yencilek F, Gozen AS, Rassweiler J (2009) Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56:332–338PubMedCrossRef
11.
go back to reference Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreat Sci 18(4):506–509 Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreat Sci 18(4):506–509
12.
go back to reference Fernandez-Esparrach G, San Jose Estepar R, Guarner-Argente C, Martinez-Palli G, Navarro R, Rodriguez de Miguel C, Cordova H, Thompson CC, Lacy AM, Donoso L, Ayuso-Colella JR, Gines A, Pellise M, Llach J, Vosburgh KG (2010) The role of a computed tomography-based image registered navigation system for natural orifice transluminal endoscopic surgery: a comparative study in a porcine model. Endoscopy 42:1096–1103PubMedCrossRef Fernandez-Esparrach G, San Jose Estepar R, Guarner-Argente C, Martinez-Palli G, Navarro R, Rodriguez de Miguel C, Cordova H, Thompson CC, Lacy AM, Donoso L, Ayuso-Colella JR, Gines A, Pellise M, Llach J, Vosburgh KG (2010) The role of a computed tomography-based image registered navigation system for natural orifice transluminal endoscopic surgery: a comparative study in a porcine model. Endoscopy 42:1096–1103PubMedCrossRef
13.
go back to reference Simons DJ, Chabris CF (1999) Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception 28:1059–1074PubMedCrossRef Simons DJ, Chabris CF (1999) Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception 28:1059–1074PubMedCrossRef
14.
go back to reference Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12:80–90PubMedCrossRef Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12:80–90PubMedCrossRef
15.
go back to reference Yeh M, Wickens CD (2001) Display signaling in augmented reality: effects of cue reliability and image realism on attention allocation and trust calibration. Hum Factors 43:355–365PubMedCrossRef Yeh M, Wickens CD (2001) Display signaling in augmented reality: effects of cue reliability and image realism on attention allocation and trust calibration. Hum Factors 43:355–365PubMedCrossRef
16.
go back to reference Maltz M, Shinar D (2003) New alternative methods of analyzing human behavior in cued target acquisition. Hum Factors 45:281–295PubMedCrossRef Maltz M, Shinar D (2003) New alternative methods of analyzing human behavior in cued target acquisition. Hum Factors 45:281–295PubMedCrossRef
17.
go back to reference Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMedCrossRef Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMedCrossRef
18.
go back to reference Liu D, Jenkins SA, Sanderson PM (2009) Patient monitoring with head-mounted displays. Curr Opin Anaesthesiol 22:796–803PubMedCrossRef Liu D, Jenkins SA, Sanderson PM (2009) Patient monitoring with head-mounted displays. Curr Opin Anaesthesiol 22:796–803PubMedCrossRef
19.
go back to reference Liu D, Jenkins SA, Sanderson PM, Fabian P, Russell WJ (2010) Monitoring with head-mounted displays in general anesthesia: a clinical evaluation in the operating room. Anesth Analg 110:1032–1038PubMedCrossRef Liu D, Jenkins SA, Sanderson PM, Fabian P, Russell WJ (2010) Monitoring with head-mounted displays in general anesthesia: a clinical evaluation in the operating room. Anesth Analg 110:1032–1038PubMedCrossRef
20.
go back to reference Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. J Display Technol 4:451–467CrossRef Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. J Display Technol 4:451–467CrossRef
21.
go back to reference McCann RS, Foyle DC, Andre AD, Battiste V (1996) Advanced navigation aids in the flight deck: effects on ground taxi performance under low visibilty conditions. SAE Transact J Aerospace 105:1419–1430 McCann RS, Foyle DC, Andre AD, Battiste V (1996) Advanced navigation aids in the flight deck: effects on ground taxi performance under low visibilty conditions. SAE Transact J Aerospace 105:1419–1430
22.
go back to reference Marescaux J, Rubino F, Arenas M, Mutter D, Soler L (2004) Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 292:2214–2215PubMedCrossRef Marescaux J, Rubino F, Arenas M, Mutter D, Soler L (2004) Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 292:2214–2215PubMedCrossRef
23.
go back to reference Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed
24.
go back to reference Wickens CD (2005) Attentional tunneling and task management: Technical Report AHFD-05-23/NASA-05-10. University of Illinois, Urbana-Champaign Wickens CD (2005) Attentional tunneling and task management: Technical Report AHFD-05-23/NASA-05-10. University of Illinois, Urbana-Champaign
25.
go back to reference Shappell SA, Wiegmann DA (2003) A human error analysis of general aviation controlled flight into terrain accidents occurring between 1990–1998. Final Rep. DOT/FAA/AM-03/4. Office of Aerospace Medicine, Washington, DC Shappell SA, Wiegmann DA (2003) A human error analysis of general aviation controlled flight into terrain accidents occurring between 1990–1998. Final Rep. DOT/FAA/AM-03/4. Office of Aerospace Medicine, Washington, DC
26.
go back to reference Strayer DL, Johnston WA (2001) Driven to distraction: dual-task studies of simulated driving and conversing on cellular telephone. Psychol Sci 12:462–466PubMedCrossRef Strayer DL, Johnston WA (2001) Driven to distraction: dual-task studies of simulated driving and conversing on cellular telephone. Psychol Sci 12:462–466PubMedCrossRef
27.
go back to reference Horrey WJ, Wickens CD (2006) Examining the impact of cell phone conversations on driving using meta-analytic techniques. Hum Factors 48:196–205PubMedCrossRef Horrey WJ, Wickens CD (2006) Examining the impact of cell phone conversations on driving using meta-analytic techniques. Hum Factors 48:196–205PubMedCrossRef
28.
go back to reference McCann RS, Foyle DC, Johnston JC (1993) Attentional limitations with head-up displays. In: Jensen RS (ed) Proceedings of the Seventh International Symposium on Aviation Psychology 1993, Colombus, pp 70–75 McCann RS, Foyle DC, Johnston JC (1993) Attentional limitations with head-up displays. In: Jensen RS (ed) Proceedings of the Seventh International Symposium on Aviation Psychology 1993, Colombus, pp 70–75
29.
go back to reference Fischer E, Haines RF, Price TA (1980) Cognitive issues in head-up displays. NASA Technical paper 1711. NASA Ames Research Center, Moffat Field Fischer E, Haines RF, Price TA (1980) Cognitive issues in head-up displays. NASA Technical paper 1711. NASA Ames Research Center, Moffat Field
30.
go back to reference Wickens CD, Alexander AL, Horrey WJ, Nunes A, Hardy TJ (2004) Traffic and flight guidance depiction on a synthetic vision system display: the affects of clutter on performance and visual attention allocation. In: Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, pp 218–222 Wickens CD, Alexander AL, Horrey WJ, Nunes A, Hardy TJ (2004) Traffic and flight guidance depiction on a synthetic vision system display: the affects of clutter on performance and visual attention allocation. In: Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, pp 218–222
31.
go back to reference Berbaum KS, Franken EA Jr, Dorfman DD, Miller EM, Krupinski EA, Kreinbring K, Caldwell RT, Lu CH (1996) Cause of satisfaction of search effects in contrast studies of the abdomen. Acad Radiol 3:815–826PubMedCrossRef Berbaum KS, Franken EA Jr, Dorfman DD, Miller EM, Krupinski EA, Kreinbring K, Caldwell RT, Lu CH (1996) Cause of satisfaction of search effects in contrast studies of the abdomen. Acad Radiol 3:815–826PubMedCrossRef
32.
go back to reference Samuel S, Kundel HL, Nodine CF, Toto LC (1995) Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs. Radiology 194:895–902PubMed Samuel S, Kundel HL, Nodine CF, Toto LC (1995) Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs. Radiology 194:895–902PubMed
33.
go back to reference Berbaum KS, Caldwell RT, Schartz KM, Thompson BH, Franken EA Jr (2007) Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography? Acad Radiol 14:1069–1076PubMedCrossRef Berbaum KS, Caldwell RT, Schartz KM, Thompson BH, Franken EA Jr (2007) Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography? Acad Radiol 14:1069–1076PubMedCrossRef
34.
go back to reference Yeh M, Merlo JL, Wickens CD, Brandenburg DL (2003) Head-up versus head-down: the costs of imprecision, unreliability, and visual clutter on cue effectiveness for display signaling. Hum Factors 45:390–407PubMedCrossRef Yeh M, Merlo JL, Wickens CD, Brandenburg DL (2003) Head-up versus head-down: the costs of imprecision, unreliability, and visual clutter on cue effectiveness for display signaling. Hum Factors 45:390–407PubMedCrossRef
35.
go back to reference Ververs PM, Wickens CD (1998) Head-up displays: effects of clutter, display intensity, and display location on pilot performance. Int J Aviat Psychol 8:377–403PubMedCrossRef Ververs PM, Wickens CD (1998) Head-up displays: effects of clutter, display intensity, and display location on pilot performance. Int J Aviat Psychol 8:377–403PubMedCrossRef
36.
go back to reference Livingston MA (2005) Evaluating human factors in augmented reality systems. IEEE Comput Graph Appl 25:6–9PubMedCrossRef Livingston MA (2005) Evaluating human factors in augmented reality systems. IEEE Comput Graph Appl 25:6–9PubMedCrossRef
37.
go back to reference Shenai MB, Dillavou M, Shum C, Ross D, Tubbs RS, Shih A, Guthrie BL (2011) Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery 68(1 Suppl operative):200–207; discussion 207 Shenai MB, Dillavou M, Shum C, Ross D, Tubbs RS, Shih A, Guthrie BL (2011) Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery 68(1 Suppl operative):200–207; discussion 207
38.
go back to reference Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46:50–80PubMed Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46:50–80PubMed
39.
go back to reference Sanderson PM, Liu D, Jenkins SA (2009) Auditory displays in anesthesiology. Curr Opin Anaesthesiol 22:788–795PubMedCrossRef Sanderson PM, Liu D, Jenkins SA (2009) Auditory displays in anesthesiology. Curr Opin Anaesthesiol 22:788–795PubMedCrossRef
Metadata
Title
Surgeons blinded by enhanced navigation: the effect of augmented reality on attention
Authors
Benjamin J. Dixon
Michael J. Daly
Harley Chan
Allan D. Vescan
Ian J. Witterick
Jonathan C. Irish
Publication date
01-02-2013
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 2/2013
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-012-2457-3

Other articles of this Issue 2/2013

Surgical Endoscopy 2/2013 Go to the issue