Skip to main content
Top
Published in: Perspectives on Medical Education 2/2019

Open Access 01-04-2019 | Original article

Eye-tracking for assessing medical image interpretation: A pilot feasibility study comparing novice vs expert cardiologists

Authors: Tad T. Brunyé, Brahmajee K. Nallamothu, Joann G. Elmore

Published in: Perspectives on Medical Education | Issue 2/2019

Login to get access

Abstract

Introduction

As specialized medical professionals such as radiologists, pathologists, and cardiologists gain education and experience, their diagnostic efficiency and accuracy change, and they show altered eye movement patterns during medical image interpretation. Existing research in this area is limited to interpretation of static medical images, such as digitized whole slide biopsies, making it difficult to understand how expertise development might manifest during dynamic image interpretation, such as with angiograms or volumetric scans.

Methods

A two-group (novice, expert) comparative pilot study examined the feasibility and utility of tracking and interpreting eye movement patterns while cardiologists viewed video-based coronary angiograms. A non-invasive eye tracking system recorded cardiologists’ (n = 8) visual behaviour while they viewed and diagnosed a series of eight angiogram videos. Analyses assessed frame-by-frame video navigation behaviour, eye fixation behaviour, and resulting diagnostic decision making.

Results

Relative to novices, expert cardiologists demonstrated shorter and less variable video review times, fewer eye fixations and saccadic eye movements, and less time spent paused on individual video frames. Novices showed repeated eye fixations on critical image frames and regions, though these were not predictive of accurate diagnostic decisions.

Discussion

These preliminary results demonstrate interpretive decision errors among novices, suggesting they identify and process critical diagnostic features, but sometimes fail to accurately interpret those features. Results also showcase the feasibility of tracking and understanding eye movements during video-based coronary angiogram interpretation and suggest that eye tracking may be valuable for informing assessments of competency progression during medical education and training.
Literature
1.
go back to reference Norman GR, Coblentz CL, Brooks L, Babcook C. Expertise in visual diagnosis: a review of the literature. Acad Med. 1992;67:S78–S83.CrossRef Norman GR, Coblentz CL, Brooks L, Babcook C. Expertise in visual diagnosis: a review of the literature. Acad Med. 1992;67:S78–S83.CrossRef
2.
go back to reference Crowley RS, Naus GJ, Stewart J III, Friedman CP. Development of visual diagnostic expertise in pathology: an information-processing study. J Am Med Inform Assoc. 2003;10:39–51.CrossRef Crowley RS, Naus GJ, Stewart J III, Friedman CP. Development of visual diagnostic expertise in pathology: an information-processing study. J Am Med Inform Assoc. 2003;10:39–51.CrossRef
3.
go back to reference Nodine CF, Kundel HL. The cognitive side of visual search in radiology. In: O’Regan JK, Levy-Schoen A, editors. Eye movements from psychol to Cogn. Amsterdam: Elsevier; 1987. pp. 572–82. Nodine CF, Kundel HL. The cognitive side of visual search in radiology. In: O’Regan JK, Levy-Schoen A, editors. Eye movements from psychol to Cogn. Amsterdam: Elsevier; 1987. pp. 572–82.
4.
go back to reference Krupinski EA, Graham AR, Weinstein RS. Characterizing the development of visual search experience in pathology residents viewing whole slide images. Hum Pathol. 2013;44:357–64.CrossRef Krupinski EA, Graham AR, Weinstein RS. Characterizing the development of visual search experience in pathology residents viewing whole slide images. Hum Pathol. 2013;44:357–64.CrossRef
5.
go back to reference Gegenfurtner A, Lehtinen E, Jarodzka H, Säljö R. Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis. Comput Educ. 2017;113:212–25.CrossRef Gegenfurtner A, Lehtinen E, Jarodzka H, Säljö R. Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis. Comput Educ. 2017;113:212–25.CrossRef
6.
go back to reference Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR. Eye metrics as an objective assessment of surgical skill. Ann Surg. 2010;252:177–82.CrossRef Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR. Eye metrics as an objective assessment of surgical skill. Ann Surg. 2010;252:177–82.CrossRef
7.
go back to reference Harel A, Gilaie-Dotan S, Malach R, Bentin S. Top-Down engagement modulates the neural expressions of visual expertise. Cereb Cortex. 2010;20:2304–18.CrossRef Harel A, Gilaie-Dotan S, Malach R, Bentin S. Top-Down engagement modulates the neural expressions of visual expertise. Cereb Cortex. 2010;20:2304–18.CrossRef
8.
go back to reference Gilaie-Dotan S, Harel A, Bentin S, Kanai R, Rees G. Neuroanatomical correlates of visual car expertise. Neuroimage. 2012;62:147–53.CrossRef Gilaie-Dotan S, Harel A, Bentin S, Kanai R, Rees G. Neuroanatomical correlates of visual car expertise. Neuroimage. 2012;62:147–53.CrossRef
9.
go back to reference Bukach CM, Gauthier I, Tarr MJ. Beyond faces and modularity: the power of an expertise framework. Trends Cogn Sci. 2006;10:159–66.CrossRef Bukach CM, Gauthier I, Tarr MJ. Beyond faces and modularity: the power of an expertise framework. Trends Cogn Sci. 2006;10:159–66.CrossRef
10.
go back to reference Kundel HL, Nodine CF, Conant EF, Weinstein SP. Holistic component of image perception in mammogram interpretation: gaze-tracking study. Radiology. 2007;242:396–402.CrossRef Kundel HL, Nodine CF, Conant EF, Weinstein SP. Holistic component of image perception in mammogram interpretation: gaze-tracking study. Radiology. 2007;242:396–402.CrossRef
11.
go back to reference Reingold EM, Charness N, Pomplun M, Stampe DM. Visual span in expert chess players: evidence from eye movements. Psychol Sci. 2001;12:48–55.CrossRef Reingold EM, Charness N, Pomplun M, Stampe DM. Visual span in expert chess players: evidence from eye movements. Psychol Sci. 2001;12:48–55.CrossRef
12.
go back to reference Reingold EM, Sheridan H. Eye movements and visual expertise in chess and medicine. In: Liversedge SP, Gilchrist ID, Everling S, editors. Oxford Handb eye movements. Oxford: Oxford University Press; 2011. pp. 523–50. Reingold EM, Sheridan H. Eye movements and visual expertise in chess and medicine. In: Liversedge SP, Gilchrist ID, Everling S, editors. Oxford Handb eye movements. Oxford: Oxford University Press; 2011. pp. 523–50.
13.
go back to reference Gegenfurtner A, Lehtinen E, Säljö R. Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ Psychol Rev. 2011;23:523–52.CrossRef Gegenfurtner A, Lehtinen E, Säljö R. Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ Psychol Rev. 2011;23:523–52.CrossRef
14.
go back to reference Nodine CF, Kundel HL, Mello-Thoms C, Weinstein SP, Orel SG, Sullivan DC, et al. How experience and training influence mammography expertise. Acad Radiol. 1999;6:575–85.CrossRef Nodine CF, Kundel HL, Mello-Thoms C, Weinstein SP, Orel SG, Sullivan DC, et al. How experience and training influence mammography expertise. Acad Radiol. 1999;6:575–85.CrossRef
15.
go back to reference McCormack C, Wiggins MW, Loveday T, Festa M. Expert and competent non-expert visual cues during simulated diagnosis in intensive care. Front Psychol. 2014;5:949.CrossRef McCormack C, Wiggins MW, Loveday T, Festa M. Expert and competent non-expert visual cues during simulated diagnosis in intensive care. Front Psychol. 2014;5:949.CrossRef
16.
go back to reference Brunyé TT, Carney PA, Allison KH, Shapiro LG, Weaver DL, Elmore JG. Eye movements as an index of pathologist visual expertise: a pilot study. PLoS ONE. 2014;9:e103447.CrossRef Brunyé TT, Carney PA, Allison KH, Shapiro LG, Weaver DL, Elmore JG. Eye movements as an index of pathologist visual expertise: a pilot study. PLoS ONE. 2014;9:e103447.CrossRef
17.
go back to reference Kulatunga-Moruzi C, Brooks LR, Norman GR. Using comprehensive feature lists to bias medical diagnosis. J Exp Psychol Learn Mem Cogn. 2004;30:563–72.CrossRef Kulatunga-Moruzi C, Brooks LR, Norman GR. Using comprehensive feature lists to bias medical diagnosis. J Exp Psychol Learn Mem Cogn. 2004;30:563–72.CrossRef
18.
go back to reference Harel A, Ullman S, Harari D, Bentin S. Basic-level categorization of intermediate complexity fragments reveals top-down effects of expertise in visual perception. J Vis. 2011;11:18.CrossRef Harel A, Ullman S, Harari D, Bentin S. Basic-level categorization of intermediate complexity fragments reveals top-down effects of expertise in visual perception. J Vis. 2011;11:18.CrossRef
19.
go back to reference Purves D, Augustine GJ, Fitzpatrick D, et al. Neuroscience. Sunderland: Sinauer; 2001. Purves D, Augustine GJ, Fitzpatrick D, et al. Neuroscience. Sunderland: Sinauer; 2001.
20.
go back to reference Martinez-Conde S, Macknik SL, Hubel DH. The role of fixational eye movements in visual perception. Nat Rev Neurosci. 2004;5:229–40.CrossRef Martinez-Conde S, Macknik SL, Hubel DH. The role of fixational eye movements in visual perception. Nat Rev Neurosci. 2004;5:229–40.CrossRef
21.
go back to reference Gottlieb JP, Kusunoki M, Goldberg ME. The representation of visual salience in monkey parietal cortex. Nature. 1998;391:481–4.CrossRef Gottlieb JP, Kusunoki M, Goldberg ME. The representation of visual salience in monkey parietal cortex. Nature. 1998;391:481–4.CrossRef
22.
go back to reference Henderson JM. Human gaze control during real-world scene perception. Trends Cogn Sci. 2003;7:498–504.CrossRef Henderson JM. Human gaze control during real-world scene perception. Trends Cogn Sci. 2003;7:498–504.CrossRef
23.
go back to reference Di Stasi LL, Catena A, Cañas JJ, Macknik SL, Martinez-Conde S. Saccadic velocity as an arousal index in naturalistic tasks. Neurosci Biobehav Rev. 2013;37:968–75.CrossRef Di Stasi LL, Catena A, Cañas JJ, Macknik SL, Martinez-Conde S. Saccadic velocity as an arousal index in naturalistic tasks. Neurosci Biobehav Rev. 2013;37:968–75.CrossRef
24.
go back to reference Rahafrooz A, Fallah A, Jafari AH, Bakouie F, Zendehrouh S, Gharibzadeh S. Saccadic and smooth pursuit eye movements: computational modeling of a common inhibitory mechanism in brainstem. Neurosci Lett. 2008;448:84–9.CrossRef Rahafrooz A, Fallah A, Jafari AH, Bakouie F, Zendehrouh S, Gharibzadeh S. Saccadic and smooth pursuit eye movements: computational modeling of a common inhibitory mechanism in brainstem. Neurosci Lett. 2008;448:84–9.CrossRef
25.
go back to reference Keller EL, Missal M. Shared brainstem pathways for saccades and smooth-pursuit eye movements. Ann N Y Acad Sci. 2003;1004:29–39.CrossRef Keller EL, Missal M. Shared brainstem pathways for saccades and smooth-pursuit eye movements. Ann N Y Acad Sci. 2003;1004:29–39.CrossRef
26.
go back to reference Al-Moteri MO, Symmons M, Plummer V, Cooper S. Eye tracking to investigate cue processing in medical decision-making: a scoping review. Comput Hum Behav. 2017;66:52–66.CrossRef Al-Moteri MO, Symmons M, Plummer V, Cooper S. Eye tracking to investigate cue processing in medical decision-making: a scoping review. Comput Hum Behav. 2017;66:52–66.CrossRef
27.
go back to reference Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang GZ, Darzi A. Eye tracking for skills assessment and training: a systematic review. J Surg Res. 2014;191:169–78.CrossRef Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang GZ, Darzi A. Eye tracking for skills assessment and training: a systematic review. J Surg Res. 2014;191:169–78.CrossRef
28.
go back to reference Jacob RJK, Karn KS. Eye tracking in human-computer interaction and usability research. Ready to deliver the promises. In: Mind’s Eye Cogn Appl Asp Eye Mov Res. 2003. pp. 531–53. Jacob RJK, Karn KS. Eye tracking in human-computer interaction and usability research. Ready to deliver the promises. In: Mind’s Eye Cogn Appl Asp Eye Mov Res. 2003. pp. 531–53.
29.
go back to reference Jarodzka H, Scheiter K, Gerjets P, van Gog T. In the eyes of the beholder: how experts and novices interpret dynamic stimuli. Learn Instr. 2010;20:146–54.CrossRef Jarodzka H, Scheiter K, Gerjets P, van Gog T. In the eyes of the beholder: how experts and novices interpret dynamic stimuli. Learn Instr. 2010;20:146–54.CrossRef
30.
go back to reference Bombari D, Mora B, Schaefer SC, Mast FW, Lehr H‑A. What was I thinking? Eye-tracking experiments underscore the bias that architecture exerts on nuclear grading in prostate cancer. PLoS ONE. 2012;7:e38023.CrossRef Bombari D, Mora B, Schaefer SC, Mast FW, Lehr H‑A. What was I thinking? Eye-tracking experiments underscore the bias that architecture exerts on nuclear grading in prostate cancer. PLoS ONE. 2012;7:e38023.CrossRef
31.
go back to reference Venjakob AC, Mello-Thoms CR. Review of prospects and challenges of eye tracking in volumetric imaging. J Med Imaging. 2015;3:11002.CrossRef Venjakob AC, Mello-Thoms CR. Review of prospects and challenges of eye tracking in volumetric imaging. J Med Imaging. 2015;3:11002.CrossRef
32.
go back to reference Brunyé TT, Mercan E, Weaver DL, Elmore JG. Accuracy is in the eyes of the pathologist: the visual interpretive process and diagnostic accuracy with digital whole slide images. J Biomed Inform. 2017;66:171–9.CrossRef Brunyé TT, Mercan E, Weaver DL, Elmore JG. Accuracy is in the eyes of the pathologist: the visual interpretive process and diagnostic accuracy with digital whole slide images. J Biomed Inform. 2017;66:171–9.CrossRef
33.
go back to reference Crowe EC, Narayanan NH. Comparing interfaces based on what users watch and do. Proc Symp Eye Track Res Appl—ETRA ’00. 2000. pp. 29–36. Crowe EC, Narayanan NH. Comparing interfaces based on what users watch and do. Proc Symp Eye Track Res Appl—ETRA ’00. 2000. pp. 29–36.
34.
go back to reference Reeder RW, Pirolli P, Card SK. WebEyeMapper and WebLogger: Tools for analyzing eye tracking data collected in web-use studies. CHI ’01 Ext Abstr Hum Factors Comput Syst.. 2001. pp. 19–20. Reeder RW, Pirolli P, Card SK. WebEyeMapper and WebLogger: Tools for analyzing eye tracking data collected in web-use studies. CHI ’01 Ext Abstr Hum Factors Comput Syst.. 2001. pp. 19–20.
35.
go back to reference Raiturkar P, Kleinsmith A, Keil A, Banerjee A, Jain E. Decoupling light reflex from pupillary dilation to measure emotional arousal in videos. Proc ACM Symp Appl Percept. 2016. pp. 89–96. Raiturkar P, Kleinsmith A, Keil A, Banerjee A, Jain E. Decoupling light reflex from pupillary dilation to measure emotional arousal in videos. Proc ACM Symp Appl Percept. 2016. pp. 89–96.
36.
go back to reference Rajendra SP, Keshaveni N. A survey of automatic video summarization techniques. Int J Electron Electr Comput Syst. 2014;2:1. Rajendra SP, Keshaveni N. A survey of automatic video summarization techniques. Int J Electron Electr Comput Syst. 2014;2:1.
37.
go back to reference Yu B, Ma W‑Y, Nahrstedt K, Zhang H‑J. Video summarization based on user log enhanced link analysis. Proc ACM Multimed Conf; Berkeley. 2003. pp. 382–91. Yu B, Ma W‑Y, Nahrstedt K, Zhang H‑J. Video summarization based on user log enhanced link analysis. Proc ACM Multimed Conf; Berkeley. 2003. pp. 382–91.
38.
go back to reference Gudde HB, Coventry KR, Engelhardt PE. Language and memory for object location. Cognition. 2016;153:99–107.CrossRef Gudde HB, Coventry KR, Engelhardt PE. Language and memory for object location. Cognition. 2016;153:99–107.CrossRef
39.
go back to reference Kim R, Lester BD, Schwark J, et al. Gaze behavior during curb approach: the effect of mobile device use while walking. Proc Hum Factors Ergon Soc Annu Meet. 2016. pp. 1580–4. Kim R, Lester BD, Schwark J, et al. Gaze behavior during curb approach: the effect of mobile device use while walking. Proc Hum Factors Ergon Soc Annu Meet. 2016. pp. 1580–4.
40.
go back to reference Ooms K, Coltekin A, De Maeyer P, et al. Combining user logging with eye tracking for interactive and dynamic applications. Behav Res Methods. 2014;47:977–93.CrossRef Ooms K, Coltekin A, De Maeyer P, et al. Combining user logging with eye tracking for interactive and dynamic applications. Behav Res Methods. 2014;47:977–93.CrossRef
41.
go back to reference Mozaffarian D, Benjamin EJ, Go AS, et al. Heart disease and stroke statistics—2015 update: a report from the American Heart Association. Circulation. 2015;131:e29–e322. Mozaffarian D, Benjamin EJ, Go AS, et al. Heart disease and stroke statistics—2015 update: a report from the American Heart Association. Circulation. 2015;131:e29–e322.
42.
go back to reference Cook S, Walker A, Hügli O, Togni M, Meier B. Percutaneous coronary interventions in Europe: prevalence, numerical estimates, and projections based on data up to 2004. Clin Res Cardiol. 2007;96:375–82.CrossRef Cook S, Walker A, Hügli O, Togni M, Meier B. Percutaneous coronary interventions in Europe: prevalence, numerical estimates, and projections based on data up to 2004. Clin Res Cardiol. 2007;96:375–82.CrossRef
43.
go back to reference Duchowski AT. Eye tracking methodology: theory and practice. Book. New York: Springer; 2007. Duchowski AT. Eye tracking methodology: theory and practice. Book. New York: Springer; 2007.
44.
go back to reference Krupinski EA, Tillack AA, Richter L, et al. Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Hum Pathol. 2006;37:1543–56.CrossRef Krupinski EA, Tillack AA, Richter L, et al. Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Hum Pathol. 2006;37:1543–56.CrossRef
45.
go back to reference Tiersma ESM, Peters AA, Mooij HA, Fleuren GJ. Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia. J Clin Pathol. 2003;56:677–80.CrossRef Tiersma ESM, Peters AA, Mooij HA, Fleuren GJ. Visualising scanning patterns of pathologists in the grading of cervical intraepithelial neoplasia. J Clin Pathol. 2003;56:677–80.CrossRef
46.
go back to reference Wald HS, Davis SW, Reis SP, Monroe AD, Borkan JM. Reflecting on reflections: enhancement of medical education curriculum with structured field notes and guided feedback. Acad Med. 2009;84:830–7.CrossRef Wald HS, Davis SW, Reis SP, Monroe AD, Borkan JM. Reflecting on reflections: enhancement of medical education curriculum with structured field notes and guided feedback. Acad Med. 2009;84:830–7.CrossRef
48.
go back to reference Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317:465–8.CrossRef Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Getting research findings into practice: closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317:465–8.CrossRef
49.
go back to reference Danchin N, Juilliere Y, Foley D, Serruys PW. Visual versus quantitative assessment of the severity of coronary artery stenoses: can the angiographer’s eye be reeducated? Am Heart J. 1993;126:549–600.CrossRef Danchin N, Juilliere Y, Foley D, Serruys PW. Visual versus quantitative assessment of the severity of coronary artery stenoses: can the angiographer’s eye be reeducated? Am Heart J. 1993;126:549–600.CrossRef
50.
go back to reference Myers MG, Shulman HS, Saibil EA, Naqvi SZ. Variation in measurement of coronary lesions on 35 and 70 mm angiograms. Am J Roentgenol. 1978;130:913–5.CrossRef Myers MG, Shulman HS, Saibil EA, Naqvi SZ. Variation in measurement of coronary lesions on 35 and 70 mm angiograms. Am J Roentgenol. 1978;130:913–5.CrossRef
51.
go back to reference White CW, Creighton BW, Doty DB, et al. Does visual interpretation of the coronary arteriogram predict the physiologic importance of a coronary stenosis? N Engl J Med. 1984;310:819–94.CrossRef White CW, Creighton BW, Doty DB, et al. Does visual interpretation of the coronary arteriogram predict the physiologic importance of a coronary stenosis? N Engl J Med. 1984;310:819–94.CrossRef
52.
go back to reference Gould KL, Kirkeeide RL. Assessment of stenosis severity. In: Reiber JHC, Serruys PW, editors. State art quant Coron arter. 1986. pp. 209–28.CrossRef Gould KL, Kirkeeide RL. Assessment of stenosis severity. In: Reiber JHC, Serruys PW, editors. State art quant Coron arter. 1986. pp. 209–28.CrossRef
53.
go back to reference Leape LL, Park RE, Bashore TM, Harrison JK, Davidson CJ, Brook RH. Effect of variability in the interpretation of coronary angiograms on the appropriateness of use of coronary revascularization procedures. Am Heart J. 2000;139:106–13.CrossRef Leape LL, Park RE, Bashore TM, Harrison JK, Davidson CJ, Brook RH. Effect of variability in the interpretation of coronary angiograms on the appropriateness of use of coronary revascularization procedures. Am Heart J. 2000;139:106–13.CrossRef
Metadata
Title
Eye-tracking for assessing medical image interpretation: A pilot feasibility study comparing novice vs expert cardiologists
Authors
Tad T. Brunyé
Brahmajee K. Nallamothu
Joann G. Elmore
Publication date
01-04-2019
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 2/2019
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-019-0505-6

Other articles of this Issue 2/2019

Perspectives on Medical Education 2/2019 Go to the issue