Skip to main content
Top
Published in: Surgical Endoscopy 3/2011

01-03-2011 | Review

New technologies for information retrieval to achieve situational awareness and higher patient safety in the surgical operating room: the MRI institutional approach and review of the literature

Authors: Michael Kranzfelder, Armin Schneider, Sonja Gillen, Hubertus Feussner

Published in: Surgical Endoscopy | Issue 3/2011

Login to get access

Abstract

Background

Technical progress in the operating room (OR) increases constantly, but advanced techniques for error prevention are lacking. It has been the vision to create intelligent OR systems (“autopilot”) that not only collect intraoperative data but also interpret whether the course of the operation is normal or deviating from the schedule (“situation awareness”), to recommend the adequate next steps of the intervention, and to identify imminent risky situations.

Methods

Recently introduced technologies in health care for real-time data acquisition (bar code, radiofrequency identification [RFID], voice and emotion recognition) may have the potential to meet these demands. This report aims to identify, based on the authors’ institutional experience and a review of the literature (MEDLINE search 2000–2010), which technologies are currently most promising for providing the required data and to describe their fields of application and potential limitations.

Results

Retrieval of information on the functional state of the peripheral devices in the OR is technically feasible by continuous sensor-based data acquisition and online analysis. Using bar code technologies, automatic instrument identification seems conceivable, with information given about the actual part of the procedure and indication of any change in the routine workflow. The dynamics of human activities also comprise key information. A promising technology for continuous personnel tracking is data acquisition with RFID. Emotional data capture and analysis in the OR are difficult. Although technically feasible, nonverbal emotion recognition is difficult to assess. In contrast, emotion recognition by speech seems to be a promising technology for further workflow prediction.

Conclusion

The presented technologies are a first step to achieving an increased situational awareness in the OR. However, workflow definition in surgery is feasible only if the procedure is standardized, the peculiarities of the individual patient are taken into account, the level of the surgeon’s expertise is regarded, and a comprehensive data capture can be obtained.
Literature
1.
go back to reference Sutherland JV, van den Heuvel W, Ganous T, Burton MM, Kumar A (2005) Towards an intelligent hospital environment: OR of the future. Stud Health Technol Inform 118:278–312PubMed Sutherland JV, van den Heuvel W, Ganous T, Burton MM, Kumar A (2005) Towards an intelligent hospital environment: OR of the future. Stud Health Technol Inform 118:278–312PubMed
2.
go back to reference Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform. [Epub ahead of print] Bouarfa L, Jonker PP, Dankelman J (2010) Discovery of high-level tasks in the operating room. J Biomed Inform. [Epub ahead of print]
4.
go back to reference Mishra A, Catchpole K, Dale T, McCulloch P (2008) The influence of nontechnical performance on technical outcome in laparoscopic cholecystectomy. Surg Endosc 22:68–73PubMedCrossRef Mishra A, Catchpole K, Dale T, McCulloch P (2008) The influence of nontechnical performance on technical outcome in laparoscopic cholecystectomy. Surg Endosc 22:68–73PubMedCrossRef
5.
go back to reference Padoy N, Blum T, Essa I, Feussner H, Berger MO, Navab N (2007) A boosted segmentation method for surgical workflow analysis. Med Image Comput Comput Assist Interv 10:102–109PubMed Padoy N, Blum T, Essa I, Feussner H, Berger MO, Navab N (2007) A boosted segmentation method for surgical workflow analysis. Med Image Comput Comput Assist Interv 10:102–109PubMed
6.
go back to reference Blum T, Padoy N, Feussner H, Navab N (2008) Modeling and online recognition of surgical phases using hidden Markov models. Med Image Comput Comput Assist Interv 11:627–635PubMed Blum T, Padoy N, Feussner H, Navab N (2008) Modeling and online recognition of surgical phases using hidden Markov models. Med Image Comput Comput Assist Interv 11:627–635PubMed
7.
go back to reference Vankipuram M, Kahol K, Cohen T, Patel VL (2009) Visualization and analysis of activities in critical care environments. AMIA Annu Symp Proc 662–666 Vankipuram M, Kahol K, Cohen T, Patel VL (2009) Visualization and analysis of activities in critical care environments. AMIA Annu Symp Proc 662–666
8.
go back to reference James A, Vieira D, Lo B, Darzi A, Yang GZ (2007) Eye-gaze-driven surgical workflow segmentation. Med Image Comput Comput Assist Interv 10:110–117PubMed James A, Vieira D, Lo B, Darzi A, Yang GZ (2007) Eye-gaze-driven surgical workflow segmentation. Med Image Comput Comput Assist Interv 10:110–117PubMed
10.
go back to reference Shepherd JP, Brickley MR, Jones ML (1994) Automatic identification of surgical and orthodontic instruments. Ann R Coll Surg Engl 76:59–62PubMed Shepherd JP, Brickley MR, Jones ML (1994) Automatic identification of surgical and orthodontic instruments. Ann R Coll Surg Engl 76:59–62PubMed
11.
go back to reference Kumar S, Swanson E, Tran T (2009) RFID in the healthcare supply chain: usage and application. Int J Health Care Qual Assur 22:67–81PubMedCrossRef Kumar S, Swanson E, Tran T (2009) RFID in the healthcare supply chain: usage and application. Int J Health Care Qual Assur 22:67–81PubMedCrossRef
12.
go back to reference Iadanza E, Dori F (2009) Custom active RFID solution for children tracking and identifying in a resuscitation ward. Conf Proc IEEE Eng Med Biol Soc 5223–5226 Iadanza E, Dori F (2009) Custom active RFID solution for children tracking and identifying in a resuscitation ward. Conf Proc IEEE Eng Med Biol Soc 5223–5226
13.
go back to reference Rogers A, Jones E, Oleynikov D (2007) Radiofrequency identification (RFID) applied to surgical sponges. Surg Endosc 21:1235–1237PubMedCrossRef Rogers A, Jones E, Oleynikov D (2007) Radiofrequency identification (RFID) applied to surgical sponges. Surg Endosc 21:1235–1237PubMedCrossRef
14.
15.
go back to reference Sargent MC, Sotile W, Sotile MO, Rubash H, Barrack RL (2004) Stress and coping among orthopaedic surgery residents and faculty. J Bone Joint Surg Am 86:1579–1586PubMed Sargent MC, Sotile W, Sotile MO, Rubash H, Barrack RL (2004) Stress and coping among orthopaedic surgery residents and faculty. J Bone Joint Surg Am 86:1579–1586PubMed
16.
go back to reference Granholm E, Steinhauer SR (2004) Pupillometric measures of cognitive and emotional processes. Int J Psychophysiol 52:1–6PubMedCrossRef Granholm E, Steinhauer SR (2004) Pupillometric measures of cognitive and emotional processes. Int J Psychophysiol 52:1–6PubMedCrossRef
17.
go back to reference Schuller B (2008) Sprachkommunikation (ITG-FB 211). VDE Verlag, Berlin Schuller B (2008) Sprachkommunikation (ITG-FB 211). VDE Verlag, Berlin
18.
go back to reference Schneider A (2006) Intraoperative workflow analyse bei minimal invasiven Eingriffen. Master’s thesis. TU München Schneider A (2006) Intraoperative workflow analyse bei minimal invasiven Eingriffen. Master’s thesis. TU München
19.
go back to reference Kranzfelder M, Schneider A, Blahusch G, Schaaf H, Feussner H (2009) Feasibility of opto-electronic surgical instrument identification. Minim Invasive Ther Allied Technol 18:253–258PubMedCrossRef Kranzfelder M, Schneider A, Blahusch G, Schaaf H, Feussner H (2009) Feasibility of opto-electronic surgical instrument identification. Minim Invasive Ther Allied Technol 18:253–258PubMedCrossRef
20.
go back to reference Gillen S, Wilhelm D, Meining A, Fiolka A, Doundoulakis E, Schneider A, von Delius S, Friess H, Feussner H (2009) The “ELITE” model: construct validation of a new training system for natural orifice transluminal endoscopic surgery (NOTES). Endoscopy 41:395–399PubMedCrossRef Gillen S, Wilhelm D, Meining A, Fiolka A, Doundoulakis E, Schneider A, von Delius S, Friess H, Feussner H (2009) The “ELITE” model: construct validation of a new training system for natural orifice transluminal endoscopic surgery (NOTES). Endoscopy 41:395–399PubMedCrossRef
21.
go back to reference Schuller B, Rigoll G, Can S, Feussner H (2008) Emotion-sensitive speech control for human-robot interaction in minimal invasive surgery. www.ieeexplore.ieee.org. Retrieved 15 May 2010 Schuller B, Rigoll G, Can S, Feussner H (2008) Emotion-sensitive speech control for human-robot interaction in minimal invasive surgery. www.​ieeexplore.​ieee.​org. Retrieved 15 May 2010
22.
go back to reference Leotta DF (2004) An efficient calibration method for freehand 3-D ultrasound imaging systems. Ultrasound Med Biol 30:999–1008PubMedCrossRef Leotta DF (2004) An efficient calibration method for freehand 3-D ultrasound imaging systems. Ultrasound Med Biol 30:999–1008PubMedCrossRef
23.
go back to reference Lindseth F, Tangen GA, Langø T, Bang J (2003) Probe calibration for freehand 3-D ultrasound. Ultrasound Med Biol 29:1607–1623PubMedCrossRef Lindseth F, Tangen GA, Langø T, Bang J (2003) Probe calibration for freehand 3-D ultrasound. Ultrasound Med Biol 29:1607–1623PubMedCrossRef
24.
go back to reference Draper KJ, Blake CC, Gowman L, Downey DB, Fenster A (2000) An algorithm for automatic needle localization in ultrasound-guided breast biopsies. Med Phys 27:1971–1979PubMedCrossRef Draper KJ, Blake CC, Gowman L, Downey DB, Fenster A (2000) An algorithm for automatic needle localization in ultrasound-guided breast biopsies. Med Phys 27:1971–1979PubMedCrossRef
25.
go back to reference Ortmaier T, Gröger M, Boehm DH, Falk V, Hirzinger G (2005) Motion estimation in beating heart surgery. IEEE Trans Biomed Eng 52:1729–1740PubMedCrossRef Ortmaier T, Gröger M, Boehm DH, Falk V, Hirzinger G (2005) Motion estimation in beating heart surgery. IEEE Trans Biomed Eng 52:1729–1740PubMedCrossRef
26.
go back to reference Novotny PM, Stoll JA, Vasilyev NV, del Nido PJ, Dupont PE, Zickler TE, Howe RD (2007) GPU-based real-time instrument tracking with three-dimensional ultrasound. Med Image Anal 11:458–464PubMedCrossRef Novotny PM, Stoll JA, Vasilyev NV, del Nido PJ, Dupont PE, Zickler TE, Howe RD (2007) GPU-based real-time instrument tracking with three-dimensional ultrasound. Med Image Anal 11:458–464PubMedCrossRef
28.
go back to reference Macario A, Morris D, Morris S (2006) Initial clinical evaluation of a handheld device for detecting retained surgical gauze sponges using radiofrequency identification technology. Arch Surg 141:659–662PubMedCrossRef Macario A, Morris D, Morris S (2006) Initial clinical evaluation of a handheld device for detecting retained surgical gauze sponges using radiofrequency identification technology. Arch Surg 141:659–662PubMedCrossRef
30.
go back to reference Neuenschwander M, Cohen MR, Vaida AJ, Patchett JA et al (2005) The 2D data matrix bar code. Comput Control Eng 16:39CrossRef Neuenschwander M, Cohen MR, Vaida AJ, Patchett JA et al (2005) The 2D data matrix bar code. Comput Control Eng 16:39CrossRef
31.
go back to reference Greenberg CC, Diaz-Flores R, Lipsitz SR, Regenbogen SE, Mulholland L, Mearn F, Rao S, Toidze T, Gawande AA (2008) Bar coding surgical sponges to improve safety: a randomized controlled trial. Ann Surg 247:612–616PubMedCrossRef Greenberg CC, Diaz-Flores R, Lipsitz SR, Regenbogen SE, Mulholland L, Mearn F, Rao S, Toidze T, Gawande AA (2008) Bar coding surgical sponges to improve safety: a randomized controlled trial. Ann Surg 247:612–616PubMedCrossRef
32.
go back to reference Jones ML, Shepherd JP, Brickley MR (1995) A technique for the computerized identification of orthodontic instruments. Br J Orthod 22:269–271PubMed Jones ML, Shepherd JP, Brickley MR (1995) A technique for the computerized identification of orthodontic instruments. Br J Orthod 22:269–271PubMed
33.
go back to reference Neuenschwander M, Cohen MR, Vaida AJ, Patchett JA, Kelly J, Trohimovich B (2003) Practical guide to bar coding for patient medication safety. Am J Health Syst Pharm 60:768–779PubMed Neuenschwander M, Cohen MR, Vaida AJ, Patchett JA, Kelly J, Trohimovich B (2003) Practical guide to bar coding for patient medication safety. Am J Health Syst Pharm 60:768–779PubMed
34.
go back to reference Houni K, Sawaya W, Delignon Y (2008) One-dimensional bar code reading: an information theoretic approach. Appl Opt 47:1025–1036PubMedCrossRef Houni K, Sawaya W, Delignon Y (2008) One-dimensional bar code reading: an information theoretic approach. Appl Opt 47:1025–1036PubMedCrossRef
35.
go back to reference Schwaitzberg SD (2006) The emergence of radiofrequency identification tags: applications in surgery. Surg Endosc 20:1315–1319PubMedCrossRef Schwaitzberg SD (2006) The emergence of radiofrequency identification tags: applications in surgery. Surg Endosc 20:1315–1319PubMedCrossRef
37.
go back to reference Allaf ME, Jackman SV, Schulam PG, Cadeddu JA, Lee BR, Moore RG, Kavoussi LR (1998) Laparoscopic visual field: voice vs foot pedal interfaces for control of the AESOP robot. Surg Endosc 12:1415–1418PubMedCrossRef Allaf ME, Jackman SV, Schulam PG, Cadeddu JA, Lee BR, Moore RG, Kavoussi LR (1998) Laparoscopic visual field: voice vs foot pedal interfaces for control of the AESOP robot. Surg Endosc 12:1415–1418PubMedCrossRef
38.
go back to reference Wichert A, Marcos-Suarez P, Vereczkei A, Seitz T, Bubb H, Feussner H (2004) Improvement of the ergonomic situation in the integrated operating room for laparoscopic operations. http://www.sciencedirect.com. Retrieved 15 May 2010 Wichert A, Marcos-Suarez P, Vereczkei A, Seitz T, Bubb H, Feussner H (2004) Improvement of the ergonomic situation in the integrated operating room for laparoscopic operations. http://​www.​sciencedirect.​com. Retrieved 15 May 2010
39.
go back to reference Eyben F, Wöllmer M, Schuller B (2009) openEAR: introducing the Munich open-source emotion and affect recognition toolkit. In: 4th International HUMAINE association conference on affective computing and intelligent interaction (ACII 2009), Amsterdam, The Netherlands Eyben F, Wöllmer M, Schuller B (2009) openEAR: introducing the Munich open-source emotion and affect recognition toolkit. In: 4th International HUMAINE association conference on affective computing and intelligent interaction (ACII 2009), Amsterdam, The Netherlands
40.
go back to reference Schuller B, Can S, Feussner H, Woellmer M, Arsiæ D, Hörnler B (2009) Speech control in surgery: a field analysis and strategies. In: International conference on multimedia and expo (ICME 2009), New York, NY Schuller B, Can S, Feussner H, Woellmer M, Arsiæ D, Hörnler B (2009) Speech control in surgery: a field analysis and strategies. In: International conference on multimedia and expo (ICME 2009), New York, NY
41.
go back to reference De Lemos J, Sadeghnia G, Ólafsdóttir I, Jensen O (2008) Measuring emotions using eye tracking. In: Spink A (ed) 6th International conference on methods and techniques in behavioral research. Maastricht, The Netherlands De Lemos J, Sadeghnia G, Ólafsdóttir I, Jensen O (2008) Measuring emotions using eye tracking. In: Spink A (ed) 6th International conference on methods and techniques in behavioral research. Maastricht, The Netherlands
42.
go back to reference Eckmann C, Olbrich G, Shekarriz H, Bruch H (2003) The empty OR: process analysis and a new concept for flexible and modular use in minimal invasive surgery. Surg Technol Int 11:45–49PubMed Eckmann C, Olbrich G, Shekarriz H, Bruch H (2003) The empty OR: process analysis and a new concept for flexible and modular use in minimal invasive surgery. Surg Technol Int 11:45–49PubMed
43.
go back to reference Reijnen MMPJ, Zeebregts CJ, Meijerink WJHJ (2005) Future of operating rooms. Surg Technol Int 14:21–27PubMed Reijnen MMPJ, Zeebregts CJ, Meijerink WJHJ (2005) Future of operating rooms. Surg Technol Int 14:21–27PubMed
44.
go back to reference Marohn MR, Hanly EJ (2004) Twenty-first-century surgery using twenty-first century technology: surgical robotics. Curr Surg 61:466–473PubMedCrossRef Marohn MR, Hanly EJ (2004) Twenty-first-century surgery using twenty-first century technology: surgical robotics. Curr Surg 61:466–473PubMedCrossRef
45.
go back to reference Feussner H (2003) The operating room of the future: a view from Europe. Semin Laparosc Surg 10:149–156PubMed Feussner H (2003) The operating room of the future: a view from Europe. Semin Laparosc Surg 10:149–156PubMed
46.
go back to reference Yule S, Flin R, Paterson-Brown S, Maran N (2006) Nontechnical skills for surgeons in the operating room: a review of the literature. Surgery 139:140–149PubMedCrossRef Yule S, Flin R, Paterson-Brown S, Maran N (2006) Nontechnical skills for surgeons in the operating room: a review of the literature. Surgery 139:140–149PubMedCrossRef
47.
go back to reference Gawande AA, Zinner MJ, Studdert DM, Brennan TA (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:614–621PubMedCrossRef Gawande AA, Zinner MJ, Studdert DM, Brennan TA (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:614–621PubMedCrossRef
Metadata
Title
New technologies for information retrieval to achieve situational awareness and higher patient safety in the surgical operating room: the MRI institutional approach and review of the literature
Authors
Michael Kranzfelder
Armin Schneider
Sonja Gillen
Hubertus Feussner
Publication date
01-03-2011
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 3/2011
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-010-1239-z

Other articles of this Issue 3/2011

Surgical Endoscopy 3/2011 Go to the issue