Top

Published in:

Open Access 01-03-2021

Implementing structured team debriefing using a Black Box in the operating room: surveying team satisfaction

Authors: A. S. H. M. van Dalen, M. Jansen, M. van Haperen, S. van Dieren, C. J. Buskens, E. J. M. Nieveen van Dijkum, W. A. Bemelman, T. P. Grantcharov, M. P. Schijven

Published in: Surgical Endoscopy | Issue 3/2021

Abstract

Background

Surgical safety may be improved using a medical data recorder (MDR) for the purpose of postoperative team debriefing. It provides the team in the operating room (OR) with the opportunity to look back upon their joint performance objectively to discuss and learn from suboptimal situations or possible adverse events. The aim of this study was to investigate the satisfaction of the OR team using an MDR, the OR Black Box®, in the OR as a tool providing output for structured team debriefing.

Methods

In this longitudinal survey study, 35 gastro-intestinal laparoscopic operations were recorded using the OR Black Box® and the output was subsequently debriefed with the operating team. Prior to study, a privacy impact assessment was conducted to ensure alignment with applicable legal and regulatory requirements. A structured debrief model and an OR Back Box® performance report was developed. A standardized survey was used to measure participant’s satisfaction with the team debriefing, the debrief model used and the performance report. Factor analysis was performed to assess the questionnaire’s quality and identified contributing satisfaction factors. Multivariable analysis was performed to identify variables associated with participants’ opinions.

Results

In total, 81 team members of various disciplines in the OR participated, comprising 35 laparoscopic procedures. Mean satisfaction with the OR Black Box® performance report and team debriefing was high for all 3 identified independent satisfaction factors. Of all participants, 98% recommend using the OR Black Box® and the outcome report in team debriefing.

Conclusion

The use of an MDR in the OR for the purpose of team debriefing is considered to be both beneficial and important. Team debriefing using the OR Black Box® outcome report is highly recommended by 98% of team members participating.

Available only for authorised users

Brennan TA, Leape LL, Laird NM et al (2004) Incidence of adverse events and negligence in hospitalized patients: results of the Harvard Medical Practice Study I. Qual Saf Health Care 13(2):145–151. https://doi.org/10.1136/qshc.2002.003822PubMedPubMedCentralCrossRef

Zegers M, de Bruijne MC, Wagner C et al (2009) Adverse events and potentially preventable deaths in Dutch hospitals: results of a retrospective patient record review study. Qual Saf Health Care 18(4):297–302. https://doi.org/10.1136/qshc.2007.025924PubMedCrossRef

Makary MA, Daniel M (2016) Medical error—the third leading cause of death in the US. BMJ. https://doi.org/10.1136/bmj.i2139PubMedCrossRef

Anderson O, Davis R, Hanna GB et al (2013) Surgical adverse events: a systematic review. Am J Surg 206(2):253–262. https://doi.org/10.1016/j.amjsurg.2012.11.009PubMedCrossRef

Rajasekaran S, Ravi S, Aiyer SN (2016) Incidence and preventability of adverse events in an orthopaedic unit: a prospective analysis of four thousand, nine hundred and six admissions. Int Orthop 40(11):2233–2238. https://doi.org/10.1007/s00264-016-3282-4PubMedCrossRef

Gawande AA, Zinner MJ, Studdert DM et al (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133(6):614–621. https://doi.org/10.1067/msy.2003.169PubMedCrossRef

Bonrath EM, Gordon LE, Grantcharov TP (2015) Characterising 'near miss' events in complex laparoscopic surgery through video analysis. BMJ Qual Saf 24(8):516–521. https://doi.org/10.1136/bmjqs-2014-003816PubMedCrossRef

Graafland M, Schijven MP (2015) Situational awareness: you won't see it unless you understand it. Ned Tijdschr Geneeskd 159:A8656PubMed

Sexton K, Johnson A, Gotsch A et al (2017) Anticipation, teamwork and cognitive load: chasing efficiency during robot-assisted surgery. BMJ Qual Saf 27:148PubMedPubMedCentralCrossRef

10.

Sentinel Event Data (2016) Root Causes by Event Type, 2004 – 2014: The Joint Commission; 2014. https://www.jointcommission.org/Sentinel_Event_Policy_and_Procedures/ Accessed 6 June 2016

11.

Wahr JA, Prager RL, Abernathy JH 3rd et al (2013) Patient safety in the cardiac operating room: human factors and teamwork: a scientific statement from the American Heart Association. Circulation 128(10):1139–1169. https://doi.org/10.1161/CIR.0b013e3182a38efaPubMedCrossRef

12.

Hu YY, Parker SH, Lipsitz SR et al (2016) Surgeons' leadership styles and team behavior in the operating room. J Am Coll Surg 222(1):41–51. https://doi.org/10.1016/j.jamcollsurg.2015.09.013PubMedCrossRef

13.

Catchpole K, Mishra A, Handa A et al (2008) Teamwork and error in the operating room: analysis of skills and roles. Ann Surg 247(4):699–706. https://doi.org/10.1097/SLA.0b013e3181642ec8PubMedCrossRef

14.

Fanning RM, Gaba DM (2007) The role of debriefing in simulation-based learning. Simul Healthcare 2(2):115–125CrossRef

15.

Boza C, Leon F, Buckel E et al (2016) Simulation-trained junior residents perform better than general surgeons on advanced laparoscopic cases. Surg Endosc. https://doi.org/10.1007/s00464-016-4942-6PubMedCrossRef

16.

Arora S, Ahmed M, Paige J et al (2012) Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery. Ann Surg 256(6):982–988PubMedCrossRef

17.

Ahmed M, Arora S, Russ S et al (2013) Operation debrief: a SHARP improvement in performance feedback in the operating room. Ann Surg 258(6):958–963. https://doi.org/10.1097/SLA.0b013e31828c88fcPubMedCrossRef

18.

Goldenberg MG, Jung J, Grantcharov TP (2017) Using data to enhance performance and improve quality and safety in surgery. JAMA Surg. https://doi.org/10.1001/jamasurg.2017.2888PubMedCrossRef

19.

van Dalen ASHM, Legemaate J, Schlack WS et al (2019) Legal perspectives on black box recording devices in the operating environment. BJS. https://doi.org/10.1002/bjs.11198CrossRef

20.

Olympus. ENDOALPHA Olympus Europe [Operating Room Integration]. https://www.olympus-europa.com/medical/en/Products-and-Solutions/Medical-Solutions/OR-Integration/2018

21.

de Vries E, Smorenburg S, Gouma D et al (2008) Een checklist voor het gehele chirurgische traject. Nederlands Tijdschrift voor Evid Based Pract 6(1):17–19. https://doi.org/10.1007/bf03077156CrossRef

22.

Rydenfalt C, Johansson G, Odenrick P et al (2013) Compliance with the WHO Surgical Safety Checklist: deviations and possible improvements. Int J Qual Health Care 25(2):182–187. https://doi.org/10.1093/intqhc/mzt004PubMedCrossRef

23.

Carayon P, Schoofs Hundt A, Karsh B-T et al (2006) Work system design for patient safety: the SEIPS model. Qual Saf Health Care 15(suppl 1):i50–i58. https://doi.org/10.1136/qshc.2005.015842PubMedPubMedCentralCrossRef

24.

Crossley J, Marriott J, Purdie H et al (2011) Prospective observational study to evaluate NOTSS (Non-Technical Skills for Surgeons) for assessing trainees' non-technical performance in the operating theatre. Br J Surg 98(7):1010–1020. https://doi.org/10.1002/bjs.7478PubMedCrossRef

25.

Mitchell L, Flin R, Yule S et al (2012) Evaluation of the scrub practitioners’ list of intraoperative non-technical skills (SPLINTS) system. Int J Nurs Stud 49(2):201–211. https://doi.org/10.1016/j.ijnurstu.2011.08.012PubMedCrossRef

26.

Sevdalis N, Forrest D, Undre S et al (2008) Annoyances, disruptions, and interruptions in surgery: the Disruptions in Surgery Index (DiSI). World J Surg 32(8):1643–1650PubMedCrossRef

27.

van Dalen ASHM, Swinkels JA, Grantcharov TP, Schijven MP (2017) Debriefing using medical data recorders in the operating room: this is how we do it: poster: 25th International Congress of the European Association for Endoscopic Surgery (EAES) Frankfurt, Germany, 14–17 June 2017. Surg Endosc 31(2):60–189. https://doi.org/10.1007/s00464-017-5541-xCrossRef

28.

Rudolph JW, Simon R, Dufresne RL et al (2006) There's no such thing as "nonjudgmental" debriefing: a theory and method for debriefing with good judgment. Simul Healthcare 1(1):49–55CrossRef

29.

Salas E, Klein C, King H et al (2008) Debriefing medical teams: 12 evidence-based best practices and tips. Jt Comm J Qual Patient Saf 34(9):518–527PubMed

30.

Field A (2013) Discovering statistics using IBM SPSS statistics. Sage, Thousand Oaks

31.

Field A (2009) Discovering statistics using SPSS. Sage, Thousand Oaks

32.

Jung JJ, Jüni P, Lebovic G et al (2020) First-year analysis of the operating room black box study. Ann Surg 271(1):122–127PubMedCrossRef

33.

Hamad GG, Brown MT, Clavijo-Alvarez JA (2007) Postoperative video debriefing reduces technical errors in laparoscopic surgery. Am J Surg 194(1):110–114. https://doi.org/10.1016/j.amjsurg.2006.10.027PubMedCrossRef

34.

Roter DL, Larson S, Shinitzky H et al (2004) Use of an innovative video feedback technique to enhance communication skills training. Med Educ 38(2):145–157PubMedCrossRef

35.

Dedy NJ, Bonrath EM, Ahmed N et al (2016) Structured training to improve nontechnical performance of junior surgical residents in the operating room: a randomized controlled trial. Ann Surg 263(1):43–49. https://doi.org/10.1097/sla.0000000000001186PubMedCrossRef

36.

Bezemer J, Cope A, Korkiakangas T et al (2016) Microanalysis of video from the operating room: an underused approach to patient safety research. BMJ Qual Saf. https://doi.org/10.1136/bmjqs-2016-005816PubMedPubMedCentralCrossRef

37.

Meynaar IA, Kamps G-J, Heuver G (2019) Leren van incidenten in de zorg; de waarde van incidentonderzoek en verbetermaatregelen. Nederlands tijdschrift voor geneeskunde

38.

Draper SW, Brown MI (2004) Increasing interactivity in lectures using an electronic voting system. J Comput Assist Learn 20(2):81–94. https://doi.org/10.1111/j.1365-2729.2004.00074.xCrossRef

39.

Yi MY, Jackson JD, Park JS et al (2006) Understanding information technology acceptance by individual professionals: toward an integrative view. Inf Manag 43(3):350–363. https://doi.org/10.1016/j.im.2005.08.006CrossRef

40.

Rogers EM (1976) New product adoption and diffusion. J Consumer Res 2(4):290–301CrossRef

41.

Carney BT, West P, Neily J et al (2010) Differences in nurse and surgeon perceptions of teamwork: implications for use of a briefing checklist in the OR. AORN J 91(6):722–729. https://doi.org/10.1016/j.aorn.2009.11.066PubMedCrossRef

42.

Lingard L, Regehr G, Espin S et al (2005) Perceptions of operating room tension across professions: building generalizable evidence and educational resources. Acad Med 80(10 Suppl):S75–S79PubMedCrossRef

43.

Wauben LS, Dekker-van Doorn CM, van Wijngaarden JD et al (2011) Discrepant perceptions of communication, teamwork and situation awareness among surgical team members. Int J Qual Health Care 23(2):159–166. https://doi.org/10.1093/intqhc/mzq079PubMedPubMedCentralCrossRef

44.

Anderson R (2015) What is the Rashomon effect? Rashomon effects. Routledge, London, pp 86–105

45.

Jung JJ, Elfassy J, Grantcharov T (2019) Factors associated with surgeon's perception of distraction in the operating room. Surg Endosc. https://doi.org/10.1007/s00464-019-07088-zPubMedPubMedCentralCrossRef

46.

Kolodzey L, Trbovich P, Kashfi A et al (2019) System factors affecting intraoperative risk and resilience: applying a novel integrated approach to study surgical performance and patient safety. Ann Surg. https://doi.org/10.1097/sla.0000000000003280CrossRef

47.

Makary MA, Sexton JB, Freischlag JA et al (2006) Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg 202(5):746–752. https://doi.org/10.1016/j.jamcollsurg.2006.01.017PubMedCrossRef

48.

Sexton JB, Makary MA, Tersigni AR, Pryor D, Hendrich A, Thomas EJ, Holzmueller CG, Knight AP, Wu Y, Pronovost PJ (2006) Teamwork in the operating roomfrontline perspectives among hospitals and operating room personnel. Anesthesiology 105(5):877–884PubMedCrossRef

49.

Dismukes RK, Gaba DM, Howard SK (2006) So many roads: facilitated debriefing in healthcare. Simul Healthcare 1(1):23–25CrossRef

50.

Adams-McGavin RC, Jung JJ, van Dalen ASHM, Grantcharov TP, Schijven MP (2019) System factors affecting patient safety in the OR: an analysis of safety threats and resiliency. Ann Surg. https://doi.org/10.1097/SLA.0000000000003616PubMedCrossRef

51.

O'Connor T, Papanikolaou V, Keogh I (2010) Safe surgery, the human factors approach. Surgeon 8(2):93–95. https://doi.org/10.1016/j.surge.2009.10.004PubMedCrossRef

52.

George S, Ahmed S, Mammen KJ et al (2011) Influence of music on operation theatre staff. J Anaesthesiol Clin Pharmacol 27(3):354PubMedPubMedCentralCrossRef

53.

Weldon SM, Korkiakangas T, Bezemer J et al (2015) Music and communication in the operating theatre. J Adv Nurs 71(12):2763–2774PubMedCrossRef

54.

Using a Black Box in the operating theatre. Good idea? [video]. Amsterdam: Amsterdam UMC, location AMC, (2018)

55.

Guerlain S, Adams RB, Turrentine FB et al (2005) Assessing team performance in the operating room: development and use of a “black-box” recorder and other tools for the intraoperative environment. J Am Coll Surg 200(1):29–37PubMedCrossRef

56.

Meyer RD, Tamarapalli J, Lemons JE (1993) Arthroscopy training using a “black box” technique. Arthroscopy 9(3):338–340PubMedCrossRef

57.

Jue J, Shah NA, Mackey TK (2019) An interdisciplinary review of surgical data recording technology features and legal considerations. Surg Innov 2019:1553350619891379. https://doi.org/10.1177/1553350619891379CrossRef

58.

Nejjari W, Gerritsen M, van der Haagen M et al (2012) Responses to Dutch-accented English. World Englishes 31(2):248–267. https://doi.org/10.1111/j.1467-971X.2012.01754.xCrossRef

59.

European Commission (2006) Special eurobarometer: Europeans and their languages. https://ec.europa.eu/commfrontoffice/publicopinion/archives/ebs/ebs_243_en.pdf. Accessed Sept 2019

60.

Kompier MA (2006) The “Hawthorne effect” is a myth, but what keeps the story going? Scand J Work Environ Health 5:402–412. https://doi.org/10.5271/sjweh.1036CrossRef

61.

Sanchez-Carrillo LA, Rodriguez-Lopez JM, Galarza-Delgado DA et al (2016) Enhancement of hand hygiene compliance among health care workers from a hemodialysis unit using video-monitoring feedback. Am J Infect Control. https://doi.org/10.1016/j.ajic.2016.01.040PubMedCrossRef

62.

Paradis E, Sutkin G (2017) Beyond a good story: from Hawthorne Effect to reactivity in health professions education research. Med Educ 51(1):31–39. https://doi.org/10.1111/medu.13122]PubMedCrossRef

63.

Surgical Safety Technologies, Inc. Toronto. https://www.surgicalsafety.com/. Accessed Sept 2019

64.

Khalid S, Goldenberg M, Grantcharov T, Taati B, Rudzicz F (2020) Evaluation of deep learning models for identifying surgical actions and measuring performance. JAMA Netw Open 3(3):e201664. https://doi.org/10.1001/jamanetworkopen.2020.1664PubMedCrossRef

Title: Implementing structured team debriefing using a Black Box in the operating room: surveying team satisfaction
Authors: A. S. H. M. van Dalen
M. Jansen
M. van Haperen
S. van Dieren
C. J. Buskens
E. J. M. Nieveen van Dijkum
W. A. Bemelman
T. P. Grantcharov
M. P. Schijven
Publication date: 01-03-2021
Publisher: Springer US
Published in: Surgical Endoscopy / Issue 3/2021
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI: https://doi.org/10.1007/s00464-020-07526-3

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Implementing structured team debriefing using a Black Box in the operating room: surveying team satisfaction

Abstract

Background

Methods

Results

Conclusion

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 3/2021

Application of clockwise modularized laparoscopic lymphadenectomy in the suprapancreatic area, a propensity score matching study and comparison with open gastrectomy

Double-clip traction could be superior to the pocket-creation method with cylindrical cap for colonic ESD: a randomized study in an ex vivo model

Endoscopic treatment of post-cholecystectomy bile leaks: a tertiary center experience

Analysis of economic impact of laparoscopic liver resection according to surgical difficulty

Laparoscopic subtotal cholecystectomy: comparison of reconstituting and fenestrating techniques

Minimally invasive options for gastrointestinal stromal tumors of the stomach