Skip to main content
Top
Published in: World Journal of Surgery 2/2010

01-02-2010

Development and Evaluation of an Observational Tool for Assessing Surgical Flow Disruptions and Their Impact on Surgical Performance

Authors: Sarah E. Henrickson Parker, Aaron A. Laviana, Rishi K. Wadhera, Douglas A. Wiegmann, Thoralf M. Sundt III

Published in: World Journal of Surgery | Issue 2/2010

Login to get access

Abstract

Background

Many researchers have previously explored the correlation between surgical flow disruptions and adverse events in cardiac surgery; however, there is no reliable tool to prospectively categorize surgical flow disruptions and the conditions that predispose a surgical team to adverse events.

Methods

Two independent raters of different medical and human factors expertise observed 12 cardiovascular operations and iteratively designed a surgical flow disruption tool (SFDT) to characterize surgical flow disruptions and the latent factors that contribute to adverse events. Categories to characterize surgical flow disruptions were created based on human factors models of human error. After the design period, both raters observed ten surgical cases using the tool to assess validity and inter-rater reliability.

Results

Rating agreement (weighted kappa) for each category across the ten surgeries was moderate to very high, resulting in strong inter-rater reliability for each category on the surgical flow disruption tool. Use of the SFDT was simple and clear for observers of diverse backgrounds, including human factors experts and medical personnel.

Conclusions

This research depicts the development and utility of a tool to analyze surgical flow disruptions in the cardiovascular operating room with satisfactory inter-rater reliability. This tool is an important first step in systematically categorizing and measuring surgical flow disruptions and their impact on patient safety in the operating room.
Literature
1.
go back to reference Chantler C (1999) The role and education of doctors in the delivery of health care. Lancet 353:1178–1181CrossRefPubMed Chantler C (1999) The role and education of doctors in the delivery of health care. Lancet 353:1178–1181CrossRefPubMed
2.
go back to reference Committee on Quality of Health Care in America, Institute of Medicine (1999) Kohn LT, Corrigan JM, Donaldson MS (eds) To err is human: building a safer health system. Washington, DC: National Academy Press Committee on Quality of Health Care in America, Institute of Medicine (1999) Kohn LT, Corrigan JM, Donaldson MS (eds) To err is human: building a safer health system. Washington, DC: National Academy Press
3.
go back to reference Guru V, Tu JV, Etchells E et al (2008) Relationship between preventability of death after coronary artery bypass graft surgery and all-cause risk-adjusted mortality rates. Circulation 117:2969–2976CrossRefPubMed Guru V, Tu JV, Etchells E et al (2008) Relationship between preventability of death after coronary artery bypass graft surgery and all-cause risk-adjusted mortality rates. Circulation 117:2969–2976CrossRefPubMed
4.
go back to reference Vincent C, Taylor-Adams S, Stanhope N (1998) Framework for analyzing risk and safety in clinical medicine. BMJ 316:1154–1157PubMed Vincent C, Taylor-Adams S, Stanhope N (1998) Framework for analyzing risk and safety in clinical medicine. BMJ 316:1154–1157PubMed
5.
go back to reference Wiegmann DA, Shappell SA (2003) A human error approach to aviation accident analysis: the human factors analysis and classification system. Ashgate, Burlington, VT Wiegmann DA, Shappell SA (2003) A human error approach to aviation accident analysis: the human factors analysis and classification system. Ashgate, Burlington, VT
6.
go back to reference Reason JT (1990) Human error. Cambridge University Press, Cambridge, England Reason JT (1990) Human error. Cambridge University Press, Cambridge, England
7.
go back to reference de Leval MR, Carthey J, Wright DJ et al (2000) Human factors and cardiac surgery: a multicenter study. J Thorac Cardiovasc Surg 119:661–672CrossRefPubMed de Leval MR, Carthey J, Wright DJ et al (2000) Human factors and cardiac surgery: a multicenter study. J Thorac Cardiovasc Surg 119:661–672CrossRefPubMed
8.
go back to reference Lingard L, Espin S, Whyte S et al (2004) Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Safe Health Care 13:330–334CrossRef Lingard L, Espin S, Whyte S et al (2004) Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Safe Health Care 13:330–334CrossRef
9.
go back to reference de Leval MR, Rancois K, Bull C et al (1994) Analysis of a cluster of surgical failures: application to a series of neonatal arterial switch operations. J Thorac Cardiovasc Surg 107:914–924PubMed de Leval MR, Rancois K, Bull C et al (1994) Analysis of a cluster of surgical failures: application to a series of neonatal arterial switch operations. J Thorac Cardiovasc Surg 107:914–924PubMed
10.
go back to reference Wiegmann DA, Elbardissi AW, Dearani JA et al (2007) Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery 142:658–665CrossRefPubMed Wiegmann DA, Elbardissi AW, Dearani JA et al (2007) Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery 142:658–665CrossRefPubMed
11.
go back to reference Elbardissi AW, Wiegmann DA, Dearani JA et al (2007) Application of the human factors analysis and classification system methodology to the cardiovascular surgery operating room. Ann Thorac Surg 83:1412–1419CrossRefPubMed Elbardissi AW, Wiegmann DA, Dearani JA et al (2007) Application of the human factors analysis and classification system methodology to the cardiovascular surgery operating room. Ann Thorac Surg 83:1412–1419CrossRefPubMed
12.
go back to reference Cohen J (1960) A coefficient of agreement for nominal scales. Edu Psych Measure 20:37–46CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Edu Psych Measure 20:37–46CrossRef
13.
go back to reference Altman DG (1991) Practical statistics for medical research. Chapman and Hall, London Altman DG (1991) Practical statistics for medical research. Chapman and Hall, London
14.
go back to reference MedCalc for Windows version 9.5.0.0. (2009) MedCalc Software, Mariakerke, Belgium MedCalc for Windows version 9.5.0.0. (2009) MedCalc Software, Mariakerke, Belgium
15.
go back to reference Lingard L, Regher G, Espin S et al (2006) A theory-based instrument to evaluate team communication in the operating room: balancing measurement authenticity and reliability. Qual Saf Health Care 15:422–426CrossRefPubMed Lingard L, Regher G, Espin S et al (2006) A theory-based instrument to evaluate team communication in the operating room: balancing measurement authenticity and reliability. Qual Saf Health Care 15:422–426CrossRefPubMed
16.
go back to reference Flin R, Martin L, Goeters K et al (2003) Development of the NOTECHS (non-technical skills) system for rating pilots’ CRM skills. Hum Fac Aero Safety 3:95–117 Flin R, Martin L, Goeters K et al (2003) Development of the NOTECHS (non-technical skills) system for rating pilots’ CRM skills. Hum Fac Aero Safety 3:95–117
17.
go back to reference Helmreich RL, Roushee HC (1993) Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In: Wiener E, Kanaki B, Helmreich R (eds) Cockpit resource management. Academic Press, San Diego, pp 3–45 Helmreich RL, Roushee HC (1993) Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In: Wiener E, Kanaki B, Helmreich R (eds) Cockpit resource management. Academic Press, San Diego, pp 3–45
18.
go back to reference Yule S, Flin R, Paterson-Brown S et al (2006) Non-technical skills for surgeons in the operating room: a review of the literature. Surgery 139:140–149CrossRefPubMed Yule S, Flin R, Paterson-Brown S et al (2006) Non-technical skills for surgeons in the operating room: a review of the literature. Surgery 139:140–149CrossRefPubMed
19.
go back to reference Yule S, Flin R, Maran N et al (2008) Surgeons’ non-technical skills in the operating room: reliability testing of the NOTSS behavior rating system. World J Surg 32:548–556CrossRefPubMed Yule S, Flin R, Maran N et al (2008) Surgeons’ non-technical skills in the operating room: reliability testing of the NOTSS behavior rating system. World J Surg 32:548–556CrossRefPubMed
20.
go back to reference Sevdalis N, Davis R, Koutantji M et al (2008) Reliability of a revised NOTECHS scale for use in surgical teams. Am J Surg 196:184–190CrossRefPubMed Sevdalis N, Davis R, Koutantji M et al (2008) Reliability of a revised NOTECHS scale for use in surgical teams. Am J Surg 196:184–190CrossRefPubMed
21.
go back to reference Healey AN, Undre S, Vincent CA (2004) Developing observational measures of performance in surgical teams. Qual Saf Health Care 13(Suppl 1):i33–i40CrossRefPubMed Healey AN, Undre S, Vincent CA (2004) Developing observational measures of performance in surgical teams. Qual Saf Health Care 13(Suppl 1):i33–i40CrossRefPubMed
22.
go back to reference Wong DR, Torchiana DF, Vadner Salm TJ et al (2007) Impact of cardiac intraoperative precursor events on adverse outcomes. Surgery 141:715–722CrossRefPubMed Wong DR, Torchiana DF, Vadner Salm TJ et al (2007) Impact of cardiac intraoperative precursor events on adverse outcomes. Surgery 141:715–722CrossRefPubMed
23.
go back to reference Solis-Trapala IL, Carthey J, Farwell VT et al (2007) Dynamic modeling in a study of surgical error management. Stat Med 26:5189–5202CrossRefPubMed Solis-Trapala IL, Carthey J, Farwell VT et al (2007) Dynamic modeling in a study of surgical error management. Stat Med 26:5189–5202CrossRefPubMed
24.
go back to reference Nowicki ER, Birkmeyer NJ, Weintraub RW et al (2004) Multivariable prediction of in-hospital mortality associated with aortic and mitral valve surgery in Northern New England. Ann Thorac Surg 77:1966–1977CrossRefPubMed Nowicki ER, Birkmeyer NJ, Weintraub RW et al (2004) Multivariable prediction of in-hospital mortality associated with aortic and mitral valve surgery in Northern New England. Ann Thorac Surg 77:1966–1977CrossRefPubMed
25.
go back to reference O’Connor GT, Malenka DJ, Quinton H et al (1999) Multivariate prediction of in-hospital mortality after percutaneous coronary interventions in 1994–1996. Northern New England Cardiovascular Disease Study Group. J Am Coll Cardiol 34:681–691CrossRefPubMed O’Connor GT, Malenka DJ, Quinton H et al (1999) Multivariate prediction of in-hospital mortality after percutaneous coronary interventions in 1994–1996. Northern New England Cardiovascular Disease Study Group. J Am Coll Cardiol 34:681–691CrossRefPubMed
26.
go back to reference O’Connor GT, Plume SK, Olmstead EM, Coffin LH, Morton JR, Maloney CT, Nowicki ER, Levy DG, Tryzelaar JF, Hernandez F (1992) Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Northern New England Cardiovascular Disease Study Group. Circulation 85:2110–2118PubMed O’Connor GT, Plume SK, Olmstead EM, Coffin LH, Morton JR, Maloney CT, Nowicki ER, Levy DG, Tryzelaar JF, Hernandez F (1992) Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Northern New England Cardiovascular Disease Study Group. Circulation 85:2110–2118PubMed
Metadata
Title
Development and Evaluation of an Observational Tool for Assessing Surgical Flow Disruptions and Their Impact on Surgical Performance
Authors
Sarah E. Henrickson Parker
Aaron A. Laviana
Rishi K. Wadhera
Douglas A. Wiegmann
Thoralf M. Sundt III
Publication date
01-02-2010
Publisher
Springer-Verlag
Published in
World Journal of Surgery / Issue 2/2010
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-009-0312-z

Other articles of this Issue 2/2010

World Journal of Surgery 2/2010 Go to the issue