Skip to main content
Top
Published in: World Journal of Surgery 8/2010

01-08-2010

The Imperial Stress Assessment Tool (ISAT): A Feasible, Reliable and Valid Approach to Measuring Stress in the Operating Room

Authors: Sonal Arora, Tanya Tierney, Nick Sevdalis, Rajesh Aggarwal, Debra Nestel, Maria Woloshynowych, Ara Darzi, Roger Kneebone

Published in: World Journal of Surgery | Issue 8/2010

Login to get access

Abstract

Background

Stress can impair surgical performance and may compromise patient safety. This prospective, cross-sectional study describes the feasibility, reliability, and validity of the Imperial Stress Assessment Tool (ISAT) as an approach to measuring stress during surgery.

Methods

A total of 54 procedures were observed with 11 surgeons (4 attendings, 4 senior residents and 3 junior residents) in a large university teaching hospital in London, UK. Data collection involved physiological measures of operating surgeons [heart rate (HR) and salivary cortisol] and self-report questionnaires (State Trait Anxiety Inventory, or STAI).

Results

In all, 23 of 54 procedures were stressful, as identified by self-reporting. For stressful procedures compared to nonstressful ones, STAI was higher (mean ± SD) 9.81 ± 2.20 vs. 12.87 ± 4.27, t (30.64) = 3.15 as was the HR (mean ± SD) 79.94 ± 8.55 vs. 93.17 ± 14.94, t(32.57) = 3.81) (p < 0.05). Significant positive correlations were obtained between the measures indicating concurrent validity: Pearson’s r = 0.47 (HR vs. STAI), 0.34 (cortisol vs. STAI), and 0.57 (HR vs. cortisol) (p < 0.05). Perfect correlation of subjective and objective measures was found for 70% of the procedures. HR and cortisol had specificities of 78% and 91% and sensitivities of 91% and 70% respectively for detecting stress during surgery.

Conclusion

ISAT is a nonintrusive, feasible approach that combines subjective and objective methods for measuring stress in the operating room. The ISAT may increase understanding of the effects of stress on clinical performance and outcomes, leading to improved patient care.
Literature
1.
go back to reference Arora S, Sevdalis N, Nestel D et al (2009) Managing intraoperative stress: what do surgeons want from a crisis training program? Am J Surg 197:537–543CrossRefPubMed Arora S, Sevdalis N, Nestel D et al (2009) Managing intraoperative stress: what do surgeons want from a crisis training program? Am J Surg 197:537–543CrossRefPubMed
2.
go back to reference Wetzel CM, Kneebone RL, Woloshynowych M et al (2006) The effects of stress on surgical performance. Am J Surg 191:5–10CrossRefPubMed Wetzel CM, Kneebone RL, Woloshynowych M et al (2006) The effects of stress on surgical performance. Am J Surg 191:5–10CrossRefPubMed
3.
go back to reference Sevdalis N, Forrest D, Undre S et al (2008) Annoyances, disruptions, and interruptions in surgery: the Disruptions in Surgery Index (DiSI). World J Surg 32:1643–1650CrossRefPubMed Sevdalis N, Forrest D, Undre S et al (2008) Annoyances, disruptions, and interruptions in surgery: the Disruptions in Surgery Index (DiSI). World J Surg 32:1643–1650CrossRefPubMed
4.
go back to reference Hassan I, Weyers P, Maschuw K et al (2006) Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg 93:1554–1559CrossRefPubMed Hassan I, Weyers P, Maschuw K et al (2006) Negative stress-coping strategies among novices in surgery correlate with poor virtual laparoscopic performance. Br J Surg 93:1554–1559CrossRefPubMed
5.
go back to reference Flin R, O’Connor P, Crichton M (2008) Safety at the sharp end: a guide to non-technical skills. Ashgate, Aldershot Flin R, O’Connor P, Crichton M (2008) Safety at the sharp end: a guide to non-technical skills. Ashgate, Aldershot
6.
go back to reference Klein G (1996) The effects of acute stress on decision making. In: Driskell JE, Salas E (eds) Stress and human performance. Erlbaum, Mahwah, NJ Klein G (1996) The effects of acute stress on decision making. In: Driskell JE, Salas E (eds) Stress and human performance. Erlbaum, Mahwah, NJ
7.
go back to reference Berguer R, Smith WD, Chung YH (2001) Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 15:1204–1207CrossRefPubMed Berguer R, Smith WD, Chung YH (2001) Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surg Endosc 15:1204–1207CrossRefPubMed
8.
go back to reference Moorthy K, Munz Y, Dosis A et al (2003) The effect of stress-inducing conditions on the performance of a laparoscopic task. Surg Endosc 17:1481–1484CrossRefPubMed Moorthy K, Munz Y, Dosis A et al (2003) The effect of stress-inducing conditions on the performance of a laparoscopic task. Surg Endosc 17:1481–1484CrossRefPubMed
9.
go back to reference Gawande AA, Zinner MJ, Studdert DM et al (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:614–621CrossRefPubMed Gawande AA, Zinner MJ, Studdert DM et al (2003) Analysis of errors reported by surgeons at three teaching hospitals. Surgery 133:614–621CrossRefPubMed
10.
go back to reference Vincent C, Moorthy K, Sarker SK et al (2004) Systems approaches to surgical quality and safety: from concept to measurement. Ann Surg 239:475–482CrossRefPubMed Vincent C, Moorthy K, Sarker SK et al (2004) Systems approaches to surgical quality and safety: from concept to measurement. Ann Surg 239:475–482CrossRefPubMed
11.
go back to reference Berguer R, Chen CY, Smith WD (1999) A virtual instrument ergonomics workstation to measure surgeons’ physical stress. Stud Health Tech Inform 62:49–54 Berguer R, Chen CY, Smith WD (1999) A virtual instrument ergonomics workstation to measure surgeons’ physical stress. Stud Health Tech Inform 62:49–54
12.
go back to reference Smith WD, Berguer R, Nguyen NT (2005) Monitor height affects surgeons’ stress level and performance on minimally invasive surgery tasks. Stud Health Tech Inform 111:498–501 Smith WD, Berguer R, Nguyen NT (2005) Monitor height affects surgeons’ stress level and performance on minimally invasive surgery tasks. Stud Health Tech Inform 111:498–501
13.
go back to reference Becker W, Ellis H, Goldsmith R et al (1983) Heart rates of surgeons in theatre. Ergonomics 26:803–807CrossRefPubMed Becker W, Ellis H, Goldsmith R et al (1983) Heart rates of surgeons in theatre. Ergonomics 26:803–807CrossRefPubMed
14.
go back to reference Schuetz M, Gockel I, Beardi J et al (2008) Three different types of surgeon-specific stress reactions identified by laparoscopic simulation in a virtual scenario. Surg Endosc 22:1263–1267CrossRefPubMed Schuetz M, Gockel I, Beardi J et al (2008) Three different types of surgeon-specific stress reactions identified by laparoscopic simulation in a virtual scenario. Surg Endosc 22:1263–1267CrossRefPubMed
15.
go back to reference Jezova D, Slezak V, Alexandrova M et al (1992) Professional stress in surgeons and artists as assessed by salivary cortisol. Gordon & Breach Science, Philadelphia Jezova D, Slezak V, Alexandrova M et al (1992) Professional stress in surgeons and artists as assessed by salivary cortisol. Gordon & Breach Science, Philadelphia
16.
go back to reference Pagani M, Furlan R, Pizzinelli P et al (1989) Spectral analysis of R-R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. J Hypertens Suppl 7:S14–S15PubMed Pagani M, Furlan R, Pizzinelli P et al (1989) Spectral analysis of R-R and arterial pressure variabilities to assess sympatho-vagal interaction during mental stress in humans. J Hypertens Suppl 7:S14–S15PubMed
17.
go back to reference Payne R, Rick J (1986) Heart rate as an indicator of stress in surgeons and anaesthetists. J Psychosom Res 30:411–420CrossRefPubMed Payne R, Rick J (1986) Heart rate as an indicator of stress in surgeons and anaesthetists. J Psychosom Res 30:411–420CrossRefPubMed
18.
go back to reference Marteau TM, Bekker H (1992) The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol 31(Pt 3):301–306PubMed Marteau TM, Bekker H (1992) The development of a six-item short-form of the state scale of the Spielberger State-Trait Anxiety Inventory (STAI). Br J Clin Psychol 31(Pt 3):301–306PubMed
19.
go back to reference Speilberger CD, Gorsuch RL, Lushene RE (1970) STAI manual. Consulting Psychologist Press, Palo Alto, CA Speilberger CD, Gorsuch RL, Lushene RE (1970) STAI manual. Consulting Psychologist Press, Palo Alto, CA
20.
go back to reference Laudat MH, Cerdas S, Fournier C et al (1988) Salivary cortisol measurement: a practical approach to assess pituitary-adrenal function. J Clin Endocrinol Metab 66:343–348CrossRefPubMed Laudat MH, Cerdas S, Fournier C et al (1988) Salivary cortisol measurement: a practical approach to assess pituitary-adrenal function. J Clin Endocrinol Metab 66:343–348CrossRefPubMed
21.
go back to reference Stroud LR, Salovey P, Epel ES (2002) Sex differences in stress responses: social rejection versus achievement stress. Biol Psychiatry 52:318–327CrossRefPubMed Stroud LR, Salovey P, Epel ES (2002) Sex differences in stress responses: social rejection versus achievement stress. Biol Psychiatry 52:318–327CrossRefPubMed
22.
23.
go back to reference Arora S, Sevdalis N, Nestel D et al (2010) The impact of stress on surgical performance: a systematic review of the literature. Surgery 147:318–330CrossRefPubMed Arora S, Sevdalis N, Nestel D et al (2010) The impact of stress on surgical performance: a systematic review of the literature. Surgery 147:318–330CrossRefPubMed
24.
go back to reference Arora S, Hull L, Sevdalis N et al (2010) Factors compromising safety in surgery: stressful events in the operating room. Am J Surg 199:60–65CrossRefPubMed Arora S, Hull L, Sevdalis N et al (2010) Factors compromising safety in surgery: stressful events in the operating room. Am J Surg 199:60–65CrossRefPubMed
25.
go back to reference Grantcharov TP, Bardram L, Funch-Jensen P et al (2002) Assessment of technical surgical skills. Eur J Surg 168:139–144CrossRefPubMed Grantcharov TP, Bardram L, Funch-Jensen P et al (2002) Assessment of technical surgical skills. Eur J Surg 168:139–144CrossRefPubMed
26.
go back to reference Aggarwal R, Grantcharov TP, Darzi A (2007) Framework for systematic training and assessment of technical skills. J Am Coll Surg 204:697–705CrossRefPubMed Aggarwal R, Grantcharov TP, Darzi A (2007) Framework for systematic training and assessment of technical skills. J Am Coll Surg 204:697–705CrossRefPubMed
27.
go back to reference Tang B, Hanna GB, Joice P et al (2004) Identification and categorization of technical errors by Observational Clinical Human Reliability Assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139:1215–1220CrossRefPubMed Tang B, Hanna GB, Joice P et al (2004) Identification and categorization of technical errors by Observational Clinical Human Reliability Assessment (OCHRA) during laparoscopic cholecystectomy. Arch Surg 139:1215–1220CrossRefPubMed
28.
go back to reference Undre S, Sevdalis N, Healey AN et al (2007) Observational teamwork assessment for surgery (OTAS): refinement and application in urological surgery. World J Surg 31:1373–1381CrossRefPubMed Undre S, Sevdalis N, Healey AN et al (2007) Observational teamwork assessment for surgery (OTAS): refinement and application in urological surgery. World J Surg 31:1373–1381CrossRefPubMed
29.
go back to reference Sevdalis N, Lyons M, Healey AN et al (2009) Observational teamwork assessment for surgery: construct validation with expert versus novice raters. Ann Surg 249:1047–1051CrossRefPubMed Sevdalis N, Lyons M, Healey AN et al (2009) Observational teamwork assessment for surgery: construct validation with expert versus novice raters. Ann Surg 249:1047–1051CrossRefPubMed
30.
go back to reference Sevdalis N, Davis R, Koutantji M et al (2008) Reliability of a revised NOTECHS scale for use in surgical teams. Am J Surg 196:184–190CrossRefPubMed Sevdalis N, Davis R, Koutantji M et al (2008) Reliability of a revised NOTECHS scale for use in surgical teams. Am J Surg 196:184–190CrossRefPubMed
31.
go back to reference Gaba DM, Howard SK, Flanagan B et al (1998) Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 89:8–18CrossRefPubMed Gaba DM, Howard SK, Flanagan B et al (1998) Assessment of clinical performance during simulated crises using both technical and behavioral ratings. Anesthesiology 89:8–18CrossRefPubMed
32.
go back to reference Driskell JE, Salas E (1991) Overcoming the effects of stress on military performance; human factors, training and selection strategies. Wiley, Oxford, UK Driskell JE, Salas E (1991) Overcoming the effects of stress on military performance; human factors, training and selection strategies. Wiley, Oxford, UK
Metadata
Title
The Imperial Stress Assessment Tool (ISAT): A Feasible, Reliable and Valid Approach to Measuring Stress in the Operating Room
Authors
Sonal Arora
Tanya Tierney
Nick Sevdalis
Rajesh Aggarwal
Debra Nestel
Maria Woloshynowych
Ara Darzi
Roger Kneebone
Publication date
01-08-2010
Publisher
Springer-Verlag
Published in
World Journal of Surgery / Issue 8/2010
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-010-0559-4

Other articles of this Issue 8/2010

World Journal of Surgery 8/2010 Go to the issue