Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Research article

Assessing safety climate in prehospital settings: testing psychometric properties of a common structural model in a cross-sectional and prospective study

Authors: Leif Inge K. Sørskår, Espen Olsen, Eirik B. Abrahamsen, Gunnar Tschudi Bondevik, Håkon B. Abrahamsen

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

Little research exists on patient safety climate in the prehospital context. The purpose of this article is to test and validate a safety climate measurement model for the prehospital environment, and to explore and develop a theoretical model measuring associations between safety climate factors and the outcome variable transitions and handoffs.

Methods

A web-based survey design was utilized. An adjusted short version of the instrument Hospital Survey on Patient Safety Culture (HSOPSC) was developed into a hypothetical structural model. Three samples were obtained. Two from air ambulance workers in 2012 and 2016, with respectively 83 and 55% response rate, and the third from the ground ambulance workers in 2016, with 26% response rate. Confirmatory factor analysis (CFA) was applied to test validity and psychometric properties. Internal consistency was estimated and descriptive data analysis was performed. Structural equation modelling (SEM) was applied to assess the theoretical model developed for the prehospital setting.

Results

A post-hoc modified instrument consisting of six dimensions and 17 items provided overall acceptable psychometric properties for all samples, i.e. acceptable Chronbach’s alphas (.68–.86) and construct validity (model fit values: SRMR; .026–.056, TLI; .95–.98, RMSEA; .031–.052, CFI; .96–.98). A common structural model could also be established.

Conclusions

The results provided a validated instrument, the Prehospital Survey on Patient Safety Culture short version (PreHSOPSC-S), for measuring patient safety climate in a prehospital context. We also demonstrated a positive relation between safety climate dimensions from leadership to unit level, from unit to individual level, and from individual level on the outcome dimension related to transitions and handoffs. Safe patient transitions and handoffs are considered an important outcome of prehospital deliveries; hence, new theory and a validated model will constitute an important contribution to the prehospital safety climate research.
Literature
1.
St Pierre M, Hofinger G, Buerschaper C, Simon R. Crisis management in acute care settings: human factors, team psychology, and patient safety in a high stakes environment. Berlin: Springer; 2011.CrossRef
2.
Atack L, Maher J. Emergency medical and health providers' perceptions of key issues in prehospital patient safety. Prehosp Emerg Care. 2010;14(1):95–102.PubMedCrossRef
3.
Patterson PD, Huang DT, Fairbanks RJ, Wang HE. The emergency medical services safety attitudes questionnaire. Am J Med Qual. 2010;25(2):109–15.PubMedCrossRef
4.
Bigham BL, Buick JE, Brooks SC, Morrison M, Shojania KG, Morrison LJ. Patient safety in emergency medical services: a systematic review of the literature. Prehosp Emerg Care. 2012;16(1):20–35.PubMedCrossRef
5.
Wood K, Crouch R, Rowland E, Pope C. Clinical handovers between prehospital and hospital staff: literature review. Emerg Med J. 2015;32:577–81.PubMedCrossRef
6.
Nieva VF, Sorra J. Safety culture assessment: a tool for improving patient safety in healthcare organizations. Qual Saf Health Care. 2003;12(suppl 2):ii17–23.PubMedPubMedCentral
7.
Kaufman G, McCaughan D. The effect of organisational culture on patient safety. Nurs Stand. 2013;27(43):50–6.PubMedCrossRef
8.
Hofmann DA, Mark B. An investigation of the relationship between safety climate and medication errors as well as other nurse and patient outcomes. Pers Psychol. 2006;59(4):847–69.CrossRef
9.
Naveh E, Katz-Navon T, Stern Z. Treatment errors in healthcare: a safety climate approach. Manag Sci. 2005;51(6):948–60.CrossRef
10.
Neal A, Griffin MA. A study of the lagged relationships among safety climate, safety motivation, safety behavior, and accidents at the individual and group levels. J Appl Psychol. 2006;91(4):946.PubMedCrossRef
11.
Singer SJ, Gaba DM, Falwell A, Lin S, Hayes J, Baker L. Patient safety climate in 92 US hospitals: differences by work area and discipline. Med Care. 2009;47(1):23–31.PubMedCrossRef
12.
Vogus TJ, Sutcliffe KM. The safety organizing scale: development and validation of a behavioral measure of safety culture in hospital nursing units. Med Care. 2007;45(1):46–54.PubMedCrossRef
13.
Singer SJ, Lin S, Falwell A, Gaba D, Baker L. Relationship of safety climate and safety performance in hospitals. Health Serv Res. 2009;44(2p1):399–421.PubMedPubMedCentralCrossRef
14.
Mardon RE, Khanna K, Sorra J, Dyer N, Famolaro T. Exploring relationships between hospital patient safety culture and adverse events. J Patient Saf. 2010;6(4):226–32.PubMedCrossRef
15.
Halligan M, Zecevic A. Safety culture in healthcare: a review of concepts, dimensions, measures and progress. BMJ Qual Saf. 2011;20(4):338–43.PubMedCrossRef
16.
Guldenmund FW. The use of questionnaires in safety culture research–an evaluation. Saf Sci. 2007;45(6):723–43.CrossRef
17.
Hellings J, Schrooten W, Klazinga N, Vleugels A. Challenging patient safety culture: survey results. Int J Health Care Qual Assur. 2007;20(7):620–32.PubMedCrossRef
18.
Flin R. Measuring safety culture in healthcare: a case for accurate diagnosis. Saf Sci. 2007;45(6):653–67.CrossRef
19.
Christian MS, Bradley JC, Wallace JC, Burke MJ. Workplace safety: a meta-analysis of the roles of person and situation factors. J Appl Psychol. 2009;94(5):1103.PubMedCrossRef
20.
Clarke S. An integrative model of safety climate: linking psychological climate and work attitudes to individual safety outcomes using meta-analysis. J Occup Organ Psychol. 2010;83(3):553–78.CrossRef
21.
Huang YH, Chen JC, DeArmond S, Cigularov K, Chen PY. Roles of safety climate and shift work on perceived injury risk: a multi-level analysis. Accid Anal Prev. 2007;39(6):1088–96.PubMedCrossRef
22.
Mearns K, Whitaker SM, Flin R. Benchmarking safety climate in hazardous environments: a longitudinal, interorganizational approach. Risk Anal. 2001;21(4):771–86.PubMedCrossRef
23.
Meisel ZF, Shea JA, Peacock NJ, Dickinson ET, Paciotti B, Bhatia R, Buharin E, Cannuscio CC. Optimizing the patient handoff between emergency medical services and the emergency department. Ann Emerg Med. 2015;65(3):310–7.PubMedCrossRef
24.
Lee SH, Phan PH, Dorman T, Weaver SJ, Pronovost PJ. Handoffs, safety culture, and practices: evidence from the hospital survey on patient safety culture. BMC Health Serv Res. 2016;16(1):254.PubMedPubMedCentralCrossRef
25.
Hopkins A. Studying organisational cultures and their effects on safety. Saf Sci. 2006;44(10):875–89.CrossRef
26.
Alsalem G, Bowie P, Morrison J. Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools. BMC Health Serv Res. 2018;18(1):353.PubMedPubMedCentralCrossRef
27.
Sorra JS, Nieva VF. Hospital survey on patient safety culture. AHRQ publication no. 04–0041. Rockville: Agency for Healthcare Research and Quality; 2004.
28.
Sørskår LIK, Abrahamsen EB, Olsen E, Sollid SJ, Abrahamsen HB. Psychometric properties of the Norwegian version of the hospital survey on patient safety culture in a prehospital environment. BMC Health Serv Res. 2018;18(1):784.PubMedPubMedCentralCrossRef
29.
Olsen E. Exploring the possibility of a common structural model measuring associations between safety climate factors and safety behaviour in health care and the petroleum sectors. Accid Anal Prev. 2010;42(5):1507–16.PubMedCrossRef
30.
31.
32.
Olsen E. Reliability and validity of the Hospital Survey on Patient Safety Culture at a Norwegian hospital. Quality and Safety Improvement Research: Methods and Research Practice from the International Quality Improvement Research Network (QIRN). 2008;173:186.
33.
Waterson P, Griffiths P, Stride C, Murphy J, Hignett S. Psychometric properties of the hospital survey on patient safety culture: findings from the UK. Qual Saf Health Care. 2010;19(5):e2.PubMed
34.
Pfeiffer Y, Manser T. Development of the German version of the hospital survey on patient safety culture: dimensionality and psychometric properties. Saf Sci. 2010;48(10):1452–62.CrossRef
35.
Haugen AS, Søfteland E, Eide GE, Nortvedt MW, Aase K, Harthug S. Patient safety in surgical environments: cross-countries comparison of psychometric properties and results of the Norwegian version of the hospital survey on patient safety. BMC Health Serv Res. 2010;10(1):279.PubMedPubMedCentralCrossRef
36.
Hedsköld M, Pukk-Härenstam K, Berg E, Lindh M, Soop M, Øvretveit J, Sachs MA. Psychometric properties of the hospital survey on patient safety culture, HSOPSC, applied on a large Swedish health care sample. BMC Health Serv Res. 2013;13(1):332.PubMedPubMedCentralCrossRef
37.
38.
Zohar D. Safety climate: Conceptualization, measurement, and improvement: The Oxford handbook of organizational climate and culture: New York: Oxford University Press; 2014:317–334.
39.
Schein EH. Organizational culture and leadership. San Francisco: John Wiley & Sons; 2010.
40.
Zohar D, Luria G. Group leaders as gatekeepers: testing safety climate variations across levels of analysis. Appl Psychol. 2010;59(4):647–73.CrossRef
41.
Zohar D. Modifying supervisory practices to improve subunit safety: a leadership-based intervention model. J Appl Psychol. 2002;87(1):156.PubMedCrossRef
42.
Zohar D, Luria G. A multilevel model of safety climate: cross-level relationships between organization and group-level climates. J Appl Psychol. 2005;90(4):616.PubMedCrossRef
43.
Kapp EA. The influence of supervisor leadership practices and perceived group safety climate on employee safety performance. Saf Sci. 2012;50(4):1119–24.CrossRef
44.
Judge TA, Piccolo RF. Transformational and transactional leadership: a meta-analytic test of their relative validity. J Appl Psychol. 2004;89:755.PubMedCrossRef
45.
Michaelis B, Stegmaier R, Sonntag K. Affective commitment to change and innovation implementation behavior: the role of charismatic leadership and employees’ trust in top management. J Chang Manag. 2009;9(4):399–417.CrossRef
46.
Zohar D, Tenne-Gazit O. Transformational leadership and group interaction as climate antecedents: a social network analysis. J Appl Psychol. 2008;93(4):744.PubMedCrossRef
47.
Yukl GA. Leadership in organizations. Pearson: Upper Saddle River; 2010.
48.
Reader TW, Flin R, Mearns K, Cuthbertson BH. Interdisciplinary communication in the intensive care unit. Br J Anaesth. 2007;98(3):347–52.PubMedCrossRef
49.
Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13(suppl 1):i85–90.PubMedPubMedCentralCrossRef
50.
Barrett J, Gifford C, Morey J, Risser D, Salisbury M. Enhancing patient safety through teamwork training. J Healthcare Risk Manage. 2001;21(4):61–9.CrossRef
51.
Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA, Berns SD. Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. Health Serv Res. 2002;37(6):1553–81.PubMedPubMedCentralCrossRef
52.
Weaver SJ, Rosen MA, DiazGranados D, Lazzara EH, Lyons R, Salas E, Knych SA, McKeever M, Adler L, Barker M, King HB. Does teamwork improve performance in the operating room? A multilevel evaluation. Jt Comm J Qual Patient Saf. 2010;36(3):133–42.PubMedCrossRef
53.
Reader TW, Flin R, Mearns K, Cuthbertson BH. Developing a team performance framework for the intensive care unit. Crit Care Med. 2009;37(5):1787–93.PubMedCrossRef
54.
Risser DT, Rice MM, Salisbury ML, Simon R, Jay GD, Berns SD. MedTeams research consortium. The potential for improved teamwork to reduce medical errors in the emergency department. Ann Emerg Med. 1999;34(3):373–83.PubMedCrossRef
55.
Wheelan SA, Burchill CN, Tilin F. The link between teamwork and patients’ outcomes in intensive care units. Am J Crit Care. 2003;12(6):527–34.PubMed
56.
Reid J, Bromiley M. Clinical human factors: the need to speak up to improve patient safety. Nurs Stand. 2012;26(35):35–40.PubMedCrossRef
57.
Dietz AS, Pronovost PJ, Mendez-Tellez PA, Wyskiel R, Marsteller JA, Thompson DA, Rosen MA. A systematic review of teamwork in the intensive care unit: what do we know about teamwork, team tasks, and improvement strategies? J Crit Care. 2014;29(6):908–14.PubMedCrossRef
58.
Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143–51.PubMedCrossRef
59.
Hesselink G, Berben S, Beune T, Schoonhoven L. Improving the governance of patient safety in emergency care: a systematic review of interventions. BMJ Open. 2016;6(1):e009837.PubMedPubMedCentralCrossRef
60.
Argote L. Organizational learning research: past, present and future. Manag Learn. 2011;42(4):439–46.CrossRef
61.
Crossan MM, Lane HW, White RE. An organizational learning framework: from intuition to institution. Acad Manag Rev. 1999;24(3):522–37.CrossRef
62.
63.
Behara R, Wears RL, Perry SJ, Eisenberg E, Murphy L, Vanderhoef M, Shapiro M, Beach C, Croskerry P, Cosby K. A conceptual framework for studying the safety of transitions in emergency care. In: Henriksen K, Battles JB, Marks ES, et al., editors. Advances in patient safety: From research to implementation (Volume 2: Concepts and Methodology). Rockville: Agency for Healthcare Research and Quality (US); 2005.
64.
Owen C, Hemmings L, Brown T. Lost in translation: maximizing handover effectiveness between paramedics and receiving staff in the emergency department. Emerg Med Australasia. 2009;21(2):102–7.
65.
Jensen SM, Lippert A, Østergaard D. Handover of patients: a topical review of ambulance crew to emergency department handover. Acta Anaesthesiol Scand. 2013;57(8):964–70.PubMedCrossRef
66.
67.
Cuk S, Wimmer H, Powell LM. Problems associated with patient care reports and transferring data between ambulance and hospitals from the perspective of emergency medical technicians. Issues Inform Syst. 2017;18(4):16–26.
68.
Bost N, Crilly J, Wallis M, Patterson E, Chaboyer W. Clinical handover of patients arriving by ambulance to the emergency department–a literature review. Int Emerg Nurs. 2010;18(4):210–20.PubMedCrossRef
69.
Bost N, Crilly J, Patterson E, Chaboyer W. Clinical handover of patients arriving by ambulance to a hospital emergency department: a qualitative study. Int Emerg Nurs. 2012;20(3):133–41.PubMedCrossRef
70.
Jenkin A, Abelson-Mitchell N, Cooper S. Patient handover: time for a change? Accid Emerg Nurs. 2007;15(3):141–7.PubMedCrossRef
71.
Thakore S, Morrison W. A survey of the perceived quality of patient handover by ambulance staff in the resuscitation room. Emerg Med J. 2001;18(4):293–6.PubMedPubMedCentralCrossRef
72.
Smith AF, Pope C, Goodwin D, Mort M. Interprofessional handover and patient safety in anaesthesia: observational study of handovers in the recovery room. Br J Anaesth. 2008;101(3):332–7.PubMedCrossRef
73.
Berkenstadt H, Haviv Y, Tuval A, Shemesh Y, Megrill A, Perry A, Rubin O, Ziv A. Improving handoff communications in critical care: utilizing simulation-based training toward process improvement in managing patient risk. CHEST Journal. 2008;134(1):158–62.
74.
75.
Netemeyer RG, Bearden WO, Sharma S. Scaling procedures: issues and applications: Sage Publications: Thousand Oaks, California; 2003.
76.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Pearson: Essex; 2014.
77.
Schumacker RE, Lomax RG. A beginner's guide to structural equation modeling: Mahwah, New Jersey: Lawrence Erlbaum Associates; 2004.
78.
Lei PW, Wu Q. Introduction to structural equation modeling: issues and practical considerations. Educ Meas Issues Pract. 2007;26(3):33–43.CrossRef
79.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef
80.
Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electronic J Bus Res Methods. 2008;6(1):53–60.
81.
MacCallum RC, Roznowski M, Necowitz LB. Model modifications in covariance structure analysis: the problem of capitalization on chance. Psychol Bull. 1992;111(3):490–504.PubMedCrossRef
82.
Milfont TL, Fischer R. Testing measurement invariance across groups: applications in cross-cultural research. Int J Psychol Res. 2010;3(1):111–30.CrossRef
83.
84.
85.
Bodur S, Filiz E. A survey on patient safety culture in primary healthcare services in Turkey. Int J Qual Health Care. 2009;21(5):348–55.PubMedCrossRef
86.
87.
Sexton JB, Adair KC, Leonard MW, Frankel TC, Proulx J, Watson SR, Magnus B, Bogan B, Jamal M, Schwendimann R, Frankel AS. Providing feedback following leadership WalkRounds is associated with better patient safety culture, higher employee engagement and lower burnout. BMJ Qual Saf. 2017;0:1. https://​doi.​org/​10.​1136/​bmjqs-2016-006399.CrossRef
88.
DiCuccio MH. The relationship between patient safety culture and patient outcomes: a systematic review. J Patient Saf. 2015;11(3):135–42.PubMedCrossRef
89.
Olsen E, Bjerkan AM, Nævestad TO. Modelling the effects of a large-scale safety culture programme: a combined qualitative and quantitative approach. J Risk Res. 2009;12(3–4):389–409.CrossRef
90.
Zohar D, Livne Y, Tenne-Gazit O, Admi H, Donchin Y. Healthcare climate: a framework for measuring and improving patient safety. Crit Care Med. 2007;35(5):1312–7.PubMedCrossRef
91.
Foster S, Manser T. The effects of patient handoff characteristics on subsequent care: a systematic review and areas for future research. Acad Med. 2012;87(8):1105–24.PubMedCrossRef
92.
Brice JH, Studnek JR, Bigham BL, Martin-Gill C, Custalow CB, Hawkins E, Morrison LJ. EMS provider and patient safety during response and transport: proceedings of an ambulance safety conference. Prehosp Emerg Care. 2012;16(1):3–19.PubMedCrossRef
93.
Price R, Bendall JC, Patterson JA, Middleton PM. What causes adverse events in prehospital care? A human-factors approach. Emerg Med J. 2013;30:583–8.PubMedCrossRef
94.
Perneger TV, Staines A, Kundig F. Internal consistency, factor structure and construct validity of the French version of the hospital survey on patient safety culture. BMJ Qual Saf. 2014;23:389–97.PubMedCrossRef
95.
Huang DT, Clermont G, Sexton JB, Karlo CA, Miller RG, Weissfeld LA, et al. Perceptions of safety culture vary across the intensive care units of a single institution. Crit Care Med. 2007;35(1):165–76.PubMedCrossRef
96.
Pronovost P, Weast B, Rosenstein B, Sexton JB, Holzmueller CG, Paine L, et al. Implementing and validating a comprehensive unit-based safety program. J Patient Saf. 2005;1(1):33–40.CrossRef
Metadata
Title
Assessing safety climate in prehospital settings: testing psychometric properties of a common structural model in a cross-sectional and prospective study
Authors
Leif Inge K. Sørskår
Espen Olsen
Eirik B. Abrahamsen
Gunnar Tschudi Bondevik
Håkon B. Abrahamsen
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-4459-5

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue

Research article

Influencing factors of physicians’ prescription behavior in selecting essential medicines: a cross-sectional survey in Chinese county hospitals

Research article

Beyond hybrid professionals: evidence from the hospital sector

Research article

Impact of mobile radiography services in nursing homes on the utilisation of diagnostic imaging procedures

Research article

The impact of paid community health worker deployment on child survival: the connect randomized cluster trial in rural Tanzania

Research article

Determinants of inappropriate admissions of children to county hospitals: a cross-sectional study from rural China

Research article

Creating performance intelligence for primary health care strengthening in Europe