Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools

Authors: Gheed Alsalem, Paul Bowie, Jillian Morrison

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

The perceived importance of safety culture in improving patient safety and its impact on patient outcomes has led to a growing interest in the assessment of safety climate in healthcare organizations; however, the rigour with which safety climate tools were developed and psychometrically tested was shown to be variable. This paper aims to identify and review questionnaire studies designed to measure safety climate in acute hospital settings, in order to assess the adequacy of reported psychometric properties of identified tools.

Methods

A systematic review of published empirical literature was undertaken to examine sample characteristics and instrument details including safety climate dimensions, origin and theoretical basis, and extent of psychometric evaluation (content validity, criterion validity, construct validity and internal reliability).

Results

Five questionnaire tools, designed for general evaluation of safety climate in acute hospital settings, were included. Detailed inspection revealed ambiguity around concepts of safety culture and climate, safety climate dimensions and the methodological rigour associated with the design of these measures. Standard reporting of the psychometric properties of developed questionnaires was variable, although evidence of an improving trend in the quality of the reported psychometric properties of studies was noted. Evidence of the theoretical underpinnings of climate tools was limited, while a lack of clarity in the relationship between safety culture and patient outcome measures still exists.

Conclusions

Evidence of the adequacy of the psychometric development of safety climate questionnaire tools is still limited. Research is necessary to resolve the controversies in the definitions and dimensions of safety culture and climate in healthcare and identify related inconsistencies. More importance should be given to the appropriate validation of safety climate questionnaires before extending their usage in healthcare contexts different from those in which they were originally developed. Mixed methods research to understand why psychometric assessment and measurement reporting practices can be inadequate and lacking in a theoretical basis is also necessary.
Appendix
Available only for authorised users
Literature
1.
Institute of Medicine. To err is human: building a safer health system Washington, DC; 1999.
2.
Hellings J, Schrooten W, Klazinga N, Vleugels A. Challenging patient safety culture: survey results. International Journal of Health Care Quality Assurance. 2007;20(7):620–32.CrossRefPubMed
3.
Health and Safety Commission. Organizing for safety. Third report of the human factors study group of ACSNI. Sudbury, UK: HSE Books; 1993.
4.
Zohar D, Livne Y, Tenne-Gazit O, Admi H, Donchin Y. Healthcare climate: a framework for measuring and improving patient safety. Crit Care Med. 2007;35(5):1312–7.CrossRefPubMed
5.
Guldenmund FW. The nature of safety culture: a review of theory and research. Saf Sci. 2000;34(1):215–57.CrossRef
6.
Pidgeon N. Safety culture: key theoretical issues. Work & Stress. 1998;12(3):202–16.CrossRef
7.
Denison DR. What is the difference between organizational culture and organizational climate? A native's point of view on a decade of paradigm wars. Acad Manag Rev. 1996;21(3):619–54.CrossRef
8.
9.
Mearns KJ, Flin R. Assessing the state of organizational safety—culture or climate? Curr Psychol. 1999;18(1):5–17.CrossRef
10.
11.
Frazier CB, Ludwig TD, Whitaker B, Roberts DS. A hierarchical factor analysis of a safety culture survey. J Saf Res. 2013;45:15–28.CrossRef
12.
Neal A, Griffin MA, Hart PM. The impact of organizational climate on safety climate and individual behavior. Saf Sci. 2000;34(1):99–109.CrossRef
13.
Reichers A, Schneider B. Climate and culture: an evolution of constructs. San Francisco: Jossey-Bass; 1990.
14.
Cox S, Flin R. Safety culture: philosopher's stone or man of straw? Work & stress. 1998;12(3):189–201.CrossRef
15.
16.
Wreathall, J. “Organizational culture, behavior norms, and safety.” In: Proc., Int. Topical Meeting on Safety Culture in Nuclear Installations. Vienna: IAEA; 1995. p. 24–28.
17.
Cheyne A, Oliver A, Tomas J. Differences in safety climate in three European countries proceedings of 2003 British Psychological Society occupational psychology conference. p. 2003.
18.
Kirk S, Parker D, Claridge T, Esmail A, Marshall M. Patient safety culture in primary care: developing a theoretical framework for practical use. Quality and Safety in Health Care. 2007;16:313–20.CrossRefPubMedPubMedCentral
19.
Pronovost P, Berenholtz S, Goeschel C, Needham D, Sexton J, Thompson D, et al. Creating high reliability in health care organizations. Health Serv Res. 2006;41(4p2):1599–617.CrossRefPubMedPubMedCentral
20.
21.
Singla AK, Kitch BT, Weissman JS, Campbell EG. Assessing patient safety culture: a review and synthesis of the measurement tools. Journal of Patient Safety. 2006;2(3):105–15.CrossRef
22.
Sexton J, Helmreich R, Neilands T, Rowan K, Vella K, Boyden J, et al. The safety attitudes questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44.CrossRefPubMedPubMedCentral
23.
24.
Singer S, Meterko M, Baker L, Gaba D, Falwell A, Rosen A. Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey. Health Serv Res. 2007;42(5):1999–2021.CrossRefPubMedPubMedCentral
25.
Vogus TJ, Sutcliffe KM. The safety organizing scale: development and validation of a behavioral measure of safety culture in hospital nursing units. Med Care. 2007;45(1):46–54.CrossRefPubMed
26.
Vincent C, Taylor-Adams S, Stanhope N. Framework for analysing risk and safety in clinical medicine. BMJ: British Medical Journal. 1998;316(7138):1154.CrossRefPubMedPubMedCentral
27.
Donabedian A. The quality of care: how can it be assessed? Journal of the American Medical Asssociation. 1988;260(12):1743–8.CrossRef
28.
Zohar D. Safety climate in industrial organizations: theoretical and applied implications. J Appl Psychol. 1980;65(1):96.CrossRefPubMed
29.
Hofmann DA, Mark B. An investigation of the relationship between safety climate and medication errors as well as other nurse and patient outcomes. Pers Psychol. 2006;59(4):847–69.CrossRef
30.
Madsen MD. Improving patient safety: Safety Culture & Patient Safety Ethics. Roskilde, Denmark: Roskilde University; 2006.
31.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324(7347):1183.CrossRefPubMedPubMedCentral
32.
Flin R. Measuring safety culture in healthcare: a case for accurate diagnosis. Saf Sci. 2007;45:653–67.CrossRef
33.
Sorra J, Nieva V. Hospital survey on patient safety culture. Rockville, MD: Agency for Healthcare Research and Quality (AHRQ); 2004. Contract No.: AHRQ Publication No. 04-0041
34.
Manser T, Brösterhaus M, Hammer A. You can’t improve what you don’t measure: safety climate measures available in the German-speaking countries to support safety culture development in healthcare. Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen. 2016;114:58–71.CrossRefPubMed
35.
Griffin MA, Neal A. Perceptions of safety at work: a framework for linking safety climate to safety performance, knowledge, and motivation. J Occup Health Psychol. 2000;5(3):347.CrossRefPubMed
36.
Neal A, Griffin MA. A study of the lagged relationships among safety climate, safety motivation, safety behavior, and accidents at the individual and group levels. J Appl Psychol. 2006;91(4):946.CrossRefPubMed
37.
Perneger TV, Staines A, Kundig F. Internal consistency, factor structure and construct validity of the French version of the hospital survey on patient safety culture. BMJ quality & safety. 2014;23(5):389–97.CrossRef
38.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55.CrossRef
39.
Felknor SA, Aday LA, Burau KD, Delclos GL, Kapadia AS. Safety climate and its association with injuries and safety practices in public hospitals in Costa Rica. International Journal of Occupational & Environmental Health. 2000;6(1):18–25.CrossRef
40.
Itoh K, Abe T, Andersen H. A survey of safety culture in hospitals including staff attitudes about incident reporting. Glasgow: Proceedings of the Workshop on the Investigation and Reporting of Incidents and Accidents; 2002.
41.
Pronovost PJ, Weast B, Holzmueller CG, Rosenstein BJ, Kidwell RP, Haller KB, et al. Evaluation of the culture of safety: survey of clinicians and managers in an academic medical center. Quality & Safety in Health Care. 2003;12(6):405–10.CrossRef
42.
Singer S, Gaba D, Geppert J, Sinaiko A, Howard S, Park K. The culture of safety: results of an organization-wide survey in 15 California hospitals. Qual Saf Health Care. 2003;12:112–8.CrossRefPubMedPubMedCentral
43.
Zhu J, Li L, Zhao H, Han G, Wu AW, Weingart SN. Development of a patient safety climate survey for Chinese hospitals: cross-national adaptation and psychometric evaluation. BMJ Qual Saf. 2014;23(10):847–56.CrossRefPubMed
44.
Nie Y, Mao X, Cui H, He S, Li J, Zhang M. Hospital survey on patient safety culture in China. BMC Health Services Research. 2013;13(1):228.
45.
Haugen AS, Softeland E, Eide GE, Nortvedt MW, Aase K, Harthug S. Patient safety in surgical environments: cross-countries comparison of psychometric properties and results of the Norwegian version of the hospital survey on patient safety. BMC Health Serv Res. 2010;10:279.CrossRefPubMedPubMedCentral
46.
Waterson P, Griffiths P, Stride C, Murphy J, Hignett S. Psychometric properties of the hospital survey on patient safety culture: findings from the UK. Quality and Safety in Health Care. 2010;19(5):e2–e.PubMed
47.
Coyle IR, Sleeman SD, Adams N. Safety climate. J Saf Res. 1995;26(4):247–54.CrossRef
48.
Jackson J, Sarac C, Flin R. Hospital safety climate surveys: measurement issues. Curr Opin Crit Care. 2010;16(6):632–8.CrossRefPubMed
49.
Halligan M, Zecevic A. Safety culture in healthcare: a review of concepts, dimensions, measures and progress. BMJ quality & safety. 2011;20(4):338–43.CrossRef
50.
Pumar-Méndez MJ, Attree M, Wakefield A. Methodological aspects in the assessment of safety culture in the hospital setting: a review of the literature. Nurse Educ Today. 2014;34(2):162–70.CrossRefPubMed
51.
Sammer CE, Lykens K, Singh KP, Mains DA, Lackan NA. What is patient safety culture? A review of the literature. J Nurs Scholarsh. 2010;42(2):156–65.CrossRefPubMed
52.
Fleming M, Wentzell N. Patient safety culture improvement tool: development and guidelines for use. Healthcare quarterly (Toronto, Ont). 2008;11(3 Spec):10.CrossRef
53.
Reason J. Managing the risks of organizational accidents: Ashgate Aldershot; 1997.
54.
Singer SJ, Vogus TJ. Safety climate research: taking stock and looking forward. BMJ quality & safety. 2013;22(1):1–4.CrossRef
55.
Ausserhofer D. High-reliability in healthcare: nurse-reported patient safety climate and its relationship with patient outcomes in Swiss acute care hospitals: University of Basel; 2012.
56.
Almutairi AF. A case study examination of the influence of cultural diversity in the multicultural nursing workforce on the quality of care and patient safety in a Saudi Arabian hospital. Brisbane, Australia: Queensland University of Technology; 2012.
57.
Algahtani FD. The culture in safety culture: exploration of patient safety culture in Saudi Arabian operating theatres [doctoral thesis]. Australia: University of Adelaide, School of Nursing; 2015.
58.
Carayon P, Hundt AS, Karsh B, Gurses A, Alvarado C, Smith M, et al. Work system design for patient safety: the SEIPS model. Quality and Safety in Health Care. 2006;15(suppl 1):i50–i8.CrossRefPubMedPubMedCentral
59.
Phipps DL, Ashcroft DM. Psychosocial influences on safety climate: evidence from community pharmacies. Quality and Safety in Health Care. 2011;bmjqs. 2011:051912.
60.
Flin R, Mearns K, O'Connor P, Bryden R. Measuring safety climate: identifying the common features. Saf Sci. 2000;34:177–92.CrossRef
61.
Reiman T, Silla I, Pietikäinen E. The validity of the Nordic patient safety culture questionnaire (TUKU). International Journal of Risk and Safety in Medicine. 2013;25(3):169–84.
62.
Groves PS, Meisenbach R, Scott-Cawiezell J. Keeping patients safe in healthcare organizations: a structuration theory of safety culture. J Adv Nurs. 2011;67(8):1846.CrossRefPubMed
63.
Ruchlin HS, Dubbs NL, Callahan MA, Fosina MJ. The role of leadership in instilling a culture of safety: lessons from the literature. J Healthc Manag. 2004;49(1):47.CrossRefPubMed
64.
Donabedian A. An introduction to quality assurance in health care: Oxford university press; 2002.
65.
Mitchell PH, Ferketich S, Jennings BM. Quality health outcomes model. J Nurs Scholarsh. 1998;30(1):43–6.CrossRef
66.
67.
Nieva V, Sorra J. Safety culture assessment: a tool for improving patient safety in healthcare organizations. Qual Saf Health Care. 2003;12(Suppl II):ii17–23.PubMedPubMedCentral
68.
Walshe K, Boaden R. Patient safety: research into practice: McGraw-hill education (UK); 2005.
69.
Palmieri PA. Safety culture as a contemporary healthcare construct: theoretical review, research assessment, and translation to human resource management. Advances in Health Care Management (Patient Safety). 2010;9:97–133.CrossRef
70.
71.
72.
73.
Wilson KA. Does safety cutlure predict clinical outcomes? Florida: University of Central Florida Orlando; 2007.
74.
Pronovost PJ, Goeschel CA, Marsteller JA, Sexton JB, Pham JC, Berenholtz SM. Framework for patient safety research and improvement. Circulation. 2009;119(2):330–7.CrossRefPubMed
75.
76.
Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use: Oxford university press; 2014.
77.
Haynes SN, Richard D, Kubany ES. Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess. 1995;7(3):238.CrossRef
78.
DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–64.CrossRefPubMed
79.
Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008;65(23):2276–84.CrossRefPubMed
80.
Kane MT. Current concerns in validity theory. J Educ Meas. 2001;38(4):319–42.CrossRef
81.
Hutchinson A, Cooper K, Dean J, McIntosh A, Patterson M, Stride C, et al. Use of a safety climate questionnaire in UK health care: factor structure, reliability and usability. Quality and Safety in Health Care. 2006;15(5):347–53.CrossRefPubMedPubMedCentral
82.
Geisinger KF, Bracken BA, Carlson JF, Hansen J-IC, Kuncel NR, Reise SP, et al. APA handbook of testing and assessment in psychology, Vol. 1: test theory and testing and assessment in industrial and organizational psychology. 2013.CrossRef
83.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334.CrossRef
84.
Metadata
Title
Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools
Authors
Gheed Alsalem
Paul Bowie
Jillian Morrison
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3167-x

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue

Research article

Characteristics of patients with thromboembolic disorders on warfarin therapy in resource limited settings

Study protocol

Understanding the implementation and efficacy of a home-based strength and balance fall prevention intervention in people aged 50 years or over with vision impairment: a process evaluation protocol

Research article

Personality of Belgian physicians in a clinical leadership program

Research article

A qualitative exploration of contextual factors that influence dissemination and implementation of evidence-based chronic disease prevention across four countries

Research article

“One program that could improve health in this neighbourhood is ____?” using concept mapping to engage communities as part of a health and human services needs assessment

Research article

Availability, use, and affordability of medicines in urban China under universal health coverage: an empirical study in Hangzhou and Baoji