Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Research article

The German version of the high-performance work systems questionnaire (HPWS-G) in the context of patient safety: a validation study in a Swiss university hospital

Authors: Juliane Mielke, Sabina De Geest, Sonja Beckmann, Lynn Leppla, Xhyljeta Luta, Raphaelle-Ashley Guerbaai, Sabina Hunziker, René Schwendimann

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

High performance work systems (HPWSs) are successful work systems in the context of safety climate and patient safety. The 10-item HPWS questionnaire is a validated instrument developed to assess existing HPWS structures in hospitals. The objectives of this cross-sectional study were to translate the English HPWS questionnaire into German (HPWS-G), to rate its content validity, and to examine its psychometric properties.

Methods

Content validity was examined by a panel of 12 physicians and nurses, and I-CVI and S-CVI calculated. For internal consistency, Cronbach’s α and item-scale correlations were determined. Construct validity was measured via confirmatory factor analysis.
A convenience sample of 782 nurses and physicians in a University hospital setting in Switzerland’s German-speaking region was surveyed. Four inclusion criteria were applied: working in intensive care, emergency department or operating room; having daily patient contact; having worked in the current clinical area for more than three months; and more than 40% employment.

Results

A total of 281 questionnaires were completed (response rate: 35.9%). Overall, the 10-item HPWS-G questionnaire showed good content validity (I-CVI = .83–1; S-CVI = .86) and internal consistency (Cronbach’s α = .853). HPWS-G scores correlated significantly with safety climate (rs = .657, p < .01) and teamwork climate (rs = .615, p < .01). The proposed 1-factor model was accepted considering results of applied minimum rank factor analysis; a confirmatory factor analysis indicated an acceptable to good model fit (GFI = .968; CFI = .902; RMSEA = .043).

Conclusions

The HPWS-G showed good psychometric properties. In clinical practice it can be used to assess HPWS practices and for intra- and inter-hospital benchmarking. Some minor adaptions to the wording could be made as well as reassessing the psychometric properties at other clinical sites.
Footnotes
1
How many times in the last six months had CIRS cases been discussed in your clinical area, e.g. in case reviews or team meetings? (‘not at all’ to ‘once a month’).
 
2
What is the overall grade of patient safety in your clinical area? (Scale from 1 to 10).
 
3
calculated using Maximum likelihood, N = 281.
 
4
corrected p-value performing Bollen-Stine bootstrap.
 
5
Bootstrap confidence intervals.
 
6
‘teamwork is important for providing quality service to patients’.
 
Literature
1.
go back to reference Tomer JF. Understanding high-performance work systems: the joint contribution of economics and human resource management. J Socio Econ. 2001;30(1):63–73.CrossRef Tomer JF. Understanding high-performance work systems: the joint contribution of economics and human resource management. J Socio Econ. 2001;30(1):63–73.CrossRef
2.
go back to reference Etchegaray JM, St. John C, Thomas EJ: measures and measurement of high-performance work systems in health care settings: propositions for improvement. Health Care Manag Rev 2011, 36(1):38–46.PubMedCrossRef Etchegaray JM, St. John C, Thomas EJ: measures and measurement of high-performance work systems in health care settings: propositions for improvement. Health Care Manag Rev 2011, 36(1):38–46.PubMedCrossRef
3.
go back to reference Garman AN, McAlearney AS, Harrison MI, Song PH, McHugh M. High-performance work systems in health care management, part 1: development of an evidence-informed model. Health Care Manag Rev. 2011;36(3):201–13.CrossRef Garman AN, McAlearney AS, Harrison MI, Song PH, McHugh M. High-performance work systems in health care management, part 1: development of an evidence-informed model. Health Care Manag Rev. 2011;36(3):201–13.CrossRef
4.
go back to reference Weinberg DB, Avgar AC, Sugrue NM, Cooney-Miner D. The importance of a high-performance work environment in hospitals. Health Serv Res. 2013;48(1):319–32.PubMedCrossRef Weinberg DB, Avgar AC, Sugrue NM, Cooney-Miner D. The importance of a high-performance work environment in hospitals. Health Serv Res. 2013;48(1):319–32.PubMedCrossRef
5.
go back to reference Etchegaray JM, Thomas EJ. Engaging employees: the importance of high-performance work Systems for Patient Safety. J Patient Saf. 2015;11(4):221–7.PubMedCrossRef Etchegaray JM, Thomas EJ. Engaging employees: the importance of high-performance work Systems for Patient Safety. J Patient Saf. 2015;11(4):221–7.PubMedCrossRef
6.
go back to reference Scotti DJ, Harmon J, Behson SJ. Links among high-performance work environment, service quality, and customer satisfaction: an extension to the healthcare sector. J Healthc Manag. 2007;52(2):109–25.PubMedCrossRef Scotti DJ, Harmon J, Behson SJ. Links among high-performance work environment, service quality, and customer satisfaction: an extension to the healthcare sector. J Healthc Manag. 2007;52(2):109–25.PubMedCrossRef
7.
go back to reference Chuang E, Dill J, Morgan JC, Konrad TR. A configurational approach to the relationship between high-performance work practices and frontline health care worker outcomes. Health Serv Res. 2012;47(4):1460–81.PubMedPubMedCentralCrossRef Chuang E, Dill J, Morgan JC, Konrad TR. A configurational approach to the relationship between high-performance work practices and frontline health care worker outcomes. Health Serv Res. 2012;47(4):1460–81.PubMedPubMedCentralCrossRef
8.
go back to reference Kohn LT, Corrigan JM, Donaldson MS. To err is human. Washington: National Academies Press; 2000. Kohn LT, Corrigan JM, Donaldson MS. To err is human. Washington: National Academies Press; 2000.
10.
11.
go back to reference Schwendimann R, Blatter C, Dhaini S, Simon M, Ausserhofer D. The occurrence, types, consequences and preventability of in-hospital adverse events – a scoping review. BMC Health Serv Res. 2018;18(1):521.PubMedPubMedCentralCrossRef Schwendimann R, Blatter C, Dhaini S, Simon M, Ausserhofer D. The occurrence, types, consequences and preventability of in-hospital adverse events – a scoping review. BMC Health Serv Res. 2018;18(1):521.PubMedPubMedCentralCrossRef
12.
go back to reference Mihail DM, Kloutsiniotis PV. The effects of high-performance work systems on hospital employees’ work-related well-being: evidence from Greece. Eur Manag J. 2016;34(4):424–38.CrossRef Mihail DM, Kloutsiniotis PV. The effects of high-performance work systems on hospital employees’ work-related well-being: evidence from Greece. Eur Manag J. 2016;34(4):424–38.CrossRef
13.
go back to reference Young S, Bartram T, Stanton P, Leggat SG. High performance work systems and employee well-being: a two stage study of a rural Australian hospital. J Health Organ Manag. 2010;24(2):182–99.PubMedCrossRef Young S, Bartram T, Stanton P, Leggat SG. High performance work systems and employee well-being: a two stage study of a rural Australian hospital. J Health Organ Manag. 2010;24(2):182–99.PubMedCrossRef
14.
go back to reference Lee SM, Lee D, Kang C-Y. The impact of high-performance work systems in the health-care industry: employee reactions, service quality, customer satisfaction, and customer loyalty. Serv Ind J. 2012;32(1):17–36.CrossRef Lee SM, Lee D, Kang C-Y. The impact of high-performance work systems in the health-care industry: employee reactions, service quality, customer satisfaction, and customer loyalty. Serv Ind J. 2012;32(1):17–36.CrossRef
15.
go back to reference Leggat SG, Bartram T, Casimir G, Stanton P. Nurse perceptions of the quality of patient care: confirming the importance of empowerment and job satisfaction. Health Care Manag Rev. 2010;35(4):355–64.CrossRef Leggat SG, Bartram T, Casimir G, Stanton P. Nurse perceptions of the quality of patient care: confirming the importance of empowerment and job satisfaction. Health Care Manag Rev. 2010;35(4):355–64.CrossRef
16.
go back to reference Guldenmund FW. (Mis) understanding safety culture and its relationship to safety management. J Risk Res. 2010;30(10):1466–80. Guldenmund FW. (Mis) understanding safety culture and its relationship to safety management. J Risk Res. 2010;30(10):1466–80.
17.
go back to reference Manser T, Brösterhaus M, Hammer A. You can't improve what you don't measure: safety climate measures available in the German-speaking countries to support safety culture development in healthcare. Z Evid Fortbild Qual Gesundhwes. 2016;114:58–71.PubMedCrossRef Manser T, Brösterhaus M, Hammer A. You can't improve what you don't measure: safety climate measures available in the German-speaking countries to support safety culture development in healthcare. Z Evid Fortbild Qual Gesundhwes. 2016;114:58–71.PubMedCrossRef
18.
go back to reference Pfeiffer Y, Manser T. Development of the German version of the hospital survey on patient safety culture. Saf Sci. 2010;48(10):1452–62.CrossRef Pfeiffer Y, Manser T. Development of the German version of the hospital survey on patient safety culture. Saf Sci. 2010;48(10):1452–62.CrossRef
19.
go back to reference Gehring K, Mascherek AC, Bezzola P, Schwappach DLB. Safety climate in Swiss hospital units: Swiss version of the safety climate survey. J Eval Clin Pract. 2015;21(2):332–8.PubMedPubMedCentralCrossRef Gehring K, Mascherek AC, Bezzola P, Schwappach DLB. Safety climate in Swiss hospital units: Swiss version of the safety climate survey. J Eval Clin Pract. 2015;21(2):332–8.PubMedPubMedCentralCrossRef
20.
go back to reference West MA, Borrill C, Dawson J, Scully J, Carter M, Anelay S, Patterson M, Waring J. The link between the management of employees and patient mortality in acute hospitals. Int J Hum Resour Man. 2002;13(8):1299–310.CrossRef West MA, Borrill C, Dawson J, Scully J, Carter M, Anelay S, Patterson M, Waring J. The link between the management of employees and patient mortality in acute hospitals. Int J Hum Resour Man. 2002;13(8):1299–310.CrossRef
21.
go back to reference Robbins J, McAlearney AS. Toward a high-performance management system in health care, part 5: how high-performance work practices facilitate speaking up in health care organizations. Health Care Manag Rev. 2018. Robbins J, McAlearney AS. Toward a high-performance management system in health care, part 5: how high-performance work practices facilitate speaking up in health care organizations. Health Care Manag Rev. 2018.
22.
go back to reference Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 2014.
23.
go back to reference Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, Irwig L, Levine D, Reitsma JB, de Vet HC, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11).PubMedPubMedCentralCrossRef Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, Irwig L, Levine D, Reitsma JB, de Vet HC, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11).PubMedPubMedCentralCrossRef
24.
go back to reference Jones PS, Lee JW, Phillips LR, Zhang XE, Jaceldo KB. An adaption of Brislin’s translation model for cross-cultural research. Nurs Res. 2001;(5):50. Jones PS, Lee JW, Phillips LR, Zhang XE, Jaceldo KB. An adaption of Brislin’s translation model for cross-cultural research. Nurs Res. 2001;(5):50.
25.
go back to reference Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.PubMedCrossRef Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.PubMedCrossRef
26.
go back to reference Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–97.PubMedCrossRef Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–97.PubMedCrossRef
27.
go back to reference Zimmermann N, Küng K, Sereika SM, Engberg S, Sexton B, Schwendimann R. Assessing the safety attitudes questionnaire (SAQ), German language version in Swiss university hospitals - a validation study. BMC Health Serv Res. 2013;13(1):347.PubMedPubMedCentralCrossRef Zimmermann N, Küng K, Sereika SM, Engberg S, Sexton B, Schwendimann R. Assessing the safety attitudes questionnaire (SAQ), German language version in Swiss university hospitals - a validation study. BMC Health Serv Res. 2013;13(1):347.PubMedPubMedCentralCrossRef
28.
go back to reference Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ. The safety attitudes questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6(1):44.PubMedPubMedCentralCrossRef Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ. The safety attitudes questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6(1):44.PubMedPubMedCentralCrossRef
29.
go back to reference Sorra JS, Nieva VF. Hospital Survey on Patient Safety Culture (Prepared by Westat, under Contract No. 290–96-0004). Rockville, MD: Agency for Healthcare Research and Quality; 2004. Sorra JS, Nieva VF. Hospital Survey on Patient Safety Culture (Prepared by Westat, under Contract No. 290–96-0004). Rockville, MD: Agency for Healthcare Research and Quality; 2004.
30.
31.
go back to reference Tabachnick BG, Fidell LS. Using multivariate statistics, 4th ed. edn. Boston, MA: Allyn and Bacon; 2001. Tabachnick BG, Fidell LS. Using multivariate statistics, 4th ed. edn. Boston, MA: Allyn and Bacon; 2001.
32.
go back to reference Polit DF, Beck CT. Nursing research, 10th edn. Philadelphia: Wolters Kluwer; 2017. Polit DF, Beck CT. Nursing research, 10th edn. Philadelphia: Wolters Kluwer; 2017.
33.
go back to reference Field A, Allison PD: Discovering statistics using SPSS / multiple regression: sage publications; 2010. Field A, Allison PD: Discovering statistics using SPSS / multiple regression: sage publications; 2010.
34.
go back to reference Leonhart R: Lehrbuch Statistik, 3rd edn. Bern: Huber; 2013. Leonhart R: Lehrbuch Statistik, 3rd edn. Bern: Huber; 2013.
35.
go back to reference Häcker H. Standards für pädagogisches und psychologisches Testen, vol. 1, 1st edn. Bern; Göttingen; Toronto; Seattle: Huber; 1998. Häcker H. Standards für pädagogisches und psychologisches Testen, vol. 1, 1st edn. Bern; Göttingen; Toronto; Seattle: Huber; 1998.
36.
go back to reference Tinsley HE, Brown SD: Multivariate statistics and mathematical modeling. Handbook of applied multivariate statistics and mathematical modeling 2000:3–36.CrossRef Tinsley HE, Brown SD: Multivariate statistics and mathematical modeling. Handbook of applied multivariate statistics and mathematical modeling 2000:3–36.CrossRef
37.
go back to reference Thompson B: Exploratory and confirmatory factor analysis, 3rd edn. Washington, DC: American Psychological Assoc; 2008. Thompson B: Exploratory and confirmatory factor analysis, 3rd edn. Washington, DC: American Psychological Assoc; 2008.
38.
go back to reference Lorenzo-Seva U, Timmerman ME, Kiers HAL. The Hull method for selecting the number of common factors. Multivariate Behav Res. 2011;46(2):340–64.PubMedCrossRef Lorenzo-Seva U, Timmerman ME, Kiers HAL. The Hull method for selecting the number of common factors. Multivariate Behav Res. 2011;46(2):340–64.PubMedCrossRef
39.
go back to reference Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762–80.CrossRef Ferrando PJ, Lorenzo-Seva U. Assessing the quality and appropriateness of factor solutions and factor score estimates in exploratory item factor analysis. Educ Psychol Meas. 2018;78(5):762–80.CrossRef
40.
go back to reference DiStefano C, Hess B. Using confirmatory factor analysis for construct validation: an empirical review. J Psychoeduc Assess. 2005;23(3):225–41.CrossRef DiStefano C, Hess B. Using confirmatory factor analysis for construct validation: an empirical review. J Psychoeduc Assess. 2005;23(3):225–41.CrossRef
41.
go back to reference Reise SP, Revicki DA. Handbook of item response theory modeling. Routledge: Applications to typical performance assessment; 2014.CrossRef Reise SP, Revicki DA. Handbook of item response theory modeling. Routledge: Applications to typical performance assessment; 2014.CrossRef
42.
go back to reference Christensen KB, Makransky G, Horton M. Critical values for Yen’s Q3: identification of local dependence in the Rasch model using residual correlations. Appl Psychol Meas. 2017;41(3):178–94.PubMedCrossRef Christensen KB, Makransky G, Horton M. Critical values for Yen’s Q3: identification of local dependence in the Rasch model using residual correlations. Appl Psychol Meas. 2017;41(3):178–94.PubMedCrossRef
43.
go back to reference Cohen J. Statistical power analysis current directions. Psychol Sci. 1992;1(3):98–101. Cohen J. Statistical power analysis current directions. Psychol Sci. 1992;1(3):98–101.
44.
go back to reference Singer SJ, Gaba DM, Falwell A, Lin S, Hayes J, Baker L. Patient safety climate in 92 US hospitals: differences by work area and discipline. Med Care. 2009;47(1):23–31.PubMedCrossRef Singer SJ, Gaba DM, Falwell A, Lin S, Hayes J, Baker L. Patient safety climate in 92 US hospitals: differences by work area and discipline. Med Care. 2009;47(1):23–31.PubMedCrossRef
45.
go back to reference Bühner M: Einführung in die Test-und Fragebogenkonstruktion: Pearson Deutschland GmbH; 2011. Bühner M: Einführung in die Test-und Fragebogenkonstruktion: Pearson Deutschland GmbH; 2011.
46.
go back to reference De Witte H. Job insecurity: review of the international literature on definitions, prevalence, antecedents and consequences. SA J Ind Psychol. 2005;31(4):1–6. De Witte H. Job insecurity: review of the international literature on definitions, prevalence, antecedents and consequences. SA J Ind Psychol. 2005;31(4):1–6.
47.
48.
go back to reference Hu L-T, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3(4):424.CrossRef Hu L-T, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3(4):424.CrossRef
49.
go back to reference Zacharatos A, Barling J, Iverson RD. High-performance work systems and occupational safety. J Appl Psychol. 2005;90(1):77–93.PubMedCrossRef Zacharatos A, Barling J, Iverson RD. High-performance work systems and occupational safety. J Appl Psychol. 2005;90(1):77–93.PubMedCrossRef
51.
go back to reference Schwendimann R, Zimmermann N, Küng K, Ausserhofer D, Sexton B. Variation in safety culture dimensions within and between US and Swiss hospital units: an exploratory study. BMJ Qual Saf. 2012;22(1):32–41.PubMedCrossRef Schwendimann R, Zimmermann N, Küng K, Ausserhofer D, Sexton B. Variation in safety culture dimensions within and between US and Swiss hospital units: an exploratory study. BMJ Qual Saf. 2012;22(1):32–41.PubMedCrossRef
52.
go back to reference McAlearney AS, Hefner J, Robbins J, Garman AN. Toward a high-performance management system in health care, part 4: using high-performance work practices to prevent central line-associated blood stream infections-a comparative case study. Health Care Manag Rev. 2016;41(3):233–43.CrossRef McAlearney AS, Hefner J, Robbins J, Garman AN. Toward a high-performance management system in health care, part 4: using high-performance work practices to prevent central line-associated blood stream infections-a comparative case study. Health Care Manag Rev. 2016;41(3):233–43.CrossRef
53.
go back to reference Powell M, Dawson J, Topakas A, Durose J, Fewtrell C. Systematic review of the high-performance work systems literature in the health-care sector. In: Powell M, Dawson J, Topakas A, Durose J, Fewtrell C, editors. Staff satisfaction and organisational performance: evidence from a longitudinal secondary analysis of the NHS staff survey and outcome data. Southampton: NIHR journals Library; 2014. Powell M, Dawson J, Topakas A, Durose J, Fewtrell C. Systematic review of the high-performance work systems literature in the health-care sector. In: Powell M, Dawson J, Topakas A, Durose J, Fewtrell C, editors. Staff satisfaction and organisational performance: evidence from a longitudinal secondary analysis of the NHS staff survey and outcome data. Southampton: NIHR journals Library; 2014.
Metadata
Title
The German version of the high-performance work systems questionnaire (HPWS-G) in the context of patient safety: a validation study in a Swiss university hospital
Authors
Juliane Mielke
Sabina De Geest
Sonja Beckmann
Lynn Leppla
Xhyljeta Luta
Raphaelle-Ashley Guerbaai
Sabina Hunziker
René Schwendimann
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-4189-8

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue