Skip to main content
Top
Published in: International Journal of Behavioral Medicine 3/2015

01-06-2015

Investigating Variations in Implementation Fidelity of an Organizational-Level Occupational Health Intervention

Authors: Hanna Augustsson, Ulrica von Thiele Schwarz, Terese Stenfors-Hayes, Henna Hasson

Published in: International Journal of Behavioral Medicine | Issue 3/2015

Login to get access

Abstract

Background

The workplace has been suggested as an important arena for health promotion, but little is known about how the organizational setting influences the implementation of interventions.

Purpose

The aims of this study are to evaluate implementation fidelity in an organizational-level occupational health intervention and to investigate possible explanations for variations in fidelity between intervention units.

Method

The intervention consisted of an integration of health promotion, occupational health and safety, and a system for continuous improvements (Kaizen) and was conducted in a quasi-experimental design at a Swedish hospital. Implementation fidelity was evaluated with the Conceptual Framework for Implementation Fidelity and implementation factors used to investigate variations in fidelity with the Framework for Evaluating Organizational-level Interventions. A multi-method approach including interviews, Kaizen notes, and questionnaires was applied.

Results

Implementation fidelity differed between units even though the intervention was introduced and supported in the same way. Important differences in all elements proposed in the model for evaluating organizational-level interventions, i.e., context, intervention, and mental models, were found to explain the differences in fidelity.

Conclusion

Implementation strategies may need to be adapted depending on the local context. Implementation fidelity, as well as pre-intervention implementation elements, is likely to affect the implementation success and needs to be assessed in intervention research. The high variation in fidelity across the units indicates the need for adjustments to the type of designs used to assess the effects of interventions. Thus, rather than using designs that aim to control variation, it may be necessary to use those that aim at exploring and explaining variation, such as adapted study designs.
Literature
1.
go back to reference Cohen WS. Health promotion in the workplace: a prescription for good health. Am Psychol. 1985;40(2):213–6.CrossRefPubMed Cohen WS. Health promotion in the workplace: a prescription for good health. Am Psychol. 1985;40(2):213–6.CrossRefPubMed
2.
go back to reference Ilgen DR. Health issues at work. Opportunities for industrial/organizational psychology. Am Psychol. 1990;45(2):273–83.CrossRefPubMed Ilgen DR. Health issues at work. Opportunities for industrial/organizational psychology. Am Psychol. 1990;45(2):273–83.CrossRefPubMed
3.
go back to reference Drach-Zahavy A. Workplace health friendliness: a cross-level model for predicting workers’ health. J Occup Health Psychol. 2008;13(3):197–213.CrossRefPubMed Drach-Zahavy A. Workplace health friendliness: a cross-level model for predicting workers’ health. J Occup Health Psychol. 2008;13(3):197–213.CrossRefPubMed
4.
go back to reference Bamberger P, Sonnensthul W. Tailoring union-wide innovations to local conditions: the case of member assistance program implementation in the airline industry. Labor Stud J. 1996;21:19–39. Bamberger P, Sonnensthul W. Tailoring union-wide innovations to local conditions: the case of member assistance program implementation in the airline industry. Labor Stud J. 1996;21:19–39.
5.
go back to reference Hays C, Hays SP, DeVille J, Mulhall PF. Capacity for effectiveness: the relationship between coalition structure and community impact. Eval Program Plan. 2000;23(3):373–9.CrossRef Hays C, Hays SP, DeVille J, Mulhall PF. Capacity for effectiveness: the relationship between coalition structure and community impact. Eval Program Plan. 2000;23(3):373–9.CrossRef
6.
go back to reference Wilson MG, Dejoy DM, Vandenberg RJ, Richardson HA, McGrath AL. Work characteristics and employee health and well‐being: test of a model of healthy work organization. J Occup Organ Psychol. 2004;77(4):565–88.CrossRef Wilson MG, Dejoy DM, Vandenberg RJ, Richardson HA, McGrath AL. Work characteristics and employee health and well‐being: test of a model of healthy work organization. J Occup Organ Psychol. 2004;77(4):565–88.CrossRef
7.
go back to reference Nielsen K, Randall R, Holten A, Rial Gonzale E. Conducting organizational-level occupational health interventions: what works? Work Stress. 2010;24(3):234–59.CrossRef Nielsen K, Randall R, Holten A, Rial Gonzale E. Conducting organizational-level occupational health interventions: what works? Work Stress. 2010;24(3):234–59.CrossRef
8.
go back to reference EU-OSHA. European survey of enterprises on new and emerging risks: managing safety and health at work. Luxembourg. 2010. EU-OSHA. European survey of enterprises on new and emerging risks: managing safety and health at work. Luxembourg. 2010.
9.
go back to reference Semmer NK. Job stress interventions and the organization of work. Scand J Work Environ Health. 2006;32:515–27.CrossRefPubMed Semmer NK. Job stress interventions and the organization of work. Scand J Work Environ Health. 2006;32:515–27.CrossRefPubMed
10.
go back to reference Kompier MAJ, Kristensen TS. Organizational work stress interventions in a theoretical, methodological and practical context. In: Dunham, editor. Stress in the workplace: past, present and future. London: Whurr Publishers; 2001. Kompier MAJ, Kristensen TS. Organizational work stress interventions in a theoretical, methodological and practical context. In: Dunham, editor. Stress in the workplace: past, present and future. London: Whurr Publishers; 2001.
11.
go back to reference Taris TW, Kompier MAJ, Geurts SA, Schreurs PJ, Schaufeli WB, de Boer E, et al. Stress management interventions in the Dutch domiciliary care sector: findings from 81 organizations. Int J Stress Manag. 2003;10(4):297–325.CrossRef Taris TW, Kompier MAJ, Geurts SA, Schreurs PJ, Schaufeli WB, de Boer E, et al. Stress management interventions in the Dutch domiciliary care sector: findings from 81 organizations. Int J Stress Manag. 2003;10(4):297–325.CrossRef
12.
go back to reference Mikkelsen A, Saksvik PØ, Landsbergis P. The impact of a participatory organizational intervention on job stress in community health care institutions. Work Stress. 2000;14(2):156–70.CrossRef Mikkelsen A, Saksvik PØ, Landsbergis P. The impact of a participatory organizational intervention on job stress in community health care institutions. Work Stress. 2000;14(2):156–70.CrossRef
13.
go back to reference Ruotsalainen J, Serra C, Marine A, Verbeek J. Systematic review of interventions for reducing occupational stress in health care workers. Scand J Work Environ Health. 2008;34(3):169–78.CrossRefPubMed Ruotsalainen J, Serra C, Marine A, Verbeek J. Systematic review of interventions for reducing occupational stress in health care workers. Scand J Work Environ Health. 2008;34(3):169–78.CrossRefPubMed
14.
go back to reference Briner RB, Reynolds S. The costs, benefits, and limitations of organizational level stress interventions. J Organ Behav. 1999;20(5):647–64.CrossRef Briner RB, Reynolds S. The costs, benefits, and limitations of organizational level stress interventions. J Organ Behav. 1999;20(5):647–64.CrossRef
15.
16.
go back to reference Nielsen K, Taris T, Cox T. The future of organizational interventions: addressing the challenges of today’s organizations. Work Stress. 2010;24(3):219–33.CrossRef Nielsen K, Taris T, Cox T. The future of organizational interventions: addressing the challenges of today’s organizations. Work Stress. 2010;24(3):219–33.CrossRef
17.
go back to reference Egan M, Bambra C, Thomas S, Petticrew M, Whitehead M, Thomson H. The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control. J Epidemiol Community Health. 2007;61(11):945–54.CrossRefPubMedCentralPubMed Egan M, Bambra C, Thomas S, Petticrew M, Whitehead M, Thomson H. The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control. J Epidemiol Community Health. 2007;61(11):945–54.CrossRefPubMedCentralPubMed
18.
go back to reference Nielsen K, Randall R. Opening the black box: presenting a model for evaluating organizational-level interventions. Eur J Work Organ Psychol. 2013;22(5):601–17.CrossRef Nielsen K, Randall R. Opening the black box: presenting a model for evaluating organizational-level interventions. Eur J Work Organ Psychol. 2013;22(5):601–17.CrossRef
19.
go back to reference Murta SG, Sanderson K, Oldenburg B. Process evaluation in occupational stress management programs: a systematic review. Am J Health Promot. 2007;21(4):248–54.CrossRefPubMed Murta SG, Sanderson K, Oldenburg B. Process evaluation in occupational stress management programs: a systematic review. Am J Health Promot. 2007;21(4):248–54.CrossRefPubMed
20.
go back to reference Bambra C, Egan M, Thomas S, Petticrew M, Whitehead M. The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions. J Epidemiol Community Health. 2007;61(12):1028–37.CrossRefPubMedCentralPubMed Bambra C, Egan M, Thomas S, Petticrew M, Whitehead M. The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions. J Epidemiol Community Health. 2007;61(12):1028–37.CrossRefPubMedCentralPubMed
21.
go back to reference Roen K, Arai L, Roberts H, Popay J. Extending systematic reviews to include evidence on implementation: methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006;63(4):1060–71.CrossRefPubMed Roen K, Arai L, Roberts H, Popay J. Extending systematic reviews to include evidence on implementation: methodological work on a review of community-based initiatives to prevent injuries. Soc Sci Med. 2006;63(4):1060–71.CrossRefPubMed
22.
go back to reference Egan M, Bambra C, Petticrew M, Whitehead M. Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions. J Epidemiol Community Health. 2009;63(1):4–11.CrossRefPubMedCentralPubMed Egan M, Bambra C, Petticrew M, Whitehead M. Reviewing evidence on complex social interventions: appraising implementation in systematic reviews of the health effects of organisational-level workplace interventions. J Epidemiol Community Health. 2009;63(1):4–11.CrossRefPubMedCentralPubMed
23.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40). Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40).
24.
go back to reference Steckler AB, Linnan L. Process evaluation for public health interventions and research. Jossey-Bass; 2002. Steckler AB, Linnan L. Process evaluation for public health interventions and research. Jossey-Bass; 2002.
25.
go back to reference Womack JP, Jones DT, Roos D. The machine that changed the world: the story of lean production. New York: Rawson Associates; 1990. Womack JP, Jones DT, Roos D. The machine that changed the world: the story of lean production. New York: Rawson Associates; 1990.
26.
go back to reference Jacobson GH, Mccoin NS, Lescallette R, Russ S, Slovis CM. Kaizen: a method of process improvement in the emergency department. Acad Emerg Med. 2009;16(12):1341–9.CrossRefPubMed Jacobson GH, Mccoin NS, Lescallette R, Russ S, Slovis CM. Kaizen: a method of process improvement in the emergency department. Acad Emerg Med. 2009;16(12):1341–9.CrossRefPubMed
27.
go back to reference Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.CrossRefPubMed Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.CrossRefPubMed
28.
go back to reference Yin RK. Case study research: design and methods. Sage Publications Inc; 2003. Yin RK. Case study research: design and methods. Sage Publications Inc; 2003.
29.
go back to reference Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5(67). Hasson H. Study protocol: systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010;5(67).
30.
go back to reference Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7(23). Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7(23).
31.
go back to reference von Thiele Schwarz U, Hasson H, Lindfors P. Applying a fidelity framework to understand adaptations in an occupational health intervention. Work. 2014. doi:10.3233/WOR-141840. von Thiele Schwarz U, Hasson H, Lindfors P. Applying a fidelity framework to understand adaptations in an occupational health intervention. Work. 2014. doi:10.​3233/​WOR-141840.
32.
go back to reference Randall R, Nielsen K, Tvedt SD. The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work Stress. 2009;23(1):1–23.CrossRef Randall R, Nielsen K, Tvedt SD. The development of five scales to measure employees’ appraisals of organizational-level stress management interventions. Work Stress. 2009;23(1):1–23.CrossRef
33.
go back to reference Yang B, Watkins KE, Marsick VJ. The construct of the learning organization: dimensions, measurement, and validation. Hum Resour Dev Q. 2004;15(1):31–55.CrossRef Yang B, Watkins KE, Marsick VJ. The construct of the learning organization: dimensions, measurement, and validation. Hum Resour Dev Q. 2004;15(1):31–55.CrossRef
34.
go back to reference Lien BYH, Hung RYY, Yang B, Li M. Is the learning organization a valid concept in the Taiwanese context? Int J Manpow. 2006;27(2):189–203.CrossRef Lien BYH, Hung RYY, Yang B, Li M. Is the learning organization a valid concept in the Taiwanese context? Int J Manpow. 2006;27(2):189–203.CrossRef
35.
go back to reference Song JH, Joo BKB, Chermack TJ. The Dimensions of Learning Organization Questionnaire (DLOQ): a validation study in a Korean context. Hum Resour Dev Q. 2009;20(1):43–64.CrossRef Song JH, Joo BKB, Chermack TJ. The Dimensions of Learning Organization Questionnaire (DLOQ): a validation study in a Korean context. Hum Resour Dev Q. 2009;20(1):43–64.CrossRef
36.
go back to reference Taylor JC, Bowers DG. Survey of organizations: a machine-scored standardized questionnaire instrument. Ann Arbour: University of Michigan, Institute for Social Research; 1972. Taylor JC, Bowers DG. Survey of organizations: a machine-scored standardized questionnaire instrument. Ann Arbour: University of Michigan, Institute for Social Research; 1972.
37.
go back to reference Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed
38.
go back to reference Ulhassan W. Westerlund H, Thor J, Sandahl C, von Thiele Schwarz U. How does Lean relate to teamwork? A prospective observational study in a Swedish hospital. Submitted for publication. 2013. Ulhassan W. Westerlund H, Thor J, Sandahl C, von Thiele Schwarz U. How does Lean relate to teamwork? A prospective observational study in a Swedish hospital. Submitted for publication. 2013.
39.
go back to reference Frykman M. Hasson H, Atlin Muntlin Å, von Thiele Schwarz U. Functions of behavior change interventions when implementing multi-professional teamwork at an emergency department: a comparative case study. BMC Health Serv Res. 2014;14:218. Frykman M. Hasson H, Atlin Muntlin Å, von Thiele Schwarz U. Functions of behavior change interventions when implementing multi-professional teamwork at an emergency department: a comparative case study. BMC Health Serv Res. 2014;14:218.
40.
go back to reference Nytrø K, Saksvik P, Mikkelsen A, Bohle P, Quinlan M. An appraisal of key factors in the implementation of occupational stress interventions. Work Stress. 2000;14(3):213–25.CrossRef Nytrø K, Saksvik P, Mikkelsen A, Bohle P, Quinlan M. An appraisal of key factors in the implementation of occupational stress interventions. Work Stress. 2000;14(3):213–25.CrossRef
41.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3.
42.
go back to reference Randall R, Griffiths A, Cox T. Evaluating organizational stress-management interventions using adapted study designs. Eur J Work Organ Psychol. 2005;14(1):23–41.CrossRef Randall R, Griffiths A, Cox T. Evaluating organizational stress-management interventions using adapted study designs. Eur J Work Organ Psychol. 2005;14(1):23–41.CrossRef
43.
go back to reference Cox T, Karanika M, Griffiths A, Houdmont J. Evaluating organizational-level work stress interventions: beyond traditional methods. Work Stress. 2007;21(4):348–62.CrossRef Cox T, Karanika M, Griffiths A, Houdmont J. Evaluating organizational-level work stress interventions: beyond traditional methods. Work Stress. 2007;21(4):348–62.CrossRef
Metadata
Title
Investigating Variations in Implementation Fidelity of an Organizational-Level Occupational Health Intervention
Authors
Hanna Augustsson
Ulrica von Thiele Schwarz
Terese Stenfors-Hayes
Henna Hasson
Publication date
01-06-2015
Publisher
Springer US
Published in
International Journal of Behavioral Medicine / Issue 3/2015
Print ISSN: 1070-5503
Electronic ISSN: 1532-7558
DOI
https://doi.org/10.1007/s12529-014-9420-8

Other articles of this Issue 3/2015

International Journal of Behavioral Medicine 3/2015 Go to the issue