Skip to main content
Top
Published in: BMC Public Health 1/2012

Open Access 01-12-2012 | Study protocol

The design of a real-time formative evaluation of the implementation process of lifestyle interventions at two worksites using a 7-step strategy (BRAVO@Work)

Authors: Debbie Wierenga, Luuk H Engbers, Pepijn van Empelen, Vincent H Hildebrandt, Willem van Mechelen

Published in: BMC Public Health | Issue 1/2012

Login to get access

Abstract

Background

Worksite health promotion programs (WHPPs) offer an attractive opportunity to improve the lifestyle of employees. Nevertheless, broad scale and successful implementation of WHPPs in daily practice often fails. In the present study, called BRAVO@Work, a 7-step implementation strategy was used to develop, implement and embed a WHPP in two different worksites with a focus on multiple lifestyle interventions.
This article describes the design and framework for the formative evaluation of this 7-step strategy under real-time conditions by an embedded scientist with the purpose to gain insight into whether this this 7-step strategy is a useful and effective implementation strategy. Furthermore, we aim to gain insight into factors that either facilitate or hamper the implementation process, the quality of the implemented lifestyle interventions and the degree of adoption, implementation and continuation of these interventions.

Methods and design

This study is a formative evaluation within two different worksites with an embedded scientist on site to continuously monitor the implementation process. Each worksite (i.e. a University of Applied Sciences and an Academic Hospital) will assign a participating faculty or a department, to implement a WHPP focusing on lifestyle interventions using the 7-step strategy. The primary focus will be to describe the natural course of development, implementation and maintenance of a WHPP by studying [a] the use and adherence to the 7-step strategy, [b] barriers and facilitators that influence the natural course of adoption, implementation and maintenance, and [c] the implementation process of the lifestyle interventions. All data will be collected using qualitative (i.e. real-time monitoring and semi-structured interviews) and quantitative methods (i.e. process evaluation questionnaires) applying data triangulation. Except for the real-time monitoring, the data collection will take place at baseline and after 6, 12 and 18 months.

Discussion

This is one of the few studies to extensively and continuously monitor the natural course of the implementation process of a WHPP by a formative evaluation using a mix of quantitative and qualitative methods on different organizational levels (i.e. management, project group, employees) with an embedded scientist on site.

Trial Registration

NTR2861
Appendix
Available only for authorised users
Literature
1.
go back to reference Gommer AM, Poos MJJC: Welke ziekten hebben de hoogste prevalentie?. Volksgezondheid toekomstverkenning. 2010, Bilthoven: RIVM Gommer AM, Poos MJJC: Welke ziekten hebben de hoogste prevalentie?. Volksgezondheid toekomstverkenning. 2010, Bilthoven: RIVM
2.
go back to reference Pronk NP, Martinson B, Kessler RC, Beck AL, Simon GE, Wang P: The association between work performance and physical activity, cardiorespiratory fitness, and obesity. J Occup Environ Med. 2004, 46 (1): 19-25. 10.1097/01.jom.0000105910.69449.b7.CrossRefPubMed Pronk NP, Martinson B, Kessler RC, Beck AL, Simon GE, Wang P: The association between work performance and physical activity, cardiorespiratory fitness, and obesity. J Occup Environ Med. 2004, 46 (1): 19-25. 10.1097/01.jom.0000105910.69449.b7.CrossRefPubMed
3.
go back to reference van Duijvenbode DC, Hoozemans MJ, van Poppel MN, Proper KI: The relationship between overweight and obesity, and sick leave: a systematic review. Int J Obes (Lond). 2009, 33 (8): 807-816. 10.1038/ijo.2009.121.CrossRef van Duijvenbode DC, Hoozemans MJ, van Poppel MN, Proper KI: The relationship between overweight and obesity, and sick leave: a systematic review. Int J Obes (Lond). 2009, 33 (8): 807-816. 10.1038/ijo.2009.121.CrossRef
4.
go back to reference Proper KI, Hildebrandt VH: Overweight and obesity among Dutch workers: differences between occupational groups and sectors. Int Arch Occup Environ Health. 2010, 83 (1): 61-68. 10.1007/s00420-009-0438-1.CrossRefPubMed Proper KI, Hildebrandt VH: Overweight and obesity among Dutch workers: differences between occupational groups and sectors. Int Arch Occup Environ Health. 2010, 83 (1): 61-68. 10.1007/s00420-009-0438-1.CrossRefPubMed
5.
go back to reference Jans MP, van den Heuvel SG, Hildebrandt VH, Bongers PM: Overweight and Obesity as Predictors of Absenteeism in the Working Population of the Netherlands. JOEM. 2007, 49 (9): 975-980.PubMed Jans MP, van den Heuvel SG, Hildebrandt VH, Bongers PM: Overweight and Obesity as Predictors of Absenteeism in the Working Population of the Netherlands. JOEM. 2007, 49 (9): 975-980.PubMed
6.
go back to reference Kirsten W: Making the link between health and productivity at the workplace–a global perspective. Ind Health. 2010, 48 (3): 251-255. 10.2486/indhealth.48.251.CrossRefPubMed Kirsten W: Making the link between health and productivity at the workplace–a global perspective. Ind Health. 2010, 48 (3): 251-255. 10.2486/indhealth.48.251.CrossRefPubMed
7.
go back to reference Mills PR, Kessler RC, Cooper J, Sullivan S: Impact of a health promotion program on employee health risks and work productivity. Am J Health Promot. 2007, 22 (1): 45-53. 10.4278/0890-1171-22.1.45.CrossRefPubMed Mills PR, Kessler RC, Cooper J, Sullivan S: Impact of a health promotion program on employee health risks and work productivity. Am J Health Promot. 2007, 22 (1): 45-53. 10.4278/0890-1171-22.1.45.CrossRefPubMed
9.
go back to reference Engbers LE, van Poppel MN, Chin A, Paw MJ, van Mechelen W: Worksite health promotion programs with environmental changes: a systematic review. Am J Prev Med. 2005, 29 (1): 61-70. 10.1016/j.amepre.2005.03.001.CrossRefPubMed Engbers LE, van Poppel MN, Chin A, Paw MJ, van Mechelen W: Worksite health promotion programs with environmental changes: a systematic review. Am J Prev Med. 2005, 29 (1): 61-70. 10.1016/j.amepre.2005.03.001.CrossRefPubMed
10.
go back to reference Kremers S, Reubsaet A, Martens M, Gerards S, Jonkers R, Candel M, de Weerdt I, de Vries N: Systematic prevention of overweight and obesity in adults: a qualitative and quantitative literature analysis. Obes Rev. 2010, 11 (5): 371-379. 10.1111/j.1467-789X.2009.00598.x.CrossRefPubMed Kremers S, Reubsaet A, Martens M, Gerards S, Jonkers R, Candel M, de Weerdt I, de Vries N: Systematic prevention of overweight and obesity in adults: a qualitative and quantitative literature analysis. Obes Rev. 2010, 11 (5): 371-379. 10.1111/j.1467-789X.2009.00598.x.CrossRefPubMed
11.
go back to reference Ni Mhurchu C, Aston LM, Jebb SA: Effects of worksite health promotion interventions on employee diets: a systematic review. BMC Public Health. 2010, 10 (10): 62-CrossRefPubMedPubMedCentral Ni Mhurchu C, Aston LM, Jebb SA: Effects of worksite health promotion interventions on employee diets: a systematic review. BMC Public Health. 2010, 10 (10): 62-CrossRefPubMedPubMedCentral
12.
go back to reference Jepson RG, Harris FM, Platt S, Tannahill C: The effectiveness of interventions to change six health behaviors: a review of reviews. BMC Public Health. 2010, 8 (10): 538-CrossRef Jepson RG, Harris FM, Platt S, Tannahill C: The effectiveness of interventions to change six health behaviors: a review of reviews. BMC Public Health. 2010, 8 (10): 538-CrossRef
13.
go back to reference Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180 (6 Suppl): S57-S60.PubMed Grol R, Wensing M: What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004, 180 (6 Suppl): S57-S60.PubMed
14.
go back to reference Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362 (9391): 1225-1230. 10.1016/S0140-6736(03)14546-1.CrossRefPubMed
16.
go back to reference Durlak JA, DuPre EP: Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008, 41: 327-350. 10.1007/s10464-008-9165-0.CrossRefPubMed Durlak JA, DuPre EP: Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008, 41: 327-350. 10.1007/s10464-008-9165-0.CrossRefPubMed
17.
go back to reference Grimshaw J, Eccles M, Tetroe J: Implementing Clinical Guideline: Current Evidence and Future Implication. J Contin Educ Health Prof. 2004, 24: S31-S37. 10.1002/chp.1340240506.CrossRefPubMed Grimshaw J, Eccles M, Tetroe J: Implementing Clinical Guideline: Current Evidence and Future Implication. J Contin Educ Health Prof. 2004, 24: S31-S37. 10.1002/chp.1340240506.CrossRefPubMed
18.
go back to reference Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp N, Smith JL: The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006, 21 Suppl 2: S1-S8.CrossRefPubMed Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp N, Smith JL: The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006, 21 Suppl 2: S1-S8.CrossRefPubMed
19.
go back to reference Mittman BS: Creating the evidence base for quality improvement collaboratives. Ann Int Med. 2004, 140 (11): 897-901.CrossRefPubMed Mittman BS: Creating the evidence base for quality improvement collaboratives. Ann Int Med. 2004, 140 (11): 897-901.CrossRefPubMed
20.
go back to reference Patton MQ: Evaluation of program implementation. Eval Stu Rev Annu. 1979, 4: 318-345. Patton MQ: Evaluation of program implementation. Eval Stu Rev Annu. 1979, 4: 318-345.
21.
go back to reference Leykum LK, Pugh JA, Lanham HJ, Harmon J, McDaniel RRJ: Implementation research design: integrating participatory action research into randomized controlled trials. Implement Sci. 2009, 4: 69-10.1186/1748-5908-4-69.CrossRefPubMedPubMedCentral Leykum LK, Pugh JA, Lanham HJ, Harmon J, McDaniel RRJ: Implementation research design: integrating participatory action research into randomized controlled trials. Implement Sci. 2009, 4: 69-10.1186/1748-5908-4-69.CrossRefPubMedPubMedCentral
22.
go back to reference Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell KS, Stillman L, Blachman M, Dunville R, Saul J: Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008, 41: 171-181. 10.1007/s10464-008-9174-z.CrossRefPubMed Wandersman A, Duffy J, Flaspohler P, Noonan R, Lubell KS, Stillman L, Blachman M, Dunville R, Saul J: Bridging the gap between prevention research and practice: the interactive systems framework for dissemination and implementation. Am J Community Psychol. 2008, 41: 171-181. 10.1007/s10464-008-9174-z.CrossRefPubMed
23.
go back to reference Rogers EM: Diffusion of innovations. 2003, New York: Free Press Rogers EM: Diffusion of innovations. 2003, New York: Free Press
24.
go back to reference Paulussen TH, Wiefferink K, Mesters I: Invoering van effectief gebleken interventies. Gezondheidsvoorlichting en gedragsverandering. Edited by: Brug J, Asseman P, Lechner L. 2007, Assen: van Gorcum Paulussen TH, Wiefferink K, Mesters I: Invoering van effectief gebleken interventies. Gezondheidsvoorlichting en gedragsverandering. Edited by: Brug J, Asseman P, Lechner L. 2007, Assen: van Gorcum
25.
go back to reference Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004, 16 (2): 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care. 2004, 16 (2): 107-123. 10.1093/intqhc/mzh030.CrossRefPubMed
26.
go back to reference Wynne R: European foundation for the improvement of living and working conditions: Workplace health promotion in Europe. Research summary. 1997, Luxembourg: Office for official publications of the European Communities Wynne R: European foundation for the improvement of living and working conditions: Workplace health promotion in Europe. Research summary. 1997, Luxembourg: Office for official publications of the European Communities
27.
go back to reference Wynne R, Clarkin N: Under construction: building for health in the EC workplace. 1992, Luxembourg: Officer for Offical Publication of the European Communities Wynne R, Clarkin N: Under construction: building for health in the EC workplace. 1992, Luxembourg: Officer for Offical Publication of the European Communities
28.
go back to reference Koenders P: BRAVO: a healthy lifestyle. Fortis puts health management on the agenda (BRAVO: een gezonde leefstijl. Fortis zet gezondheidsmanagement op de kaart). Arbo. 2008, 6: 16-19. Koenders P: BRAVO: a healthy lifestyle. Fortis puts health management on the agenda (BRAVO: een gezonde leefstijl. Fortis zet gezondheidsmanagement op de kaart). Arbo. 2008, 6: 16-19.
29.
go back to reference Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89: 9-1322.CrossRef Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89: 9-1322.CrossRef
30.
go back to reference Dzewaltowski DA, Estabrooks PA, Glasgow RE: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Exerc Sport Sci Rev. 2004, 32 (2): 57-63. 10.1097/00003677-200404000-00004.CrossRefPubMed Dzewaltowski DA, Estabrooks PA, Glasgow RE: The future of physical activity behavior change research: what is needed to improve translation of research into health promotion practice?. Exerc Sport Sci Rev. 2004, 32 (2): 57-63. 10.1097/00003677-200404000-00004.CrossRefPubMed
31.
go back to reference Dzewaltowski DA, Glasgow RE, Klesges LM, Estabrooks PA, Brock E: RE-AIM: evidence-based standards and a web resource to improve translation of research into practice. Ann Behav Med. 2004, 28 (2): 75-80. 10.1207/s15324796abm2802_1.CrossRefPubMed Dzewaltowski DA, Glasgow RE, Klesges LM, Estabrooks PA, Brock E: RE-AIM: evidence-based standards and a web resource to improve translation of research into practice. Ann Behav Med. 2004, 28 (2): 75-80. 10.1207/s15324796abm2802_1.CrossRefPubMed
32.
go back to reference Steckler A, Linnan L: Proces Evaluation for Public Health Interventions and Research. 2002, San Francisco: Jossey-Bass Steckler A, Linnan L: Proces Evaluation for Public Health Interventions and Research. 2002, San Francisco: Jossey-Bass
34.
go back to reference Mays N, Pope C: Assessing quality in qualitative research. BMJ. 2000, 320: 50-52.PubMed Mays N, Pope C: Assessing quality in qualitative research. BMJ. 2000, 320: 50-52.PubMed
35.
go back to reference Boeije H: Analyze in qualitative research. (Analyseren in kwalitatief onderzoek. denken en doen). 2009, Amsterdam, The Netherlands: Boom onderwijs Boeije H: Analyze in qualitative research. (Analyseren in kwalitatief onderzoek. denken en doen). 2009, Amsterdam, The Netherlands: Boom onderwijs
36.
go back to reference Wester F, Peters V: Qualitative analyse. Principles and procedures (Kwalitatieve analyse. Uitgangspunten en procedures). 2004, Bussem, The Netherlands: Coutinho bv Wester F, Peters V: Qualitative analyse. Principles and procedures (Kwalitatieve analyse. Uitgangspunten en procedures). 2004, Bussem, The Netherlands: Coutinho bv
37.
go back to reference Steckler A, Ethelbah B, Martin CJ, Stewart D, Pardilla M, Gittelsohn J, Stone E, Fenn D, Smyth M, Vu M: Pathways process evaluation results: a school-based prevention trial to promote healthful diet and physical activity in American Indian third, fourth, and fifth grade students. Prev med. 2003, 37: S80-S90.CrossRefPubMed Steckler A, Ethelbah B, Martin CJ, Stewart D, Pardilla M, Gittelsohn J, Stone E, Fenn D, Smyth M, Vu M: Pathways process evaluation results: a school-based prevention trial to promote healthful diet and physical activity in American Indian third, fourth, and fifth grade students. Prev med. 2003, 37: S80-S90.CrossRefPubMed
38.
go back to reference Baranowski T, Stables G: Process evaluations of the 5-a-day projects. Health Educ Behav. 2000, 27 (2): 157-166. 10.1177/109019810002700202.CrossRefPubMed Baranowski T, Stables G: Process evaluations of the 5-a-day projects. Health Educ Behav. 2000, 27 (2): 157-166. 10.1177/109019810002700202.CrossRefPubMed
39.
go back to reference Pratt CC, McGuidan WM, Katzev AR: Measuring program outcomes: Using retrospective pretest methodology. Amer J Evaluation. 2000, 21 (3): 341-349.CrossRef Pratt CC, McGuidan WM, Katzev AR: Measuring program outcomes: Using retrospective pretest methodology. Amer J Evaluation. 2000, 21 (3): 341-349.CrossRef
40.
go back to reference Johnson CC, Lai YL, Rice J, Rose D, Webber LS: ACTION live: using process evaluation to describe implementation of a worksite wellness program. J Occup Environ Med. 2010, 52 (Suppl 1): S14-S21.CrossRefPubMedPubMedCentral Johnson CC, Lai YL, Rice J, Rose D, Webber LS: ACTION live: using process evaluation to describe implementation of a worksite wellness program. J Occup Environ Med. 2010, 52 (Suppl 1): S14-S21.CrossRefPubMedPubMedCentral
41.
go back to reference Glasgow RE, McCaul KD, Fisher KJ: Participation in worksite health promotion: a critique of the literature and recommendations for future practice. Health Educ Q. 1993, 20 (3): 391-408. 10.1177/109019819302000309.CrossRefPubMed Glasgow RE, McCaul KD, Fisher KJ: Participation in worksite health promotion: a critique of the literature and recommendations for future practice. Health Educ Q. 1993, 20 (3): 391-408. 10.1177/109019819302000309.CrossRefPubMed
42.
go back to reference Bouffard JA, Taxman FS, Silvermand R: Improving process evaluations of correctional programs by using a comprehensive evaluation methodology. Eval Programm Plann. 2003, 26: 149-161. 10.1016/S0149-7189(03)00010-7.CrossRef Bouffard JA, Taxman FS, Silvermand R: Improving process evaluations of correctional programs by using a comprehensive evaluation methodology. Eval Programm Plann. 2003, 26: 149-161. 10.1016/S0149-7189(03)00010-7.CrossRef
43.
go back to reference Bull SS, Gillette C, Glasgow RE, Estabrooks PA: Work site health promotion research: to what extent can we generalize the results and what is needed to translate research into practice?. Am J Public Health. 2003, 30: 537-549. Bull SS, Gillette C, Glasgow RE, Estabrooks PA: Work site health promotion research: to what extent can we generalize the results and what is needed to translate research into practice?. Am J Public Health. 2003, 30: 537-549.
44.
go back to reference Craig P, Dieppe P, Macintyre S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the ned Medical Research Council guidance. BMJ. 2008, 337 (1655): 979-983. Craig P, Dieppe P, Macintyre S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the ned Medical Research Council guidance. BMJ. 2008, 337 (1655): 979-983.
45.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral
Metadata
Title
The design of a real-time formative evaluation of the implementation process of lifestyle interventions at two worksites using a 7-step strategy (BRAVO@Work)
Authors
Debbie Wierenga
Luuk H Engbers
Pepijn van Empelen
Vincent H Hildebrandt
Willem van Mechelen
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2012
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-12-619

Other articles of this Issue 1/2012

BMC Public Health 1/2012 Go to the issue