Skip to main content
Top
Published in: BMC Public Health 1/2018

Open Access 01-12-2018 | Research article

Process evaluation of implementation fidelity in a Danish health-promoting school intervention

Authors: Ane Høstgaard Bonde, Nanna Wurr Stjernqvist, Marianne S. Sabinsky, Helle Terkildsen Maindal

Published in: BMC Public Health | Issue 1/2018

Login to get access

Abstract

Background

“We Act” is a health-promoting school intervention comprising an educational, a parental and a school component. The intervention was implemented in 4 Danish public schools with 4 control schools. The objectives were to improve pupils’ dietary habits, physical activity, well-being and social capital using the Investigation, Vision, Action & Change (IVAC) health educational methodology. The target group was pupils in grades 5–6. The purpose of this study was to evaluate implementation fidelity and interacting context factors in the intervention schools.

Methods

The Medical Research Council’s new guidance for process evaluation was used as a framework. Data were collected concurrently and evenly at the 4 intervention schools through field visits (n = 43 days), questionnaires (n = 17 teachers, 52 parents), and interviews (n = 9 teachers, 4 principals, 52 pupils). The data were analysed separately and via triangulation.

Results

A total of 289 pupils participated, and 22 teachers delivered the educational component in 12 classes. In all schools, the implementation fidelity to the educational methodology was high for the Investigation and Vision phases as the teachers delivered the proposed lessons and activities. However, the implementation fidelity to the Action & Change phase was low, and little change occurred in the schools. The pupils’ presentation of their visions did not work as intended as an impact mechanism to prompt actions. The implementation of the parental and the school components was weak. The main context factors influencing implementation fidelity were a poor fit into the school-year plan and weak management support.

Conclusions

Although ‘We Act’ was designed to comply with evidence- and theory-based requirements, IVAC and the health-promoting school approach did not result in change. The time dedicated to schools’ preparation and competence development may have been too low. This must be considered in future process evaluation research on health-promoting schools and by school health promotion administrators when planning future school interventions.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Baranowski T, Mendlein J, Resnicow K, Frank E, Cullen KW, Baranowski J. Physical activity and nutrition in children and youth: an overview of obesity prevention. Prev Med. 2000;31:S1–10.CrossRef Baranowski T, Mendlein J, Resnicow K, Frank E, Cullen KW, Baranowski J. Physical activity and nutrition in children and youth: an overview of obesity prevention. Prev Med. 2000;31:S1–10.CrossRef
2.
go back to reference Lytle LA, Seifert S, Greenstein J, McGovern P. How do children's eating patterns and food choices change over time? Results from a cohort study. Am J Health Promot. 2000;14:222–8.CrossRef Lytle LA, Seifert S, Greenstein J, McGovern P. How do children's eating patterns and food choices change over time? Results from a cohort study. Am J Health Promot. 2000;14:222–8.CrossRef
3.
go back to reference Young I. Health promotion in schools - a historical perspective. Promot Educ. 2005;12:112–7.CrossRef Young I. Health promotion in schools - a historical perspective. Promot Educ. 2005;12:112–7.CrossRef
5.
go back to reference Jensen BB. A case of two paradigms within health education. Health Educ Res. 1997;12:419–28.CrossRef Jensen BB. A case of two paradigms within health education. Health Educ Res. 1997;12:419–28.CrossRef
6.
go back to reference Jensen B, Simovska V. Involving students in learning and health promotion processes - clarifying why? What? And how? Promot Educ. 2005;12:150–6.CrossRef Jensen B, Simovska V. Involving students in learning and health promotion processes - clarifying why? What? And how? Promot Educ. 2005;12:150–6.CrossRef
7.
go back to reference Simovska V, Jensen B. The health of children and young people. Copenhagen: WHO Regional Office for Europe; 2009. Simovska V, Jensen B. The health of children and young people. Copenhagen: WHO Regional Office for Europe; 2009.
8.
go back to reference Carlsson M, Simovska V. Exploring learning outcomes of school-based health promotion--a multiple case study. Health Educ Res. 2012;27:437–47.CrossRef Carlsson M, Simovska V. Exploring learning outcomes of school-based health promotion--a multiple case study. Health Educ Res. 2012;27:437–47.CrossRef
9.
go back to reference Llargues E, Franco R, Recasens A, Nadal A, Vila M, Perez MJ, et al. Assessment of a school-based intervention in eating habits and physical activity in school children: the avall study. J Epidemiol Community Health. 2011;65:896–901.CrossRef Llargues E, Franco R, Recasens A, Nadal A, Vila M, Perez MJ, et al. Assessment of a school-based intervention in eating habits and physical activity in school children: the avall study. J Epidemiol Community Health. 2011;65:896–901.CrossRef
10.
go back to reference St. Leger L. Schools, health literacy and public health: possibilities and challenges. Health Promot Int. 2001;16:197–205.CrossRef St. Leger L. Schools, health literacy and public health: possibilities and challenges. Health Promot Int. 2001;16:197–205.CrossRef
11.
go back to reference Rowling L, Jeffreys V. Capturing complexity: integrating health and education research to inform helath-promoting schools policy and practice. Health Educ Res. 2006;21:705–18.CrossRef Rowling L, Jeffreys V. Capturing complexity: integrating health and education research to inform helath-promoting schools policy and practice. Health Educ Res. 2006;21:705–18.CrossRef
12.
go back to reference Inchley J, Muldoon J, Currie C. Becoming a health promoting school: evaluating the process of effective implementation in Scotland. Health Promot Int. 2007;22:65–71.CrossRef Inchley J, Muldoon J, Currie C. Becoming a health promoting school: evaluating the process of effective implementation in Scotland. Health Promot Int. 2007;22:65–71.CrossRef
13.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655.CrossRef Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655.CrossRef
14.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRef Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRef
15.
go back to reference Lendrum A, Humphrey N. The importance of studying the implementation of interventions in school settings. Oxford Rev Educ. 2012;38:635–52.CrossRef Lendrum A, Humphrey N. The importance of studying the implementation of interventions in school settings. Oxford Rev Educ. 2012;38:635–52.CrossRef
16.
go back to reference Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2005;20:308–13.CrossRef Dusenbury L, Brannigan R, Hansen WB, Walsh J, Falco M. Quality of implementation: developing measures crucial to understanding the diffusion of preventive interventions. Health Educ Res. 2005;20:308–13.CrossRef
17.
go back to reference Linnan L, Steckler A. Process evaluation for public health interventions and research: an overview. In: Steckler A, Linnan L, editors. Process evaluation for public health interventions and research. San Francisco: Jossey-Bass; 2002. p. 1–23. Linnan L, Steckler A. Process evaluation for public health interventions and research: an overview. In: Steckler A, Linnan L, editors. Process evaluation for public health interventions and research. San Francisco: Jossey-Bass; 2002. p. 1–23.
18.
go back to reference Durlak JA, Dupre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRef Durlak JA, Dupre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRef
19.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.CrossRef Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.CrossRef
20.
go back to reference Bonde AH, Bruselius-Jensen M. Is it feasible to use students’ self-reported step data in a local school policy process? Health Behav Policy Rev. 2017;4:531–8.CrossRef Bonde AH, Bruselius-Jensen M. Is it feasible to use students’ self-reported step data in a local school policy process? Health Behav Policy Rev. 2017;4:531–8.CrossRef
21.
go back to reference Bruselius-Jensen M, Bonde AH, Christensen JH. Promoting health literacy in the classroom. Health Educ J. 2016;76:156–68.CrossRef Bruselius-Jensen M, Bonde AH, Christensen JH. Promoting health literacy in the classroom. Health Educ J. 2016;76:156–68.CrossRef
22.
go back to reference Sabinsky MS, Bonde AH, Stjernqvist NW, Jessen-Klixbüll E, Maindal HT, Tetens I. The “We Act”-study: design of a multicomponent intervention to promote healthy diet, physical activity, and well-being in school children. J Food Nutrit Res. 2018;6:602–13. https://doi.org/10.12691/jfnr-6-x-x.CrossRef Sabinsky MS, Bonde AH, Stjernqvist NW, Jessen-Klixbüll E, Maindal HT, Tetens I. The “We Act”-study: design of a multicomponent intervention to promote healthy diet, physical activity, and well-being in school children. J Food Nutrit Res. 2018;6:602–13. https://​doi.​org/​10.​12691/​jfnr-6-x-x.CrossRef
23.
go back to reference Domitrovich CE, Bradshaw CP, Poduska JM, Hoagwood K, Buckley JA, Olin S, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv Sch Ment Health Promot. 2008;1:6–28.CrossRef Domitrovich CE, Bradshaw CP, Poduska JM, Hoagwood K, Buckley JA, Olin S, et al. Maximizing the implementation quality of evidence-based preventive interventions in schools: a conceptual framework. Adv Sch Ment Health Promot. 2008;1:6–28.CrossRef
24.
go back to reference Creswell JW. Research design. Qualitative, quantitative and mixed methods approaches. 2nd ed. Thousand Oaks: Sage; 2003. Creswell JW. Research design. Qualitative, quantitative and mixed methods approaches. 2nd ed. Thousand Oaks: Sage; 2003.
25.
go back to reference Green J, Thorogood N. Qualitative methods for health research. 3rd ed. London: Sage; 2014. Green J, Thorogood N. Qualitative methods for health research. 3rd ed. London: Sage; 2014.
26.
go back to reference Tashakkori A, Teddlie C. Handbook of mixed methods in social and behavioural sciences. Thousand Oaks: Sage; 2003. Tashakkori A, Teddlie C. Handbook of mixed methods in social and behavioural sciences. Thousand Oaks: Sage; 2003.
27.
go back to reference Pike J, Ioannou S. Evaluating school-community health in Cyprus. Health Promot Int. 2017;32:185–94.CrossRef Pike J, Ioannou S. Evaluating school-community health in Cyprus. Health Promot Int. 2017;32:185–94.CrossRef
28.
go back to reference Rowling L, Samdal O. Filling the black box of implementation for health-promoting schools. Health Educ. 2011;111:347–62.CrossRef Rowling L, Samdal O. Filling the black box of implementation for health-promoting schools. Health Educ. 2011;111:347–62.CrossRef
29.
go back to reference Macnab AJ, Gagnon FA, Stewart D. Health promoting schools: consensus, strategies, and potential. Health Educ. 2014;114:170–85.CrossRef Macnab AJ, Gagnon FA, Stewart D. Health promoting schools: consensus, strategies, and potential. Health Educ. 2014;114:170–85.CrossRef
30.
go back to reference Schneller MB, Duncan S, Schipperijn J, Nielsen G, Mygind E, Bentsen P. Are children participating in a quasi-experimental education outside the classroom intervention more physically active? BMC Public Health. 2017;17:523.CrossRef Schneller MB, Duncan S, Schipperijn J, Nielsen G, Mygind E, Bentsen P. Are children participating in a quasi-experimental education outside the classroom intervention more physically active? BMC Public Health. 2017;17:523.CrossRef
31.
go back to reference Boot N, van Assema P, Hesdahl B, de Vries N. Professional assistance in implementing school health policies. Health Educ. 2010;110:294–308.CrossRef Boot N, van Assema P, Hesdahl B, de Vries N. Professional assistance in implementing school health policies. Health Educ. 2010;110:294–308.CrossRef
32.
go back to reference Langford R, Bonell C, Jones H, Campbell R. Obesity prevention and the health promoting schools framework: essential components and barriers to success. Int J Behav Nutr Phys Act. 2015;12:15.CrossRef Langford R, Bonell C, Jones H, Campbell R. Obesity prevention and the health promoting schools framework: essential components and barriers to success. Int J Behav Nutr Phys Act. 2015;12:15.CrossRef
33.
go back to reference Persson L, Haraldsson K. Health promotion in Swedish schools: school managers’ views. Health Promot Int. 2017;32:231–40.CrossRef Persson L, Haraldsson K. Health promotion in Swedish schools: school managers’ views. Health Promot Int. 2017;32:231–40.CrossRef
34.
go back to reference Simovska V, Nordin LL, Madsen KD. Health promotion in Danish schools: local priorities, policies and practices. Health Promot Int. 2016;31:480–9.CrossRef Simovska V, Nordin LL, Madsen KD. Health promotion in Danish schools: local priorities, policies and practices. Health Promot Int. 2016;31:480–9.CrossRef
35.
go back to reference Jørgensen TS, Krølner R, Aarestrup AK, Tjørnhøj-Thomsen T, Due P, Rasmussen M. Barriers and facilitators for teachers’ implementation of the curricular component of the boost intervention targeting adolescents’ fruit and vegetable intake. J Nutr Educ Behav. 2014;46:e1–8.CrossRef Jørgensen TS, Krølner R, Aarestrup AK, Tjørnhøj-Thomsen T, Due P, Rasmussen M. Barriers and facilitators for teachers’ implementation of the curricular component of the boost intervention targeting adolescents’ fruit and vegetable intake. J Nutr Educ Behav. 2014;46:e1–8.CrossRef
36.
go back to reference Jorgensen SE, Jorgensen TS, Aarestrup AK, Due P, Krolner R. Parental involvement and association with adolescents’ fruit and vegetable intake at follow-up: process evaluation results from the multi-component school-based boost intervention. Int J Behav Nutr Phys Act. 2016;13:112.CrossRef Jorgensen SE, Jorgensen TS, Aarestrup AK, Due P, Krolner R. Parental involvement and association with adolescents’ fruit and vegetable intake at follow-up: process evaluation results from the multi-component school-based boost intervention. Int J Behav Nutr Phys Act. 2016;13:112.CrossRef
37.
Metadata
Title
Process evaluation of implementation fidelity in a Danish health-promoting school intervention
Authors
Ane Høstgaard Bonde
Nanna Wurr Stjernqvist
Marianne S. Sabinsky
Helle Terkildsen Maindal
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2018
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-018-6289-5

Other articles of this Issue 1/2018

BMC Public Health 1/2018 Go to the issue