Skip to main content
Top
Published in: BMC Public Health 1/2019

Open Access 01-12-2019 | Research article

Process evaluation of the Healthy Primary School of the Future: the key learning points

Authors: N. H. M. Bartelink, P. van Assema, M. W. J. Jansen, H. H. C. M. Savelberg, G. F. Moore, J. Hawkins, S. P. J. Kremers

Published in: BMC Public Health | Issue 1/2019

Login to get access

Abstract

Background

While schools have potential to contribute to children’s health and healthy behaviour, embedding health promotion within complex school systems is challenging. The ‘Healthy Primary School of the Future’ (HPSF) is an initiative that aims to integrate health and well-being into school systems. Central to HPSF are two top-down changes that are hypothesized as being positively disruptive to the Dutch school system: daily free healthy lunches and structured physical activity sessions. These changes are expected to create momentum for bottom-up processes leading to additional health-promoting changes. Using a programme theory, this paper explores the processes through which HPSF and the school context adapt to one another. The aim is to generate and share knowledge and experiences on how to implement changes in the complex school system to integrate school health promotion.

Methods

The current study involved a mixed methods process evaluation with a contextual action-oriented research approach. The processes of change were investigated in four Dutch primary schools during the development year (2014–2015) and the first two years of implementation (2015–2017) of HPSF. The schools (each with 15–26 teachers and 233–389 children) were in low socio-economic status areas. Measurements included interviews, questionnaires, observations, and analysis of minutes of meetings.

Results

Top-down advice, combined with bottom-up involvement and external practical support were key facilitators in embedding HPSF within the schools’ contexts. Sufficient coordination and communication at the school level, team cohesion, and feedback loops enhanced implementation of the changes. Implementation of the healthy lunch appeared to be disruptive and create momentum for additional health-promoting changes.

Conclusions

Initiating highly visible positive disruptions to improve school health can act as a catalyst for wider school health promotion efforts. Conditions to create a positive disruption are enough time, and sufficient bottom-up involvement, external support, team cohesion and coordination. The focus should be on each specific school, as each school has their own starting point and process of change.

Trial registration

The study was retrospectively registered in the ClinicalTrials.​gov database on 14 June 2016 (NCT02800616).
Appendix
Available only for authorised users
Literature
1.
go back to reference Dooris M, Poland B, Kolbe L, De Leeuw E, McCall DS, Wharf-Higgins J. Healthy settings. Global perspectives on health promotion effectiveness. Springer: Berlin; 2007. p. 327–52.CrossRef Dooris M, Poland B, Kolbe L, De Leeuw E, McCall DS, Wharf-Higgins J. Healthy settings. Global perspectives on health promotion effectiveness. Springer: Berlin; 2007. p. 327–52.CrossRef
2.
go back to reference Langford R, Campbell R, Magnus D, Bonell CP, Murphy SM, Waters E, et al. The WHO health promoting school framework for improving the health and well-being of students and staff. Cochrane Database Syst Rev. 2011;1. Langford R, Campbell R, Magnus D, Bonell CP, Murphy SM, Waters E, et al. The WHO health promoting school framework for improving the health and well-being of students and staff. Cochrane Database Syst Rev. 2011;1.
3.
go back to reference Bonell C, Parry W, Wells H, Jamal F, Fletcher A, Harden A, et al. The effects of the school environment on student health: a systematic review of multi-level studies. Health Place. 2013;21:180–91.CrossRefPubMed Bonell C, Parry W, Wells H, Jamal F, Fletcher A, Harden A, et al. The effects of the school environment on student health: a systematic review of multi-level studies. Health Place. 2013;21:180–91.CrossRefPubMed
4.
go back to reference Suhrcke M, de Paz Nieves C. The impact of health and health behaviours on educational outcomes in high-income countries: a review of the evidence: World Health Organization. Denmark: Regional Office for Europe Copenhagen; 2011. Suhrcke M, de Paz Nieves C. The impact of health and health behaviours on educational outcomes in high-income countries: a review of the evidence: World Health Organization. Denmark: Regional Office for Europe Copenhagen; 2011.
5.
go back to reference Fiscella K, Kitzman H Disparities in academic achievement and health: the intersection of child education and health policy. Pediatrics. 2009;123(3):1073–1080.CrossRefPubMed Fiscella K, Kitzman H Disparities in academic achievement and health: the intersection of child education and health policy. Pediatrics. 2009;123(3):1073–1080.CrossRefPubMed
6.
go back to reference Leurs MT, Schaalma HP, Jansen MW, Mur-Veeman IM, St. Leger LH, De Vries N. Development of a collaborative model to improve school health promotion in the Netherlands. Health Promot Int. 2005;20(3):296–305.CrossRefPubMed Leurs MT, Schaalma HP, Jansen MW, Mur-Veeman IM, St. Leger LH, De Vries N. Development of a collaborative model to improve school health promotion in the Netherlands. Health Promot Int. 2005;20(3):296–305.CrossRefPubMed
7.
go back to reference WHO. Promoting health through schools: report of a WHO expert committee on comprehensive school health education and promotion. 1997. WHO. Promoting health through schools: report of a WHO expert committee on comprehensive school health education and promotion. 1997.
8.
go back to reference WHO. Health promoting schools: A framework for action. Manila, Philippines: World Health Organization Western Pacific Region. 2009. WHO. Health promoting schools: A framework for action. Manila, Philippines: World Health Organization Western Pacific Region. 2009.
9.
go back to reference Deschesnes M, Martin C, Hill AJ. Comprehensive approaches to school health promotion: how to achieve broader implementation? Health Promot Int. 2003;18(4):387–96.CrossRefPubMed Deschesnes M, Martin C, Hill AJ. Comprehensive approaches to school health promotion: how to achieve broader implementation? Health Promot Int. 2003;18(4):387–96.CrossRefPubMed
10.
go back to reference Darlington EJ, Violon N, Jourdan D. Implementation of health promotion programmes in schools: an approach to understand the influence of contextual factors on the process? BMC Public Health. 2018;18(1):163.CrossRefPubMedPubMedCentral Darlington EJ, Violon N, Jourdan D. Implementation of health promotion programmes in schools: an approach to understand the influence of contextual factors on the process? BMC Public Health. 2018;18(1):163.CrossRefPubMedPubMedCentral
11.
go back to reference Keshavarz N, Nutbeam D, Rowling L, Khavarpour F. Schools as social complex adaptive systems: a new way to understand the challenges of introducing the health promoting schools concept. Soc Sci Med. 2010;70(10):1467–74.CrossRefPubMed Keshavarz N, Nutbeam D, Rowling L, Khavarpour F. Schools as social complex adaptive systems: a new way to understand the challenges of introducing the health promoting schools concept. Soc Sci Med. 2010;70(10):1467–74.CrossRefPubMed
12.
go back to reference Schaap R, Bessems K, Otten R, Kremers S, van Nassau F. Measuring implementation fidelity of school-based obesity prevention programmes: a systematic review. Int J Behav Nutr Phys Act. 2018;15(1):75.CrossRefPubMedPubMedCentral Schaap R, Bessems K, Otten R, Kremers S, van Nassau F. Measuring implementation fidelity of school-based obesity prevention programmes: a systematic review. Int J Behav Nutr Phys Act. 2018;15(1):75.CrossRefPubMedPubMedCentral
13.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral
14.
go back to reference Owen B, Brown AD, Kuhlberg J, Millar L, Nichols M, Economos C, et al. Understanding a successful obesity prevention initiative in children under 5 from a systems perspective. PLoS One. 2018;13(3):e0195141.CrossRefPubMedPubMedCentral Owen B, Brown AD, Kuhlberg J, Millar L, Nichols M, Economos C, et al. Understanding a successful obesity prevention initiative in children under 5 from a systems perspective. PLoS One. 2018;13(3):e0195141.CrossRefPubMedPubMedCentral
15.
go back to reference Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Commun Psychol. 2009;43(3–4):267–76.CrossRef Hawe P, Shiell A, Riley T. Theorising interventions as events in systems. Am J Commun Psychol. 2009;43(3–4):267–76.CrossRef
16.
go back to reference Mason M. What is complexity theory and what are its implications for educational change? Educ Philos Theory. 2008;40(1):35–49.CrossRef Mason M. What is complexity theory and what are its implications for educational change? Educ Philos Theory. 2008;40(1):35–49.CrossRef
17.
go back to reference Gubbels JS, Van Kann DH, de Vries NK, Thijs C, Kremers SP. The next step in health behavior research: the need for ecological moderation analyses-an application to diet and physical activity at childcare. Int J Behav Nutr Phys Act. 2014;11(1):52.CrossRefPubMedPubMedCentral Gubbels JS, Van Kann DH, de Vries NK, Thijs C, Kremers SP. The next step in health behavior research: the need for ecological moderation analyses-an application to diet and physical activity at childcare. Int J Behav Nutr Phys Act. 2014;11(1):52.CrossRefPubMedPubMedCentral
18.
go back to reference Young I, St Leger L, Buijs G. School health promotion: evidence for effective action. Background paper SHE factsheet. 2013;2. Young I, St Leger L, Buijs G. School health promotion: evidence for effective action. Background paper SHE factsheet. 2013;2.
19.
go back to reference Willeboordse M, Jansen M, van den Heijkant S, Simons A, Winkens B, de Groot R, et al. The healthy primary School of the Future: study protocol of a quasi-experimental study. BMC Public Health. 2016;16(1):1. Willeboordse M, Jansen M, van den Heijkant S, Simons A, Winkens B, de Groot R, et al. The healthy primary School of the Future: study protocol of a quasi-experimental study. BMC Public Health. 2016;16(1):1.
20.
go back to reference Hawe P. Lessons from complex interventions to improve health. Annu Rev Public Health. 2015;36:307–23.CrossRefPubMed Hawe P. Lessons from complex interventions to improve health. Annu Rev Public Health. 2015;36:307–23.CrossRefPubMed
21.
go back to reference Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011. Patton MQ. Developmental evaluation: applying complexity concepts to enhance innovation and use. New York: Guilford Press; 2011.
22.
go back to reference Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood DT, et al. The need for a complex systems model of evidence for public health. Lancet 2017. Rutter H, Savona N, Glonti K, Bibby J, Cummins S, Finegood DT, et al. The need for a complex systems model of evidence for public health. Lancet 2017.
23.
go back to reference Bartelink NH, van Assema P, Jansen MW, Savelberg HH, Willeboordse M, Kremers SP. The healthy primary School of the Future: a contextual action-oriented research approach. Int J Environ Res Public Health. 2018;15(10):2243.CrossRefPubMedCentral Bartelink NH, van Assema P, Jansen MW, Savelberg HH, Willeboordse M, Kremers SP. The healthy primary School of the Future: a contextual action-oriented research approach. Int J Environ Res Public Health. 2018;15(10):2243.CrossRefPubMedCentral
24.
go back to reference Poland B, Krupa G, McCall D. Settings for health promotion: an analytic framework to guide intervention design and implementation. Health Promot Pract. 2009;10(4):505–16.CrossRefPubMed Poland B, Krupa G, McCall D. Settings for health promotion: an analytic framework to guide intervention design and implementation. Health Promot Pract. 2009;10(4):505–16.CrossRefPubMed
25.
go back to reference Fleuren MA, Paulussen TG, Van Dommelen P, Van Buuren S. Towards a measurement instrument for determinants of innovations. Int J Qual Health C. 2014;26(5):501–10.CrossRef Fleuren MA, Paulussen TG, Van Dommelen P, Van Buuren S. Towards a measurement instrument for determinants of innovations. Int J Qual Health C. 2014;26(5):501–10.CrossRef
26.
go back to reference Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRefPubMedPubMedCentral Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRefPubMedPubMedCentral
27.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):1.CrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):1.CrossRef
28.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRefPubMed Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRefPubMed
29.
go back to reference Pearson M, Chilton R, Wyatt K, Abraham C, Ford T, Woods HB, et al. Implementing health promotion programmes in schools: a realist systematic review of research and experience in the United Kingdom. Implement Sci. 2015;10(1):149.CrossRefPubMedPubMedCentral Pearson M, Chilton R, Wyatt K, Abraham C, Ford T, Woods HB, et al. Implementing health promotion programmes in schools: a realist systematic review of research and experience in the United Kingdom. Implement Sci. 2015;10(1):149.CrossRefPubMedPubMedCentral
30.
go back to reference Moore GF, Evans RE, Hawkins J, Littlecott H, Melendez-Torres G, Bonell C, et al. From complex social interventions to interventions in complex social systems: future directions and unresolved questions for intervention development and evaluation. Evaluation. 2019;25(1):23–45.CrossRefPubMed Moore GF, Evans RE, Hawkins J, Littlecott H, Melendez-Torres G, Bonell C, et al. From complex social interventions to interventions in complex social systems: future directions and unresolved questions for intervention development and evaluation. Evaluation. 2019;25(1):23–45.CrossRefPubMed
31.
go back to reference Van Kann DH, Jansen M, De Vries S, De Vries N, Kremers S. Active living: development and quasi-experimental evaluation of a school-centered physical activity intervention for primary school children. BMC Public Health. 2015;15(1):1315.CrossRefPubMedPubMedCentral Van Kann DH, Jansen M, De Vries S, De Vries N, Kremers S. Active living: development and quasi-experimental evaluation of a school-centered physical activity intervention for primary school children. BMC Public Health. 2015;15(1):1315.CrossRefPubMedPubMedCentral
32.
go back to reference Schils T. Leerlingen in het voortgezet onderwijs: wie zitten daar? Hoe zitten ze in hun vel? Hoe slim zijn ze? [Pupils in secondary education: who are they? What is their sense of self-worth? How smart are they?] Kaans reports K04201102-K04201104. Maastricht: Kaans/Maastricht University School of business and economics; 2011. Schils T. Leerlingen in het voortgezet onderwijs: wie zitten daar? Hoe zitten ze in hun vel? Hoe slim zijn ze? [Pupils in secondary education: who are they? What is their sense of self-worth? How smart are they?] Kaans reports K04201102-K04201104. Maastricht: Kaans/Maastricht University School of business and economics; 2011.
33.
go back to reference Vermeer AJMBN, Hesdahl MH, Janssen-Goffin MJH, Linssen ECAJ, Rutten N, Hajema KJ. Lokale rapporten Volksgezondheid Toekomst Verkenning: Een nieuwe kijk op gezondheid in Heerlen, Kerkrade, Landgraaf en Brunssum; [Local reports on Public Health Development: A new perspective on health in Heerlen, Kerkrade, Landgraaf and Brunssum]. GGD Zuid Limburg: Geleen; 2014. Vermeer AJMBN, Hesdahl MH, Janssen-Goffin MJH, Linssen ECAJ, Rutten N, Hajema KJ. Lokale rapporten Volksgezondheid Toekomst Verkenning: Een nieuwe kijk op gezondheid in Heerlen, Kerkrade, Landgraaf en Brunssum; [Local reports on Public Health Development: A new perspective on health in Heerlen, Kerkrade, Landgraaf and Brunssum]. GGD Zuid Limburg: Geleen; 2014.
34.
go back to reference Gevers D, Kremers S, de Vries N, van Assema P. The comprehensive snack parenting questionnaire (CSPQ): development and test-retest reliability. Int J Env Res Pub He 2018;15(5).CrossRefPubMedCentral Gevers D, Kremers S, de Vries N, van Assema P. The comprehensive snack parenting questionnaire (CSPQ): development and test-retest reliability. Int J Env Res Pub He 2018;15(5).CrossRefPubMedCentral
35.
go back to reference O’Connor TM, Cerin E, Hughes SO, Robles J, Thompson DI, Mendoza JA, et al. Psychometrics of the preschooler physical activity parenting practices instrument among a Latino sample. Int J Behav Nutr Phys Act. 2014;11(1):3.CrossRefPubMedPubMedCentral O’Connor TM, Cerin E, Hughes SO, Robles J, Thompson DI, Mendoza JA, et al. Psychometrics of the preschooler physical activity parenting practices instrument among a Latino sample. Int J Behav Nutr Phys Act. 2014;11(1):3.CrossRefPubMedPubMedCentral
36.
go back to reference Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.CrossRef
37.
go back to reference Lipsey MW. Design sensitivity: statistical power for experimental research. Pugey: Sage, 1990. Lipsey MW. Design sensitivity: statistical power for experimental research. Pugey: Sage, 1990. 
38.
go back to reference Shinde S, Weiss HA, Varghese B, Khandeparkar P, Pereira B, Sharma A, et al. Promoting school climate and health outcomes with the SEHER multi-component secondary school intervention in Bihar, India: a cluster-randomised controlled trial. Lancet. 2018;392(10163):2465–77.CrossRefPubMed Shinde S, Weiss HA, Varghese B, Khandeparkar P, Pereira B, Sharma A, et al. Promoting school climate and health outcomes with the SEHER multi-component secondary school intervention in Bihar, India: a cluster-randomised controlled trial. Lancet. 2018;392(10163):2465–77.CrossRefPubMed
39.
go back to reference Gubbels JS, Gerards SM, Kremers SP. Use of food practices by childcare staff and the association with dietary intake of children at childcare. Nutrients. 2015;7(4):2161–75.CrossRefPubMedPubMedCentral Gubbels JS, Gerards SM, Kremers SP. Use of food practices by childcare staff and the association with dietary intake of children at childcare. Nutrients. 2015;7(4):2161–75.CrossRefPubMedPubMedCentral
40.
go back to reference Boonen A, de Vries N, de Ruiter S, Bowker S, Buijs G. HEPS Guidelines. NIGZ, Woerden, The Netherlands: Guidelines on Promoting Healthy Eating and Physical Activity in Schools; 2009. Boonen A, de Vries N, de Ruiter S, Bowker S, Buijs G. HEPS Guidelines. NIGZ, Woerden, The Netherlands: Guidelines on Promoting Healthy Eating and Physical Activity in Schools; 2009.
Metadata
Title
Process evaluation of the Healthy Primary School of the Future: the key learning points
Authors
N. H. M. Bartelink
P. van Assema
M. W. J. Jansen
H. H. C. M. Savelberg
G. F. Moore
J. Hawkins
S. P. J. Kremers
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2019
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-019-6947-2

Other articles of this Issue 1/2019

BMC Public Health 1/2019 Go to the issue