Skip to main content
Top
Published in: BMC Public Health 1/2010

Open Access 01-12-2010 | Study protocol

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

Authors: Jeanine Pommier, Marie-Renée Guével, Didier Jourdan

Published in: BMC Public Health | Issue 1/2010

Login to get access

Abstract

Background

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated.

Methods/Design

The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed.

Discussion

This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hamel M, Blanchet L, Martin C: 6, 12, 17 Nous serons bien mieux! Les déterminants de la santé et du bien-être des enfants d'âge scolaire. 2001, Québec: Publications du Québec Hamel M, Blanchet L, Martin C: 6, 12, 17 Nous serons bien mieux! Les déterminants de la santé et du bien-être des enfants d'âge scolaire. 2001, Québec: Publications du Québec
2.
go back to reference St Leger L, Kolbe L, Lee A, McCall DS, Young IM: School health promotion: Achievments, Challenges and Priorities. Global perspectives on health promotion effectiveness. Edited by: McQueen DV, Jones CM. 2007, Saint-Denis: Springer, 107-124. full_text.CrossRef St Leger L, Kolbe L, Lee A, McCall DS, Young IM: School health promotion: Achievments, Challenges and Priorities. Global perspectives on health promotion effectiveness. Edited by: McQueen DV, Jones CM. 2007, Saint-Denis: Springer, 107-124. full_text.CrossRef
3.
go back to reference Li J, Mattes E, Stanley F, McMurray A, Hertzman C: Social determinants of child health and well-being. Health Sociology Review. 2009, 18: 3-11. 10.5172/hesr.18.1.3.CrossRef Li J, Mattes E, Stanley F, McMurray A, Hertzman C: Social determinants of child health and well-being. Health Sociology Review. 2009, 18: 3-11. 10.5172/hesr.18.1.3.CrossRef
4.
go back to reference WHO: Health promotion evaluation: recommendations to policy-makers. Geneva. 1998 WHO: Health promotion evaluation: recommendations to policy-makers. Geneva. 1998
5.
go back to reference Rootman I, Goodstadt M, Potvin L, Springett J: A framework for health promotion evaluation. Evaluation in health promotion. Edited by: Rootman I, Goodstadt M, Hyndman B, McQueen DV, Potvin L, Springett J, et al. 2001, Denmark: WHO Regional Publications, 7-38. Rootman I, Goodstadt M, Potvin L, Springett J: A framework for health promotion evaluation. Evaluation in health promotion. Edited by: Rootman I, Goodstadt M, Hyndman B, McQueen DV, Potvin L, Springett J, et al. 2001, Denmark: WHO Regional Publications, 7-38.
6.
go back to reference Merzel C, D'Afflitti J: Reconsidering community-based health promotion: promise, performance, and potential. American Journal of Public Health. 2003, 93: 557-574. 10.2105/AJPH.93.4.557.CrossRefPubMedPubMedCentral Merzel C, D'Afflitti J: Reconsidering community-based health promotion: promise, performance, and potential. American Journal of Public Health. 2003, 93: 557-574. 10.2105/AJPH.93.4.557.CrossRefPubMedPubMedCentral
7.
go back to reference Nutbeam D: Evaluating health promotion - progress, problems and solutions. Health Promotion International. 1998, 13: 27-44. 10.1093/heapro/13.1.27.CrossRef Nutbeam D: Evaluating health promotion - progress, problems and solutions. Health Promotion International. 1998, 13: 27-44. 10.1093/heapro/13.1.27.CrossRef
8.
go back to reference Tones K, Tilford S: Health promotion: effectiveness, efficiency and equity. 2001, Cheltenham: Nelson Thornes, 3 Tones K, Tilford S: Health promotion: effectiveness, efficiency and equity. 2001, Cheltenham: Nelson Thornes, 3
9.
go back to reference Potvin L, Bilodeau A, Gendron S: Trois défis pour l'évaluation en promotion de la santé. Promotion & Education. 2008, 15: 17-21.CrossRef Potvin L, Bilodeau A, Gendron S: Trois défis pour l'évaluation en promotion de la santé. Promotion & Education. 2008, 15: 17-21.CrossRef
10.
go back to reference Rosen L, Manor O, Engelhard D, Zucker D: In defense of the randomized controlled trial for health promotion research. American Journal of Public Health. 2006, 96: 1181-1186. 10.2105/AJPH.2004.061713.CrossRefPubMedPubMedCentral Rosen L, Manor O, Engelhard D, Zucker D: In defense of the randomized controlled trial for health promotion research. American Journal of Public Health. 2006, 96: 1181-1186. 10.2105/AJPH.2004.061713.CrossRefPubMedPubMedCentral
11.
go back to reference Chen HT, Rossi PH: Evaluating with sense - The theory driven approach. Evaluation Review. 1983, 7: 283-302. 10.1177/0193841X8300700301.CrossRef Chen HT, Rossi PH: Evaluating with sense - The theory driven approach. Evaluation Review. 1983, 7: 283-302. 10.1177/0193841X8300700301.CrossRef
12.
go back to reference Guba EG, Lincoln YS: Fourth generation evaluation. 1989, Newbury Park: Sage Publications Guba EG, Lincoln YS: Fourth generation evaluation. 1989, Newbury Park: Sage Publications
13.
go back to reference Allard D, Bilodeau A, Gendron S: Figurative thinking and models: tools for participatory evaluation. Health promotion evaluation practices in the Americas - Values and Research. Edited by: Potvin L, McQueen DV. 2008, New York: Springer, 123-147.CrossRef Allard D, Bilodeau A, Gendron S: Figurative thinking and models: tools for participatory evaluation. Health promotion evaluation practices in the Americas - Values and Research. Edited by: Potvin L, McQueen DV. 2008, New York: Springer, 123-147.CrossRef
14.
go back to reference Fetterman DM, Wandersman A: Empowerment evaluation principles in practice. 2005, New York: The Guilford Press Fetterman DM, Wandersman A: Empowerment evaluation principles in practice. 2005, New York: The Guilford Press
15.
go back to reference Hills MD, Carroll S, O'Neill M: Vers un modèle d'évaluation de l'efficacité des interventions communautaires en promotion de la santé: compte-rendu de quelques développements nord-américains récents. Promotion & Education. 2004, 11: 17-21.CrossRef Hills MD, Carroll S, O'Neill M: Vers un modèle d'évaluation de l'efficacité des interventions communautaires en promotion de la santé: compte-rendu de quelques développements nord-américains récents. Promotion & Education. 2004, 11: 17-21.CrossRef
16.
go back to reference Pawson R, Tilley N: Realistic evaluation. 1997, London: Sage Publications Pawson R, Tilley N: Realistic evaluation. 1997, London: Sage Publications
17.
go back to reference Morse JM: Principles of mixed methods and multimethod. Handbook of mixed methods in social and behavioral research. Edited by: Tashakkori A, Teddlie C. 2003, Thousand Oaks: Sage Publications, 189-208. Morse JM: Principles of mixed methods and multimethod. Handbook of mixed methods in social and behavioral research. Edited by: Tashakkori A, Teddlie C. 2003, Thousand Oaks: Sage Publications, 189-208.
18.
go back to reference Creswell JW, Plano Clark VL: Designing and conducting mixed methods research. 2007, Thousand Oaks: Sage Publications Creswell JW, Plano Clark VL: Designing and conducting mixed methods research. 2007, Thousand Oaks: Sage Publications
19.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vanderbrouke JP, et al: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Bulletin of the World Health Organisation. 2007, 85: 867-872.CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vanderbrouke JP, et al: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Bulletin of the World Health Organisation. 2007, 85: 867-872.CrossRef
20.
go back to reference Newman I, Ridenour CS, Newman C, DeMarco GMPJr: A Typology of Research Purposes and its Relationship to Mixed Methods. Handbook of mixed methods in social & behavioral research. Edited by: Tashakkori A, Teddlie C. 2003, Thousand Oaks: SAGE Publications, 167-188. Newman I, Ridenour CS, Newman C, DeMarco GMPJr: A Typology of Research Purposes and its Relationship to Mixed Methods. Handbook of mixed methods in social & behavioral research. Edited by: Tashakkori A, Teddlie C. 2003, Thousand Oaks: SAGE Publications, 167-188.
21.
go back to reference Pommier J, Jourdan D: La santé à l'école dans les pays européens. 2007, Paris: Sudel Pommier J, Jourdan D: La santé à l'école dans les pays européens. 2007, Paris: Sudel
22.
go back to reference Jourdan D, Piec I, Aublet-Cuvelier B, Berger D, Lejeune ML, Laquet-Riffaud A, et al: Education à la santé à l'école: pratiques et représentations des enseignants du primaire. Santé Publique. 2002, 14: 403-423. 10.3917/spub.024.0403.CrossRefPubMed Jourdan D, Piec I, Aublet-Cuvelier B, Berger D, Lejeune ML, Laquet-Riffaud A, et al: Education à la santé à l'école: pratiques et représentations des enseignants du primaire. Santé Publique. 2002, 14: 403-423. 10.3917/spub.024.0403.CrossRefPubMed
23.
go back to reference Simar C, Jourdan D: Education et santé: étude de l'impact d'un dispositif de formation et d'accompagnement sur l'implication des enseignants dans une démarche de promotion de la santé. Revue Recherches et Educations. 2009, 3: Simar C, Jourdan D: Education et santé: étude de l'impact d'un dispositif de formation et d'accompagnement sur l'implication des enseignants dans une démarche de promotion de la santé. Revue Recherches et Educations. 2009, 3:
24.
go back to reference Mérini C, Victor P, Bizzoni-Prévieux C: Through a functioning typology in the school teams. Partnership in education. Theoretical approach and case studies/Le partenariat en éducation. Approache théorique et études de cas. Edited by: Masson P, Pilo M. 2009, Lille: Book, 19-31. Mérini C, Victor P, Bizzoni-Prévieux C: Through a functioning typology in the school teams. Partnership in education. Theoretical approach and case studies/Le partenariat en éducation. Approache théorique et études de cas. Edited by: Masson P, Pilo M. 2009, Lille: Book, 19-31.
25.
go back to reference Knowlton LW, Phillips CC: The logic model guidebook - Better strategies for great results. 2009, Thousand Oaks: Sage Publications Knowlton LW, Phillips CC: The logic model guidebook - Better strategies for great results. 2009, Thousand Oaks: Sage Publications
26.
go back to reference Goigoux R: Un modèle d'analyse des activités des enseignants. Education et didactique. 2007, 3: 3-11. Goigoux R: Un modèle d'analyse des activités des enseignants. Education et didactique. 2007, 3: 3-11.
27.
go back to reference Schoonbroodt C, Gélinas A: Envisager la prévention par le changement émergent: apprendre à gérer ce qui fait problème. Education santé. 1996, 108: 3-10. Schoonbroodt C, Gélinas A: Envisager la prévention par le changement émergent: apprendre à gérer ce qui fait problème. Education santé. 1996, 108: 3-10.
28.
go back to reference WHO: Life skills education in school. 1993, Geneva: WHO WHO: Life skills education in school. 1993, Geneva: WHO
29.
go back to reference Tashakkori A, Teddlie C: Handbook of mixed methods in social and behavioral research. 2003, Thousand Oaks: Sage Publications Tashakkori A, Teddlie C: Handbook of mixed methods in social and behavioral research. 2003, Thousand Oaks: Sage Publications
30.
go back to reference Jourdan D, Pommier J, Quidu F: Practices and representations of school health education among primary school teachers. Scandinavian Journal of Public Health. 2009 Jourdan D, Pommier J, Quidu F: Practices and representations of school health education among primary school teachers. Scandinavian Journal of Public Health. 2009
31.
go back to reference Bartlett JE, Kotrlik JW, Higgins CC: Oragnizational research: determining appropriate sample size in survey research. Information Technology, Learning, and Performance Journal. 2001, 19: 43-50. Bartlett JE, Kotrlik JW, Higgins CC: Oragnizational research: determining appropriate sample size in survey research. Information Technology, Learning, and Performance Journal. 2001, 19: 43-50.
32.
go back to reference Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 2008, Philadelphia: Lippincott Williams & Wilkins, 3 Rothman KJ, Greenland S, Lash TL: Modern Epidemiology. 2008, Philadelphia: Lippincott Williams & Wilkins, 3
33.
go back to reference Hardy M, Bryman A: The handbook of data analysis. 2004, London: Sage PublicationsCrossRef Hardy M, Bryman A: The handbook of data analysis. 2004, London: Sage PublicationsCrossRef
34.
go back to reference Debarbieux E: La violence en milieu scolaire, Tome 1. 1996, Nanterre: ESF éditeur Debarbieux E: La violence en milieu scolaire, Tome 1. 1996, Nanterre: ESF éditeur
35.
go back to reference Debarbieux E, Blaya C: Violence à l'école et politiques publiques. ESF. 2001 Debarbieux E, Blaya C: Violence à l'école et politiques publiques. ESF. 2001
36.
go back to reference WHO: Partners in life skills education - Conclusions from a United Nations Inter-Agency Meeting. 1999, Geneva: WHO WHO: Partners in life skills education - Conclusions from a United Nations Inter-Agency Meeting. 1999, Geneva: WHO
37.
go back to reference Bieri D, Reeve R, Champion GD, Addicoat L, Ziegler J: The Faces Pain Scale for the self-assessment of the severity of pain experienced by children: Development, initial validation and preliminary investigation for ratio scale properties. Pain. 1990, 41: 139-150. 10.1016/0304-3959(90)90018-9.CrossRefPubMed Bieri D, Reeve R, Champion GD, Addicoat L, Ziegler J: The Faces Pain Scale for the self-assessment of the severity of pain experienced by children: Development, initial validation and preliminary investigation for ratio scale properties. Pain. 1990, 41: 139-150. 10.1016/0304-3959(90)90018-9.CrossRefPubMed
38.
go back to reference IUHPE: Achieving health promoting schools: guidelines for promoting health in schools. 2008, Saint-Denis IUHPE: Achieving health promoting schools: guidelines for promoting health in schools. 2008, Saint-Denis
39.
go back to reference Bardin L: L'analyse de contenu. 2001, Paris: PUF Bardin L: L'analyse de contenu. 2001, Paris: PUF
40.
go back to reference Charmaz K: Constructing grounded theory - A practical guide through qualitative analysis. 2006, London: Sage Publications Charmaz K: Constructing grounded theory - A practical guide through qualitative analysis. 2006, London: Sage Publications
41.
go back to reference Aro AA, Broucke Van Den S, Räty S: Toward European consensus tools for reviewing the evidence and enhancing the quality of health promotion practice. Promotion & Education. 2005, 10-14. Suppl 1 Aro AA, Broucke Van Den S, Räty S: Toward European consensus tools for reviewing the evidence and enhancing the quality of health promotion practice. Promotion & Education. 2005, 10-14. Suppl 1
42.
go back to reference Evans L, Hall M, Jones CM, Neiman A: Did the Ottawa Charter play a role in the push to assess the effectiveness of health promotion?. Promotion & Education. 2007, 14: 28-30. Evans L, Hall M, Jones CM, Neiman A: Did the Ottawa Charter play a role in the push to assess the effectiveness of health promotion?. Promotion & Education. 2007, 14: 28-30.
43.
go back to reference Stewart-Brown S: What is the evidence on school health promotion in improving health or preventing disease and, specifically, what is the effectiveness of the health promoting schools approach?. 2006, Copenhagen: WHO Stewart-Brown S: What is the evidence on school health promotion in improving health or preventing disease and, specifically, what is the effectiveness of the health promoting schools approach?. 2006, Copenhagen: WHO
44.
go back to reference Samdal O, Nutbeam D, Wold B, Kannas L: Achieving health and educational goals through schools - A study of the importance of the school climate and the students satisfaction with school. Health Education Research. 1998, 13: 383-397. 10.1093/her/13.3.383.CrossRef Samdal O, Nutbeam D, Wold B, Kannas L: Achieving health and educational goals through schools - A study of the importance of the school climate and the students satisfaction with school. Health Education Research. 1998, 13: 383-397. 10.1093/her/13.3.383.CrossRef
45.
go back to reference Sixsmith J, Gabhainn SN, Fleming C, O'Higgins S: Childrens', parents' and teachers' perceptions of child wellbeing. Health Education. 2007, 107: 511-523. 10.1108/09654280710827911.CrossRef Sixsmith J, Gabhainn SN, Fleming C, O'Higgins S: Childrens', parents' and teachers' perceptions of child wellbeing. Health Education. 2007, 107: 511-523. 10.1108/09654280710827911.CrossRef
46.
go back to reference Young I: Promoting health in schools: from evidence to action. 2009, Saint-Denis: IUHPE Young I: Promoting health in schools: from evidence to action. 2009, Saint-Denis: IUHPE
47.
go back to reference Grieg Viig N, Wold B: Facilitating Teachers' Participation in School-Based Health Promotion--A Qualitative Study. Scandinavian Journal of Educational Research. 2005, 49: 83-109. 10.1080/0031383042000302146.CrossRef Grieg Viig N, Wold B: Facilitating Teachers' Participation in School-Based Health Promotion--A Qualitative Study. Scandinavian Journal of Educational Research. 2005, 49: 83-109. 10.1080/0031383042000302146.CrossRef
Metadata
Title
Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods
Authors
Jeanine Pommier
Marie-Renée Guével
Didier Jourdan
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2010
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-10-43

Other articles of this Issue 1/2010

BMC Public Health 1/2010 Go to the issue