Skip to main content
Top
Published in: Archives of Public Health 1/2016

Open Access 01-12-2016 | Research

Implementing Smarter Lunchrooms Makeovers in New York state middle schools: an initial process evaluation

Authors: Laura N. Thomas, Tisa F. Hill, Alisha Gaines, Jamie S. Dollahite

Published in: Archives of Public Health | Issue 1/2016

Login to get access

Abstract

Background

This paper presents design and findings from the process evaluation of a randomized controlled trial (RCT) testing the effectiveness of Smarter Lunchrooms Movement (SLM) interventions to encourage consumption of either fruit, vegetables, or unflavored milk in middle school cafeterias (grades 6–8, typically children ages 10–14 years). Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework adapted for environmental interventions, the process evaluation monitored fidelity to SLM protocol, determined barriers and facilitators influencing fidelity, and identified the training and support needs of implementers.

Methods

Under research team guidance, community partners (interventionists) assisted school food service staff (providers) with a six week implementation of protocol items in 13 public middle school cafeterias (two milk treatment, three vegetable treatment, four fruit treatment, and four control) in New York State during the 2013–2014 academic year. Process evaluation measures included semi-quantitative measures of implementation and maintenance (lunchroom audits) and qualitative data (environmental assessments and semi-structured interviews with school food service staff). Analyses identified challenges and opportunities for improving intervention delivery.

Results

Approximately 75 % of enrolled students participated in school lunch programs and thus were exposed to the SLM intervention. Findings indicated potential contamination by other nutrition-related activities in the lunchroom and larger school environment may have affected the intervention impact. Modest implementation fidelity scores were observed for intervention treatments. Providers reported treatments were acceptable and feasible, however interventionists confirmed motivation and perceived effectiveness varied among schools. Post-intervention audits revealed limited maintenance of intervention protocols. Strategies to enhance buy-in and communication among providers and increased interventionist support are recommended.

Conclusions

RE-AIM was a valuable framework for this process evaluation. Results highlighted implementation barriers and facilitators, and findings will enhance interpretation of forthcoming outcome data. Results will inform future iterations of the SLM RCT and provide valuable insights for those designing environmental interventions in school cafeterias.
Literature
1.
go back to reference Ogden C, Carroll M, Lawman H, Fryar C, Kruszon-Moran D, Kit B, Flegal K. Trends in obesity prevalence among children and adolescents in the united states, 1988–1994 through 2013–2014. JAMA. 2016;315:2292–9.CrossRefPubMed Ogden C, Carroll M, Lawman H, Fryar C, Kruszon-Moran D, Kit B, Flegal K. Trends in obesity prevalence among children and adolescents in the united states, 1988–1994 through 2013–2014. JAMA. 2016;315:2292–9.CrossRefPubMed
2.
go back to reference Singh GK, Siahpush M, Kogan MD. Rising social inequalities in US childhood obesity, 2003–2007. Ann Epidemiol. 2010;20:40–52.CrossRefPubMed Singh GK, Siahpush M, Kogan MD. Rising social inequalities in US childhood obesity, 2003–2007. Ann Epidemiol. 2010;20:40–52.CrossRefPubMed
3.
go back to reference Must A, Anderson SE. Effects of obesity on morbidity in children and adolescents. Nutr Clin Care. 2003;6:4–12.PubMed Must A, Anderson SE. Effects of obesity on morbidity in children and adolescents. Nutr Clin Care. 2003;6:4–12.PubMed
4.
go back to reference Whitaker RC, Wright JA, Pepe MS, Seidel KD, Dietz WH. Predicting obesity in young adulthood from childhood and parental obesity. N Engl J Med. 1997;337:869–73.CrossRefPubMed Whitaker RC, Wright JA, Pepe MS, Seidel KD, Dietz WH. Predicting obesity in young adulthood from childhood and parental obesity. N Engl J Med. 1997;337:869–73.CrossRefPubMed
5.
go back to reference Pearson N, Atkin AJ, Biddle SJH, Gorely T, Edwardson C. Patterns of adolescent physical activity and dietary behaviours. Int J Behav Nutr Phys Act. 2009;6:1–7.CrossRef Pearson N, Atkin AJ, Biddle SJH, Gorely T, Edwardson C. Patterns of adolescent physical activity and dietary behaviours. Int J Behav Nutr Phys Act. 2009;6:1–7.CrossRef
6.
go back to reference Story M, Kaphingst KM, French S. The role of schools in obesity prevention. Future Child. 2006;16:109–42.CrossRefPubMed Story M, Kaphingst KM, French S. The role of schools in obesity prevention. Future Child. 2006;16:109–42.CrossRefPubMed
7.
go back to reference Evans CEL, Christian MS, Cleghorn CL, Greenwood DC, Cade JE. Systematic review and meta-analysis of school-based interventions to improve daily fruit and vegetable intake in children aged 5 to 12 y. Am J Clin Nutr. 2012;96:889–901.CrossRefPubMed Evans CEL, Christian MS, Cleghorn CL, Greenwood DC, Cade JE. Systematic review and meta-analysis of school-based interventions to improve daily fruit and vegetable intake in children aged 5 to 12 y. Am J Clin Nutr. 2012;96:889–901.CrossRefPubMed
8.
go back to reference Hung L-S, Tidwell DK, Hall ME, Lee ML, Briley CA, Hunt BP. A meta-analysis of school-based obesity prevention programs demonstrates limited efficacy of decreasing childhood obesity. Nutr Res. 2015;35:229–40.CrossRefPubMed Hung L-S, Tidwell DK, Hall ME, Lee ML, Briley CA, Hunt BP. A meta-analysis of school-based obesity prevention programs demonstrates limited efficacy of decreasing childhood obesity. Nutr Res. 2015;35:229–40.CrossRefPubMed
9.
go back to reference Institute of Medicine (US). Committee on Accelerating Progress in Obesity Prevention, Glickman D. Accelerating progress in obesity prevention: solving the weight of the nation. DC: National Academies Press Washington; 2012. Institute of Medicine (US). Committee on Accelerating Progress in Obesity Prevention, Glickman D. Accelerating progress in obesity prevention: solving the weight of the nation. DC: National Academies Press Washington; 2012.
10.
go back to reference Chriqui JF, Pickel M, Story M, Pickel M, Story M. Influence of school competitive food and beverage policies on obesity, consumption, and availability: a systematic review. JAMA Pediatr. 2014;168:279–86.CrossRefPubMed Chriqui JF, Pickel M, Story M, Pickel M, Story M. Influence of school competitive food and beverage policies on obesity, consumption, and availability: a systematic review. JAMA Pediatr. 2014;168:279–86.CrossRefPubMed
11.
go back to reference Thaler RH, Sunstein CR. Libertarian paternalism. Am Econ Rev. 2003;93:175–9.CrossRef Thaler RH, Sunstein CR. Libertarian paternalism. Am Econ Rev. 2003;93:175–9.CrossRef
12.
go back to reference Hanks AS, Just DR, Wansink B. Smarter lunchrooms can address new school lunchroom guidelines and childhood obesity. J Pediatr. 2013;162:867–9.CrossRefPubMed Hanks AS, Just DR, Wansink B. Smarter lunchrooms can address new school lunchroom guidelines and childhood obesity. J Pediatr. 2013;162:867–9.CrossRefPubMed
13.
go back to reference Just DR, Wansink, B. Smarter Lunchrooms: Using Behavioral Economics to Improve Meal Selection. Choices, 2009;24(3). Just DR, Wansink, B. Smarter Lunchrooms: Using Behavioral Economics to Improve Meal Selection. Choices, 2009;24(3).
14.
go back to reference Hanks AS, Just DR, Smith LE, Wansink B. Healthy convenience: nudging students toward healthier choices in the lunchroom. J Public Health (Oxf). 2012;34:370–6.CrossRef Hanks AS, Just DR, Smith LE, Wansink B. Healthy convenience: nudging students toward healthier choices in the lunchroom. J Public Health (Oxf). 2012;34:370–6.CrossRef
15.
go back to reference Wansink B, Just DR. Trayless cafeterias lead diners to take less salad and relatively more dessert. Public Health Nutr. 2013;18:1–2. Wansink B, Just DR. Trayless cafeterias lead diners to take less salad and relatively more dessert. Public Health Nutr. 2013;18:1–2.
16.
go back to reference Just DR, Price J. Using incentives to encourage healthy eating in children. J Hum Resour. 2013;48:855–72.CrossRef Just DR, Price J. Using incentives to encourage healthy eating in children. J Hum Resour. 2013;48:855–72.CrossRef
17.
go back to reference Just D, Price J. Default options, incentives and food choices. Public Health Nutr. 2014;16:2281–8.CrossRef Just D, Price J. Default options, incentives and food choices. Public Health Nutr. 2014;16:2281–8.CrossRef
18.
go back to reference Wansink B, Just D, Smith L. What is in a name? giving descriptive names to vegetables increases lunchroom sales. J Nutr Educ Behav. 2011;43:S1. Wansink B, Just D, Smith L. What is in a name? giving descriptive names to vegetables increases lunchroom sales. J Nutr Educ Behav. 2011;43:S1.
19.
go back to reference Just DR, Lund J, Price J. The role of variety in increasing the consumption of fruits and vegetables among children. Agric Res Econ Rev. 2012;41:72.CrossRef Just DR, Lund J, Price J. The role of variety in increasing the consumption of fruits and vegetables among children. Agric Res Econ Rev. 2012;41:72.CrossRef
20.
go back to reference Wansink B, Just D, Smith L. Move the fruit: putting fruit in New bowls and New places doubles lunchroom sales. J Nutr Educ Behav. 2011;43:S1. Wansink B, Just D, Smith L. Move the fruit: putting fruit in New bowls and New places doubles lunchroom sales. J Nutr Educ Behav. 2011;43:S1.
21.
go back to reference Wansink B, Just DR, Hanks AS, Smith LE. Pre-sliced fruit in school cafeterias: children’s selection and intake. Am J Prev Med. 2013;44:477–80.CrossRefPubMed Wansink B, Just DR, Hanks AS, Smith LE. Pre-sliced fruit in school cafeterias: children’s selection and intake. Am J Prev Med. 2013;44:477–80.CrossRefPubMed
22.
go back to reference Basch CE, Sliepcevich EM, Gold RS, Duncan DF, Kolbe LJ. Avoiding type III errors in health education program evaluations: a case study. Heal Educ Behav. 1985;12:315–31.CrossRef Basch CE, Sliepcevich EM, Gold RS, Duncan DF, Kolbe LJ. Avoiding type III errors in health education program evaluations: a case study. Heal Educ Behav. 1985;12:315–31.CrossRef
23.
go back to reference Kim AE, Towers A, Renaud J, Zhu J, Shea JA, Galvin R, Volpp KG. Application of the RE-AIM framework to evaluate the impact of a worksite-based financial incentive intervention for smoking cessation. J Occup Environ Med. 2012;54:610–4.CrossRefPubMed Kim AE, Towers A, Renaud J, Zhu J, Shea JA, Galvin R, Volpp KG. Application of the RE-AIM framework to evaluate the impact of a worksite-based financial incentive intervention for smoking cessation. J Occup Environ Med. 2012;54:610–4.CrossRefPubMed
24.
go back to reference Wilcox S, Parra-Medina D, Felton GM, Poston MB, McClain A. Adoption and implementation of physical activity and dietary counseling by community health center providers and nurses. J Phys Act Health. 2010;7:602–12.CrossRefPubMedPubMedCentral Wilcox S, Parra-Medina D, Felton GM, Poston MB, McClain A. Adoption and implementation of physical activity and dietary counseling by community health center providers and nurses. J Phys Act Health. 2010;7:602–12.CrossRefPubMedPubMedCentral
25.
go back to reference Baranowski T, Stables G. Process evaluations of the 5-a-day projects. Health Educ Behav. 2000;27:157–66.CrossRefPubMed Baranowski T, Stables G. Process evaluations of the 5-a-day projects. Health Educ Behav. 2000;27:157–66.CrossRefPubMed
26.
go back to reference Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.CrossRefPubMedPubMedCentral Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.CrossRefPubMedPubMedCentral
27.
go back to reference King DK, Glasgow RE, Leeman-Castillo B. Reaiming RE-AIM: using the model to plan, implement, and evaluate the effects of environmental change approaches to enhancing population health. Am J Public Health. 2010;100:2076–84.CrossRefPubMedPubMedCentral King DK, Glasgow RE, Leeman-Castillo B. Reaiming RE-AIM: using the model to plan, implement, and evaluate the effects of environmental change approaches to enhancing population health. Am J Public Health. 2010;100:2076–84.CrossRefPubMedPubMedCentral
28.
go back to reference Austin G, Bell T, Caperchione C, Mummery WK. Translating research to practice: using the RE-AIM framework to examine an evidence-based physical activity intervention in primary school settings. Health Promot Pract. 2011;12:932–41.CrossRefPubMed Austin G, Bell T, Caperchione C, Mummery WK. Translating research to practice: using the RE-AIM framework to examine an evidence-based physical activity intervention in primary school settings. Health Promot Pract. 2011;12:932–41.CrossRefPubMed
31.
go back to reference Hanks AS, Wansink B, Just DR. Reliability and accuracy of real-time visualization techniques for measuring school cafeteria tray waste: validating the quarter-waste method. J Acad Nutr Diet. 2014;114:470–4.CrossRefPubMed Hanks AS, Wansink B, Just DR. Reliability and accuracy of real-time visualization techniques for measuring school cafeteria tray waste: validating the quarter-waste method. J Acad Nutr Diet. 2014;114:470–4.CrossRefPubMed
32.
go back to reference Norris JA. From telling to teaching: a dialogue approach to adult learning. North Myrtle Beach: Learning By Dialogue; 2003. Norris JA. From telling to teaching: a dialogue approach to adult learning. North Myrtle Beach: Learning By Dialogue; 2003.
40.
go back to reference Sweet SN, Ginis KAM, Estabrooks PA, Latimer-Cheung AE. Operationalizing the RE-AIM framework to evaluate the impact of multi-sector partnerships. Implement Sci. 2014;9:74.CrossRefPubMedPubMedCentral Sweet SN, Ginis KAM, Estabrooks PA, Latimer-Cheung AE. Operationalizing the RE-AIM framework to evaluate the impact of multi-sector partnerships. Implement Sci. 2014;9:74.CrossRefPubMedPubMedCentral
41.
go back to reference Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21:688–94.CrossRefPubMed Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21:688–94.CrossRefPubMed
42.
go back to reference Janssen M, Toussaint HM, van Mechelen W, Verhagen EALM. Translating the PLAYgrounds program into practice: a process evaluation using the RE-AIM framework. J Sci Med Sport. 2013;16:211–6.CrossRefPubMed Janssen M, Toussaint HM, van Mechelen W, Verhagen EALM. Translating the PLAYgrounds program into practice: a process evaluation using the RE-AIM framework. J Sci Med Sport. 2013;16:211–6.CrossRefPubMed
43.
go back to reference Institute of Medicine, Committee on Comprehensive School Health Programs in Grades K-12. Challenges in School Health Research and Evaluation. In: Allensworth D, Lawson E, Nicholson L, Wyche J (eds) Sch. Heal. Our Nation’s Invest. Washington: The National Academies Press; 1997. pp. 271–295. Institute of Medicine, Committee on Comprehensive School Health Programs in Grades K-12. Challenges in School Health Research and Evaluation. In: Allensworth D, Lawson E, Nicholson L, Wyche J (eds) Sch. Heal. Our Nation’s Invest. Washington: The National Academies Press; 1997. pp. 271–295.
44.
go back to reference Collard DCM, Chinapaw MJM, Verhagen EALM, van Mechelen W. Process evaluation of a school based physical activity related injury prevention programme using the RE-AIM framework. BMC Pediatr. 2010;10:86.CrossRefPubMedPubMedCentral Collard DCM, Chinapaw MJM, Verhagen EALM, van Mechelen W. Process evaluation of a school based physical activity related injury prevention programme using the RE-AIM framework. BMC Pediatr. 2010;10:86.CrossRefPubMedPubMedCentral
45.
go back to reference Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Heal Psychol. 2004;23:443.CrossRef Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Heal Psychol. 2004;23:443.CrossRef
46.
go back to reference Rose PJ, Golub HM, Kennel JA (2015) Methods and Fidelity of Smarter Lunchrooms Program to Decrease Plate Waste in Children’s School Lunch Meal. Columbus: The Ohio State University Rose PJ, Golub HM, Kennel JA (2015) Methods and Fidelity of Smarter Lunchrooms Program to Decrease Plate Waste in Children’s School Lunch Meal. Columbus: The Ohio State University
47.
go back to reference Jilcott S, Ammerman A, Sommers J, Glasgow RE. Applying the RE-AIM framework to assess the public health impact of policy change. Ann Behav Med. 2007;34:105–14.CrossRefPubMed Jilcott S, Ammerman A, Sommers J, Glasgow RE. Applying the RE-AIM framework to assess the public health impact of policy change. Ann Behav Med. 2007;34:105–14.CrossRefPubMed
48.
go back to reference Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to Employ’ the RE-AIM model? Eval Health Prof. 2012;00:1–23. Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to Employ’ the RE-AIM model? Eval Health Prof. 2012;00:1–23.
Metadata
Title
Implementing Smarter Lunchrooms Makeovers in New York state middle schools: an initial process evaluation
Authors
Laura N. Thomas
Tisa F. Hill
Alisha Gaines
Jamie S. Dollahite
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Archives of Public Health / Issue 1/2016
Electronic ISSN: 2049-3258
DOI
https://doi.org/10.1186/s13690-016-0153-9

Other articles of this Issue 1/2016

Archives of Public Health 1/2016 Go to the issue