Skip to main content
Top
Published in: BMC Public Health 1/2017

Open Access 01-12-2017 | Research article

Assessment of nutrition and physical activity environments in family child care homes: modification and psychometric testing of the Environment and Policy Assessment and Observation

Authors: Amber E. Vaughn, Stephanie Mazzucca, Regan Burney, Truls Østbye, Sara E. Benjamin Neelon, Alison Tovar, Dianne S. Ward

Published in: BMC Public Health | Issue 1/2017

Login to get access

Abstract

Background

Early care and education (ECE) settings play an important role in shaping the nutrition and physical activity habits of young children. Increasing research attention is being directed toward family child care homes (FCCHs) specifically. However, existing measures of child care nutrition and physical activity environments are limited in that they have been created for use with center-based programs and require modification for studies involving FCCHs. This paper describes the modification of the Environment and Policy Assessment and Observation (EPAO) for use in FCCHs.

Methods

The EPAO underwent a through modification process that incorporated an updated format for the data collection instrument, assessment of emerging best practices, tailoring to the FCCH environment, and creation of a new scoring rubric. The new instrument was implemented as part of a larger randomized control trial. To assess inter-rater reliability, observations on 61 different days were performed independently by two data collectors. To assess construct validity, associations between EPAO scores and measures of children’s dietary intake (Healthy Eating Index (HEI) score) and physical activity (accelerometer-measured minutes per hour of moderate to vigorous physical activity, MVPA) were examined.

Results

The modified EPAO assesses 38 nutrition and 27 physical activity best practices, which can be summarized into 7 nutrition-related and 10 physical activity-related environmental sub- scores as well as overall nutrition and overall physical activity scores. There was generally good agreement between data collectors (ICC > 0.60). Reliability was slightly lower for feeding practices and physical activity education and professional development (ICC = 0.56 and 0.22, respectively). Child HEI was significantly correlated with the overall nutrition score (r = 0.23), foods provided (r = 0.28), beverages provided (r = 0.15), nutrition education and professional development (r = 0.21), and nutrition policy (r = 0.18). Child MVPA was significantly associated with overall time provided for activity (r = 0.18) and outdoor playtime (r = 0.20). There was also an unexpected negative association between child MVPA and screen time (−0.16) and screen time practices (r = −0.21).

Conclusions

The EPAO for the FCCH instrument is a useful tool for researchers working with this unique type of ECE setting. It has undergone rigorous development and testing and appears to have good psychometric properties.

Trial registration

NCT01814215, March 15, 2013.
Appendix
Available only for authorised users
Literature
1.
go back to reference Story M, Kaphingst KM, French S. The role of child care settings in obesity prevention. Futur Child. 2006;16(1):143–68.CrossRef Story M, Kaphingst KM, French S. The role of child care settings in obesity prevention. Futur Child. 2006;16(1):143–68.CrossRef
2.
go back to reference Larson N, Ward DS, Neelon SB, Story M. What role can child-care settings play in obesity prevention? A review of the evidence and call for research efforts. J Am Diet Assoc. 2011;111(9):1343–62.CrossRefPubMed Larson N, Ward DS, Neelon SB, Story M. What role can child-care settings play in obesity prevention? A review of the evidence and call for research efforts. J Am Diet Assoc. 2011;111(9):1343–62.CrossRefPubMed
3.
go back to reference American Academy of Pediatrics, American Public Health Association, National Resource Center for Health, Safety in Child Care and Early Education. Caring for our children: National health and safty performance standards; Guidelines for early care and education programs. In., 3rd edn: Elk Grove Village, IL: American Academy of Pediatrics; Washington, DC: American Public Health Association; 2011. American Academy of Pediatrics, American Public Health Association, National Resource Center for Health, Safety in Child Care and Early Education. Caring for our children: National health and safty performance standards; Guidelines for early care and education programs. In., 3rd edn: Elk Grove Village, IL: American Academy of Pediatrics; Washington, DC: American Public Health Association; 2011.
4.
go back to reference Institute of Medicine. Early childhood obesity prevention policies. Washington, DC: The National Academies Press; 2011. Institute of Medicine. Early childhood obesity prevention policies. Washington, DC: The National Academies Press; 2011.
5.
go back to reference Benjamin Neelon SE, Briley ME. Position of the American dietetic association: benchmarks for nutrition in child care. J Am Diet Assoc. 2011;111(4):607–15.CrossRefPubMed Benjamin Neelon SE, Briley ME. Position of the American dietetic association: benchmarks for nutrition in child care. J Am Diet Assoc. 2011;111(4):607–15.CrossRefPubMed
6.
go back to reference Ostbye T, Mann CM, Vaughn AE, Namenek Brouwer RJ, Benjamin Neelon SE, Hales D, Bangdiwala SI, Ward DS. The keys to healthy family child care homes intervention: study design and rationale. Contemporary clinical trials. 2015;40:81–9.CrossRefPubMed Ostbye T, Mann CM, Vaughn AE, Namenek Brouwer RJ, Benjamin Neelon SE, Hales D, Bangdiwala SI, Ward DS. The keys to healthy family child care homes intervention: study design and rationale. Contemporary clinical trials. 2015;40:81–9.CrossRefPubMed
7.
go back to reference de Silva-Sanigorski A, Elea D, Bell C, Kremer P, Carpenter L, Nichols M, Smith M, Sharp S, Boak R, Swinburn B. Obesity prevention in the family day care setting: impact of the Romp & Chomp intervention on opportunities for children’s physical activity and healthy eating. Child Care Health Dev. 2011;37(3):385–93.CrossRefPubMed de Silva-Sanigorski A, Elea D, Bell C, Kremer P, Carpenter L, Nichols M, Smith M, Sharp S, Boak R, Swinburn B. Obesity prevention in the family day care setting: impact of the Romp & Chomp intervention on opportunities for children’s physical activity and healthy eating. Child Care Health Dev. 2011;37(3):385–93.CrossRefPubMed
8.
go back to reference Van Stan S, Lessard L, Dupont PK. The impact of a statewide training to increase child care providers knowledge of nutrition and physical activity rules in Delaware. Child Obes. 2013;9(1):43–50.CrossRefPubMedPubMedCentral Van Stan S, Lessard L, Dupont PK. The impact of a statewide training to increase child care providers knowledge of nutrition and physical activity rules in Delaware. Child Obes. 2013;9(1):43–50.CrossRefPubMedPubMedCentral
9.
go back to reference Tovar A, Vaughn A, Grummon A, Burney R, Erinosho T, Østbye T, Ward D. Family child care home providers as role models for children: cause for concern? Prev Med Rep. 2016;5:308–13.CrossRefPubMedPubMedCentral Tovar A, Vaughn A, Grummon A, Burney R, Erinosho T, Østbye T, Ward D. Family child care home providers as role models for children: cause for concern? Prev Med Rep. 2016;5:308–13.CrossRefPubMedPubMedCentral
10.
go back to reference Laughlin L. Who's Minding the Kids? Child Care Arrangements: Spring 2011. In: household economic studies. U.S. Department of Commerce, economics and statistics administration, U.S. Census Bureau; 2013. p. 1–23. Laughlin L. Who's Minding the Kids? Child Care Arrangements: Spring 2011. In: household economic studies. U.S. Department of Commerce, economics and statistics administration, U.S. Census Bureau; 2013. p. 1–23.
11.
go back to reference Benjamin SE, Cradock A, Walker EM, Slining M, Gillman MW. Obesity prevention in child care: a review of U.S. state regulations. BMC Public Health. 2008;8:188.CrossRefPubMedPubMedCentral Benjamin SE, Cradock A, Walker EM, Slining M, Gillman MW. Obesity prevention in child care: a review of U.S. state regulations. BMC Public Health. 2008;8:188.CrossRefPubMedPubMedCentral
12.
go back to reference Kaphingst KM, Story M. Child care as an untapped setting for obesity prevention: state child care licensing regulations related to nutrition, physical activity, and media use for preschool-aged children in the United States. Prev Chronic Dis. 2009;6(1):A11.PubMed Kaphingst KM, Story M. Child care as an untapped setting for obesity prevention: state child care licensing regulations related to nutrition, physical activity, and media use for preschool-aged children in the United States. Prev Chronic Dis. 2009;6(1):A11.PubMed
13.
go back to reference Duffey KJ, Slining MM, Benjamin Neelon SE. States lack physical activity policies in child care that are consistent with national recommendations. Child Obes. 2014;10(6):491–500.CrossRefPubMedPubMedCentral Duffey KJ, Slining MM, Benjamin Neelon SE. States lack physical activity policies in child care that are consistent with national recommendations. Child Obes. 2014;10(6):491–500.CrossRefPubMedPubMedCentral
14.
go back to reference Benjamin Neelon SE, Duncan DT, Burgoine T, Mayhew M, Platt A. Promoting breastfeeding in child care through state regulation. Matern Child Health J. 2015;19(4):745–54.CrossRefPubMed Benjamin Neelon SE, Duncan DT, Burgoine T, Mayhew M, Platt A. Promoting breastfeeding in child care through state regulation. Matern Child Health J. 2015;19(4):745–54.CrossRefPubMed
15.
go back to reference Monsivais P, Kirkpatrick S, Johnson DB. More nutritious food is served in child-care homes receiving higher federal food subsidies. J Am Diet Assoc. 2011;111(5):721–6.CrossRefPubMed Monsivais P, Kirkpatrick S, Johnson DB. More nutritious food is served in child-care homes receiving higher federal food subsidies. J Am Diet Assoc. 2011;111(5):721–6.CrossRefPubMed
16.
go back to reference Delaney SL, Monsivais P, Johnson DB. Physical activity levels in family child care homes. J Phys Act Health. 2014;11(7):1362–6.CrossRefPubMed Delaney SL, Monsivais P, Johnson DB. Physical activity levels in family child care homes. J Phys Act Health. 2014;11(7):1362–6.CrossRefPubMed
17.
go back to reference Rice KR, Trost SG. Physical activity levels among children attending family day care. J Nutr Educ Behav. 2014;46(3):197–202.CrossRefPubMed Rice KR, Trost SG. Physical activity levels among children attending family day care. J Nutr Educ Behav. 2014;46(3):197–202.CrossRefPubMed
18.
go back to reference Benjamin Neelon SE, Schou Andersen C, Schmidt Morgen C, Kamper-Jorgensen M, Oken E, Gillman MW, Sorensen TI. Early child care and obesity at 12 months of age in the Danish National Birth Cohort. Int J Obes. 2015;39(1):33–8.CrossRef Benjamin Neelon SE, Schou Andersen C, Schmidt Morgen C, Kamper-Jorgensen M, Oken E, Gillman MW, Sorensen TI. Early child care and obesity at 12 months of age in the Danish National Birth Cohort. Int J Obes. 2015;39(1):33–8.CrossRef
19.
go back to reference Alberdi G, McNamara AE, Lindsay KL, Scully HA, Horan MH, Gibney ER, McAuliffe FM. The association between childcare and risk of childhood overweight and obesity in children aged 5 years and under: a systematic review. Eur J Pediatr. 2016; Alberdi G, McNamara AE, Lindsay KL, Scully HA, Horan MH, Gibney ER, McAuliffe FM. The association between childcare and risk of childhood overweight and obesity in children aged 5 years and under: a systematic review. Eur J Pediatr. 2016;
20.
go back to reference Ward DS, Vaughn A, Story M. Expert and stakeholder consensus on priorities for obesity prevention research in early care and education settings. Child Obes. 2013;9(2):116–24.CrossRefPubMedPubMedCentral Ward DS, Vaughn A, Story M. Expert and stakeholder consensus on priorities for obesity prevention research in early care and education settings. Child Obes. 2013;9(2):116–24.CrossRefPubMedPubMedCentral
21.
go back to reference Ward D, Hales D, Haverly K, Marks J, Benjamin S, Ball S, Trost S. An instrument to assess the obesogenic environment of child care centers. Am J Health Behav. 2008;32(4):380–6.CrossRefPubMed Ward D, Hales D, Haverly K, Marks J, Benjamin S, Ball S, Trost S. An instrument to assess the obesogenic environment of child care centers. Am J Health Behav. 2008;32(4):380–6.CrossRefPubMed
22.
go back to reference Ward DS, Mazzucca S, McWilliams C, Hales D. Use of the environment and policy evaluation and observation as a self-report instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence. Int J Behav Nutr Phys Act. 2015;12:124.CrossRefPubMedPubMedCentral Ward DS, Mazzucca S, McWilliams C, Hales D. Use of the environment and policy evaluation and observation as a self-report instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence. Int J Behav Nutr Phys Act. 2015;12:124.CrossRefPubMedPubMedCentral
23.
go back to reference Ward DS, Benjamin SE, Ammerman AS, Ball SC, Neelon BH, Bangdiwala SI. Nutrition and physical activity in child care: results from an environmental intervention. Am J Prev Med. 2008;35(4):352–6.CrossRefPubMed Ward DS, Benjamin SE, Ammerman AS, Ball SC, Neelon BH, Bangdiwala SI. Nutrition and physical activity in child care: results from an environmental intervention. Am J Prev Med. 2008;35(4):352–6.CrossRefPubMed
24.
go back to reference Ward D, Morris E, McWilliams C, Vaughn A, Erinosho T, Mazzucca S, Hanson P, Ammerman A, Neelon S, Sommers J et al. Go NAP SACC: Nutrition and Physical Activity Self-Assessment for Child Care, 2nd Edition. www.gonapsacc.org. Assessed August 8 2016. Ward D, Morris E, McWilliams C, Vaughn A, Erinosho T, Mazzucca S, Hanson P, Ammerman A, Neelon S, Sommers J et al. Go NAP SACC: Nutrition and Physical Activity Self-Assessment for Child Care, 2nd Edition. www.​gonapsacc.​org. Assessed August 8 2016.
25.
go back to reference Ball SC, Benjamin SE, Ward DS. Development and reliability of an observation method to assess food intake of young children in child care. J Am Diet Assoc. 2007;107(4):656–61.CrossRefPubMed Ball SC, Benjamin SE, Ward DS. Development and reliability of an observation method to assess food intake of young children in child care. J Am Diet Assoc. 2007;107(4):656–61.CrossRefPubMed
26.
go back to reference Guenther PM, Casavale KO, Reedy J, Kirkpatrick SI, Hiza HA, Kuczynski KJ, Kahle LL, Krebs-Smith SM. Update of the healthy eating index: HEI-2010. J Acad Nutr Diet. 2013;113(4):569–80.CrossRefPubMed Guenther PM, Casavale KO, Reedy J, Kirkpatrick SI, Hiza HA, Kuczynski KJ, Kahle LL, Krebs-Smith SM. Update of the healthy eating index: HEI-2010. J Acad Nutr Diet. 2013;113(4):569–80.CrossRefPubMed
27.
go back to reference Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG. Calibration of two objective measures of physical activity for children. J Sports Sci. 2008;26(14):1557–65.CrossRefPubMed Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG. Calibration of two objective measures of physical activity for children. J Sports Sci. 2008;26(14):1557–65.CrossRefPubMed
28.
go back to reference Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardize assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardize assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
29.
go back to reference Neuendorf KA. The content analysis guidebook. Thousand Oaks, CA: Sage Publications; 2002. Neuendorf KA. The content analysis guidebook. Thousand Oaks, CA: Sage Publications; 2002.
30.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276–82.CrossRef
31.
go back to reference Ward DS, Welker E, Choate A, Henderson KE, Lott M, Tovar A, Wilson A, Sallis JF. Strength of obesity prevention interventions in early care and education settings: a systematic review. Prev Med. 2016; Ward DS, Welker E, Choate A, Henderson KE, Lott M, Tovar A, Wilson A, Sallis JF. Strength of obesity prevention interventions in early care and education settings: a systematic review. Prev Med. 2016;
32.
go back to reference Maatta S, Lehto R, Nislin M, Ray C, Erkkola M, Sajaniemi N, Roos E. Increased health and well-being in preschools (DAGIS): rationale and design for a randomized controlled trial. BMC Public Health. 2015;15:402.CrossRefPubMedPubMedCentral Maatta S, Lehto R, Nislin M, Ray C, Erkkola M, Sajaniemi N, Roos E. Increased health and well-being in preschools (DAGIS): rationale and design for a randomized controlled trial. BMC Public Health. 2015;15:402.CrossRefPubMedPubMedCentral
33.
go back to reference Adamo KB, Barrowman N, Naylor PJ, Yaya S, Harvey A, Grattan KP, Goldfield GS. Activity begins in childhood (ABC) - inspiring healthy active behaviour in preschoolers: study protocol for a cluster randomized controlled trial. Trials. 2014;15:305.CrossRefPubMedPubMedCentral Adamo KB, Barrowman N, Naylor PJ, Yaya S, Harvey A, Grattan KP, Goldfield GS. Activity begins in childhood (ABC) - inspiring healthy active behaviour in preschoolers: study protocol for a cluster randomized controlled trial. Trials. 2014;15:305.CrossRefPubMedPubMedCentral
34.
go back to reference Lyn R, Maalouf J, Evers S, Davis J, Griffin M. Nutrition and physical activity in child care centers: the impact of a wellness policy initiative on environment and policy assessment and observation outcomes, 2011. Prev Chronic Dis. 2013;10:E83.CrossRefPubMedPubMedCentral Lyn R, Maalouf J, Evers S, Davis J, Griffin M. Nutrition and physical activity in child care centers: the impact of a wellness policy initiative on environment and policy assessment and observation outcomes, 2011. Prev Chronic Dis. 2013;10:E83.CrossRefPubMedPubMedCentral
35.
go back to reference Finch M, Wolfenden L, Morgan PJ, Freund M, Wyse R, Wiggers J. A cluster randomised trial to evaluate a physical activity intervention among 3-5 year old children attending long day care services: study protocol. BMC Public Health. 2010;10:534.CrossRefPubMedPubMedCentral Finch M, Wolfenden L, Morgan PJ, Freund M, Wyse R, Wiggers J. A cluster randomised trial to evaluate a physical activity intervention among 3-5 year old children attending long day care services: study protocol. BMC Public Health. 2010;10:534.CrossRefPubMedPubMedCentral
36.
go back to reference DeVellis R. Scale development theory and applications. Vol. 26, second edn. Thousand Oaks: Sage Publications; 2003. DeVellis R. Scale development theory and applications. Vol. 26, second edn. Thousand Oaks: Sage Publications; 2003.
37.
go back to reference Saelens BE, Glanz K. Work group I: measures of the food and physical activity environment: instruments. Am J Prev Med. 2009;36(4 Suppl):S166–70.CrossRefPubMed Saelens BE, Glanz K. Work group I: measures of the food and physical activity environment: instruments. Am J Prev Med. 2009;36(4 Suppl):S166–70.CrossRefPubMed
38.
go back to reference Vaughn AE, Tabak RG, Bryant MJ, Ward DS. Measuring parent food practices: a systematic review of existing measures and examination of instruments. Int J Behav Nutr Phys Act. 2013;10(1):61.CrossRefPubMedPubMedCentral Vaughn AE, Tabak RG, Bryant MJ, Ward DS. Measuring parent food practices: a systematic review of existing measures and examination of instruments. Int J Behav Nutr Phys Act. 2013;10(1):61.CrossRefPubMedPubMedCentral
Metadata
Title
Assessment of nutrition and physical activity environments in family child care homes: modification and psychometric testing of the Environment and Policy Assessment and Observation
Authors
Amber E. Vaughn
Stephanie Mazzucca
Regan Burney
Truls Østbye
Sara E. Benjamin Neelon
Alison Tovar
Dianne S. Ward
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2017
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-017-4686-9

Other articles of this Issue 1/2017

BMC Public Health 1/2017 Go to the issue