Skip to main content
Top
Published in: BMC Public Health 1/2018

Open Access 01-12-2018 | Research article

Development and testing of a novel survey to assess Stakeholder-driven Community Diffusion of childhood obesity prevention efforts

Authors: Ariella R. Korn, Erin Hennessy, Ross A. Hammond, Steven Allender, Matthew W. Gillman, Matt Kasman, Jaimie McGlashan, Lynne Millar, Brynle Owen, Mark C. Pachucki, Boyd Swinburn, Alison Tovar, Christina D. Economos

Published in: BMC Public Health | Issue 1/2018

Login to get access

Abstract

Background

Involving groups of community stakeholders (e.g., steering committees) to lead community-wide health interventions appears to support multiple outcomes ranging from policy and systems change to individual biology. While numerous tools are available to measure stakeholder characteristics, many lack detail on reliability and validity, are not context specific, and may not be sensitive enough to capture change over time. This study describes the development and reliability of a novel survey to measure Stakeholder-driven Community Diffusion via assessment of stakeholders’ social networks, knowledge, and engagement about childhood obesity prevention.

Methods

This study was completed in three phases. Phase 1 included conceptualization and online survey development through literature reviews and expert input. Phase 2 included a retrospective study with stakeholders from two completed whole-of-community interventions. Between May–October 2015, 21 stakeholders from the Shape Up Somerville and Romp & Chomp interventions recalled their social networks, knowledge, and engagement pre-post intervention. We also assessed one-week test-retest reliability of knowledge and engagement survey modules among Shape Up Somerville respondents. Phase 3 included survey modifications and a second prospective reliability assessment. Test-retest reliability was assessed in May 2016 among 13 stakeholders involved in ongoing interventions in Victoria, Australia.

Results

In Phase 1, we developed a survey with 7, 20 and 50 items for the social networks, knowledge, and engagement survey modules, respectively. In the Phase 2 retrospective study, Shape Up Somerville and Romp & Chomp networks included 99 and 54 individuals. Pre-post Shape Up Somerville and Romp & Chomp mean knowledge scores increased by 3.5 points (95% CI: 0.35–6.72) and (− 0.42–7.42). Engagement scores did not change significantly (Shape Up Somerville: 1.1 points (− 0.55–2.73); Romp & Chomp: 0.7 points (− 0.43–1.73)). Intraclass correlation coefficients (ICCs) for knowledge and engagement were 0.88 (0.67–0.97) and 0.97 (0.89–0.99). In Phase 3, the modified knowledge and engagement survey modules included 18 and 25 items, respectively. Knowledge and engagement ICCs were 0.84 (0.62–0.95) and 0.58 (0.23–0.86).

Conclusions

The survey measures upstream stakeholder properties—social networks, knowledge, and engagement—with good test-retest reliability. Future research related to Stakeholder-driven Community Diffusion should focus on prospective change and survey validation for intervention effectiveness.
Appendix
Available only for authorised users
Literature
1.
go back to reference World Health Organization. Population-based approaches to childhood obesity Prevention. Geneva: WHO Press; 2012. World Health Organization. Population-based approaches to childhood obesity Prevention. Geneva: WHO Press; 2012.
2.
go back to reference IOM (Institute of Medicine). Accelerating Progress in Obesity Prevention: Solving the Weight of the Nation. Washington, DC: The National Academies Press; 2012. IOM (Institute of Medicine). Accelerating Progress in Obesity Prevention: Solving the Weight of the Nation. Washington, DC: The National Academies Press; 2012.
3.
go back to reference Bleich SN, Segal J, Wu Y, Wilson R, Wang Y. Systematic review of community-based childhood obesity prevention studies. Pediatrics. 2013;132(1):e201–10.CrossRefPubMedPubMedCentral Bleich SN, Segal J, Wu Y, Wilson R, Wang Y. Systematic review of community-based childhood obesity prevention studies. Pediatrics. 2013;132(1):e201–10.CrossRefPubMedPubMedCentral
4.
go back to reference Wolfenden L, Wyse R, Nichols M, Allender S, Millar L, McElduff P. A systematic review and meta-analysis of whole of community interventions to prevent excessive population weight gain. Prev Med. 2014;62:193–200.CrossRefPubMed Wolfenden L, Wyse R, Nichols M, Allender S, Millar L, McElduff P. A systematic review and meta-analysis of whole of community interventions to prevent excessive population weight gain. Prev Med. 2014;62:193–200.CrossRefPubMed
5.
go back to reference Boelsen-Robinson T, Peeters A, Beauchamp A, Chung A, Gearon E, Backholer K. A systematic review of the effectiveness of whole-of-community interventions by socioeconomic position. Obes Rev. 2015;16(9):806–16.CrossRefPubMed Boelsen-Robinson T, Peeters A, Beauchamp A, Chung A, Gearon E, Backholer K. A systematic review of the effectiveness of whole-of-community interventions by socioeconomic position. Obes Rev. 2015;16(9):806–16.CrossRefPubMed
6.
go back to reference Economos CD, Hyatt RR, Goldberg JP, Must A, Naumova EN, Collins JJ, Nelson ME. A community intervention reduces BMI z-score in children: shape up Somerville first year results. Obesity (Silver Spring). 2007;15(5):1325–36.CrossRef Economos CD, Hyatt RR, Goldberg JP, Must A, Naumova EN, Collins JJ, Nelson ME. A community intervention reduces BMI z-score in children: shape up Somerville first year results. Obesity (Silver Spring). 2007;15(5):1325–36.CrossRef
7.
go back to reference de Silva-Sanigorski AM, Bell AC, Kremer P, Nichols M, Crellin M, Smith M, Sharp S, de Groot F, Carpenter L, Boak R, et al. Reducing obesity in early childhood: results from Romp & Chomp, an Australian community-wide intervention program. Am J Clin Nutr. 2010;91(4):831–40.CrossRefPubMed de Silva-Sanigorski AM, Bell AC, Kremer P, Nichols M, Crellin M, Smith M, Sharp S, de Groot F, Carpenter L, Boak R, et al. Reducing obesity in early childhood: results from Romp & Chomp, an Australian community-wide intervention program. Am J Clin Nutr. 2010;91(4):831–40.CrossRefPubMed
8.
go back to reference Millar L, Robertson N, Allender S, Nichols M, Bennett C, Swinburn B. Increasing community capacity and decreasing prevalence of overweight and obesity in a community based intervention among Australian adolescents. Prev Med. 2013;56(6):379–84.CrossRefPubMed Millar L, Robertson N, Allender S, Nichols M, Bennett C, Swinburn B. Increasing community capacity and decreasing prevalence of overweight and obesity in a community based intervention among Australian adolescents. Prev Med. 2013;56(6):379–84.CrossRefPubMed
9.
go back to reference Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA. Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, be active eat well. Int J Obes. 2008;32(7):1060–7.CrossRef Sanigorski AM, Bell AC, Kremer PJ, Cuttler R, Swinburn BA. Reducing unhealthy weight gain in children through community capacity-building: results of a quasi-experimental intervention program, be active eat well. Int J Obes. 2008;32(7):1060–7.CrossRef
10.
go back to reference Economos C, Blondin S. Obesity interventions in the community: engaged and participatory approaches. Curr Obes Rep. 2014;3(2):199–205.CrossRefPubMed Economos C, Blondin S. Obesity interventions in the community: engaged and participatory approaches. Curr Obes Rep. 2014;3(2):199–205.CrossRefPubMed
11.
go back to reference Economos CD, Hammond RA. Designing effective and sustainable multifaceted interventions for obesity prevention and healthy communities. Obesity (Silver Spring). 2017;25(7):1155–6.CrossRef Economos CD, Hammond RA. Designing effective and sustainable multifaceted interventions for obesity prevention and healthy communities. Obesity (Silver Spring). 2017;25(7):1155–6.CrossRef
12.
go back to reference Wallerstein N, Oetzel J, Duran B, Tafoya G, Belone L, Rae R. What predicts outcomes in CBPR? In: Meredith Minkler NW, editor. Community-based participatory research for health: from process to outcomes. 2nd ed. San Francisco: John Wiley & Sons; 2008. Wallerstein N, Oetzel J, Duran B, Tafoya G, Belone L, Rae R. What predicts outcomes in CBPR? In: Meredith Minkler NW, editor. Community-based participatory research for health: from process to outcomes. 2nd ed. San Francisco: John Wiley & Sons; 2008.
13.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral
14.
go back to reference Ewart-Pierce E, Mejia Ruiz MJ, Gittelsohn J. "Whole-of-community" obesity prevention: a review of challenges and opportunities in multilevel, multicomponent interventions. Curr Obes Rep. 2016;5(3):361–74. Ewart-Pierce E, Mejia Ruiz MJ, Gittelsohn J. "Whole-of-community" obesity prevention: a review of challenges and opportunities in multilevel, multicomponent interventions. Curr Obes Rep. 2016;5(3):361–74.
15.
go back to reference Tanner-Smith EE, Grant S. Meta-analysis of complex interventions. Annu Rev Public Health. 2018;39(1):135-151. Tanner-Smith EE, Grant S. Meta-analysis of complex interventions. Annu Rev Public Health. 2018;39(1):135-151.
16.
go back to reference Singer HH, Kegler MC. Assessing interorganizational networks as a dimension of community capacity: illustrations from a community intervention to prevent lead poisoning. Health Educ Behav. 2004;31(6):808–21.CrossRefPubMed Singer HH, Kegler MC. Assessing interorganizational networks as a dimension of community capacity: illustrations from a community intervention to prevent lead poisoning. Health Educ Behav. 2004;31(6):808–21.CrossRefPubMed
17.
go back to reference Sandoval JA, Lucero J, Oetzel J, Avila M, Belone L, Mau M, Pearson C, Tafoya G, Duran B, Iglesias Rios L, et al. Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Educ Res. 2012;27(4):680–90.CrossRefPubMed Sandoval JA, Lucero J, Oetzel J, Avila M, Belone L, Mau M, Pearson C, Tafoya G, Duran B, Iglesias Rios L, et al. Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Educ Res. 2012;27(4):680–90.CrossRefPubMed
18.
19.
go back to reference Israel BA, Checkoway B, Schulz A, Zimmerman M. Health education and community empowerment: conceptualizing and measuring perceptions of individual, organizational, and community control. Health Educ Q. 1994;21(2):149–70.CrossRefPubMed Israel BA, Checkoway B, Schulz A, Zimmerman M. Health education and community empowerment: conceptualizing and measuring perceptions of individual, organizational, and community control. Health Educ Q. 1994;21(2):149–70.CrossRefPubMed
20.
go back to reference Mattessich P, Murray-Close M, Monsey B. Wilder Collaboration Factors Inventory. St. Paul: Amherst H. Wilder Foundation; 2001. Mattessich P, Murray-Close M, Monsey B. Wilder Collaboration Factors Inventory. St. Paul: Amherst H. Wilder Foundation; 2001.
21.
go back to reference Plested BA, Edwards RW, Jumper-Thurman P. Community Readiness: A Handbook for Successful Change. Fort Collins: Tri-Ethnic Center for Prevention Research; 2006. Plested BA, Edwards RW, Jumper-Thurman P. Community Readiness: A Handbook for Successful Change. Fort Collins: Tri-Ethnic Center for Prevention Research; 2006.
23.
go back to reference Osypuk TL, Kehm R, Misra DP. Where we used to live: validating retrospective measures of childhood neighborhood context for life course epidemiologic studies. PLoS One. 2015;10(4):e0124635.CrossRefPubMedPubMedCentral Osypuk TL, Kehm R, Misra DP. Where we used to live: validating retrospective measures of childhood neighborhood context for life course epidemiologic studies. PLoS One. 2015;10(4):e0124635.CrossRefPubMedPubMedCentral
24.
go back to reference McGlashan J, Nichols M, Korn A, Millar L, Marks J, Sanigorski A, Pachucki M, Swinburn B, Allender S, Economos C. Social network analysis of stakeholder networks from two community-based obesity prevention interventions. PLoS One. 2018;13(4):e0196211.CrossRefPubMedPubMedCentral McGlashan J, Nichols M, Korn A, Millar L, Marks J, Sanigorski A, Pachucki M, Swinburn B, Allender S, Economos C. Social network analysis of stakeholder networks from two community-based obesity prevention interventions. PLoS One. 2018;13(4):e0196211.CrossRefPubMedPubMedCentral
25.
go back to reference Marsden PV. Survey methods for network data. In: Scott J, Carrington PJ, eds. The SAGE Handbook of Social Network Analysis. London: SAGE Publications Ltd; 2011. p. 370–88. Marsden PV. Survey methods for network data. In: Scott J, Carrington PJ, eds. The SAGE Handbook of Social Network Analysis. London: SAGE Publications Ltd; 2011. p. 370–88.
26.
go back to reference Committee on Prevention of Obesity in Children and Youth; Food and Nutrition Board; Board on Health Promotion and Disease Prevention: Preventing childhood obesity: health in the balance. Washington, D.C.: National Academies Press; 2005. Committee on Prevention of Obesity in Children and Youth; Food and Nutrition Board; Board on Health Promotion and Disease Prevention: Preventing childhood obesity: health in the balance. Washington, D.C.: National Academies Press; 2005.
27.
go back to reference Bush R, Dower J, Mutch A. Community capacity index version 2. Centre for Primary Health Care: Brisbane; 2002. Bush R, Dower J, Mutch A. Community capacity index version 2. Centre for Primary Health Care: Brisbane; 2002.
28.
go back to reference Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl 1):S40–6.CrossRefPubMedPubMedCentral Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl 1):S40–6.CrossRefPubMedPubMedCentral
30.
go back to reference de Groot FP, Robertson NM, Swinburn BA, de Silva-Sanigorski AM. Increasing community capacity to prevent childhood obesity: challenges, lessons learned and results from the Romp & Chomp intervention. BMC Public Health. 2010;10:522.CrossRefPubMedPubMedCentral de Groot FP, Robertson NM, Swinburn BA, de Silva-Sanigorski AM. Increasing community capacity to prevent childhood obesity: challenges, lessons learned and results from the Romp & Chomp intervention. BMC Public Health. 2010;10:522.CrossRefPubMedPubMedCentral
31.
go back to reference Butts CT. "Sna: tools for social network analysis" R package version 2.4. 2016. Butts CT. "Sna: tools for social network analysis" R package version 2.4. 2016.
32.
go back to reference Butts CT. Network: a package for managing relational data in R. J Stat Softw. 2008;24(2). Butts CT. Network: a package for managing relational data in R. J Stat Softw. 2008;24(2).
34.
go back to reference Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20.CrossRefPubMed Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968;70(4):213–20.CrossRefPubMed
35.
go back to reference Allender S, Millar L, Hovmand P, Bell C, Moodie M, Carter R, Swinburn B, Strugnell C, Lowe J, de la Haye K, et al. Whole of systems trial of prevention strategies for childhood obesity: WHO STOPS childhood obesity. Int J Environ Res Public Health. 2016;13(11):1143. Allender S, Millar L, Hovmand P, Bell C, Moodie M, Carter R, Swinburn B, Strugnell C, Lowe J, de la Haye K, et al. Whole of systems trial of prevention strategies for childhood obesity: WHO STOPS childhood obesity. Int J Environ Res Public Health. 2016;13(11):1143.
36.
go back to reference Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
37.
go back to reference Zoellner J, Hill JL, Brock D, Barlow ML, Alexander R, Brito F, Price B, Jones CL, Marshall R, Estabrooks PA. One-year mixed-methods case study of a community-academic advisory board addressing childhood obesity. Health Promot Pract. 2017;18(6):833–53.CrossRefPubMed Zoellner J, Hill JL, Brock D, Barlow ML, Alexander R, Brito F, Price B, Jones CL, Marshall R, Estabrooks PA. One-year mixed-methods case study of a community-academic advisory board addressing childhood obesity. Health Promot Pract. 2017;18(6):833–53.CrossRefPubMed
38.
go back to reference Brewer DD. Forgetting in the recall-based elicitation of personal and social networks. Soc Networks. 2000;22(1):29–43.CrossRef Brewer DD. Forgetting in the recall-based elicitation of personal and social networks. Soc Networks. 2000;22(1):29–43.CrossRef
40.
42.
go back to reference Frerichs L, Lich KH, Dave G, Corbie-Smith G. Integrating systems science and community-based participatory research to achieve health equity. Am J Public Health. 2016;106(2):215–22.CrossRefPubMedPubMedCentral Frerichs L, Lich KH, Dave G, Corbie-Smith G. Integrating systems science and community-based participatory research to achieve health equity. Am J Public Health. 2016;106(2):215–22.CrossRefPubMedPubMedCentral
43.
go back to reference Hennessy E, Ornstein JT, Economos CD, Herzog JB, Lynskey V, Coffield E, Hammond RA. Designing an agent-based model for childhood obesity interventions: a case study of ChildObesity180. Prev Chronic Dis. 2016;13:E04.CrossRefPubMedPubMedCentral Hennessy E, Ornstein JT, Economos CD, Herzog JB, Lynskey V, Coffield E, Hammond RA. Designing an agent-based model for childhood obesity interventions: a case study of ChildObesity180. Prev Chronic Dis. 2016;13:E04.CrossRefPubMedPubMedCentral
Metadata
Title
Development and testing of a novel survey to assess Stakeholder-driven Community Diffusion of childhood obesity prevention efforts
Authors
Ariella R. Korn
Erin Hennessy
Ross A. Hammond
Steven Allender
Matthew W. Gillman
Matt Kasman
Jaimie McGlashan
Lynne Millar
Brynle Owen
Mark C. Pachucki
Boyd Swinburn
Alison Tovar
Christina D. Economos
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2018
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-018-5588-1

Other articles of this Issue 1/2018

BMC Public Health 1/2018 Go to the issue