Top

Published in:

01-12-2021 | Research article

Evaluation of a school-based participatory intervention to improve school environments using the Consolidated Framework for Implementation Research

Authors: April K. Wilhelm, Maria Schwedhelm, Martha Bigelow, Nicole Bates, Mikow Hang, Luis Ortega, Shannon Pergament, Michele L. Allen

Published in: BMC Public Health | Issue 1/2021

Abstract

Background

Participatory research offers a promising approach to addressing health inequities and improving the social determinants of health for diverse populations of adolescents. However, little research has systematically explored factors influencing the implementation of participatory health interventions targeting health disparities.

Objective

This study examined the utility of the Consolidated Framework for Implementation Research (CFIR) in identifying and comparing barriers and facilitators influencing implementation of participatory research trials by employing an adaptation of the CFIR to assess the implementation of a multi-component, urban public school-based participatory health intervention.

Methods

We collected qualitative data over a one-year period through weekly team meeting observational field notes and regular semi-structured interviews with five community-based participatory researchers, one school-based partner, and four school principals involved in implementing a participatory intervention in five schools. Adapted CFIR constructs guided our largely deductive approach to thematic data analysis. We ranked each of the three intervention components as high or low implementation to create an overall implementation effectiveness score for all five schools. Cross-case comparison of constructs across high and low implementation schools identified constructs that most strongly influenced implementation.

Results

Ten of 30 assessed constructs consistently distinguished between high and low implementation schools in this participatory intervention, with five strongly distinguishing. Three additional constructs played influential, though non-distinguishing, roles within this participatory intervention implementation. Influential constructs spanned all five domains and fit within three broad themes: 1) leadership engagement, 2) alignment between the intervention and institutional goals, priorities, demographics, and existing systems, and 3) tensions between adaptability and complexity within participatory interventions. However, the dynamic and collaborative nature of participatory intervention implementation underscores the artificial distinction between inner and outer settings in participatory research and the individual behavior change focus does not consider how relationships between stakeholders at multiple levels of participatory interventions shape the implementation process.

Conclusions

The CFIR is a useful framework for the assessment of participatory research trial implementation. Our findings underscore how the framework can be readily adapted to further strengthen its fit as a tool to examine project implementation in this context.

Available only for authorised users

Izumi BT, Peden AM, Hallman JA, Barberis D, Stott B, Nimz S, et al. A community-based participatory research approach to developing the harvest for healthy kids curriculum. Prog Community Heal Partnerships Res Educ Action. 2013;7(4):379–84. https://doi.org/10.1353/cpr.2013.0047.CrossRef

Lindquist-Grantz R, Abraczinskas M. Using youth participatory action research as a health intervention in community settings. Health Promot Pract. 2020;21(4):573–81. https://doi.org/10.1177/1524839918818831.CrossRefPubMed

Okamoto SK, Helm S, Chin SK, Hata J, Hata E, Okamura KH. The implementation of a culturally grounded, school-based, drug prevention curriculum in rural Hawai‘i. J Community Psychol. 2020;48(4):1085–99. https://doi.org/10.1002/jcop.22222.CrossRefPubMed

Schelvis RMC, Wiezer NM, Blatter BM, Van Genabeek JAGM, Oude Hengel KM, Bohlmeijer ET, et al. Evaluating the implementation process of a participatory organizational level occupational health intervention in schools. BMC Public Health. 2016;16(1):1212. https://doi.org/10.1186/s12889-016-3869-0.CrossRefPubMedPubMedCentral

Breimaier HE, Heckemann B, Halfens RJG, Lohrmann C. The consolidated framework for implementation research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice. BMC Nurs. 2015;14(43):1.

Morgan D, Kosteniuk J, O’Connell ME, Kirk A, Stewart NJ, Seitz D, et al. Barriers and facilitators to development and implementation of a rural primary health care intervention for dementia: a process evaluation. BMC Health Serv Res. 2019;19(1):1–18.CrossRef

Warren CE, Ndwiga C, Sripad P, Medich M, Njeru A, Maranga A, et al. Sowing the seeds of transformative practice to actualize women’s rights to respectful maternity care: reflections from Kenya using the consolidated framework for implementation research. BMC Womens Health. 2017;17(1):69. https://doi.org/10.1186/s12905-017-0425-8.CrossRefPubMedPubMedCentral

Allen ML, Garcia-Huidobro D, Bastian T, Hurtado GA, Linares R, Svetaz MV. Reconciling research and community priorities in participatory trials: application to padres Informados/Jovenes Preparados. Fam Pract. 2017;34(3):347–52. https://doi.org/10.1093/fampra/cmw143.CrossRefPubMedPubMedCentral

Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10(1):53. https://doi.org/10.1186/s13012-015-0242-0.CrossRefPubMedPubMedCentral

10.

CFIR Research Team-Center for Clinical Management Research. Consolidated Framework for Implementation Research [Internet]. 2020. [cited 2020 Apr 8]. Available from: https://cfirguide.org/.

11.

Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50. https://doi.org/10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral

12.

Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8(1):51. https://doi.org/10.1186/1748-5908-8-51.CrossRefPubMedPubMedCentral

13.

Keith RE, Crosson JC, O ‘Malley AS, Cromp D, Taylor EF. Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation. Implement Sci. 2017;12:15.CrossRefPubMedPubMedCentral

14.

Ware P, Ross HJ, Cafazzo JA, Laporte A, Gordon K, Seto E. Evaluating the implementation of a mobile phone-based telemonitoring program: longitudinal study guided by the consolidated framework for implementation research. JMIR mHealth uHealth. 2018;6(7):e10768. https://doi.org/10.2196/10768.CrossRefPubMedPubMedCentral

15.

Northridge ME, Kavathe R, Zanowiak J, Wyatt L, Singh H, Islam N. Implementation and dissemination of the Sikh American families Oral health promotion program. Transl Behav Med. 2017;7(3):435–43. https://doi.org/10.1007/s13142-017-0466-4.CrossRefPubMedPubMedCentral

16.

Hudson KG, Lawton R, Hugh-Jones S. Factors affecting the implementation of a whole school mindfulness program: a qualitative study using the consolidated framework for implementation research. BMC Health Serv Res. 2020;20(1):133. https://doi.org/10.1186/s12913-020-4942-z.CrossRefPubMedPubMedCentral

17.

Leung E, Wanner KJ, Senter L, Brown A, Middleton D. What will it take? Using an implementation research framework to identify facilitators and barriers in implementing a school-based referral system for sexual health services. Health Serv Res. 2020;20(1):292. https://doi.org/10.1186/s12913-020-05147-z.CrossRef

18.

Fernandez ME, Walker TJ, Weiner BJ, Calo WA, Liang S, Risendal B, et al. Developing measures to assess constructs from the inner setting domain of the consolidated framework for implementation research. Implement Sci. 2018;13(1):52. https://doi.org/10.1186/s13012-018-0736-7.CrossRefPubMedPubMedCentral

19.

Ramanadhan S, Davis MM, Armstrong R, Baquero B, Ko LK, Leng JC, et al. Participatory implementation science to increase the impact of evidence-based cancer prevention and control. Cancer Causes Control. 2018;29(3):363–9. https://doi.org/10.1007/s10552-018-1008-1.CrossRefPubMedPubMedCentral

20.

Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomised controlled trial be? Br Med J. 2004;328(7455):1561–3. https://doi.org/10.1136/bmj.328.7455.1561.CrossRef

21.

Dias S, Gama A, Simões D, Mendão L. Implementation process and impacts of a participatory HIV research project with key populations. Biomed Res Int. 2018;2018:5845218.CrossRefPubMedPubMedCentral

22.

Bond L, Butler H, Thomas L, Carlin J, Glover S, Bowes G, et al. Social and school connectedness in early secondary school as predictors of late teenage substance use, mental health, and academic outcomes. J Adolesc Heal. 2007;357:e9–357.e18.

23.

Weatherson KA, O’Neill M, Lau EY, Qian W, Leatherdale ST, Faulkner GEJ. The protective effects of school connectedness on substance use and physical activity. J Adolesc Health. 2018;63(6):724–31. https://doi.org/10.1016/j.jadohealth.2018.07.002.CrossRefPubMed

24.

Klem AM, Connell JP. Relationships matter: linking teacher support to student engagement and achievement. J Sch Health. 2004;74(7):262–73. https://doi.org/10.1111/j.1746-1561.2004.tb08283.x.CrossRefPubMed

25.

Bottiani JH, Bradshaw CP, Mendelson T. Promoting an equitable and supportive school climate in high schools: the role of school organizational health and staff burnout. J Sch Psychol. 2014;52(6):567–82. https://doi.org/10.1016/j.jsp.2014.09.003.CrossRefPubMed

26.

Voight A, Hanson T, O’Malley M, Adekanye L. The racial school climate gap: within-school disparities in students’ experiences of safety, support, and connectedness. Am J Community Psychol. 2015;56(3-4):252–67. https://doi.org/10.1007/s10464-015-9751-x.

27.

Peguero AA, Bondy JM. Immigration and students’ relationship with teachers. Educ Urban Soc. 2011;43(2):165–83. https://doi.org/10.1177/0013124510380233.CrossRef

28.

Marnita’s Table [Internet]. 2020. [cited 2020 Apr 8]. Available from: https://projects.marnitastable.org/.

29.

O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. 2014;89(9):1245–51.

30.

Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. https://doi.org/10.1177/1049732305276687.CrossRefPubMed

31.

Ahearn L. Language and agency. Annu Rev Anthropol. 2001;30(1):109–37. https://doi.org/10.1146/annurev.anthro.30.1.109.CrossRef

32.

Dedoose. Web application for managing, analyzing, and presenting qualitative and mixed method research data. Los Angeles: SocioCultural Research Consultants, LLC; 2018. Available from: www.dedoose.com

33.

Hill CE, Thompson BJ, Hess SA, Knox S, Williams EN, Ladany N. Consensual qualitative research: an update. J Couns Psychol. 2005;52(2):196–205. https://doi.org/10.1037/0022-0167.52.2.196.CrossRef

34.

Varsi C, Ekstedt M, Gammon D, Ruland CM. Using the consolidated framework for implementation research to identify barriers and facilitators for the implementation of an internet-based patient-provider communication service in five settings: a qualitative study. J Med Internet Res. 2015;17(11):e262. https://doi.org/10.2196/jmir.5091.CrossRefPubMedPubMedCentral

35.

Cannon JS, Gilbert M, Ebener P, Malone PS, Reardon CM, Acosta J, et al. Influence of an implementation support intervention on barriers and facilitators to delivery of a substance use prevention program. Prev Sci. 2019;20(8):1200–10. https://doi.org/10.1007/s11121-019-01037-x.CrossRefPubMedPubMedCentral

36.

Fish J. Co-producing knowledge about lesbian and bisexual women with breast cancer: messages for nursing professionals from a knowledge exchange project. J Res Nurs. 2016;21(3):225–39. https://doi.org/10.1177/1744987116640581.CrossRef

37.

King DK, Shoup JA, Raebel MA, Anderson CB, Wagner NM, Ritzwoller DP, et al. Planning for implementation success using RE-AIM and CFIR frameworks: a qualitative study. Front Public Heal. 2020;8:59. https://doi.org/10.3389/fpubh.2020.00059.CrossRef

38.

Hawe P, Bond L, Butler H. Knowledge theories can inform evaluation practice: What can a complexity lens add? In: Ottoson JM, Hawe P, editors. Knowledge utilization, diffusion, implementation, transfer, and translation: Implications for evaluation New Directions for Evaluation; 2009. p. 89–100.

Title: Evaluation of a school-based participatory intervention to improve school environments using the Consolidated Framework for Implementation Research
Authors: April K. Wilhelm
Maria Schwedhelm
Martha Bigelow
Nicole Bates
Mikow Hang
Luis Ortega
Shannon Pergament
Michele L. Allen
Publication date: 01-12-2021
Publisher: BioMed Central
Published in: BMC Public Health / Issue 1/2021
Electronic ISSN: 1471-2458
DOI: https://doi.org/10.1186/s12889-021-11644-5

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Evaluation of a school-based participatory intervention to improve school environments using the Consolidated Framework for Implementation Research

Abstract

Background

Objective

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Objective

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2021

Association of food insecurity with dietary patterns and expenditure on food, alcohol and tobacco amongst indigenous Inuit in Greenland: results from a population health survey

Metabolic syndrome in Thai adolescents and associated factors: the Thai National Health Examination Survey V (NHES V)

Disclosure of same-sex practices and experiences of healthcare stigma among cisgender men who have sex with men in five sub-Saharan African countries

Project SUMS (scaling up of mental health in schools): design and methods for a pragmatic, cluster randomised waitlist-controlled trial on integrated school mental health intervention for adolescents

Factors influencing smoking behaviour of online ride-hailing drivers in China: a cross-sectional analysis

Supporting mental health and psychosocial wellbeing through social and emotional learning: A participatory study of conflict-affected youth resettled to the U.S.