Skip to main content
Top
Published in: BMC Public Health 1/2015

Open Access 01-12-2015 | Research article

Assessing implementation fidelity of a community-based infant and young child feeding intervention in Ethiopia identifies delivery challenges that limit reach to communities: a mixed-method process evaluation study

Authors: Sunny S Kim, Disha Ali, Andrew Kennedy, Roman Tesfaye, Amare W Tadesse, Teweldebrhan H Abrha, Rahul Rawat, Purnima Menon

Published in: BMC Public Health | Issue 1/2015

Login to get access

Abstract

Background

Program effectiveness is influenced by the degree and quality of implementation, thus requiring careful examination of delivery processes and how the program is or is not being implemented as intended. Implementation fidelity is defined by adherence to intervention design, exposure or dose, quality of delivery, and participant responsiveness. As part of the process evaluation (PE) of Alive & Thrive in Ethiopia, a large-scale initiative to improve infant and young child feeding (IYCF), we assessed these four fidelity elements along three components of its community-based intervention: training of frontline workers (FLWs), delivery of program tools and messages, and supportive supervision.

Methods

Data from a qualitative study among three levels of FLWs (n = 54), i.e. supervisors, health extension workers (HEWs), and community volunteers, and among mothers with children under two years of age (n = 60); and cross-sectional PE surveys with FLWs (n = 504) and mothers (n = 750) in two regions (Tigray and SNNPR) were analyzed to examine program fidelity.

Results

There was strong adherence to the intended cascading design (i.e. transfer of knowledge and information from higher to lower FLW levels) and high exposure to training (95% HEWs and 94% volunteers in Tigray, 68% and 81% respectively in SNNPR). Training quality, assessed by IYCF knowledge and self-reported capacity, was high and increased since baseline. Job aids were used regularly by most supervisors and HEWs, but only 54% of volunteers in Tigray and 39% in SNNPR received them. Quality of program message delivery was lower among volunteers, and aided recall of key messages among mothers was also low. Although FLW supervision exposure was high, content and frequency were irregular.

Conclusions

There is evidence of strong fidelity in training and delivery of program tools and messages at higher FLW levels, but gaps in the reach of these to community volunteers and mothers and variability between regions could limit the potential for impact. Strengthening the linkages between HEWs and volunteers further can help to reach the target households and deliver IYCF results at scale.
Literature
1.
go back to reference Central Statistical Agency and ICF International. Ethiopia Demographic and Health Survey 2011. Addis Ababa, Ethiopia, and Calverton, MD, USA; 2012. Central Statistical Agency and ICF International. Ethiopia Demographic and Health Survey 2011. Addis Ababa, Ethiopia, and Calverton, MD, USA; 2012.
2.
go back to reference Federal Ministry of Health, Health Extension and Education Center. Health extension program operation guidance. 2006. Federal Ministry of Health, Health Extension and Education Center. Health extension program operation guidance. 2006.
3.
go back to reference Federal Ministry of Health, Health Extension and Education Center. Profile of health extension program in Ethiopia. 2007. Federal Ministry of Health, Health Extension and Education Center. Profile of health extension program in Ethiopia. 2007.
5.
go back to reference Bhutta Z, Lassi Z, Pariyo G, Huicho L. Global experience of community health workers for delivery of health related millennium development goals: a systematic review, country case studies, and recommendations for integration into National Health Systems. Geneva; 2010. Bhutta Z, Lassi Z, Pariyo G, Huicho L. Global experience of community health workers for delivery of health related millennium development goals: a systematic review, country case studies, and recommendations for integration into National Health Systems. Geneva; 2010.
6.
go back to reference Bilal N, Herbst C, Zhao F, Soucat A, Lemiere C. Health extension workers in Ethiopia: improved access and coverage for the rural poor. In: Chuhan-Pole P, Angwafo M, editors. Yes Africa can success stories from a dyn cont. Washington, DC: World Bank; 2011. p. 433–43. Bilal N, Herbst C, Zhao F, Soucat A, Lemiere C. Health extension workers in Ethiopia: improved access and coverage for the rural poor. In: Chuhan-Pole P, Angwafo M, editors. Yes Africa can success stories from a dyn cont. Washington, DC: World Bank; 2011. p. 433–43.
7.
go back to reference Admassie A, Abebaw D, Woldemichael AD. Impact evaluation of the Ethiopian health services extension programme. J Dev Eff. 2009;1:430–49. Admassie A, Abebaw D, Woldemichael AD. Impact evaluation of the Ethiopian health services extension programme. J Dev Eff. 2009;1:430–49.
8.
go back to reference Medhanyie A, Spigt M, Kifle Y, Schaay N, Sanders D, Blanco R, et al. The role of health extension workers in improving utilization of maternal health services in rural areas in Ethiopia: a cross sectional study. BMC Health Serv Res. 2012;12:352.CrossRefPubMedPubMedCentral Medhanyie A, Spigt M, Kifle Y, Schaay N, Sanders D, Blanco R, et al. The role of health extension workers in improving utilization of maternal health services in rural areas in Ethiopia: a cross sectional study. BMC Health Serv Res. 2012;12:352.CrossRefPubMedPubMedCentral
9.
go back to reference Karim AM, Admassu K, Schellenberg J, Alemu H, Getachew N, Ameha A, et al. Effect of Ethiopia’s health extension program on maternal and newborn health care practices in 101 rural districts: a dose–response study. PLoS One. 2013;8:e65160.CrossRefPubMedPubMedCentral Karim AM, Admassu K, Schellenberg J, Alemu H, Getachew N, Ameha A, et al. Effect of Ethiopia’s health extension program on maternal and newborn health care practices in 101 rural districts: a dose–response study. PLoS One. 2013;8:e65160.CrossRefPubMedPubMedCentral
10.
go back to reference Teklehaimanot HD, Teklehaimanot A. Human resource development for a community-based health extension program: a case study from Ethiopia. Hum Resour Health. 2013;11:39.CrossRefPubMedPubMedCentral Teklehaimanot HD, Teklehaimanot A. Human resource development for a community-based health extension program: a case study from Ethiopia. Hum Resour Health. 2013;11:39.CrossRefPubMedPubMedCentral
11.
go back to reference Saldanha LS, Buback L, White JM, Mulugeta A, Solomon G, Roba AC, et al. Policies and program implementation experience to improve maternal nutrition in Ethiopia. Food Nutr Bull. 2012;33(2 Suppl):S27–50.CrossRefPubMed Saldanha LS, Buback L, White JM, Mulugeta A, Solomon G, Roba AC, et al. Policies and program implementation experience to improve maternal nutrition in Ethiopia. Food Nutr Bull. 2012;33(2 Suppl):S27–50.CrossRefPubMed
12.
go back to reference Dusenbury L. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRefPubMed Dusenbury L. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18:237–56.CrossRefPubMed
13.
go back to reference Dane A, Schneider B. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45.CrossRefPubMed Dane A, Schneider B. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18:23–45.CrossRefPubMed
14.
go back to reference Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5:47–53.CrossRefPubMed Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5:47–53.CrossRefPubMed
16.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41:327–50.CrossRefPubMed
17.
go back to reference Robert RC, Gittelsohn J, Creed-Kanashiro HM, Penny ME, Caulfield LE, Narro MR, et al. Process evaluation determines the pathway of success for a health center-delivered, nutrition education intervention for infants in Trujillo, Peru. J Nutr. 2006;136:634–41.PubMed Robert RC, Gittelsohn J, Creed-Kanashiro HM, Penny ME, Caulfield LE, Narro MR, et al. Process evaluation determines the pathway of success for a health center-delivered, nutrition education intervention for infants in Trujillo, Peru. J Nutr. 2006;136:634–41.PubMed
19.
go back to reference Breitenstein SM, Gross D, Garvey CA, Hill C, Fogg L, Resnick B. Implementation fidelity in community-based interventions. Res Nurs Health. 2010;33:164–73.PubMedPubMedCentral Breitenstein SM, Gross D, Garvey CA, Hill C, Fogg L, Resnick B. Implementation fidelity in community-based interventions. Res Nurs Health. 2010;33:164–73.PubMedPubMedCentral
20.
go back to reference Rawat R, Nguyen PH, Ali D, Saha K, Alayon S, Kim SS, et al. Learning how programs achieve their impact: Embedding theory-driven process evaluation and other program learning mechanisms in Alive & Thrive. Food Nutr Bull. 2013;34(Supplement 2):212S–25.CrossRef Rawat R, Nguyen PH, Ali D, Saha K, Alayon S, Kim SS, et al. Learning how programs achieve their impact: Embedding theory-driven process evaluation and other program learning mechanisms in Alive & Thrive. Food Nutr Bull. 2013;34(Supplement 2):212S–25.CrossRef
21.
go back to reference Menon P, Rawat R, Ruel M. Bringing rigor to evaluations of large-scale programs to improve infant and young child feeding and nutrition: the evaluation designs for the Alive & Thrive initiative. Food Nutr Bull. 2013;34(3 Suppl):S195–211.CrossRefPubMed Menon P, Rawat R, Ruel M. Bringing rigor to evaluations of large-scale programs to improve infant and young child feeding and nutrition: the evaluation designs for the Alive & Thrive initiative. Food Nutr Bull. 2013;34(3 Suppl):S195–211.CrossRefPubMed
22.
go back to reference Habicht JP, Victora CG, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme. Int J Epidemiol. 1999;28:10–8.CrossRefPubMed Habicht JP, Victora CG, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme. Int J Epidemiol. 1999;28:10–8.CrossRefPubMed
23.
go back to reference StataCorp. Stata statistical software: release 11. 2009. StataCorp. Stata statistical software: release 11. 2009.
24.
go back to reference QSR International. NVivo qualitative data analysis software, version 10. 2012. QSR International. NVivo qualitative data analysis software, version 10. 2012.
25.
go back to reference Bekele A, Kefale M, Tadesse M. Preliminary assessment of the implementation of the health services extension program : the case of southern Ethiopia. Ethiop J Health Dev. 2008;22:302–5.CrossRef Bekele A, Kefale M, Tadesse M. Preliminary assessment of the implementation of the health services extension program : the case of southern Ethiopia. Ethiop J Health Dev. 2008;22:302–5.CrossRef
26.
go back to reference Nguyen PH, Kim SS, Keithly SC, Hajeebhoy N, Tran LM, Ruel MT, et al. Incorporating elements of social franchising in government health services improves the quality of infant and young child feeding counselling services at commune health centres in Vietnam. Health Policy Plan. 2014;29(8):1008–20.CrossRefPubMed Nguyen PH, Kim SS, Keithly SC, Hajeebhoy N, Tran LM, Ruel MT, et al. Incorporating elements of social franchising in government health services improves the quality of infant and young child feeding counselling services at commune health centres in Vietnam. Health Policy Plan. 2014;29(8):1008–20.CrossRefPubMed
27.
go back to reference Loechl CU, Menon P, Arimond M, Ruel MT, Pelto G, Habicht J-P, et al. Using programme theory to assess the feasibility of delivering micronutrient Sprinkles through a food-assisted maternal and child health and nutrition programme in rural Haiti. Matern Child Nutr. 2009;5:33–48.CrossRefPubMed Loechl CU, Menon P, Arimond M, Ruel MT, Pelto G, Habicht J-P, et al. Using programme theory to assess the feasibility of delivering micronutrient Sprinkles through a food-assisted maternal and child health and nutrition programme in rural Haiti. Matern Child Nutr. 2009;5:33–48.CrossRefPubMed
28.
go back to reference Suchdev PS, Ruth L, Obure A, Were V, Ochieng C, Ogange L, et al. Monitoring the marketing, distribution, and use of Sprinkles micronutrient powders in rural western Kenya. Food Nutr Bull. 2010;31(2 Suppl):S168–78.CrossRefPubMed Suchdev PS, Ruth L, Obure A, Were V, Ochieng C, Ogange L, et al. Monitoring the marketing, distribution, and use of Sprinkles micronutrient powders in rural western Kenya. Food Nutr Bull. 2010;31(2 Suppl):S168–78.CrossRefPubMed
29.
go back to reference Avula R, Menon P, Saha KK, Bhuiyan MI, Chowdhury AS, Siraj S, et al. A program impact pathway analysis identifies critical steps in the implementation and utilization of a behavior change communication intervention promoting infant and child feeding practices in Bangladesh. J Nutr. 2013;143:2029–37.CrossRefPubMed Avula R, Menon P, Saha KK, Bhuiyan MI, Chowdhury AS, Siraj S, et al. A program impact pathway analysis identifies critical steps in the implementation and utilization of a behavior change communication intervention promoting infant and child feeding practices in Bangladesh. J Nutr. 2013;143:2029–37.CrossRefPubMed
Metadata
Title
Assessing implementation fidelity of a community-based infant and young child feeding intervention in Ethiopia identifies delivery challenges that limit reach to communities: a mixed-method process evaluation study
Authors
Sunny S Kim
Disha Ali
Andrew Kennedy
Roman Tesfaye
Amare W Tadesse
Teweldebrhan H Abrha
Rahul Rawat
Purnima Menon
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2015
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-015-1650-4

Other articles of this Issue 1/2015

BMC Public Health 1/2015 Go to the issue