Skip to main content
Top
Published in: Health Research Policy and Systems 2/2017

Open Access 01-12-2017 | Research

Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda

Authors: Ligia Paina, Annie Wilkinson, Moses Tetui, Elizabeth Ekirapa-Kiracho, Debjani Barman, Tanvir Ahmed, Shehrin Shaila Mahmood, Gerry Bloom, Jeff Knezovich, Asha George, Sara Bennett

Published in: Health Research Policy and Systems | Special Issue 2/2017

Login to get access

Abstract

Background

The Theory of Change (ToC) is a management and evaluation tool supporting critical thinking in the design, implementation and evaluation of development programmes. We document the experience of Future Health Systems (FHS) Consortium research teams in Bangladesh, India and Uganda with using ToC. We seek to understand how and why ToCs were applied and to clarify how they facilitate the implementation of iterative intervention designs and stakeholder engagement in health systems research and strengthening.

Methods

This paper combines literature on ToC, with a summary of reflections by FHS research members on the motivation, development, revision and use of the ToC, as well as on the benefits and challenges of the process. We describe three FHS teams’ experiences along four potential uses of ToCs, namely planning, communication, learning and accountability.

Results

The three teams developed ToCs for planning and evaluation purposes as required for their initial plans for FHS in 2011 and revised them half-way through the project, based on assumptions informed by and adjusted through the teams’ experiences during the previous 2 years of implementation. All teams found that the revised ToCs and their accompanying narratives recognised greater feedback among intervention components and among key stakeholders. The ToC development and revision fostered channels for both internal and external communication, among research team members and with key stakeholders, respectively. The process of revising the ToCs challenged the teams’ initial assumptions based on new evidence and experience. In contrast, the ToCs were only minimally used for accountability purposes.

Conclusions

The ToC development and revision process helped FHS research teams, and occasionally key local stakeholders, to reflect on and make their assumptions and mental models about their respective interventions explicit. Other projects using the ToC should allow time for revising and reflecting upon the ToCs, to recognise and document the adaptive nature of health systems, and to foster the time, space and flexibility that health systems strengthening programmes must have to learn from implementation and stakeholder engagement.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vogel I. Review of the Use of “Theory of Change” in International Development. London: Commissioned by the UK Department for International Development; 2012. Vogel I. Review of the Use of “Theory of Change” in International Development. London: Commissioned by the UK Department for International Development; 2012.
2.
go back to reference Stein D, Valters C. Understanding Theory of Change in International Development. The Justice and Security Research Programme Paper 1. London: Justice and Security Research Programme – London School of Economics; 2012. Stein D, Valters C. Understanding Theory of Change in International Development. The Justice and Security Research Programme Paper 1. London: Justice and Security Research Programme – London School of Economics; 2012.
3.
go back to reference Valters C. Theories of Change in International Development: Communication, Learning, or Accountability? Justice and Security Research Program Papers. London: The Asia Foundation; 2014. Valters C. Theories of Change in International Development: Communication, Learning, or Accountability? Justice and Security Research Program Papers. London: The Asia Foundation; 2014.
4.
go back to reference Breuer E, et al. Using workshops to develop theories of change in five low and middle income countries: lessons from the programme for improving mental health care (PRIME). Int J Ment Health Syst. 2014;8:15.CrossRefPubMedPubMedCentral Breuer E, et al. Using workshops to develop theories of change in five low and middle income countries: lessons from the programme for improving mental health care (PRIME). Int J Ment Health Syst. 2014;8:15.CrossRefPubMedPubMedCentral
5.
go back to reference De Silva MJ, et al. Theory of Change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267.CrossRefPubMedPubMedCentral De Silva MJ, et al. Theory of Change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267.CrossRefPubMedPubMedCentral
6.
go back to reference Deane KL, Harre N. Program theory-driven evaluation science in a youth development context. Eval Program Plann. 2014;45:61–70.CrossRefPubMed Deane KL, Harre N. Program theory-driven evaluation science in a youth development context. Eval Program Plann. 2014;45:61–70.CrossRefPubMed
7.
go back to reference Jones SM, Bub KL, Raver CC. Unpacking the black box of the CSRP intervention: the mediating roles of teacher-child relationship quality and self-regulation. Early Educ Dev. 2013;24(7):1043–64.CrossRefPubMedPubMedCentral Jones SM, Bub KL, Raver CC. Unpacking the black box of the CSRP intervention: the mediating roles of teacher-child relationship quality and self-regulation. Early Educ Dev. 2013;24(7):1043–64.CrossRefPubMedPubMedCentral
9.
go back to reference Hagelskamp C, et al. Improving classroom quality with the RULER approach to social and emotional learning: proximal and distal outcomes. Am J Community Psychol. 2013;51(3-4):530–43.CrossRefPubMed Hagelskamp C, et al. Improving classroom quality with the RULER approach to social and emotional learning: proximal and distal outcomes. Am J Community Psychol. 2013;51(3-4):530–43.CrossRefPubMed
10.
go back to reference Chandani Y, et al. Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012;87(5 Suppl):120–6.CrossRefPubMedPubMedCentral Chandani Y, et al. Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012;87(5 Suppl):120–6.CrossRefPubMedPubMedCentral
11.
go back to reference Mackenzie M. Benefit or burden: introducing paraprofessional support staff to health visiting teams: the case of Starting Well. Health Soc Care Commun. 2006;14(6):523–31.CrossRef Mackenzie M. Benefit or burden: introducing paraprofessional support staff to health visiting teams: the case of Starting Well. Health Soc Care Commun. 2006;14(6):523–31.CrossRef
12.
go back to reference Julian DA. Enhancing quality of practice through theory of change-based evaluation: Science or practice? Am J Community Psychol. 2005;35(3-4):159–68.CrossRefPubMed Julian DA. Enhancing quality of practice through theory of change-based evaluation: Science or practice? Am J Community Psychol. 2005;35(3-4):159–68.CrossRefPubMed
14.
go back to reference Scanlon DP, et al. The Aligning Forces for Quality initiative: background and evolution from 2005 to 2012. Am J Manag Care. 2012;18(6 Suppl):s115–25.PubMed Scanlon DP, et al. The Aligning Forces for Quality initiative: background and evolution from 2005 to 2012. Am J Manag Care. 2012;18(6 Suppl):s115–25.PubMed
15.
go back to reference Carman JG. The accountability movement: what’s wrong with this Theory of Change? Nonprofit Volunt Sect Q. 2010;39(2):256–74.CrossRef Carman JG. The accountability movement: what’s wrong with this Theory of Change? Nonprofit Volunt Sect Q. 2010;39(2):256–74.CrossRef
16.
go back to reference Geddes M, Davies J, Fuller C. Evaluating local strategic partnerships: theory and practice of change. Local Government Studies. 2007;33(1):97–116.CrossRef Geddes M, Davies J, Fuller C. Evaluating local strategic partnerships: theory and practice of change. Local Government Studies. 2007;33(1):97–116.CrossRef
17.
go back to reference Klugman B. Effective social justice advocacy: a theory-of-change framework for assessing progress. Reprod Health Matters. 2011;19(38):146–62.CrossRefPubMed Klugman B. Effective social justice advocacy: a theory-of-change framework for assessing progress. Reprod Health Matters. 2011;19(38):146–62.CrossRefPubMed
18.
go back to reference Ling T. Evaluating complex and unfolding interventions in real time. Evaluation. 2012;18(1):79–91.CrossRef Ling T. Evaluating complex and unfolding interventions in real time. Evaluation. 2012;18(1):79–91.CrossRef
19.
go back to reference Hernandez M, Hodges S. Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006;38(3-4):165–73.CrossRefPubMed Hernandez M, Hodges S. Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006;38(3-4):165–73.CrossRefPubMed
20.
go back to reference Levison-Johnson J, Wenz-Gross M. From complexity to reality: providing useful frameworks for defining systems of care. Eval Program Plann. 2010;33(1):56–8.CrossRefPubMed Levison-Johnson J, Wenz-Gross M. From complexity to reality: providing useful frameworks for defining systems of care. Eval Program Plann. 2010;33(1):56–8.CrossRefPubMed
21.
go back to reference Breuer E, et al. Planning and evaluating mental health services in low- and middle-income countries using theory of change. Br J Psychiatry. 2016;208 Suppl 56:s55–62.CrossRefPubMedPubMedCentral Breuer E, et al. Planning and evaluating mental health services in low- and middle-income countries using theory of change. Br J Psychiatry. 2016;208 Suppl 56:s55–62.CrossRefPubMedPubMedCentral
22.
23.
24.
go back to reference Schierhout G, et al. Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implement Sci. 2013;8:119.CrossRefPubMedPubMedCentral Schierhout G, et al. Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implement Sci. 2013;8:119.CrossRefPubMedPubMedCentral
25.
go back to reference Douglas FC, Gray DA, van Teijlingen ER. Using a realist approach to evaluate smoking cessation interventions targeting pregnant women and young people. BMC Health Serv Res. 2010;10:49.CrossRefPubMedPubMedCentral Douglas FC, Gray DA, van Teijlingen ER. Using a realist approach to evaluate smoking cessation interventions targeting pregnant women and young people. BMC Health Serv Res. 2010;10:49.CrossRefPubMedPubMedCentral
26.
go back to reference Smith N, Barnes M. New jobs old roles - working for prevention in a whole-system model of health and social care for older people. Health Soc Care Commun. 2013;21(1):79–87.CrossRef Smith N, Barnes M. New jobs old roles - working for prevention in a whole-system model of health and social care for older people. Health Soc Care Commun. 2013;21(1):79–87.CrossRef
27.
go back to reference Valters C. Theories of Change: Time for a Radical Approach to Learning in Development. London: Overseas Development Institute; 2015. Valters C. Theories of Change: Time for a Radical Approach to Learning in Development. London: Overseas Development Institute; 2015.
28.
go back to reference Susman G. Action research: a sociotechnical systems perspective. In: Morgan G, editor. Beyond Method: Strategies for Social Research. Newbury Park: SAGE Publications; 1983. Susman G. Action research: a sociotechnical systems perspective. In: Morgan G, editor. Beyond Method: Strategies for Social Research. Newbury Park: SAGE Publications; 1983.
29.
go back to reference Loewenson R, et al. Participatory Action Research in Health Systems: A Methods Reader. Harare: TARSC, AHPSR, WHO, IDRC Canada, EQUINET; 2014. Loewenson R, et al. Participatory Action Research in Health Systems: A Methods Reader. Harare: TARSC, AHPSR, WHO, IDRC Canada, EQUINET; 2014.
30.
go back to reference Argyris C. Double Loop Learning in Organizations. Harvard Business Review. Brighton, MA: Harvard Business Publishing; 1977. Argyris C. Double Loop Learning in Organizations. Harvard Business Review. Brighton, MA: Harvard Business Publishing; 1977.
32.
go back to reference Khatun F, et al. Determinants of readiness to adopt mHealth in a rural community of Bangladesh. Int J Med Inform. 2015;84(10):847–56.CrossRefPubMed Khatun F, et al. Determinants of readiness to adopt mHealth in a rural community of Bangladesh. Int J Med Inform. 2015;84(10):847–56.CrossRefPubMed
33.
go back to reference Khatun F, et al. Community readiness for adopting mHealth in rural Bangladesh: a qualitative exploration. Int J Med Inform. 2016;93:49–56.CrossRefPubMed Khatun F, et al. Community readiness for adopting mHealth in rural Bangladesh: a qualitative exploration. Int J Med Inform. 2016;93:49–56.CrossRefPubMed
Metadata
Title
Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda
Authors
Ligia Paina
Annie Wilkinson
Moses Tetui
Elizabeth Ekirapa-Kiracho
Debjani Barman
Tanvir Ahmed
Shehrin Shaila Mahmood
Gerry Bloom
Jeff Knezovich
Asha George
Sara Bennett
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue Special Issue 2/2017
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-017-0272-y

Other articles of this Special Issue 2/2017

Health Research Policy and Systems 2/2017 Go to the issue