Skip to main content
Top
Published in: Trials 1/2014

Open Access 01-12-2014 | Methodology

Theory of Change: a theory-driven approach to enhance the Medical Research Council's framework for complex interventions

Authors: Mary J De Silva, Erica Breuer, Lucy Lee, Laura Asher, Neerja Chowdhary, Crick Lund, Vikram Patel

Published in: Trials | Issue 1/2014

Login to get access

Abstract

Background

The Medical Research Councils’ framework for complex interventions has been criticized for not including theory-driven approaches to evaluation. Although the framework does include broad guidance on the use of theory, it contains little practical guidance for implementers and there have been calls to develop a more comprehensive approach. A prospective, theory-driven process of intervention design and evaluation is required to develop complex healthcare interventions which are more likely to be effective, sustainable and scalable.

Methods

We propose a theory-driven approach to the design and evaluation of complex interventions by adapting and integrating a programmatic design and evaluation tool, Theory of Change (ToC), into the MRC framework for complex interventions. We provide a guide to what ToC is, how to construct one, and how to integrate its use into research projects seeking to design, implement and evaluate complex interventions using the MRC framework. We test this approach by using ToC within two randomized controlled trials and one non-randomized evaluation of complex interventions.

Results

Our application of ToC in three research projects has shown that ToC can strengthen key stages of the MRC framework. It can aid the development of interventions by providing a framework for enhanced stakeholder engagement and by explicitly designing an intervention that is embedded in the local context. For the feasibility and piloting stage, ToC enables the systematic identification of knowledge gaps to generate research questions that strengthen intervention design. ToC may improve the evaluation of interventions by providing a comprehensive set of indicators to evaluate all stages of the causal pathway through which an intervention achieves impact, combining evaluations of intervention effectiveness with detailed process evaluations into one theoretical framework.

Conclusions

Incorporating a ToC approach into the MRC framework holds promise for improving the design and evaluation of complex interventions, thereby increasing the likelihood that the intervention will be ultimately effective, sustainable and scalable. We urge researchers developing and evaluating complex interventions to consider using this approach, to evaluate its usefulness and to build an evidence base to further refine the methodology.

Trial registration

Clinical trials.gov: NCT02160249
Appendix
Available only for authorised users
Literature
1.
go back to reference Craig P, Dieppe P, Macintyre S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008, 337: a1655-CrossRef Craig P, Dieppe P, Macintyre S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008, 337: a1655-CrossRef
2.
go back to reference Craig P, Petticrew M: Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. Int J Nurs Stud. 2013, 50: 585-587.CrossRefPubMed Craig P, Petticrew M: Developing and evaluating complex interventions: reflections on the 2008 MRC guidance. Int J Nurs Stud. 2013, 50: 585-587.CrossRefPubMed
3.
go back to reference Anderson R: New MRC guidance on evaluating complex interventions. Br Med J. 2008, 337: a1937-CrossRef Anderson R: New MRC guidance on evaluating complex interventions. Br Med J. 2008, 337: a1937-CrossRef
4.
go back to reference Bonell C, Fletcher A, Morton M, Lorenc T, Moore L: Realist randomized controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012, 75: 2299-2306.CrossRefPubMed Bonell C, Fletcher A, Morton M, Lorenc T, Moore L: Realist randomized controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012, 75: 2299-2306.CrossRefPubMed
5.
go back to reference Ling T: Evaluating complex and unfolding interventions in real time. Evaluation. 2012, 18: 79-91.CrossRef Ling T: Evaluating complex and unfolding interventions in real time. Evaluation. 2012, 18: 79-91.CrossRef
6.
go back to reference Coryn CLS, Noakes LA, Westine CD, Schrote DC: A systematic review of theory-driven evaluation practice from 1990 to 2009. Am J Eval. 2011, 32: 199-226.CrossRef Coryn CLS, Noakes LA, Westine CD, Schrote DC: A systematic review of theory-driven evaluation practice from 1990 to 2009. Am J Eval. 2011, 32: 199-226.CrossRef
7.
go back to reference Kirkpatrick DL: Techniques for Evaluating Training Programmes”. J Am Soc for Train Dev. 1959, 11: 1-13. Kirkpatrick DL: Techniques for Evaluating Training Programmes”. J Am Soc for Train Dev. 1959, 11: 1-13.
8.
go back to reference Chen HT: Theory Driven Evaluation. 1990, Thousand Oaks, California: Sage Chen HT: Theory Driven Evaluation. 1990, Thousand Oaks, California: Sage
9.
go back to reference James C: Theory of Change Review: A report comissioned by Comic Relief. 2011 James C: Theory of Change Review: A report comissioned by Comic Relief. 2011
10.
go back to reference Weiss CH: Nothing As Practical As Good Theory: Exploring Theory-Based Evaluation For Comprehensive Community Initiatives For Children And Families. New Approaches to Evaluating Community Initiatives Volume 1 Concepts, Methods and Contexts. Edited by: Connell JP, Kubisch AC, Schorr LB, Weiss CH. 1995, Washington DC: The Aspen Institute, 65-92. Weiss CH: Nothing As Practical As Good Theory: Exploring Theory-Based Evaluation For Comprehensive Community Initiatives For Children And Families. New Approaches to Evaluating Community Initiatives Volume 1 Concepts, Methods and Contexts. Edited by: Connell JP, Kubisch AC, Schorr LB, Weiss CH. 1995, Washington DC: The Aspen Institute, 65-92.
11.
go back to reference Connell JP, Kubisch AC: Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. New Approaches to Evaluating Community Initiatives, Volume 2: Theory, Measurement, and Analysis. 1998, Washington DC: The Aspen Institute Connell JP, Kubisch AC: Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. New Approaches to Evaluating Community Initiatives, Volume 2: Theory, Measurement, and Analysis. 1998, Washington DC: The Aspen Institute
12.
go back to reference Anderson A: The Community Builder’s Approach to Theory of Change. A Practical Guide to Theory Development. 2005, New York: The Aspen Institute Anderson A: The Community Builder’s Approach to Theory of Change. A Practical Guide to Theory Development. 2005, New York: The Aspen Institute
13.
go back to reference Vogel I: Review of the use of Theory of Change in International Development. 2012, London: UK Department of International Development Vogel I: Review of the use of Theory of Change in International Development. 2012, London: UK Department of International Development
14.
go back to reference Sullivan H, Barnes HM, Matka E: Building collaborative capacity through `Theories of Change': early lessons from the evaluation of Health Action Zones in England. Evaluation. 2002, 8: 205-226.CrossRef Sullivan H, Barnes HM, Matka E: Building collaborative capacity through `Theories of Change': early lessons from the evaluation of Health Action Zones in England. Evaluation. 2002, 8: 205-226.CrossRef
15.
go back to reference Mason P, Barnes M: Constructing theories of Change: methods and sources. Evaluation. 2007, 13: 151-170.CrossRef Mason P, Barnes M: Constructing theories of Change: methods and sources. Evaluation. 2007, 13: 151-170.CrossRef
16.
go back to reference Weitzman BC, Mijanovich T, Silver D, Brecher C: Finding the impact in a messy intervention: using an integrated design to evaluate a comprehensive citywide health initiative. Am J Eval. 2009, 30: 495-514.CrossRef Weitzman BC, Mijanovich T, Silver D, Brecher C: Finding the impact in a messy intervention: using an integrated design to evaluate a comprehensive citywide health initiative. Am J Eval. 2009, 30: 495-514.CrossRef
17.
go back to reference Weitzman BC, Silver D, Dillman KN: Integrating a comparison group design into a Theory of Change evaluation: the case of the urban health initiative. Am J Eval. 2002, 23: 371-385.CrossRef Weitzman BC, Silver D, Dillman KN: Integrating a comparison group design into a Theory of Change evaluation: the case of the urban health initiative. Am J Eval. 2002, 23: 371-385.CrossRef
18.
go back to reference Cole M: The Health Action Zone initiative: lessons from Plymouth. Local Govern Stud. 2003, 29: 99-117.CrossRef Cole M: The Health Action Zone initiative: lessons from Plymouth. Local Govern Stud. 2003, 29: 99-117.CrossRef
19.
go back to reference Kernik D: Wanted—new methodologies for health service research. Is complexity theory the answer? Fam Pract. 2006, 23: 385-390.CrossRef Kernik D: Wanted—new methodologies for health service research. Is complexity theory the answer? Fam Pract. 2006, 23: 385-390.CrossRef
20.
go back to reference Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50: 179-211.CrossRef Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50: 179-211.CrossRef
21.
go back to reference Murray M, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C, Ong B, Rapley T, Rogers A, May C: Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010, 8: 63-CrossRefPubMedPubMedCentral Murray M, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C, Ong B, Rapley T, Rogers A, May C: Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010, 8: 63-CrossRefPubMedPubMedCentral
22.
go back to reference Department for International Development: How to Note: Guidance on using revised Logical Framework. 2011, London Department for International Development: How to Note: Guidance on using revised Logical Framework. 2011, London
23.
go back to reference Clark H, Andersen A: Theories of Change and Logic Models: Telling Them Apart. 2004 Presented at the American Evaluation Association Conference. 2004, Atlanta, Georgia Clark H, Andersen A: Theories of Change and Logic Models: Telling Them Apart. 2004 Presented at the American Evaluation Association Conference. 2004, Atlanta, Georgia
24.
go back to reference Rahman A, Malik A, Sikander S, Roberts C, Creed F: Cognitive behaviour therapy-based intervention by community health workers for mothers with depression and their infants in rural Pakistan: a cluster-randomized controlled trial. Lancet. 2008, 372: 902-909.CrossRefPubMedPubMedCentral Rahman A, Malik A, Sikander S, Roberts C, Creed F: Cognitive behaviour therapy-based intervention by community health workers for mothers with depression and their infants in rural Pakistan: a cluster-randomized controlled trial. Lancet. 2008, 372: 902-909.CrossRefPubMedPubMedCentral
25.
go back to reference Taplin D, Rasic M: Theory of Change Technical Papers: A series of papers to support development of theories of change based on practice in the field. 2013, New York: ActKnowledge Taplin D, Rasic M: Theory of Change Technical Papers: A series of papers to support development of theories of change based on practice in the field. 2013, New York: ActKnowledge
26.
go back to reference Taplin DH, Rasic M: Facilitator's Source Book: Source Book for facilitators leading Theory of Change development sessions. 2012, New York: ActKnowledge Taplin DH, Rasic M: Facilitator's Source Book: Source Book for facilitators leading Theory of Change development sessions. 2012, New York: ActKnowledge
27.
go back to reference Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B: Process evaluations for cluster-randomized trials of complex interventions: a proposed framework for design and reporting. Trials. 2013, 14: 15-CrossRefPubMedPubMedCentral Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B: Process evaluations for cluster-randomized trials of complex interventions: a proposed framework for design and reporting. Trials. 2013, 14: 15-CrossRefPubMedPubMedCentral
28.
go back to reference Bagozzi R, Yi Y: Specification, evaluation, and interpretation of structural equation models. J Acad Market Sci. 2012, 40: 8-34.CrossRef Bagozzi R, Yi Y: Specification, evaluation, and interpretation of structural equation models. J Acad Market Sci. 2012, 40: 8-34.CrossRef
29.
go back to reference Robinson S: Simulation - The practice of model development and use. 2004, Chichester, UK: Wiley Robinson S: Simulation - The practice of model development and use. 2004, Chichester, UK: Wiley
30.
go back to reference Bonabeau E: Agent-based modeling: methods and techniques for simulating human systems. Proc National Acad Sci. 2002, 99: 7280-7287.CrossRef Bonabeau E: Agent-based modeling: methods and techniques for simulating human systems. Proc National Acad Sci. 2002, 99: 7280-7287.CrossRef
31.
go back to reference Sterman J: System dynamics modeling: tools for learning in a complex world. Calif Manage Rev. 2001, 43: 8-25.CrossRef Sterman J: System dynamics modeling: tools for learning in a complex world. Calif Manage Rev. 2001, 43: 8-25.CrossRef
32.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, AL K: Designing and evaluating complex interventions to improve health care. Br Med J. 2007, 334: 455-459.CrossRef Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, AL K: Designing and evaluating complex interventions to improve health care. Br Med J. 2007, 334: 455-459.CrossRef
33.
go back to reference WHO: Community based rehabilitation: CBR guidelines. 2010, Geneva: World Health Organization WHO: Community based rehabilitation: CBR guidelines. 2010, Geneva: World Health Organization
34.
go back to reference Chatterjee S, Naik SS, John S, Dabholkar H, Balaji M, Koschorke M, Varghese M, Thara R, Weiss HA, Williams P, McCrone P, Patel V, Thornicroft G: Effectiveness of a community-based intervention for people with schizophrenia and their caregivers in India (COPSI): a randomized controlled trial. Lancet. 2014, 383: 1385-1394.CrossRefPubMedPubMedCentral Chatterjee S, Naik SS, John S, Dabholkar H, Balaji M, Koschorke M, Varghese M, Thara R, Weiss HA, Williams P, McCrone P, Patel V, Thornicroft G: Effectiveness of a community-based intervention for people with schizophrenia and their caregivers in India (COPSI): a randomized controlled trial. Lancet. 2014, 383: 1385-1394.CrossRefPubMedPubMedCentral
35.
go back to reference Lund C, Jordans M, Petersen I, Bhana A, Kigozi F, Prince M, Thornicroft G, Hanlon C, Kakuma R, McDaid D, Saxena S, Chisholm D, Raja S, Kippen-Wood S, Honikman S, Fairall L, Patel V: PRIME: A programme to reduce the treatment gap for mental disorders in five low- and middle-income countries. PLoS Med. 2012, 9: e1001359-CrossRefPubMedPubMedCentral Lund C, Jordans M, Petersen I, Bhana A, Kigozi F, Prince M, Thornicroft G, Hanlon C, Kakuma R, McDaid D, Saxena S, Chisholm D, Raja S, Kippen-Wood S, Honikman S, Fairall L, Patel V: PRIME: A programme to reduce the treatment gap for mental disorders in five low- and middle-income countries. PLoS Med. 2012, 9: e1001359-CrossRefPubMedPubMedCentral
36.
go back to reference Breuer E, De Silva M, Fekadu A, Luitel N, Murhar V, Nakku J, Petersen I, Lund C: Using workshops to develop Theories of Change in five low and middle income countries: lessons from the Programme for Improving Mental Health Care (PRIME). Intl J Ment Health Syst. 2014, 8: 15-CrossRef Breuer E, De Silva M, Fekadu A, Luitel N, Murhar V, Nakku J, Petersen I, Lund C: Using workshops to develop Theories of Change in five low and middle income countries: lessons from the Programme for Improving Mental Health Care (PRIME). Intl J Ment Health Syst. 2014, 8: 15-CrossRef
37.
go back to reference Hanlon C, Luitel NP, Kathree T, Murhar V, Shrivasta S, Medhin G, Ssebunnya J, Fekadu A, Shidhaye R, Petersen I, Jordans M, Kigozi F, Thornicroft G, Patel V, Tomlinson M, Lund C, Breuer E, De Silva M, Prince M: Challenges and opportunities for implementing integrated mental health care: a district level situation analysis from five low- and middle-income countries. PLoS One. 2014, 9: e88437-CrossRefPubMedPubMedCentral Hanlon C, Luitel NP, Kathree T, Murhar V, Shrivasta S, Medhin G, Ssebunnya J, Fekadu A, Shidhaye R, Petersen I, Jordans M, Kigozi F, Thornicroft G, Patel V, Tomlinson M, Lund C, Breuer E, De Silva M, Prince M: Challenges and opportunities for implementing integrated mental health care: a district level situation analysis from five low- and middle-income countries. PLoS One. 2014, 9: e88437-CrossRefPubMedPubMedCentral
38.
go back to reference Hawe P, Shiell A, Riley T, Gold L: Methods for exploring implementation variation and local context within a cluster randomized community intervention trial. J Epidemiol Community Health. 2004, 58: 788-793.CrossRefPubMedPubMedCentral Hawe P, Shiell A, Riley T, Gold L: Methods for exploring implementation variation and local context within a cluster randomized community intervention trial. J Epidemiol Community Health. 2004, 58: 788-793.CrossRefPubMedPubMedCentral
39.
go back to reference Segal L, Sara Opie R, Dalziel K: Theory! The missing link in understanding the performance of neonate/infant home-visiting programs to prevent child maltreatment: a systematic review. Milbank Q. 2012, 90: 47-106.CrossRefPubMedPubMedCentral Segal L, Sara Opie R, Dalziel K: Theory! The missing link in understanding the performance of neonate/infant home-visiting programs to prevent child maltreatment: a systematic review. Milbank Q. 2012, 90: 47-106.CrossRefPubMedPubMedCentral
40.
go back to reference Anderson L, Anderson L, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P: Using logic models to capture complexity in systematic reviews. Res Synth Meth. 2011, 2: 33-42.CrossRef Anderson L, Anderson L, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P: Using logic models to capture complexity in systematic reviews. Res Synth Meth. 2011, 2: 33-42.CrossRef
41.
go back to reference Afifi R, Makhoul J, El Hajj T, Nakkash R: Developing a logic model for youth mental health: participatory research with a refugee community in Beirut. Health Policy Plan. 2011, 26: 508-517.CrossRefPubMedPubMedCentral Afifi R, Makhoul J, El Hajj T, Nakkash R: Developing a logic model for youth mental health: participatory research with a refugee community in Beirut. Health Policy Plan. 2011, 26: 508-517.CrossRefPubMedPubMedCentral
42.
go back to reference Hernandez M, Hodges S: Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006, 38: 165-173.CrossRefPubMed Hernandez M, Hodges S: Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006, 38: 165-173.CrossRefPubMed
43.
go back to reference Chandani Y, Noel M, Pomeroy A, Andersson S, Pahl M, Williams T: Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012, 87: 120-126.CrossRefPubMedPubMedCentral Chandani Y, Noel M, Pomeroy A, Andersson S, Pahl M, Williams T: Factors affecting availability of essential medicines among community health workers in Ethiopia, Malawi, and Rwanda: solving the last mile puzzle. Am J Trop Med Hyg. 2012, 87: 120-126.CrossRefPubMedPubMedCentral
44.
go back to reference Hawkins J, Brown E, Oesterle S, Arthur M, Abbott R, Catalano R: Early effects of Communities That Care on targeted risks and initiation of delinquent behavior and substance use. J Adolesc Health. 2008, 43: 15-22.CrossRefPubMed Hawkins J, Brown E, Oesterle S, Arthur M, Abbott R, Catalano R: Early effects of Communities That Care on targeted risks and initiation of delinquent behavior and substance use. J Adolesc Health. 2008, 43: 15-22.CrossRefPubMed
45.
go back to reference Bickman L: The application of program theory to the evaluation of a managed mental health care system. Eval Program Plann. 1996, 19: 111-119.CrossRef Bickman L: The application of program theory to the evaluation of a managed mental health care system. Eval Program Plann. 1996, 19: 111-119.CrossRef
46.
go back to reference Van Belle S, Marchal B, Dubourg D, Kegels G: How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa. BMC Public Health. 2010, 10: 741-CrossRefPubMedPubMedCentral Van Belle S, Marchal B, Dubourg D, Kegels G: How to develop a theory-driven evaluation design? Lessons learned from an adolescent sexual and reproductive health programme in West Africa. BMC Public Health. 2010, 10: 741-CrossRefPubMedPubMedCentral
Metadata
Title
Theory of Change: a theory-driven approach to enhance the Medical Research Council's framework for complex interventions
Authors
Mary J De Silva
Erica Breuer
Lucy Lee
Laura Asher
Neerja Chowdhary
Crick Lund
Vikram Patel
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Trials / Issue 1/2014
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-15-267

Other articles of this Issue 1/2014

Trials 1/2014 Go to the issue