Skip to main content
Top
Published in: International Journal of Mental Health Systems 1/2014

Open Access 01-12-2014 | Research

Using workshops to develop theories of change in five low and middle income countries: lessons from the programme for improving mental health care (PRIME)

Authors: Erica Breuer, Mary J De Silva, Abebaw Fekadu, Nagendra Prasad Luitel, Vaibhav Murhar, Juliet Nakku, Inge Petersen, Crick Lund

Published in: International Journal of Mental Health Systems | Issue 1/2014

Login to get access

Abstract

Background

The Theory of Change (ToC) approach has been used to develop and evaluate complex health initiatives in a participatory way in high income countries. Little is known about its use to develop mental health care plans in low and middle income countries where mental health services remain inadequate.

Aims

ToC workshops were held as part of formative phase of the Programme for Improving Mental Health Care (PRIME) in order 1) to develop a structured logical and evidence-based ToC map as a basis for a mental health care plan in each district; (2) to contextualise the plans; and (3) to obtain stakeholder buy-in in Ethiopia, India, Nepal, South Africa and Uganda. This study describes the structure and facilitator’s experiences of ToC workshops.

Methods

The facilitators of the ToC workshops were interviewed and the interviews were recorded, transcribed and analysed together with process documentation from the workshops using a framework analysis approach.

Results

Thirteen workshops were held in the five PRIME countries at different levels of the health system. The ToC workshops achieved their stated goals with the contributions of different stakeholders. District health planners, mental health specialists, and researchers contributed the most to the development of the ToC while service providers provided detailed contextual information. Buy-in was achieved from all stakeholders but valued more from those in control of resources.

Conclusions

ToC workshops are a useful approach for developing ToCs as a basis for mental health care plans because they facilitate logical, evidence based and contextualised plans, while promoting stakeholder buy in. Because of the existing hierarchies within some health systems, strategies such as limiting the types of participants and stratifying the workshops can be used to ensure productive workshops.
Appendix
Available only for authorised users
Literature
1.
go back to reference Saraceno B, Van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, Sridhar D, Underhill C: Barriers to improvement of mental health services in low-income and middle-income countries. Lancet. 2007, 370: 1164-1174. 10.1016/S0140-6736(07)61263-X.CrossRefPubMed Saraceno B, Van Ommeren M, Batniji R, Cohen A, Gureje O, Mahoney J, Sridhar D, Underhill C: Barriers to improvement of mental health services in low-income and middle-income countries. Lancet. 2007, 370: 1164-1174. 10.1016/S0140-6736(07)61263-X.CrossRefPubMed
2.
go back to reference WHO: Mental Health Atlas 2011. 2011, Italy: World Health Organisation WHO: Mental Health Atlas 2011. 2011, Italy: World Health Organisation
3.
go back to reference Collins PY, Insel TR, Chockalingam A, Daar A, Maddox YT: Grand Challenges in Global Mental Health: Integration in Research, Policy, and Practice. PLoS Med. 2013, 10: e1001434-10.1371/journal.pmed.1001434.PubMedCentralCrossRefPubMed Collins PY, Insel TR, Chockalingam A, Daar A, Maddox YT: Grand Challenges in Global Mental Health: Integration in Research, Policy, and Practice. PLoS Med. 2013, 10: e1001434-10.1371/journal.pmed.1001434.PubMedCentralCrossRefPubMed
4.
go back to reference Dua T, Barbui C, Clark N, Fleischmann A, Poznyak V, van Ommeren M, Yasamy MT, Ayuso-Mateos JL, Birbeck GL, Drummond C, Freeman M, Giannakopoulos P, Levav I, Obot IS, Omigbodun O, Patel V, Phillips M, Prince M, Rahimi-Movaghar A, Rahman A, Sander JW, Saunders JB, Servili C, Rangaswamy T, Unutzer J, Ventevogel P, Vijayakumar L, Thornicroft G, Saxena S: Evidence-based guidelines for mental, neurological, and substance use disorders in low- and middle-income countries: summary of WHO recommendations. PLoS Med. 2011, 8: e1001122-10.1371/journal.pmed.1001122.PubMedCentralCrossRefPubMed Dua T, Barbui C, Clark N, Fleischmann A, Poznyak V, van Ommeren M, Yasamy MT, Ayuso-Mateos JL, Birbeck GL, Drummond C, Freeman M, Giannakopoulos P, Levav I, Obot IS, Omigbodun O, Patel V, Phillips M, Prince M, Rahimi-Movaghar A, Rahman A, Sander JW, Saunders JB, Servili C, Rangaswamy T, Unutzer J, Ventevogel P, Vijayakumar L, Thornicroft G, Saxena S: Evidence-based guidelines for mental, neurological, and substance use disorders in low- and middle-income countries: summary of WHO recommendations. PLoS Med. 2011, 8: e1001122-10.1371/journal.pmed.1001122.PubMedCentralCrossRefPubMed
5.
go back to reference Israel BA, Schulz AJ, Parker EA, Becker AB: Review of community based research: Assessing Partnership Approaches to Improve Public Health. Annu Rev Public Health. 1998, 19: 173-202. 10.1146/annurev.publhealth.19.1.173.CrossRefPubMed Israel BA, Schulz AJ, Parker EA, Becker AB: Review of community based research: Assessing Partnership Approaches to Improve Public Health. Annu Rev Public Health. 1998, 19: 173-202. 10.1146/annurev.publhealth.19.1.173.CrossRefPubMed
6.
go back to reference Gilson L: Health systems and institutions. Health systems in low- and middle-income countries: an economic and policy perspective. Edited by: Smith RJ, Hanson K. 2012, Oxford: Oxford University Press Gilson L: Health systems and institutions. Health systems in low- and middle-income countries: an economic and policy perspective. Edited by: Smith RJ, Hanson K. 2012, Oxford: Oxford University Press
7.
go back to reference Weiss C: Nothing as Practical as Good Theory: Exploring Theory-based Evaluation for Comprehensive Community Initiatives for Children and Families. New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts. Edited by: Connell JP. 1995, Washington, DC: Aspen Institute Weiss C: Nothing as Practical as Good Theory: Exploring Theory-based Evaluation for Comprehensive Community Initiatives for Children and Families. New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts. Edited by: Connell JP. 1995, Washington, DC: Aspen Institute
8.
go back to reference Mason P, Barnes M: Constructing theories of change: Methods and sources. Evaluation. 2007, 13: 151-170. 10.1177/1356389007075221.CrossRef Mason P, Barnes M: Constructing theories of change: Methods and sources. Evaluation. 2007, 13: 151-170. 10.1177/1356389007075221.CrossRef
9.
go back to reference Coryn CLS, Noakes L, Westine CD, Schroter DC: A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009. Am J Eval. 2011, 32: 199-226. 10.1177/1098214010389321.CrossRef Coryn CLS, Noakes L, Westine CD, Schroter DC: A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009. Am J Eval. 2011, 32: 199-226. 10.1177/1098214010389321.CrossRef
10.
go back to reference Andersen A: A Community Builder's Approach to Theory of Change: a Practical Guide to Theory Development. 2004, New York: The Aspen Insitute Andersen A: A Community Builder's Approach to Theory of Change: a Practical Guide to Theory Development. 2004, New York: The Aspen Insitute
11.
go back to reference Funnell SC, Rogers PJ: Purposeful program theory: effective use of theories of change and logic models. 2011, San Francisco, CA: Jossey-Bass, 1 Funnell SC, Rogers PJ: Purposeful program theory: effective use of theories of change and logic models. 2011, San Francisco, CA: Jossey-Bass, 1
12.
go back to reference Vogel I: Review of the use of ‘Theory of Change’ in international development. 2012, UK: Department for International Development (DFID) Vogel I: Review of the use of ‘Theory of Change’ in international development. 2012, UK: Department for International Development (DFID)
13.
go back to reference Connell JP, Kubisch AC: Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. New Approaches to Evaluating Community Initiatives, Theory, Measurement, and Analysis, Volume 2. 1998, United States of America: The Aspen Institute Connell JP, Kubisch AC: Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems. New Approaches to Evaluating Community Initiatives, Theory, Measurement, and Analysis, Volume 2. 1998, United States of America: The Aspen Institute
14.
go back to reference James C: Theory of Change Reviews: A report commissioned by Comic Relief. 2011, London: Comic Relief James C: Theory of Change Reviews: A report commissioned by Comic Relief. 2011, London: Comic Relief
15.
go back to reference Taplin DH, Clark H, Collins I, Colby DC: Theory of Change Technical Papers: A series of papers to support devlopment of Theories of Change based on practice in the field. 2013, New York: ActKnowledge Taplin DH, Clark H, Collins I, Colby DC: Theory of Change Technical Papers: A series of papers to support devlopment of Theories of Change based on practice in the field. 2013, New York: ActKnowledge
16.
go back to reference James C: The Peer Learning Programme for Small and Diaspora Organisations. Theory of Change: A Guide for Small and Diaspora NGOs. 2013 James C: The Peer Learning Programme for Small and Diaspora Organisations. Theory of Change: A Guide for Small and Diaspora NGOs. 2013
17.
go back to reference Reid M, Botma Y: A framework to expand public services to children with biomedical healthcare needs related to HIV in the Free State, South Africa. Ajar-African J Aids Res. 2012, 11: 91-98. 10.2989/16085906.2012.698054.CrossRef Reid M, Botma Y: A framework to expand public services to children with biomedical healthcare needs related to HIV in the Free State, South Africa. Ajar-African J Aids Res. 2012, 11: 91-98. 10.2989/16085906.2012.698054.CrossRef
18.
go back to reference Levison-Johnson J, Wenz-Gross M: From complexity to reality: providing useful frameworks for defining systems of care. Eval Program Plann. 2010, 33: 56-58. 10.1016/j.evalprogplan.2009.05.005.CrossRefPubMed Levison-Johnson J, Wenz-Gross M: From complexity to reality: providing useful frameworks for defining systems of care. Eval Program Plann. 2010, 33: 56-58. 10.1016/j.evalprogplan.2009.05.005.CrossRefPubMed
19.
go back to reference Walker JS, Matarese M: Using a Theory of Change to Drive Human Resource Development for Wraparound. J Child Fam Stud. 2011, 20: 791-803. 10.1007/s10826-011-9532-6.CrossRef Walker JS, Matarese M: Using a Theory of Change to Drive Human Resource Development for Wraparound. J Child Fam Stud. 2011, 20: 791-803. 10.1007/s10826-011-9532-6.CrossRef
20.
go back to reference Hernandez M, Hodges S: Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006, 38: 165-173. 10.1007/s10464-006-9079-7.CrossRefPubMed Hernandez M, Hodges S: Applying a theory of change approach to interagency planning in child mental health. Am J Community Psychol. 2006, 38: 165-173. 10.1007/s10464-006-9079-7.CrossRefPubMed
21.
go back to reference Weitzman BC, Silver D, Dillman KN: Integrating a comparison group design into a theory of change evaluation: The case of the urban health initiative. Am J Eval. 2002, 23: 371-385. 10.1177/109821400202300402.CrossRef Weitzman BC, Silver D, Dillman KN: Integrating a comparison group design into a theory of change evaluation: The case of the urban health initiative. Am J Eval. 2002, 23: 371-385. 10.1177/109821400202300402.CrossRef
22.
go back to reference Cole M: The health action zone initiative: Lessons from Plymouth. Local Government Studies. 2003, 29: 99-117. 10.1080/03003930308559381.CrossRef Cole M: The health action zone initiative: Lessons from Plymouth. Local Government Studies. 2003, 29: 99-117. 10.1080/03003930308559381.CrossRef
23.
go back to reference Basson HA, Roets L: Workplace wellness for HIV/AIDSaffected nurses in South Africa. Br J Nurs. 2013, 22: 38-44.CrossRefPubMed Basson HA, Roets L: Workplace wellness for HIV/AIDSaffected nurses in South Africa. Br J Nurs. 2013, 22: 38-44.CrossRefPubMed
24.
go back to reference Kemp L, Harris E, McMahon C, Matthey S, Vimpani G, Anderson T, Schmied V, Aslam H: Benefits of psychosocial intervention and continuity of care by child and family health nurses in the pre- and postnatal period: process evaluation. J Adv Nurs. 2013, 69: 1850-1861. 10.1111/jan.12052.CrossRefPubMed Kemp L, Harris E, McMahon C, Matthey S, Vimpani G, Anderson T, Schmied V, Aslam H: Benefits of psychosocial intervention and continuity of care by child and family health nurses in the pre- and postnatal period: process evaluation. J Adv Nurs. 2013, 69: 1850-1861. 10.1111/jan.12052.CrossRefPubMed
25.
go back to reference Hunter DEK: Using a theory of change approach to build organizational strength, capacity and sustainability with not-for-profit organizations in the human services sector. Evaluation Program Plann. 2006, 29: 193-200. 10.1016/j.evalprogplan.2005.10.003.CrossRef Hunter DEK: Using a theory of change approach to build organizational strength, capacity and sustainability with not-for-profit organizations in the human services sector. Evaluation Program Plann. 2006, 29: 193-200. 10.1016/j.evalprogplan.2005.10.003.CrossRef
26.
go back to reference Taplin DH, Rasic M: Facilitator's Source Book: Source Bookf for facilitators leading Theory of Change development sessions. 2012, New York: ActKnowledge Taplin DH, Rasic M: Facilitator's Source Book: Source Bookf for facilitators leading Theory of Change development sessions. 2012, New York: ActKnowledge
27.
go back to reference Lund C, Tomlinson M, De Silva M, Fekadu A, Shidhaye R, Jordans M, Petersen I, Bhana A, Kigozi F, Prince M, Thornicroft G, Hanlon C, Kakuma R, McDaid D, Saxena S, Chisholm D, Raja S, Kippen-Wood S, Honikman S, Fairall L, Patel V: PRIME: A Programme to Reduce the Treatment Gap for Mental Disorders in Five Low- and Middle-Income Countries. PLoS Med. 2012, 9: e1001359-10.1371/journal.pmed.1001359.PubMedCentralCrossRefPubMed Lund C, Tomlinson M, De Silva M, Fekadu A, Shidhaye R, Jordans M, Petersen I, Bhana A, Kigozi F, Prince M, Thornicroft G, Hanlon C, Kakuma R, McDaid D, Saxena S, Chisholm D, Raja S, Kippen-Wood S, Honikman S, Fairall L, Patel V: PRIME: A Programme to Reduce the Treatment Gap for Mental Disorders in Five Low- and Middle-Income Countries. PLoS Med. 2012, 9: e1001359-10.1371/journal.pmed.1001359.PubMedCentralCrossRefPubMed
28.
go back to reference Hanlon C, Luitel N, Kathree T, Murhar V, Shrivasta S, Medhin G, Ssebunnya J, Fekadu A, Petersen I, Jordans M, Kigozi F, Thornicroft G, Patel V, Tomlinson M, Lund C, Breuer E, De Silva M, Prince M: Challenges and opportunities for implementing mental health in primary care in the PRIME study: comparison of the baseline situation in five LAMIC settings. PLoS One. 2014, 9: e88437-10.1371/journal.pone.0088437.PubMedCentralCrossRefPubMed Hanlon C, Luitel N, Kathree T, Murhar V, Shrivasta S, Medhin G, Ssebunnya J, Fekadu A, Petersen I, Jordans M, Kigozi F, Thornicroft G, Patel V, Tomlinson M, Lund C, Breuer E, De Silva M, Prince M: Challenges and opportunities for implementing mental health in primary care in the PRIME study: comparison of the baseline situation in five LAMIC settings. PLoS One. 2014, 9: e88437-10.1371/journal.pone.0088437.PubMedCentralCrossRefPubMed
29.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Mitchie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008, 337: a1655-10.1136/bmj.a1655.CrossRef Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Mitchie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008, 337: a1655-10.1136/bmj.a1655.CrossRef
31.
go back to reference Jordans MJD, Luitel N, Tomlinson M, Komproe IH: Setting priorities for mental health care in Nepal: a formative study. BMC Psychiatry. 2013, 13: 332-10.1186/1471-244X-13-332. In pressPubMedCentralCrossRefPubMed Jordans MJD, Luitel N, Tomlinson M, Komproe IH: Setting priorities for mental health care in Nepal: a formative study. BMC Psychiatry. 2013, 13: 332-10.1186/1471-244X-13-332. In pressPubMedCentralCrossRefPubMed
32.
go back to reference Centers for Disease Control and Prevention. Office of the Director OoSaI, & National Center for Infectious Diseases, Division of Bacterial and Mycotic Diseases: Introduction to program evaluation for public health programs: Evaluating appropriate antibiotic use programs. 2006, Atlanta, GA: Centers for Disease Control and Prevention Centers for Disease Control and Prevention. Office of the Director OoSaI, & National Center for Infectious Diseases, Division of Bacterial and Mycotic Diseases: Introduction to program evaluation for public health programs: Evaluating appropriate antibiotic use programs. 2006, Atlanta, GA: Centers for Disease Control and Prevention
33.
go back to reference Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing qualitative data. Edited by: Bryman . 1994, Burgess. London: Routledge, 173-194.CrossRef Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing qualitative data. Edited by: Bryman . 1994, Burgess. London: Routledge, 173-194.CrossRef
34.
35.
go back to reference Lehmann U, Gilson L: Actor interfaces and practices of power in a community health worker programme: a South African study of unintended policy outcomes. Health Policy Plan. 2013, 28: 358-366. 10.1093/heapol/czs066.CrossRefPubMed Lehmann U, Gilson L: Actor interfaces and practices of power in a community health worker programme: a South African study of unintended policy outcomes. Health Policy Plan. 2013, 28: 358-366. 10.1093/heapol/czs066.CrossRefPubMed
36.
go back to reference Sheikh K, Porter JD: Disempowered doctors? A relational view of public health policy implementation in urban India. Health Policy Plann. 2011, 26: 83-92. 10.1093/heapol/czq023.CrossRef Sheikh K, Porter JD: Disempowered doctors? A relational view of public health policy implementation in urban India. Health Policy Plann. 2011, 26: 83-92. 10.1093/heapol/czq023.CrossRef
37.
go back to reference Thornicroft G, Brohan E, Rose D, Sartorius N, Leese M: Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet. 2009, 373: 408-415. 10.1016/S0140-6736(08)61817-6.CrossRefPubMed Thornicroft G, Brohan E, Rose D, Sartorius N, Leese M: Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet. 2009, 373: 408-415. 10.1016/S0140-6736(08)61817-6.CrossRefPubMed
38.
go back to reference Kakuma R, Minas H, Van Ginneken N, Dal Poz MR, Desiraju K, Morris JE, Saxena S, Scheffler RM: Human resources for mental health care: current situation and strategies for action. Lancet. 2011, 378: 1654-1663. 10.1016/S0140-6736(11)61093-3.CrossRefPubMed Kakuma R, Minas H, Van Ginneken N, Dal Poz MR, Desiraju K, Morris JE, Saxena S, Scheffler RM: Human resources for mental health care: current situation and strategies for action. Lancet. 2011, 378: 1654-1663. 10.1016/S0140-6736(11)61093-3.CrossRefPubMed
39.
go back to reference Institute A: Voices from the field: Learning from the Early Work of Comprehensive Community Initiatives. 1997, Washington DC: Aspen Institute Institute A: Voices from the field: Learning from the Early Work of Comprehensive Community Initiatives. 1997, Washington DC: Aspen Institute
40.
go back to reference Sullivan H, Stewart M: Who Owns the Theory of Change?. Evaluation. 2006, 12: 179-199. 10.1177/1356389006066971.CrossRef Sullivan H, Stewart M: Who Owns the Theory of Change?. Evaluation. 2006, 12: 179-199. 10.1177/1356389006066971.CrossRef
41.
go back to reference Tait L, Lester H: Encouraging user involvement in mental health services. Adv Psychiatr Treat. 2005, 11: 168-175. 10.1192/apt.11.3.168.CrossRef Tait L, Lester H: Encouraging user involvement in mental health services. Adv Psychiatr Treat. 2005, 11: 168-175. 10.1192/apt.11.3.168.CrossRef
42.
go back to reference Kleintjes S, Lund C, Swartz L, Flisher A, The Mhapp Research Programme C: Mental health care user participation in mental health policy development and implementation in South Africa. Int Rev Psychiatry. 2010, 22: 568-577. 10.3109/09540261.2010.536153.CrossRefPubMed Kleintjes S, Lund C, Swartz L, Flisher A, The Mhapp Research Programme C: Mental health care user participation in mental health policy development and implementation in South Africa. Int Rev Psychiatry. 2010, 22: 568-577. 10.3109/09540261.2010.536153.CrossRefPubMed
Metadata
Title
Using workshops to develop theories of change in five low and middle income countries: lessons from the programme for improving mental health care (PRIME)
Authors
Erica Breuer
Mary J De Silva
Abebaw Fekadu
Nagendra Prasad Luitel
Vaibhav Murhar
Juliet Nakku
Inge Petersen
Crick Lund
Publication date
01-12-2014
Publisher
BioMed Central
Published in
International Journal of Mental Health Systems / Issue 1/2014
Electronic ISSN: 1752-4458
DOI
https://doi.org/10.1186/1752-4458-8-15

Other articles of this Issue 1/2014

International Journal of Mental Health Systems 1/2014 Go to the issue