Skip to main content
Top
Published in: BMC Public Health 1/2019

Open Access 01-12-2019 | Hypertension | Research article

Process evaluation in the field: global learnings from seven implementation research hypertension projects in low-and middle-income countries

Authors: Felix Limbani, Jane Goudge, Rohina Joshi, Marion A. Maar, J. Jaime Miranda, Brian Oldenburg, Gary Parker, Maria Amalia Pesantes, Michaela A. Riddell, Abdul Salam, Kathy Trieu, Amanda G. Thrift, Josefien Van Olmen, Rajesh Vedanthan, Ruth Webster, Karen Yeates, Jacqui Webster, The Global Alliance for Chronic Diseases, Process Evaluation Working Group

Published in: BMC Public Health | Issue 1/2019

Login to get access

Abstract

Background

Process evaluation is increasingly recognized as an important component of effective implementation research and yet, there has been surprisingly little work to understand what constitutes best practice. Researchers use different methodologies describing causal pathways and understanding barriers and facilitators to implementation of interventions in diverse contexts and settings. We report on challenges and lessons learned from undertaking process evaluation of seven hypertension intervention trials funded through the Global Alliance of Chronic Diseases (GACD).

Methods

Preliminary data collected from the GACD hypertension teams in 2015 were used to inform a template for data collection. Case study themes included: (1) description of the intervention, (2) objectives of the process evaluation, (3) methods including theoretical basis, (4) main findings of the study and the process evaluation, (5) implications for the project, policy and research practice and (6) lessons for future process evaluations. The information was summarized and reported descriptively and narratively and key lessons were identified.

Results

The case studies were from low- and middle-income countries and Indigenous communities in Canada. They were implementation research projects with intervention arm. Six theoretical approaches were used but most comprised of mixed-methods approaches. Each of the process evaluations generated findings on whether interventions were implemented with fidelity, the extent of capacity building, contextual factors and the extent to which relationships between researchers and community impacted on intervention implementation. The most important learning was that although process evaluation is time consuming, it enhances understanding of factors affecting implementation of complex interventions. The research highlighted the need to initiate process evaluations early on in the project, to help guide design of the intervention; and the importance of effective communication between researchers responsible for trial implementation, process evaluation and outcome evaluation.

Conclusion

This research demonstrates the important role of process evaluation in understanding implementation process of complex interventions. This can help to highlight a broad range of system requirements such as new policies and capacity building to support implementation. Process evaluation is crucial in understanding contextual factors that may impact intervention implementation which is important in considering whether or not the intervention can be translated to other contexts.
Appendix
Available only for authorised users
Footnotes
1
Ministry of Science, Technology and Productive Innovation (Argentina), National Health and Medical Research Council (Australia), São Paulo Research Foundation (Brazil), Canadian Institutes of Health Research, Chinese Academy of Medical Sciences, Research & Innovation DG (European Commission), Indian Council of Medical Research, Agency for Medical Research and Development (Japan), The National Institute of Medical Science and Nutrition Salvador Zubiran (Mexico), Health Research Council (New Zealand), South African Medical Research Council, Health Systems Research Institute (Thailand), UK Medical Research Council and US National Institutes of Health
 
Literature
1.
go back to reference Peters DH, Tran NT, Adam T. Implementation research in health: a practical guide. Geneva: Alliance HPSR, WHO; 2013. p. 69. ISBN 978 92 4 150621 2 Peters DH, Tran NT, Adam T. Implementation research in health: a practical guide. Geneva: Alliance HPSR, WHO; 2013. p. 69. ISBN 978 92 4 150621 2
2.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRef Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRef
4.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.CrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.CrossRef
5.
go back to reference Rycroft-Malone J, Burton CR. Is it time for standards for reporting on research about implementation? Worldviews Evid-Based Nurs. 2011;8(4):189–90.CrossRef Rycroft-Malone J, Burton CR. Is it time for standards for reporting on research about implementation? Worldviews Evid-Based Nurs. 2011;8(4):189–90.CrossRef
6.
go back to reference Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:i6795.CrossRef Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:i6795.CrossRef
7.
go back to reference Maar MA, Yeates K, Perkins N, Boesch L, Hua-Stewart D, Liu P, Sleeth J, Tobe SW. A framework for the study of complex mHealth interventions in diverse cultural settings. JMIR Mhealth Uhealth. 2017;5(4):e47.CrossRef Maar MA, Yeates K, Perkins N, Boesch L, Hua-Stewart D, Liu P, Sleeth J, Tobe SW. A framework for the study of complex mHealth interventions in diverse cultural settings. JMIR Mhealth Uhealth. 2017;5(4):e47.CrossRef
8.
go back to reference Vedanthan R, Bernabe-Ortiz A, Herasme OI, Joshi R, Lopez-Jaramillo P, Thrift AG, Webster J, Webster R, Yeates K, Gyamfi J, et al. Innovative approaches to hypertension control in low- and middle-income countries. Cardiol Clin. 2017;35(1):99–115.CrossRef Vedanthan R, Bernabe-Ortiz A, Herasme OI, Joshi R, Lopez-Jaramillo P, Thrift AG, Webster J, Webster R, Yeates K, Gyamfi J, et al. Innovative approaches to hypertension control in low- and middle-income countries. Cardiol Clin. 2017;35(1):99–115.CrossRef
9.
go back to reference Saavedra-Garcia L, Bernabe-Ortiz A, Gilman RH, Diez-Canseco F, Cárdenas MK, Sacksteder KA, Miranda JJ. Applying the triangle taste test to assess differences between low sodium salts and common salt: evidence from Peru. PLoS One. 2015;10(7):e0134700.CrossRef Saavedra-Garcia L, Bernabe-Ortiz A, Gilman RH, Diez-Canseco F, Cárdenas MK, Sacksteder KA, Miranda JJ. Applying the triangle taste test to assess differences between low sodium salts and common salt: evidence from Peru. PLoS One. 2015;10(7):e0134700.CrossRef
12.
go back to reference Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRef Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.CrossRef
13.
go back to reference Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs: the four levels; 2006. Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs: the four levels; 2006.
14.
go back to reference Gray D. Doing research in the real world - theoretical perspectives and research methodologies. London: Sage Publications Inc; 2018. Gray D. Doing research in the real world - theoretical perspectives and research methodologies. London: Sage Publications Inc; 2018.
15.
go back to reference Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117.CrossRef Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117.CrossRef
16.
go back to reference Pawson R, Tilley N. Realistic Evaluation. London: Sage Publications; 1997. Pawson R, Tilley N. Realistic Evaluation. London: Sage Publications; 1997.
17.
go back to reference Fletcher A, Jamal F, Moore G, Evans RE, Murphy S, Bonell C. Realist complex intervention science: applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions. Evaluation (London). 2016;22(3):286–303.CrossRef Fletcher A, Jamal F, Moore G, Evans RE, Murphy S, Bonell C. Realist complex intervention science: applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions. Evaluation (London). 2016;22(3):286–303.CrossRef
18.
go back to reference Yu CH. Book review: Creswell, J., & Plano Clark, V. (2007). Designing and conducting mixed methods research. Thousand oaks, CA: sage. Organ Res Methods. 2009;12(4):801–4.CrossRef Yu CH. Book review: Creswell, J., & Plano Clark, V. (2007). Designing and conducting mixed methods research. Thousand oaks, CA: sage. Organ Res Methods. 2009;12(4):801–4.CrossRef
19.
go back to reference Thorogood M, Goudge J, Bertram M, Chirwa T, Eldridge S, Gomez-Olive FX, Limbani F, Musenge E, Myakayaka N, Tollman S, et al. The Nkateko health service trial to improve hypertension management in rural South Africa: study protocol for a randomised controlled trial. Trials. 2014;15:435.CrossRef Thorogood M, Goudge J, Bertram M, Chirwa T, Eldridge S, Gomez-Olive FX, Limbani F, Musenge E, Myakayaka N, Tollman S, et al. The Nkateko health service trial to improve hypertension management in rural South Africa: study protocol for a randomised controlled trial. Trials. 2014;15:435.CrossRef
20.
go back to reference Goudge J, Chirwa T, Eldridge S, Gómez-Olivé FXF, Kabudula C, Limbani F, Musenge E, Thorogood M. Can lay health workers support the management of hypertension? Findings of a cluster randomised trial in South Africa. BMJ Glob Health. 2018;3(1):e000577.CrossRef Goudge J, Chirwa T, Eldridge S, Gómez-Olivé FXF, Kabudula C, Limbani F, Musenge E, Thorogood M. Can lay health workers support the management of hypertension? Findings of a cluster randomised trial in South Africa. BMJ Glob Health. 2018;3(1):e000577.CrossRef
21.
go back to reference Abdel-All M, Thrift AG, Riddell M, Thankappan KRT, Mini GK, Chow CK, Maulik PK, Mahal A, Guggilla R, Kalyanram K, et al. Evaluation of a training program of hypertension for accredited social health activists (ASHA) in rural India. BMC Health Serv Res. 2018;18(1):320.CrossRef Abdel-All M, Thrift AG, Riddell M, Thankappan KRT, Mini GK, Chow CK, Maulik PK, Mahal A, Guggilla R, Kalyanram K, et al. Evaluation of a training program of hypertension for accredited social health activists (ASHA) in rural India. BMC Health Serv Res. 2018;18(1):320.CrossRef
22.
go back to reference Riddell MA, Joshi R, Oldenburg B, Chow C, Thankappan KR, Mahal A, et al. Cluster randomised feasibility trial to improve the control of hypertension in rural India (CHIRI): a study protocol. BMJ Open. 2016;6(10):1–13.CrossRef Riddell MA, Joshi R, Oldenburg B, Chow C, Thankappan KR, Mahal A, et al. Cluster randomised feasibility trial to improve the control of hypertension in rural India (CHIRI): a study protocol. BMJ Open. 2016;6(10):1–13.CrossRef
23.
go back to reference Trieu K, Webster J, Jan S, Hope S, Naseri T, Ieremia M, Bell C, Snowdon W, Moodie M. Process evaluation of Samoa's national salt reduction strategy (MASIMA): what interventions can be successfully replicated in lower-income countries? Implement Sci. 2018;13(1):107.CrossRef Trieu K, Webster J, Jan S, Hope S, Naseri T, Ieremia M, Bell C, Snowdon W, Moodie M. Process evaluation of Samoa's national salt reduction strategy (MASIMA): what interventions can be successfully replicated in lower-income countries? Implement Sci. 2018;13(1):107.CrossRef
24.
go back to reference Webster J, Pillay A, Suku A, Gohil P, Santos JA, Schultz J, Wate J, Trieu K, Hope S, Snowdon W, et al. Process evaluation and costing of a multifaceted population-wide intervention to reduce salt consumption in Fiji. Nutrients. 2018;10(2):155.CrossRef Webster J, Pillay A, Suku A, Gohil P, Santos JA, Schultz J, Wate J, Trieu K, Hope S, Snowdon W, et al. Process evaluation and costing of a multifaceted population-wide intervention to reduce salt consumption in Fiji. Nutrients. 2018;10(2):155.CrossRef
25.
go back to reference Leykum LK, Pugh J, Lawrence V, Parchman M, Noël PH, Cornell J, McDaniel RR: Organizational interventions employing principles of complexity science have improved outcomes for patients with type II diabetes. Implement Sci 2007, 2(1):1–8. Leykum LK, Pugh J, Lawrence V, Parchman M, Noël PH, Cornell J, McDaniel RR: Organizational interventions employing principles of complexity science have improved outcomes for patients with type II diabetes. Implement Sci 2007, 2(1):1–8.
26.
go back to reference Greene JC. Mixed methods in social inquiry. San Francisco: Wiley; 2007. Greene JC. Mixed methods in social inquiry. San Francisco: Wiley; 2007.
27.
go back to reference Farquhar MC, Ewing G, Booth S. Using mixed methods to develop and evaluate complex interventions in palliative care research. Palliat Med. 2011;25(8):748–57.CrossRef Farquhar MC, Ewing G, Booth S. Using mixed methods to develop and evaluate complex interventions in palliative care research. Palliat Med. 2011;25(8):748–57.CrossRef
28.
go back to reference Maar M, Yeates K, Barron M, Hua D, Liu P, Lum-Kwong MM, Perkins N, Sleeth J, Tobe J, Wabano MJ, et al. I-RREACH: an engagement and assessment tool for improving implementation readiness of researchers, organizations and communities in complex interventions. Implement Sci. 2015;10:64.CrossRef Maar M, Yeates K, Barron M, Hua D, Liu P, Lum-Kwong MM, Perkins N, Sleeth J, Tobe J, Wabano MJ, et al. I-RREACH: an engagement and assessment tool for improving implementation readiness of researchers, organizations and communities in complex interventions. Implement Sci. 2015;10:64.CrossRef
Metadata
Title
Process evaluation in the field: global learnings from seven implementation research hypertension projects in low-and middle-income countries
Authors
Felix Limbani
Jane Goudge
Rohina Joshi
Marion A. Maar
J. Jaime Miranda
Brian Oldenburg
Gary Parker
Maria Amalia Pesantes
Michaela A. Riddell
Abdul Salam
Kathy Trieu
Amanda G. Thrift
Josefien Van Olmen
Rajesh Vedanthan
Ruth Webster
Karen Yeates
Jacqui Webster
The Global Alliance for Chronic Diseases, Process Evaluation Working Group
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2019
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-019-7261-8

Other articles of this Issue 1/2019

BMC Public Health 1/2019 Go to the issue