Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Protocol

Examining the use of process evaluations of randomised controlled trials of complex interventions addressing chronic disease in primary health care—a systematic review protocol

Authors: Hueiming Liu, Janini Muhunthan, Adina Hayek, Maree Hackett, Tracey-Lea Laba, David Peiris, Stephen Jan

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) of complex interventions in primary health care (PHC) are needed to provide evidence-based programmes to achieve the Declaration of Alma Ata goal of making PHC equitable, accessible and universal and to effectively address the rising burden from chronic disease. Process evaluations of these RCTs can provide insight into the causal mechanisms of complex interventions, the contextual factors, and inform as to whether an intervention is ineffective due to implementation failure or failure of the intervention itself. To build on this emerging body of work, we aim to consolidate the methodology and methods from process evaluations of complex interventions in PHC and their findings of facilitators and barriers to intervention implementation in this important area of health service delivery.

Methods

Systematic review of process evaluations of randomised controlled trials of complex interventions which address prevalent major chronic diseases in PHC settings. Published process evaluations of RCTs will be identified through database and clinical trial registry searches and contact with authors. Data from each study will be extracted by two reviewers using standardised forms. Data extracted include descriptive items about (1) the RCT, (2) about the process evaluations (such as methods, theories, risk of bias, analysis of process and outcome data, strengths and limitations) and (3) any stated barriers and facilitators to conducting complex interventions. A narrative synthesis of the findings will be presented.

Discussion

Process evaluation findings are valuable in determining whether a complex intervention should be scaled up or modified for other contexts. Publishing this protocol serves to encourage transparency in the reporting of our synthesis of current literature on how process evaluations have been conducted thus far and a deeper understanding of potential challenges and solutions to aid in the implementation of effective interventions in PHC beyond the research setting.

Systematic review registration

Appendix
Available only for authorised users
Literature
2.
go back to reference Chalkidou K, Tunis S, Whicher D, Fowler R, Zwarenstein M. The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clin Trials. 2012;9(4):436–46.CrossRefPubMed Chalkidou K, Tunis S, Whicher D, Fowler R, Zwarenstein M. The role for pragmatic randomized controlled trials (pRCTs) in comparative effectiveness research. Clin Trials. 2012;9(4):436–46.CrossRefPubMed
3.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. Pubmed Central PMCID: 2769032.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. Pubmed Central PMCID: 2769032.CrossRefPubMedPubMedCentral
4.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. Pubmed Central PMCID: 4366184.CrossRefPubMedPubMedCentral Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. Pubmed Central PMCID: 4366184.CrossRefPubMedPubMedCentral
5.
go back to reference Bonell C, Oakley A, Hargreaves J, Strange V, Rees R. Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006;333(7563):346–9. Pubmed Central PMCID: 1539056, Epub 2006/08/12. eng.CrossRefPubMedPubMedCentral Bonell C, Oakley A, Hargreaves J, Strange V, Rees R. Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006;333(7563):346–9. Pubmed Central PMCID: 1539056, Epub 2006/08/12. eng.CrossRefPubMedPubMedCentral
6.
go back to reference Liu H, Massi L, Laba TL, Peiris D, Usherwood T, Patel A, et al. Patients’ and providers’ perspectives of a polypill strategy to improve cardiovascular prevention in Australian primary health care: a qualitative study set within a pragmatic randomized, controlled trial. Circ Cardiovasc Qual Outcomes. 2015;8(3):301–8.CrossRefPubMed Liu H, Massi L, Laba TL, Peiris D, Usherwood T, Patel A, et al. Patients’ and providers’ perspectives of a polypill strategy to improve cardiovascular prevention in Australian primary health care: a qualitative study set within a pragmatic randomized, controlled trial. Circ Cardiovasc Qual Outcomes. 2015;8(3):301–8.CrossRefPubMed
7.
go back to reference Tugwell P, Robinson V, Grimshaw J, Santesso N. Systematic reviews and knowledge translation. Bull World Health Organ. 2006;84(8):643–51. Pubmed Central PMCID: 2627444.CrossRefPubMedPubMedCentral Tugwell P, Robinson V, Grimshaw J, Santesso N. Systematic reviews and knowledge translation. Bull World Health Organ. 2006;84(8):643–51. Pubmed Central PMCID: 2627444.CrossRefPubMedPubMedCentral
8.
go back to reference Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, et al. Health research funding agencies’ support and promotion of knowledge translation: an international study. Milbank Q. 2008;86(1):125–55. Pubmed Central PMCID: 2690338.CrossRefPubMedPubMedCentral Tetroe JM, Graham ID, Foy R, Robinson N, Eccles MP, Wensing M, et al. Health research funding agencies’ support and promotion of knowledge translation: an international study. Milbank Q. 2008;86(1):125–55. Pubmed Central PMCID: 2690338.CrossRefPubMedPubMedCentral
9.
go back to reference Cordero C, Delino R, Jeyaseelan L, Lansang MA, Lozano JM, Kumar S, et al. Funding agencies in low- and middle-income countries: support for knowledge translation. Bull World Health Organ. 2008;86(7):524–34. Pubmed Central PMCID: 2647493.CrossRefPubMedPubMedCentral Cordero C, Delino R, Jeyaseelan L, Lansang MA, Lozano JM, Kumar S, et al. Funding agencies in low- and middle-income countries: support for knowledge translation. Bull World Health Organ. 2008;86(7):524–34. Pubmed Central PMCID: 2647493.CrossRefPubMedPubMedCentral
10.
go back to reference Evans DB, Edejer TT, Adam T, Lim SS. Methods to assess the costs and health effects of interventions for improving health in developing countries. BMJ. 2005;331(7525):1137–40. Pubmed Central PMCID: 1283282.CrossRefPubMedPubMedCentral Evans DB, Edejer TT, Adam T, Lim SS. Methods to assess the costs and health effects of interventions for improving health in developing countries. BMJ. 2005;331(7525):1137–40. Pubmed Central PMCID: 1283282.CrossRefPubMedPubMedCentral
12.
go back to reference Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496. Pubmed Central PMCID: 2741564.CrossRefPubMedPubMedCentral Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339:b3496. Pubmed Central PMCID: 2741564.CrossRefPubMedPubMedCentral
13.
go back to reference Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442–52.CrossRefPubMed Curry LA, Nembhard IM, Bradley EH. Qualitative and mixed methods provide unique contributions to outcomes research. Circulation. 2009;119(10):1442–52.CrossRefPubMed
15.
go back to reference O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215. Pubmed Central PMCID: 4059032.CrossRefPubMedPubMedCentral O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15:215. Pubmed Central PMCID: 4059032.CrossRefPubMedPubMedCentral
16.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6. Pubmed Central PMCID: 1370978.CrossRefPubMedPubMedCentral Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6. Pubmed Central PMCID: 1370978.CrossRefPubMedPubMedCentral
17.
go back to reference Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14(1):15. Pubmed Central PMCID: 3600672. Epub 2013/01/15. eng.CrossRefPubMedPubMedCentral Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14(1):15. Pubmed Central PMCID: 3600672. Epub 2013/01/15. eng.CrossRefPubMedPubMedCentral
18.
go back to reference Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12:181. Pubmed Central PMCID: 3552766.CrossRefPubMedPubMedCentral Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12:181. Pubmed Central PMCID: 3552766.CrossRefPubMedPubMedCentral
19.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRefPubMed Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRefPubMed
21.
22.
go back to reference Alim M, Lindley R, Felix C, Gandhi DB, Verma SJ, Tugnawat DK, et al. Family-led rehabilitation after stroke in India: the ATTEND trial, study protocol for a randomized controlled trial. Trials. 2016;17(1):13. Pubmed Central PMCID: 4704425.CrossRefPubMedPubMedCentral Alim M, Lindley R, Felix C, Gandhi DB, Verma SJ, Tugnawat DK, et al. Family-led rehabilitation after stroke in India: the ATTEND trial, study protocol for a randomized controlled trial. Trials. 2016;17(1):13. Pubmed Central PMCID: 4704425.CrossRefPubMedPubMedCentral
23.
go back to reference Praveen D, Patel A, Raghu A, Clifford GD, Maulik PK, Mohammad Abdul A, et al. SMARTHealth India: development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR MHealth UHealth. 2014;2(4):e54. Pubmed Central PMCID: 4275493.CrossRefPubMedPubMedCentral Praveen D, Patel A, Raghu A, Clifford GD, Maulik PK, Mohammad Abdul A, et al. SMARTHealth India: development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR MHealth UHealth. 2014;2(4):e54. Pubmed Central PMCID: 4275493.CrossRefPubMedPubMedCentral
24.
go back to reference Laba TL, Hayes A, Lo S, Peiris DP, Usherwood T, Hillis GS, et al. An economic case for a cardiovascular polypill? A cost analysis of the Kanyini GAP trial. Med J Aust. 2014;201(11):671–3.CrossRefPubMed Laba TL, Hayes A, Lo S, Peiris DP, Usherwood T, Hillis GS, et al. An economic case for a cardiovascular polypill? A cost analysis of the Kanyini GAP trial. Med J Aust. 2014;201(11):671–3.CrossRefPubMed
25.
go back to reference Lawoyin TO, Lawoyin OO. Translation of research into reality in sub-Saharan Africa. Lancet. 2013;381(9884):2146–7.CrossRefPubMed Lawoyin TO, Lawoyin OO. Translation of research into reality in sub-Saharan Africa. Lancet. 2013;381(9884):2146–7.CrossRefPubMed
26.
go back to reference Peiris D, Usherwood T, Panaretto K, Harris M, Hunt J, Redfern J, et al. Effect of a computer-guided, quality improvement program for cardiovascular disease risk management in primary health care: the treatment of cardiovascular risk using electronic decision support cluster-randomized trial. Circ Cardiovasc Qual Outcomes. 2015;8(1):87–95.CrossRefPubMed Peiris D, Usherwood T, Panaretto K, Harris M, Hunt J, Redfern J, et al. Effect of a computer-guided, quality improvement program for cardiovascular disease risk management in primary health care: the treatment of cardiovascular risk using electronic decision support cluster-randomized trial. Circ Cardiovasc Qual Outcomes. 2015;8(1):87–95.CrossRefPubMed
27.
go back to reference Neubeck L, Coorey G, Peiris D, Mulley J, Heeley E, Hersch F, et al. Development of an integrated e-health tool for people with, or at high risk of, cardiovascular disease: The Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) web application. International journal of medical informatics. 2016 [Epub ahead of print] Neubeck L, Coorey G, Peiris D, Mulley J, Heeley E, Hersch F, et al. Development of an integrated e-health tool for people with, or at high risk of, cardiovascular disease: The Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) web application. International journal of medical informatics. 2016 [Epub ahead of print]
28.
go back to reference Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. JAMA. 2015;314(12):1255–63.CrossRefPubMed Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. JAMA. 2015;314(12):1255–63.CrossRefPubMed
30.
go back to reference Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998;317(7156):465–8. Pubmed Central PMCID: 1113716. Epub 1998/08/14. eng.CrossRefPubMedPubMedCentral Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. BMJ. 1998;317(7156):465–8. Pubmed Central PMCID: 1113716. Epub 1998/08/14. eng.CrossRefPubMedPubMedCentral
31.
go back to reference Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in health care: a realist review. Milbank Q. 2012;90(3):421–56. Pubmed Central PMCID: 3479379.CrossRefPubMedPubMedCentral Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in health care: a realist review. Milbank Q. 2012;90(3):421–56. Pubmed Central PMCID: 3479379.CrossRefPubMedPubMedCentral
32.
33.
go back to reference Gelijns AC, Gabriel SE. Looking beyond translation—integrating clinical research with medical practice. N Engl J Med. 2012;366(18):1659–61.CrossRefPubMed Gelijns AC, Gabriel SE. Looking beyond translation—integrating clinical research with medical practice. N Engl J Med. 2012;366(18):1659–61.CrossRefPubMed
34.
go back to reference Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.CrossRefPubMed Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.CrossRefPubMed
35.
go back to reference Anderson LM, Oliver SR, Michie S, Rehfuess E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66(11):1223–9.CrossRefPubMed Anderson LM, Oliver SR, Michie S, Rehfuess E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66(11):1223–9.CrossRefPubMed
38.
go back to reference Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Serv Res. 2015;15:194. Pubmed Central PMCID: 4448852.CrossRefPubMedPubMedCentral Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Serv Res. 2015;15:194. Pubmed Central PMCID: 4448852.CrossRefPubMedPubMedCentral
39.
go back to reference Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14. Pubmed Central PMCID: 2832624, Epub 2010/02/26. eng.CrossRefPubMedPubMedCentral Davies P, Walker AE, Grimshaw JM. A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010;5:14. Pubmed Central PMCID: 2832624, Epub 2010/02/26. eng.CrossRefPubMedPubMedCentral
40.
go back to reference Petticrew M, Anderson L, Elder R, Grimshaw J, Hopkins D, Hahn R, et al. Complex interventions and their implications for systematic reviews: a pragmatic approach. Int J Nurs Stud. 2015;52:1211–6.CrossRefPubMed Petticrew M, Anderson L, Elder R, Grimshaw J, Hopkins D, Hahn R, et al. Complex interventions and their implications for systematic reviews: a pragmatic approach. Int J Nurs Stud. 2015;52:1211–6.CrossRefPubMed
41.
go back to reference Katikireddi SV, Egan M, Petticrew M. How do systematic reviews incorporate risk of bias assessments into the synthesis of evidence? A methodological study. J Epidemiol Community Health. 2015;69(2):189–95. Pubmed Central PMCID: 4316857.CrossRefPubMed Katikireddi SV, Egan M, Petticrew M. How do systematic reviews incorporate risk of bias assessments into the synthesis of evidence? A methodological study. J Epidemiol Community Health. 2015;69(2):189–95. Pubmed Central PMCID: 4316857.CrossRefPubMed
42.
go back to reference De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267. Pubmed Central PMCID: 4227087.CrossRefPubMedPubMedCentral De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15:267. Pubmed Central PMCID: 4227087.CrossRefPubMedPubMedCentral
43.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. Pubmed Central PMCID: 2736161.CrossRefPubMedPubMedCentral Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. Pubmed Central PMCID: 2736161.CrossRefPubMedPubMedCentral
Metadata
Title
Examining the use of process evaluations of randomised controlled trials of complex interventions addressing chronic disease in primary health care—a systematic review protocol
Authors
Hueiming Liu
Janini Muhunthan
Adina Hayek
Maree Hackett
Tracey-Lea Laba
David Peiris
Stephen Jan
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0314-5

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue