Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Protocol

To what extent do site-based training, mentoring, and operational research improve district health system management and leadership in low- and middle-income countries: a systematic review protocol

Authors: Zakaria Belrhiti, Andrew Booth, Bruno Marchal, Roosmarijn Verstraeten

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

District health managers play a key role in the effectiveness of decentralized health systems in low- and middle-income countries. Inadequate management and leadership skills often hamper their ability to improve quality of care and effectiveness of health service delivery. Nevertheless, significant investments have been made in capacity-building programmes based on site-based training, mentoring, and operational research. This systematic review aims to review the effectiveness of site-based training, mentoring, and operational research (or action research) on the improvement of district health system management and leadership. Our secondary objectives are to assess whether variations in composition or intensity of the intervention influence its effectiveness and to identify enabling and constraining contexts and underlying mechanisms.

Methods

We will search the following databases: MEDLINE, PsycInfo, Cochrane Library, CRD database (DARE), Cochrane Effective Practice and Organisation of Care (EPOC) group, ISI Web of Science, Health Evidence.org, PDQ-Evidence, ERIC, EMBASE, and TRIP. Complementary search will be performed (hand-searching journals and citation and reference tracking).
Studies that meet the following PICO (Population, Intervention, Comparison, Outcome) criteria will be included: P: professionals working at district health management level; I: site-based training with or without mentoring, or operational research; C: normal institutional arrangements; and O: district health management functions. We will include cluster randomized controlled trials, controlled before-and-after studies, interrupted time series analysis, quasi-experimental designs, and cohort and longitudinal studies. Qualitative research will be included to contextualize findings and identify barriers and facilitators.
Primary outcomes that will be reported are district health management and leadership functions. We will assess risk of bias with the Cochrane Collaboration’s tools for randomized controlled trials (RCT) and non RCT studies and Critical Appraisal Skills Programme checklists for qualitative studies. We will assess strength of recommendations with the GRADE tool for quantitative studies, and the CERQual approach for qualitative studies. Synthesis of quantitative studies will be performed through meta-analysis when appropriate. Best fit framework synthesis will be used to synthesize qualitative studies.

Discussion

This protocol paper describes a systematic review assessing the effectiveness of site-based training (with or without mentoring programmes or operational research) on the improvement of district health system management and leadership.

Systematic review registration

Appendix
Available only for authorised users
Footnotes
1
Site-based training is also called on-the-job training, hands-on training, and continuing education, which means training that takes place in workplace settings.
 
2
Nurse practitioners: nurses who are specially trained to assume an expanded role in providing medical care under the supervision of a physician
 
3
Clinical officer (formerly called medical assistant) is a medical separate healthcare provider who has clinical duties (diagnosis, treatment of patients in primary healthcare, assessment, management, and transfer of surgical patients) and administrative duties at respective health centres.
 
4
Community members who connect healthcare beneficiaries with providers in order to promote access to health
 
5
Prof. Bart Criel, Dr. Geneviève Michaux, and Prof. Bruno Marchal from the Institute of Tropical Medicine, Antwerp
 
6
Members of the RIPSEC consortium. RIPSEC is an EU-funded programme that aims at implementing a site-based training intervention, mentoring, and operational research in four health districts in the Democratic Republic of Congo.
 
7
Zakaria Belrhiti, National School of Public Health, PhD student at Institute of Tropical Medicine
 
8
Issam Bennis, National School of Public Health, PhD student at Institute of Tropical Medicine
 
9
Andrew Booth, University of Sheffield, and Roos Verstraeten, Institute of Tropical Medicine, Antwerp
 
10
Ibid
 
11
Theory, theories, theoretical
 
12
Concept, concepts, and conceptual
 
13
Framework, frameworks
 
14
Model, models
 
15
Critical Appraisal Skills Programme (CASP). Qualitative Research Checklist. 2013 available at http://​www.​casp-uk.​net/​#!checklists/​cb36
 
16
University of Sheffield
 
17
Institute of tropical medicine, Antwerp, Belgium
 
18
List of LMIC is based on 2016 fiscal report, World Bank, “http://​data.​worldbank.​org/​about/​country-and-lending-groups#Lower_​middle_​income. I added nationality adjectives for irregular forms.
 
Literature
1.
go back to reference Mills A, Vaughan JP, Smith DL, Tabibzadeh I. Health system Decentralization: concepts, Issues and country experience In. Geneva, Switzerland: World Health Organization; 1990. Mills A, Vaughan JP, Smith DL, Tabibzadeh I. Health system Decentralization: concepts, Issues and country experience In. Geneva, Switzerland: World Health Organization; 1990.
2.
go back to reference Bossert T. Analyzing the decentralization of health systems in developing countries: decision space, innovation and performance. Soc Sci Med. 1998;47(10):1513–27.CrossRefPubMed Bossert T. Analyzing the decentralization of health systems in developing countries: decision space, innovation and performance. Soc Sci Med. 1998;47(10):1513–27.CrossRefPubMed
3.
go back to reference Bossert TJ, Beauvais JC. Decentralization of health systems in Ghana, Zambia, Uganda and the Philippines: a comparative analysis of decision space. Health Policy Plan. 2002;17(1):14–31.CrossRefPubMed Bossert TJ, Beauvais JC. Decentralization of health systems in Ghana, Zambia, Uganda and the Philippines: a comparative analysis of decision space. Health Policy Plan. 2002;17(1):14–31.CrossRefPubMed
4.
go back to reference A.Rondinelli D, Nellis JR. Assessing decentralization policies in developing countries: the case for cautious optimism. Dev Policy Rev. 1986;4:3–23.CrossRef A.Rondinelli D, Nellis JR. Assessing decentralization policies in developing countries: the case for cautious optimism. Dev Policy Rev. 1986;4:3–23.CrossRef
5.
go back to reference Rowe AK, de Savigny D, Lanata CF, Victora CG. How can we achieve and maintain high-quality performance of health workers in low-resource settings? Lancet. 2005;366(9490):1026–35.CrossRefPubMed Rowe AK, de Savigny D, Lanata CF, Victora CG. How can we achieve and maintain high-quality performance of health workers in low-resource settings? Lancet. 2005;366(9490):1026–35.CrossRefPubMed
6.
go back to reference Waddington C. Towards better leadership and management in health. In: making health systems work. Geneva, Switzerland: World Health Organization; 2007. Waddington C. Towards better leadership and management in health. In: making health systems work. Geneva, Switzerland: World Health Organization; 2007.
7.
go back to reference Lafond AK, Brown L, Macintyre K. Mapping capacity in the health sector a conceptual framework. Int J Health Plann Manag. 2002;17:3–22.CrossRef Lafond AK, Brown L, Macintyre K. Mapping capacity in the health sector a conceptual framework. Int J Health Plann Manag. 2002;17:3–22.CrossRef
8.
go back to reference Barnoya J, Monzon JC, Colditz GA. Increasing chronic disease research capacity in Guatemala through a mentoring program. Can J Public Health. 2013;104(5):e427–432.CrossRefPubMed Barnoya J, Monzon JC, Colditz GA. Increasing chronic disease research capacity in Guatemala through a mentoring program. Can J Public Health. 2013;104(5):e427–432.CrossRefPubMed
9.
go back to reference Edwards LJ, Moises A, Nzaramba M, Cassimo A, Silva L, Mauricio J, Wester CW, Vermund SH, Moon TD. Implementation of a health management mentoring program: year-1 evaluation of its impact on health system strengthening in Zambezia Province, Mozambique. Int J Health Policy Manag. 2015;4(6):353–61.CrossRefPubMedPubMedCentral Edwards LJ, Moises A, Nzaramba M, Cassimo A, Silva L, Mauricio J, Wester CW, Vermund SH, Moon TD. Implementation of a health management mentoring program: year-1 evaluation of its impact on health system strengthening in Zambezia Province, Mozambique. Int J Health Policy Manag. 2015;4(6):353–61.CrossRefPubMedPubMedCentral
10.
go back to reference DeBrouwere V, Van Balen H. “Hands on training in health district management”. World Health Forum. 1996;17(3):271–3. DeBrouwere V, Van Balen H. “Hands on training in health district management”. World Health Forum. 1996;17(3):271–3.
11.
go back to reference Rockers PC, Bärnighausen T. Interventions for hiring, retaining and training district health systems managers in low and middles incomes countries (review). Cochrane Database of Systematic Reviews 2013 (4)Art. No.: CD009035. DOI:10.1002/14651858.CD009035.pub2. Rockers PC, Bärnighausen T. Interventions for hiring, retaining and training district health systems managers in low and middles incomes countries (review). Cochrane Database of Systematic Reviews 2013 (4)Art. No.: CD009035. DOI:10.1002/14651858.CD009035.pub2.
12.
go back to reference Zackariah R, Harries AD, Ishikawa N, Rieder HL, Bissel K, Laserson K, Massaquoi M, Herp MV, Reid T. Operational research in low-income countries: what, why, and how? Lancet Infect Dis. 2009;9:711–7.CrossRef Zackariah R, Harries AD, Ishikawa N, Rieder HL, Bissel K, Laserson K, Massaquoi M, Herp MV, Reid T. Operational research in low-income countries: what, why, and how? Lancet Infect Dis. 2009;9:711–7.CrossRef
13.
go back to reference Koshy V. Action research for improving practice: a practical guide. London: Paul Chapman Publishing; 2005. Koshy V. Action research for improving practice: a practical guide. London: Paul Chapman Publishing; 2005.
14.
go back to reference Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9(1):152.CrossRefPubMedPubMedCentral Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9(1):152.CrossRefPubMedPubMedCentral
15.
go back to reference Squires JE, Valentine JC, Grimshaw JM. Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol. 2013;66(11):1215–22.CrossRefPubMed Squires JE, Valentine JC, Grimshaw JM. Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol. 2013;66(11):1215–22.CrossRefPubMed
16.
go back to reference Gilson L, Elloker S, Olckers P, Lehmann U. Advancing the application of systems thinking in health: South African examples of a leadership of sensemaking for primary health care. Health Res Policy Syst. 2014; 12(1):1–13.CrossRef Gilson L, Elloker S, Olckers P, Lehmann U. Advancing the application of systems thinking in health: South African examples of a leadership of sensemaking for primary health care. Health Res Policy Syst. 2014; 12(1):1–13.CrossRef
17.
go back to reference Lehmann U, Gilson L. Action learning for health system governance: the reward and challenge of co-production. Health Policy Plan. 2015;30(8):957–63.CrossRefPubMed Lehmann U, Gilson L. Action learning for health system governance: the reward and challenge of co-production. Health Policy Plan. 2015;30(8):957–63.CrossRefPubMed
18.
go back to reference Bowling A. Mixed research approaches. In: Press OU, editor. Research methods in health investigating health and health services edn. 2009. p. 441–6. Bowling A. Mixed research approaches. In: Press OU, editor. Research methods in health investigating health and health services edn. 2009. p. 441–6.
19.
go back to reference Prashanth NS, Marchal B, Kegels G, Criel B. Evaluation of capacity building program of district health managers in India: a contextualized theoretical framework. Front Public Health. 2014; 2(89):1–14. Prashanth NS, Marchal B, Kegels G, Criel B. Evaluation of capacity building program of district health managers in India: a contextualized theoretical framework. Front Public Health. 2014; 2(89):1–14.
20.
go back to reference Takeuchi R, Bolino MC, Lin CC. Too many motives? The interactive effects of multiple motives on organizational citizenship behavior. J Appl Psychol. 2015;100(4):1239–48.CrossRefPubMed Takeuchi R, Bolino MC, Lin CC. Too many motives? The interactive effects of multiple motives on organizational citizenship behavior. J Appl Psychol. 2015;100(4):1239–48.CrossRefPubMed
21.
go back to reference Gilson L. Health Policy and systems research A Methodology Reader. In. Geneva, Switzerland: Alliance for Health Policy and Systems Research,World Health Organization; 2012. Gilson L. Health Policy and systems research A Methodology Reader. In. Geneva, Switzerland: Alliance for Health Policy and Systems Research,World Health Organization; 2012.
22.
go back to reference Petticrew M, Roberts H. Systematic Reviews in the Social Sciences Malden, USA Oxford,UK Carlton, Australia: Blackwell Publishing; 2006. Petticrew M, Roberts H. Systematic Reviews in the Social Sciences Malden, USA Oxford,UK Carlton, Australia: Blackwell Publishing; 2006.
23.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: medical research council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral
24.
go back to reference Carroll C, Booth A, Cooper K. A worked example of “best fit” framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents. BMC Med Res Methodol. 2011;11:29.CrossRefPubMedPubMedCentral Carroll C, Booth A, Cooper K. A worked example of “best fit” framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents. BMC Med Res Methodol. 2011;11:29.CrossRefPubMedPubMedCentral
25.
go back to reference Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13(1):1–16. Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13(1):1–16.
27.
go back to reference Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2:33–42.CrossRefPubMed Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, Francis D, Tugwell P. Using logic models to capture complexity in systematic reviews. Res Synth Methods. 2011;2:33–42.CrossRefPubMed
28.
go back to reference Baxter SK, Blank L, Woods HB, Payne N, Rimmer M, Goyder E. Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. Med Res Method. 2014;14(62):1471–2288. Baxter SK, Blank L, Woods HB, Payne N, Rimmer M, Goyder E. Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. Med Res Method. 2014;14(62):1471–2288.
29.
go back to reference Baxter S, Killoran A, Kelly MP, Goyder E. Synthesizing diverse evidence: the use of primary qualitative data analysis methods and logic models in public health reviews. Public Health. 2010;124(2):99–106.CrossRefPubMed Baxter S, Killoran A, Kelly MP, Goyder E. Synthesizing diverse evidence: the use of primary qualitative data analysis methods and logic models in public health reviews. Public Health. 2010;124(2):99–106.CrossRefPubMed
30.
go back to reference Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011 Oct 18;343:d5928. Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011 Oct 18;343:d5928.
33.
go back to reference Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407–15.CrossRefPubMed Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, et al. GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias). J Clin Epidemiol. 2011;64(4):407–15.CrossRefPubMed
34.
go back to reference Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, Alonso-Coello P, Djulbegovic B, Atkins D, Falck-Ytter Y, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol. 2011;64(12):1277–82.CrossRefPubMed Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, Alonso-Coello P, Djulbegovic B, Atkins D, Falck-Ytter Y, et al. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol. 2011;64(12):1277–82.CrossRefPubMed
35.
go back to reference Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Falck-Ytter Y, Jaeschke R, Vist G, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011;64(12):1303–10.CrossRefPubMed Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Falck-Ytter Y, Jaeschke R, Vist G, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011;64(12):1303–10.CrossRefPubMed
36.
go back to reference Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Akl EA, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. J Clin Epidemiol. 2011;64(12):1294–302.CrossRefPubMed Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Glasziou P, Jaeschke R, Akl EA, et al. GRADE guidelines: 7. Rating the quality of evidence—inconsistency. J Clin Epidemiol. 2011;64(12):1294–302.CrossRefPubMed
37.
go back to reference Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gulmezoglu M, Noyes J, Booth A, Garside R, Rashidian A. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895.CrossRefPubMedPubMedCentral Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gulmezoglu M, Noyes J, Booth A, Garside R, Rashidian A. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895.CrossRefPubMedPubMedCentral
38.
go back to reference Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.CrossRefPubMedPubMedCentral Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1.CrossRefPubMedPubMedCentral
Metadata
Title
To what extent do site-based training, mentoring, and operational research improve district health system management and leadership in low- and middle-income countries: a systematic review protocol
Authors
Zakaria Belrhiti
Andrew Booth
Bruno Marchal
Roosmarijn Verstraeten
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0239-z

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue