Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

A critique of the Uganda district league table using a normative health system performance assessment framework

Authors: Christine KirungaTashobya, Freddie Ssengooba, Juliet Nabyonga-Orem, Juliet Bataringaya, Jean Macq, Bruno Marchal, Timothy Musila, Bart Criel

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

In 2003 the Uganda Ministry of Health (MoH) introduced the District League Table (DLT) to track district performance. This review of the DLT is intended to add to the evidence base on Health Systems Performance Assessment (HSPA) globally, with emphasis on Low and Middle Income Countries (LMICs), and provide recommendations for adjustments to the current Ugandan reality.

Methods

A normative HSPA framework was used to inform the development of a Key Informant Interview (KII) tool. Thirty Key Informants were interviewed, purposively selected from the Ugandan health system on the basis of having developed or used the DLT. KII data and information from published and grey literature on the Uganda health system was analyzed using deductive analysis.

Results

Stakeholder involvement in the development of the DLT was limited, including MoH officials and development partners, and a few district technical managers. Uganda policy documents articulate a conceptually broad health system whereas the DLT focuses on a healthcare system. The complexity and dynamism of the Uganda health system was insufficiently acknowledged by the HSPA framework. Though DLT objectives and indicators were articulated, there was no conceptual reference model and lack of clarity on the constitutive dimensions. The DLT mechanisms for change were not explicit. The DLT compared markedly different districts and did not identify factors behind observed performance. Uganda lacks a designated institutional unit for the analysis and presentation of HSPA data, and there are challenges in data quality and range.

Conclusions

The critique of the DLT using a normative model supported the development of recommendation for Uganda district HSPA and provides lessons for other LMICs. A similar approach can be used by researchers and policy makers elsewhere for the review and development of other frameworks.
Adjustments in Uganda district HSPA should consider: wider stakeholder involvement with more district managers including political, administrative and technical; better anchoring within the national health system framework; integration of the notion of complexity in the design of the framework; and emphasis on facilitating district decision-making and learning. There is need to improve data quality and range and additional approaches for data analysis and presentation.
Literature
1.
go back to reference World Health Organisation. The world health report 2000, Health systems: improving performance. Geneva: World Health Organisation. p. 2000. World Health Organisation. The world health report 2000, Health systems: improving performance. Geneva: World Health Organisation. p. 2000.
2.
go back to reference Loeb JM. The current state of performance measurement in health care. Int J Qual Health Care. 2004. 16 Suppl 1:i5–9. Loeb JM. The current state of performance measurement in health care. Int J Qual Health Care. 2004. 16 Suppl 1:i5–9.
3.
go back to reference Arah OA, Klazinga NS, Delnoij DMJ, Asbroek AHATEN, Custers T. Conceptual frameworks for health systems performance : a quest for effectiveness, quality, and improvement. Int J Qual Heal Care. 2003;15:377–398. Arah OA, Klazinga NS, Delnoij DMJ, Asbroek AHATEN, Custers T. Conceptual frameworks for health systems performance : a quest for effectiveness, quality, and improvement. Int J Qual Heal Care. 2003;15:377–398.
5.
go back to reference Marshall T, Mohammed M, Rouse A. A randomized controlled trial of league tables and control charts as aids to health service decision-making. Int J Qual Heal Care. 2004;16:309–15.CrossRef Marshall T, Mohammed M, Rouse A. A randomized controlled trial of league tables and control charts as aids to health service decision-making. Int J Qual Heal Care. 2004;16:309–15.CrossRef
6.
go back to reference Leggat S, Narine L, Lemieux-Charles L, Barnsley J, Baker G, Sicotte C, et al. A review of organizational performance assessment in health care. Heal Serv Manag Res. 1998;11:3–23.CrossRef Leggat S, Narine L, Lemieux-Charles L, Barnsley J, Baker G, Sicotte C, et al. A review of organizational performance assessment in health care. Heal Serv Manag Res. 1998;11:3–23.CrossRef
7.
go back to reference Smith, PC, Mossialos E, Papanicolas I, Leatherman S. Performance measurement for health system improvement: experiences, challenges and prospects. New York: Cambrdige University Press; 2009. Smith, PC, Mossialos E, Papanicolas I, Leatherman S. Performance measurement for health system improvement: experiences, challenges and prospects. New York: Cambrdige University Press; 2009.
9.
go back to reference Uganda Bureau of Statistics (UBOS) and ICF 2017: Uganda Demographic and Health Survey 2016: Key Indicators Report. Kampala, Uganda: UBOS, and Rockville, Maryland USA: UBOS and ICF. 2016. Uganda Bureau of Statistics (UBOS) and ICF 2017: Uganda Demographic and Health Survey 2016: Key Indicators Report. Kampala, Uganda: UBOS, and Rockville, Maryland USA: UBOS and ICF. 2016.
10.
go back to reference Ministry of Health 2015. Uganda Health Accounts: National Health Expenditure Financial Year 2010/2011 to 2011/2012. Kampala: Ministry of Health; 2015. Ministry of Health 2015. Uganda Health Accounts: National Health Expenditure Financial Year 2010/2011 to 2011/2012. Kampala: Ministry of Health; 2015.
11.
go back to reference Government of Uganda 1995. Constitution of the Republic of Uganda. Entebbe: Government of Uganda; 1995. Government of Uganda 1995. Constitution of the Republic of Uganda. Entebbe: Government of Uganda; 1995.
12.
go back to reference Governement of Uganda 1997. Local Government Act 1997. Entebbe: Government of Uganda 1997. Governement of Uganda 1997. Local Government Act 1997. Entebbe: Government of Uganda 1997.
13.
go back to reference Ministry of Health 2003. Annual Health Sector Performance Report 2002/03. Kampala: Ministry of Health; 2003. Ministry of Health 2003. Annual Health Sector Performance Report 2002/03. Kampala: Ministry of Health; 2003.
14.
go back to reference Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy (New York). 2008;85:263–76.CrossRef Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy (New York). 2008;85:263–76.CrossRef
15.
go back to reference ten Asbroek AHA, Arah OA, Geelhoed J, Custers T, Delnoij DM, Klazinga NS. Developing a national performance indicator framework for the Dutch health system. Int J Qual Heal Care. 2004;16:65–72.CrossRef ten Asbroek AHA, Arah OA, Geelhoed J, Custers T, Delnoij DM, Klazinga NS. Developing a national performance indicator framework for the Dutch health system. Int J Qual Heal Care. 2004;16:65–72.CrossRef
16.
go back to reference Tashobya CK, da Silveira VC, Ssengooba F, Nabyonga-Orem J, Macq J, Criel B. Health systems performance assessment in low-income countries: learning from international experiences. Glob Health. 2014;10:5.CrossRef Tashobya CK, da Silveira VC, Ssengooba F, Nabyonga-Orem J, Macq J, Criel B. Health systems performance assessment in low-income countries: learning from international experiences. Glob Health. 2014;10:5.CrossRef
17.
go back to reference Tashobya CK, Criel B, Marchal B, Macq J, da Silveira VC, Byakika S, et al. The waxing and waning of the Uganda district league table: using historical and policy analysis to study implementation of a health system performance assessment framework. Stud Heal Serv Organ Policy. 2016;32(2016):109 Tashobya CK, Criel B, Marchal B, Macq J, da Silveira VC, Byakika S, et al. The waxing and waning of the Uganda district league table: using historical and policy analysis to study implementation of a health system performance assessment framework. Stud Heal Serv Organ Policy. 2016;32(2016):109
18.
go back to reference Tashobya CK, Dubourg D, Ssengooba F, Speybroeck N, Macq J, Criel B. A comparison of hierarchical cluster analysis and league table rankings as methods for analysis and presentation of district health system performance data in Uganda. Health Policy Plan. 2015;Advance vi. Tashobya CK, Dubourg D, Ssengooba F, Speybroeck N, Macq J, Criel B. A comparison of hierarchical cluster analysis and league table rankings as methods for analysis and presentation of district health system performance data in Uganda. Health Policy Plan. 2015;Advance vi.
19.
go back to reference Kiwanuka M. Decentralized governance in multi-Party Systems in Developing Countries: challenges to service delivery in Uganda. J African Asian Local Gov Stud. 2013;815–9. Kiwanuka M. Decentralized governance in multi-Party Systems in Developing Countries: challenges to service delivery in Uganda. J African Asian Local Gov Stud. 2013;815–9.
20.
go back to reference Jeppson A. SWAp dynamics in a decentralised context: experiences from Uganda. Soc Sci Med. 2002;55:2053–60.CrossRef Jeppson A. SWAp dynamics in a decentralised context: experiences from Uganda. Soc Sci Med. 2002;55:2053–60.CrossRef
21.
go back to reference Cruz VO, Cooper R, Mcpake B, Yates R, Ssengooba F, Omaswa F, et al. Is the sector-wide approach improving health sector performance in Uganda? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 29–44. Cruz VO, Cooper R, Mcpake B, Yates R, Ssengooba F, Omaswa F, et al. Is the sector-wide approach improving health sector performance in Uganda? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 29–44.
22.
go back to reference Ssengooba F, Yates R, Cruz VO, Tashobya CK. Have systems reforms resulted in a more efficient and equitable allocation of resources in the Uganda health sector? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 109–18. Ssengooba F, Yates R, Cruz VO, Tashobya CK. Have systems reforms resulted in a more efficient and equitable allocation of resources in the Uganda health sector? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 109–18.
23.
go back to reference Nabyonga Orem J, Mugisha F, Kirunga C, MacQ J, Criel B. Abolition of user fees: the Uganda paradox. Health Policy Plan. 2011;26 Suppl 2:ii41–51. Nabyonga Orem J, Mugisha F, Kirunga C, MacQ J, Criel B. Abolition of user fees: the Uganda paradox. Health Policy Plan. 2011;26 Suppl 2:ii41–51.
24.
go back to reference Lochoro P, Bataringaya J, Tashobya CK, Kyabaggu JH. Public private partnership in health: working together to improve health sector performance in Uganda. In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 83–96. Lochoro P, Bataringaya J, Tashobya CK, Kyabaggu JH. Public private partnership in health: working together to improve health sector performance in Uganda. In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 83–96.
25.
go back to reference Ministry of Health 2000. The Health Sector Strategic Plan 2000/01 to 2004/05. Kampala: Ministry of Health; 2000. Ministry of Health 2000. The Health Sector Strategic Plan 2000/01 to 2004/05. Kampala: Ministry of Health; 2000.
26.
go back to reference Stierman E, Ssengooba F, Bennett S. Aid alignment: a longer term lens on trends in development assistance for health in Uganda. Glob Health. 2013;9:7.CrossRef Stierman E, Ssengooba F, Bennett S. Aid alignment: a longer term lens on trends in development assistance for health in Uganda. Glob Health. 2013;9:7.CrossRef
27.
go back to reference Nazerali H, Oteba MO, Mwoga J, Zaramba S. Medicines- driving demand for health services in Uganda? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 61–82. Nazerali H, Oteba MO, Mwoga J, Zaramba S. Medicines- driving demand for health services in Uganda? In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 61–82.
28.
go back to reference Ministry of Health 2010. Annual Health Sector Performance Report 2009/2010. Kampala: Ministry of Health; 2010. Ministry of Health 2010. Annual Health Sector Performance Report 2009/2010. Kampala: Ministry of Health; 2010.
29.
go back to reference Kiwanuka M. “ National Welfare or Local Welfare ?” The Fiscal Decentralization Paradox in Uganda. J African Asian Local Gov Stud. 2013;:92–106. Kiwanuka M. “ National Welfare or Local Welfare ?” The Fiscal Decentralization Paradox in Uganda. J African Asian Local Gov Stud. 2013;:92–106.
30.
go back to reference Ministry of Health 1999. The National Health Policy. Kampala: Ministry of Health; 1999. Ministry of Health 1999. The National Health Policy. Kampala: Ministry of Health; 1999.
31.
go back to reference Ministry of Health 2005. The Health Sector Strategic Plan 2004/05 to 2009/10. Kampala: Ministry of Health; 2005. Ministry of Health 2005. The Health Sector Strategic Plan 2004/05 to 2009/10. Kampala: Ministry of Health; 2005.
32.
go back to reference Ministry of Health 2010. The Second National Health Policy: promoting people's health to enhance socio-economic development. Kampala, Uganda: 2010. Ministry of Health 2010. The Second National Health Policy: promoting people's health to enhance socio-economic development. Kampala, Uganda: 2010.
33.
go back to reference Ministry of Health 2010. The Health Sector Strateigc and Investment Plan 2010/2011 to 2014/2015. Kampala: Ministry of Health; 2010. Ministry of Health 2010. The Health Sector Strateigc and Investment Plan 2010/2011 to 2014/2015. Kampala: Ministry of Health; 2010.
34.
go back to reference Ministry of Helath 2015. The Health Sector Development Plan 2015/2016 to 2019/2020. Kampala: Ministry of Health; 2015. Ministry of Helath 2015. The Health Sector Development Plan 2015/2016 to 2019/2020. Kampala: Ministry of Health; 2015.
35.
go back to reference Ministry of Health 2011. Monitoring and Evaluation Plan for the Health Sector Strategic and Investment Plan 2010/11 to 2014/15. Kampala: Ministry of Health; 2011. Ministry of Health 2011. Monitoring and Evaluation Plan for the Health Sector Strategic and Investment Plan 2010/11 to 2014/15. Kampala: Ministry of Health; 2011.
36.
go back to reference Murindwa G, Tashobya CK, Kyabaggu JH, Rutebemberwa E, Nabyonga J. Meeting the challenges of decentralised health service delivery in Uganda as a component of broader health sector reforms. In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 97–108. Murindwa G, Tashobya CK, Kyabaggu JH, Rutebemberwa E, Nabyonga J. Meeting the challenges of decentralised health service delivery in Uganda as a component of broader health sector reforms. In: Tashobya CK, Ssengooba F, Cruz VO, editors. Health systems reforms in Uganda: processes and outputs. London: Health Systems Development Programme, London School of Hygiene & Tropical Medicine, UK; 2006. p. 97–108.
37.
go back to reference Ministry of Health 2008. Mid-term Review of the Helath Sector Strategic Plan 2004/05 to 2009/10. Kampala: Ministry of Health; 2008. Ministry of Health 2008. Mid-term Review of the Helath Sector Strategic Plan 2004/05 to 2009/10. Kampala: Ministry of Health; 2008.
38.
go back to reference Komakech I. The curse of league tables: how Uganda missed the point. Heal Policy Dev J. 2005;3:165–9. Komakech I. The curse of league tables: how Uganda missed the point. Heal Policy Dev J. 2005;3:165–9.
39.
go back to reference Boerma T, Gore F. Strengthening monitoring and evaluuation practices in the context of scaling up the IHP+ compact and Country Health System Surveillence - Uganda. Geneva: World Health Organsiation; 2010. Boerma T, Gore F. Strengthening monitoring and evaluuation practices in the context of scaling up the IHP+ compact and Country Health System Surveillence - Uganda. Geneva: World Health Organsiation; 2010.
40.
go back to reference Kiberu VM, Matovu JKB, Makumbi F, Kyozira C, Mukooyo E, Wanyenze RK. Strengthening district-based health reporting through the district health management information software system: the Ugandan experience. BMC Med Inform Decis Mak. 2014;14:40.CrossRefPubMedPubMedCentral Kiberu VM, Matovu JKB, Makumbi F, Kyozira C, Mukooyo E, Wanyenze RK. Strengthening district-based health reporting through the district health management information software system: the Ugandan experience. BMC Med Inform Decis Mak. 2014;14:40.CrossRefPubMedPubMedCentral
41.
go back to reference Driwale A. Dirty Data : disease surveillance in Arua District. Heal Policy Dev J. 2005;3:54–67. Driwale A. Dirty Data : disease surveillance in Arua District. Heal Policy Dev J. 2005;3:54–67.
42.
go back to reference Boerma T, Gore F, Health N, Strategic S, Plan I. Strengthening monitoring and evaluation practices in the context of scaling - up the IHP + compactand. 2014;2010:1–23. Boerma T, Gore F, Health N, Strategic S, Plan I. Strengthening monitoring and evaluation practices in the context of scaling - up the IHP + compactand. 2014;2010:1–23.
43.
go back to reference Tashobya CK, Zikusooka CM, Seru M. DFID Northern Uganda Post Conflict Development Plan Health Programme Design: Final Report. Kampala: DFID Uganda Country Office; 2010. Tashobya CK, Zikusooka CM, Seru M. DFID Northern Uganda Post Conflict Development Plan Health Programme Design: Final Report. Kampala: DFID Uganda Country Office; 2010.
44.
go back to reference Ministry of Health 2004. Area Teams for Health Sector Supervsion, Monitoring and Mentoring. Kampala: Ministry of Health; 2004. Ministry of Health 2004. Area Teams for Health Sector Supervsion, Monitoring and Mentoring. Kampala: Ministry of Health; 2004.
45.
go back to reference van den Berg MJ, Kringos DS, Marks LK, Klazinga NS. The Dutch health care performance report : seven years of health care performance assessment in the Netherlands. Heal Res Policy Syst. 2014;12:1–7.CrossRef van den Berg MJ, Kringos DS, Marks LK, Klazinga NS. The Dutch health care performance report : seven years of health care performance assessment in the Netherlands. Heal Res Policy Syst. 2014;12:1–7.CrossRef
46.
go back to reference Kiyaga-Nsubuga J. Local Governance and Local Democracy in Uganda. Commonw J Local Gov. 2009;:26–43. Kiyaga-Nsubuga J. Local Governance and Local Democracy in Uganda. Commonw J Local Gov. 2009;:26–43.
47.
go back to reference Mushemeza ED. The functioning of a multiparty system in local government: challenges of transition from the movement system in Uganda. Kampala, Uganda: ACODE Briefing Paper No. 20 2007; 2007. Mushemeza ED. The functioning of a multiparty system in local government: challenges of transition from the movement system in Uganda. Kampala, Uganda: ACODE Briefing Paper No. 20 2007; 2007.
48.
go back to reference Uganda National AIDS Support Organisations. THE UGANDA AIDS ACCOUNTABILITY SCORE CARD of AIDS services. 2014. Uganda National AIDS Support Organisations. THE UGANDA AIDS ACCOUNTABILITY SCORE CARD of AIDS services. 2014.
49.
go back to reference New Vision. DENIVA - Peoples Alternative Assemblies Come of Age in Uganda. 2012;2012 October Monday 8th:2012. New Vision. DENIVA - Peoples Alternative Assemblies Come of Age in Uganda. 2012;2012 October Monday 8th:2012.
50.
go back to reference Freeman T. Using performance indicators to improve health care quality in the public sector: a review of literature. Heal Serv Manag Res. 2002;15:126–37.CrossRef Freeman T. Using performance indicators to improve health care quality in the public sector: a review of literature. Heal Serv Manag Res. 2002;15:126–37.CrossRef
51.
go back to reference Ibrahim JE. Performance indicators from all. Int J Qual Heal Care. 2001;13:431–2.CrossRef Ibrahim JE. Performance indicators from all. Int J Qual Heal Care. 2001;13:431–2.CrossRef
52.
go back to reference Kusek J, Rist R. Ten steps to a results-based monitoring and evaluation system: a handbook for development practitioners. Washington DC: World Bank; 2004.CrossRef Kusek J, Rist R. Ten steps to a results-based monitoring and evaluation system: a handbook for development practitioners. Washington DC: World Bank; 2004.CrossRef
Metadata
Title
A critique of the Uganda district league table using a normative health system performance assessment framework
Authors
Christine KirungaTashobya
Freddie Ssengooba
Juliet Nabyonga-Orem
Juliet Bataringaya
Jean Macq
Bruno Marchal
Timothy Musila
Bart Criel
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3126-6

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue