Skip to main content
Top
Published in: Human Resources for Health 1/2021

Open Access 01-12-2021 | Research

A practical measure of health facility efficiency: an innovation in the application of routine health information to determine health worker productivity in Ethiopia

Authors: Md Zabir Hasan, Girmaye D. Dinsa, Peter Berman

Published in: Human Resources for Health | Issue 1/2021

Login to get access

Abstract

Background

A simple indicator of technical efficiency, such as productivity of health workers, measured using routine health facility data, can be a practical approach that can inform initiatives to improve efficiency in low- and middle-income countries. This paper presents a proof of concept of using routine information from primary healthcare (PHC) facilities to measure health workers’ productivity and its application in three regions of Ethiopia.

Methods

In four steps, we constructed a productivity measure of the health workforce of Health Centers (HCs) and demonstrated its practical application: (1) developing an analytical dataset using secondary data from health management information systems (HMIS) and human resource information system (HRIS); (2) principal component analysis and factor analysis to estimate a summary measure of output from five indicators (annual service volume of outpatient visits, family planning, first antenatal care visits, facility-based deliveries by skilled birth attendants, and children [< 1 year] with three pentavalent vaccines); (3) calculating a productivity score by combining the summary measure of outputs and the total number of health workers (input), and (4) implementing regression models to identify the determinant of productivity and ranking HCs based on their adjusted productivity score.

Results

We developed an analytical dataset of 1128 HCs; however, significant missing values and outliers were reported in the data. The principal component and factor scores developed from the five output measures were highly consistent (correlation coefficient = 0.98). We considered the factor score as the summary measure of outputs for estimating productivity. A very weak association was observed between the summary measure of output and the total number of staff. The result also highlighted a large variability in productivity across similar health facilities in Ethiopia, represented by the significant dispersion in summary measure of output occurring at similar levels of the health workers.

Conclusions

We successfully demonstrated the analytical steps to estimate health worker productivity and its practical application using HMIS and HRIS. The methodology presented in this study can be readily applied in low- and middle-income countries using widely available data—such as DHIS2—that will allow further explorations to understand the causes of technical inefficiencies in the health system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sacks E, Schleiff M, Were M, Chowdhury AM, Perry HB. Communities, universal health coverage and primary health care. Bull World Health Organ. 2020;98(11):773–80.CrossRef Sacks E, Schleiff M, Were M, Chowdhury AM, Perry HB. Communities, universal health coverage and primary health care. Bull World Health Organ. 2020;98(11):773–80.CrossRef
2.
go back to reference Heller PS. Understanding fiscal space. IMF Policy Discussion Paper. 2005;19. Heller PS. Understanding fiscal space. IMF Policy Discussion Paper. 2005;19.
4.
go back to reference Chang AY, Cowling K, Micah AE, Chapin A, Chen CS, Ikilezi G, et al. Past, present, and future of global health financing: a review of development assistance, government, out-of-pocket, and other private spending on health for 195 countries, 1995–2050. Lancet. 2019;393(10187):2233–60.CrossRef Chang AY, Cowling K, Micah AE, Chapin A, Chen CS, Ikilezi G, et al. Past, present, and future of global health financing: a review of development assistance, government, out-of-pocket, and other private spending on health for 195 countries, 1995–2050. Lancet. 2019;393(10187):2233–60.CrossRef
6.
go back to reference Cylus J, Papanicolas I, Smith PC, editors. Health system efficiency: how to make measurement matter for policy and management. Copenhagen: WHO Regional Office for Europe; 2016. Cylus J, Papanicolas I, Smith PC, editors. Health system efficiency: how to make measurement matter for policy and management. Copenhagen: WHO Regional Office for Europe; 2016.
7.
go back to reference Zeng W, Yao Y, Barroy H, Cylus J, Li G. Improving fiscal space for health from the perspective of efficiency in low- and middle-income countries: what is the evidence? J Glob Health. 2020;10(2):1.CrossRef Zeng W, Yao Y, Barroy H, Cylus J, Li G. Improving fiscal space for health from the perspective of efficiency in low- and middle-income countries: what is the evidence? J Glob Health. 2020;10(2):1.CrossRef
8.
go back to reference Watson SI, Sahota H, Taylor CA, Chen Y-F, Lilford RJ. Cost-effectiveness of health care service delivery interventions in low and middle income countries: a systematic review. Global Health Res Policy. 2018;3(1):17.CrossRef Watson SI, Sahota H, Taylor CA, Chen Y-F, Lilford RJ. Cost-effectiveness of health care service delivery interventions in low and middle income countries: a systematic review. Global Health Res Policy. 2018;3(1):17.CrossRef
9.
go back to reference Horton S, Gelband H, Jamison D, Levin C, Nugent R, Watkins D. Ranking 93 health interventions for low- and middle-income countries by cost-effectiveness. PLoS ONE. 2017;12(8):e0182951.CrossRef Horton S, Gelband H, Jamison D, Levin C, Nugent R, Watkins D. Ranking 93 health interventions for low- and middle-income countries by cost-effectiveness. PLoS ONE. 2017;12(8):e0182951.CrossRef
10.
go back to reference Etienne C, Asamoa-Baah A, Evans DB, editors. The World health report: health systems financing: the path to universal coverage. Geneva: World Health Organization; 2010. Etienne C, Asamoa-Baah A, Evans DB, editors. The World health report: health systems financing: the path to universal coverage. Geneva: World Health Organization; 2010.
11.
go back to reference Hussey PS, de Vries H, Romley J, Wang MC, Chen SS, Shekelle PG, et al. A systematic review of health care efficiency measures. Health Serv Res. 2009;44(3):784–805.CrossRef Hussey PS, de Vries H, Romley J, Wang MC, Chen SS, Shekelle PG, et al. A systematic review of health care efficiency measures. Health Serv Res. 2009;44(3):784–805.CrossRef
12.
go back to reference Busse R, Geissler A, Aaviksoo A, Cots F, Häkkinen U, Kobel C, et al. Diagnosis related groups in Europe: moving towards transparency, efficiency, and quality in hospitals? BMJ. 2013;346:f3197.CrossRef Busse R, Geissler A, Aaviksoo A, Cots F, Häkkinen U, Kobel C, et al. Diagnosis related groups in Europe: moving towards transparency, efficiency, and quality in hospitals? BMJ. 2013;346:f3197.CrossRef
14.
go back to reference Hjalmarsson L, Kumbhakar SC, Heshmati A. DEA, DFA and SFA: a comparison. J Prod Anal. 1996;7(2):303–27.CrossRef Hjalmarsson L, Kumbhakar SC, Heshmati A. DEA, DFA and SFA: a comparison. J Prod Anal. 1996;7(2):303–27.CrossRef
16.
go back to reference Chapman CS, Kern A, Laguecir A, Quentin W. Management accounting and efficiency in health services: the foundational role of cost analysis [Internet]. Health system efficiency: How to make measurement matter for policy and management [Internet]. European Observatory on Health Systems and Policies; 2016. https://www.ncbi.nlm.nih.gov/books/NBK436887/ Chapman CS, Kern A, Laguecir A, Quentin W. Management accounting and efficiency in health services: the foundational role of cost analysis [Internet]. Health system efficiency: How to make measurement matter for policy and management [Internet]. European Observatory on Health Systems and Policies; 2016. https://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK436887/​
18.
go back to reference Dilu E, Gebreslassie M, Kebede M. Human Resource Information System implementation readiness in the Ethiopian health sector: a cross-sectional study. Hum Resour Health. 2017;15(1):85.CrossRef Dilu E, Gebreslassie M, Kebede M. Human Resource Information System implementation readiness in the Ethiopian health sector: a cross-sectional study. Hum Resour Health. 2017;15(1):85.CrossRef
19.
go back to reference Geresu T, Shiferaw M, Mitike G, Mariam DH. Commentary: a brief review of the draft human resources for health strategic plan, Ethiopia; 2009–2020. Ethiop J Health Dev. 2013;27(1):41–8. Geresu T, Shiferaw M, Mitike G, Mariam DH. Commentary: a brief review of the draft human resources for health strategic plan, Ethiopia; 2009–2020. Ethiop J Health Dev. 2013;27(1):41–8.
22.
go back to reference Dejene D, Yigzaw T, Mengistu S, Ayalew F, Kahsaye M, Woldemariam D. Exploring health workforce regulation practices and gaps in Ethiopia: a national cross-sectional study. Global Health Res Policy. 2019;4(1):36.CrossRef Dejene D, Yigzaw T, Mengistu S, Ayalew F, Kahsaye M, Woldemariam D. Exploring health workforce regulation practices and gaps in Ethiopia: a national cross-sectional study. Global Health Res Policy. 2019;4(1):36.CrossRef
23.
go back to reference Gobeze AA, Kebede Z, Berhan Y, Ghosh B. Clinical performance of emergency surgical officers in southern Ethiopia. Ethiop J Health Sci. 2016;26(5):463–70.CrossRef Gobeze AA, Kebede Z, Berhan Y, Ghosh B. Clinical performance of emergency surgical officers in southern Ethiopia. Ethiop J Health Sci. 2016;26(5):463–70.CrossRef
25.
go back to reference Hafidz F, Ensor T, Tubeuf S. Efficiency measurement in health facilities: a systematic review in low- and middle-income countries. Appl Health Econ Health Policy. 2018;16(4):465–80.CrossRef Hafidz F, Ensor T, Tubeuf S. Efficiency measurement in health facilities: a systematic review in low- and middle-income countries. Appl Health Econ Health Policy. 2018;16(4):465–80.CrossRef
26.
go back to reference Masiye F. Investigating health system performance: an application of data envelopment analysis to Zambian hospitals. BMC Health Serv Res. 2007;7(1):58.CrossRef Masiye F. Investigating health system performance: an application of data envelopment analysis to Zambian hospitals. BMC Health Serv Res. 2007;7(1):58.CrossRef
27.
go back to reference Lee K, Chun K, Lee J. Reforming the hospital service structure to improve efficiency: urban hospital specialization. Health Policy. 2008;87(1):41–9.CrossRef Lee K, Chun K, Lee J. Reforming the hospital service structure to improve efficiency: urban hospital specialization. Health Policy. 2008;87(1):41–9.CrossRef
28.
go back to reference Worthington AC. Frontier efficiency measurement in health care: a review of empirical techniques and selected applications. Med Care Res Rev. 2004;61(2):135–70.CrossRef Worthington AC. Frontier efficiency measurement in health care: a review of empirical techniques and selected applications. Med Care Res Rev. 2004;61(2):135–70.CrossRef
30.
go back to reference Barbato G, Barini EM, Genta G, Levi R. Features and performance of some outlier detection methods. J Appl Stat. 2011;38(10):2133–49.CrossRef Barbato G, Barini EM, Genta G, Levi R. Features and performance of some outlier detection methods. J Appl Stat. 2011;38(10):2133–49.CrossRef
31.
go back to reference Wold S, Esbensen K, Geladi P. Principal component analysis. Chemom Intell Lab Syst. 1987;2(1–3):37–52.CrossRef Wold S, Esbensen K, Geladi P. Principal component analysis. Chemom Intell Lab Syst. 1987;2(1–3):37–52.CrossRef
32.
go back to reference Brown TA. Confirmatory factor analysis for applied research. New York: Guilford publications; 2015. Brown TA. Confirmatory factor analysis for applied research. New York: Guilford publications; 2015.
33.
go back to reference Benoit K. Linear regression models with logarithmic transformations. London: Methodology Institute, London School of Economics; 2011. Benoit K. Linear regression models with logarithmic transformations. London: Methodology Institute, London School of Economics; 2011.
34.
go back to reference Muthén LK, Muthén BO. Mplus User’s Guide. Los Angeles: Muthén & Muthén; 2017. Muthén LK, Muthén BO. Mplus User’s Guide. Los Angeles: Muthén & Muthén; 2017.
35.
go back to reference Wickham H. ggplot2: elegant graphics for data analysis. New York: Springer; 2016.CrossRef Wickham H. ggplot2: elegant graphics for data analysis. New York: Springer; 2016.CrossRef
36.
go back to reference Hayton JC, Allen DG, Scarpello V. Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis. Organ Res Methods. 2004;7(2):191–205.CrossRef Hayton JC, Allen DG, Scarpello V. Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis. Organ Res Methods. 2004;7(2):191–205.CrossRef
37.
go back to reference Hasan MZ, Leoutsakos J-M, Story WT, Dean LT, Rao KD, Gupta S. Exploration of factor structure and measurement invariance by gender for a modified shortened adapted social capital assessment tool in India. Front Psychol. 2019;10:2641.CrossRef Hasan MZ, Leoutsakos J-M, Story WT, Dean LT, Rao KD, Gupta S. Exploration of factor structure and measurement invariance by gender for a modified shortened adapted social capital assessment tool in India. Front Psychol. 2019;10:2641.CrossRef
38.
go back to reference Goodwin L. The role of factor analysis in the estimation of construct validity. Meas Phys Educ Exercise Sci. 1999;3(2):85–100.CrossRef Goodwin L. The role of factor analysis in the estimation of construct validity. Meas Phys Educ Exercise Sci. 1999;3(2):85–100.CrossRef
39.
go back to reference Byamukama E, Courtright P. Knowledge, skills, and productivity in primary eye care among health workers in Tanzania: need for reassessment of expectations? Int Health. 2010;2(4):247–52.CrossRef Byamukama E, Courtright P. Knowledge, skills, and productivity in primary eye care among health workers in Tanzania: need for reassessment of expectations? Int Health. 2010;2(4):247–52.CrossRef
40.
go back to reference Frimpong JA, Helleringer S, Awoonor-Williams JK, Yeji F, Phillips JF. Does supervision improve health worker productivity? Evidence from the Upper East Region of Ghana. Trop Med Int Health. 2011;16(10):1225–33.CrossRef Frimpong JA, Helleringer S, Awoonor-Williams JK, Yeji F, Phillips JF. Does supervision improve health worker productivity? Evidence from the Upper East Region of Ghana. Trop Med Int Health. 2011;16(10):1225–33.CrossRef
41.
go back to reference Kozuki N, Wuliji T. Measuring productivity and its relationship to community health worker performance in Uganda: a cross-sectional study. BMC Health Serv Res. 2018;18(1):340.CrossRef Kozuki N, Wuliji T. Measuring productivity and its relationship to community health worker performance in Uganda: a cross-sectional study. BMC Health Serv Res. 2018;18(1):340.CrossRef
42.
go back to reference Vonesh EF. Mixed models: theory and applications. Taylor & Francis: Routledge; 2006. Vonesh EF. Mixed models: theory and applications. Taylor & Francis: Routledge; 2006.
43.
go back to reference Ahmed S, Hasan MZ, MacLennan M, Dorin F, Ahmed MW, Hasan MM, et al. Measuring the efficiency of health systems in Asia: a data envelopment analysis. BMJ Open. 2019;9(3):e022155.CrossRef Ahmed S, Hasan MZ, MacLennan M, Dorin F, Ahmed MW, Hasan MM, et al. Measuring the efficiency of health systems in Asia: a data envelopment analysis. BMJ Open. 2019;9(3):e022155.CrossRef
44.
go back to reference Hoff A. Second stage DEA: comparison of approaches for modelling the DEA score. Eur J Oper Res. 2007;181(1):425–35.CrossRef Hoff A. Second stage DEA: comparison of approaches for modelling the DEA score. Eur J Oper Res. 2007;181(1):425–35.CrossRef
45.
go back to reference Simar L, Wilson PW. Two-stage DEA: caveat emptor. J Prod Anal. 2011;36(2):205.CrossRef Simar L, Wilson PW. Two-stage DEA: caveat emptor. J Prod Anal. 2011;36(2):205.CrossRef
47.
go back to reference Tan J, Wen HJ, Awad N. Health care and services delivery systems as complex adaptive systems. Commun ACM. 2005;48(5):36–44.CrossRef Tan J, Wen HJ, Awad N. Health care and services delivery systems as complex adaptive systems. Commun ACM. 2005;48(5):36–44.CrossRef
Metadata
Title
A practical measure of health facility efficiency: an innovation in the application of routine health information to determine health worker productivity in Ethiopia
Authors
Md Zabir Hasan
Girmaye D. Dinsa
Peter Berman
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Human Resources for Health / Issue 1/2021
Electronic ISSN: 1478-4491
DOI
https://doi.org/10.1186/s12960-021-00636-6

Other articles of this Issue 1/2021

Human Resources for Health 1/2021 Go to the issue