Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Care | Research article

Preliminary validation of the PRImary care facility Management Evaluation tool (PRIME-Tool), a national facility management survey implemented in Ghana

Authors: Jhanna Uy, Erlyn K. Macarayan, Hannah L. Ratcliffe, Kate Miller, Easmon Otupiri, John Koku Awoonor-Williams, Lisa R. Hirschhorn, Stuart R. Lipsitz, Dan Schwarz, Asaf Bitton

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

The management quality of healthcare facilities has consistently been linked to facility performance, but available tools to measure management are costly to implement, often hospital-specific, not designed for low- and middle-income countries (LMICs), nor widely deployed. We addressed this gap by developing the PRImary care facility Management Evaluation Tool (PRIME-Tool), a primary health care facility management survey for integration into routine national surveys in LMICs. We present an analysis of the tool’s psychometric properties and suggest directions for future improvements.

Methods

The PRIME-Tool assesses performance in five core management domains: Target setting, Operations, Human resources, Monitoring, and Community engagement. We evaluated two versions of the PRIME-Tool. We surveyed 142 primary health care (PHC) facilities in Ghana in 2016 using the first version (27 items) and 148 facilities in 2017 using the second version (34 items). We calculated floor and ceiling effects for each item and conducted exploratory factor analyses to examine the factor structure for each year and version of the tool. We developed a revised management framework and PRIME-tool as informed by these exploratory results, further review of management theory literature, and co-author consensus.

Results

The majority (17 items in 2016, 23 items in 2017) of PRIME-Tool items exhibited ceiling effects, but only three (2 items in 2016, 3 items in 2017) showed floor effects. Solutions suggested by factor analyses did not fully fit our initial hypothesized management domains. We found five groupings of items that consistently loaded together across each analysis and named these revised domains as Supportive supervision and target setting, Active monitoring and review, Community engagement, Client feedback for improvement, and Operations and financing.

Conclusion

The revised version of the PRIME-Tool captures a range of important and actionable information on the management of PHC facilities in LMIC contexts. We recommend its use by other investigators and practitioners to further validate its utility in PHC settings. We will continue to refine the PRIME-Tool to arrive at a parsimonious tool for tracking PHC facility management quality. Better understanding the functional components of PHC facility management can help policymakers and frontline managers drive evidence-based improvements in performance.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mabuchi S, Sesan T, Bennett SC. Pathways to high and low performance: factors differentiating primary care facilities under performance-based financing in Nigeria. Health Policy Plan. 2018;33:41–58.PubMedCrossRef Mabuchi S, Sesan T, Bennett SC. Pathways to high and low performance: factors differentiating primary care facilities under performance-based financing in Nigeria. Health Policy Plan. 2018;33:41–58.PubMedCrossRef
2.
go back to reference McNatt Z, Linnander E, Endeshaw A, Tatek D, Conteh D, Bradley EH. A national system for monitoring the performance of hospitals in Ethiopia. Bull World Health Organ. 2015;93:719–26.PubMedPubMedCentralCrossRef McNatt Z, Linnander E, Endeshaw A, Tatek D, Conteh D, Bradley EH. A national system for monitoring the performance of hospitals in Ethiopia. Bull World Health Organ. 2015;93:719–26.PubMedPubMedCentralCrossRef
3.
go back to reference Munyewende PO, Levin J, Rispel LC. An evaluation of the competencies of primary health care clinic nursing managers in two south African provinces. Glob Health Action. 2016;9:32486.PubMedCrossRef Munyewende PO, Levin J, Rispel LC. An evaluation of the competencies of primary health care clinic nursing managers in two south African provinces. Glob Health Action. 2016;9:32486.PubMedCrossRef
4.
5.
go back to reference Dieleman M, Gerretsen B, van der Wilt GJ. Human resource management interventions to improve health workers’ performance in low and middle income countries: a realist review. Health Res Policy Syst. 2009;7:7.PubMedPubMedCentralCrossRef Dieleman M, Gerretsen B, van der Wilt GJ. Human resource management interventions to improve health workers’ performance in low and middle income countries: a realist review. Health Res Policy Syst. 2009;7:7.PubMedPubMedCentralCrossRef
6.
go back to reference Macarayan EK, Ratcliffe HL, Otupiri E, Hirschhorn LR, Miller K, Lipsitz SR, et al. Facility management associated with improved primary health care outcomes in Ghana. PLoS One. 2019;14:e0218662.PubMedPubMedCentralCrossRef Macarayan EK, Ratcliffe HL, Otupiri E, Hirschhorn LR, Miller K, Lipsitz SR, et al. Facility management associated with improved primary health care outcomes in Ghana. PLoS One. 2019;14:e0218662.PubMedPubMedCentralCrossRef
7.
go back to reference Lega F, Prenestini A, Spurgeon P. Is management essential to improving the performance and sustainability of health care systems and organizations? A systematic review and a roadmap for future studies. Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2013;16(1 Suppl):S46–51.CrossRef Lega F, Prenestini A, Spurgeon P. Is management essential to improving the performance and sustainability of health care systems and organizations? A systematic review and a roadmap for future studies. Value Health J Int Soc Pharmacoeconomics Outcomes Res. 2013;16(1 Suppl):S46–51.CrossRef
8.
go back to reference McConnell KJ, Lindrooth RC, Wholey DR, Maddox TM, Bloom N. Management practices and the quality of care in cardiac units. JAMA Intern Med. 2013;173:684–92.PubMedCrossRef McConnell KJ, Lindrooth RC, Wholey DR, Maddox TM, Bloom N. Management practices and the quality of care in cardiac units. JAMA Intern Med. 2013;173:684–92.PubMedCrossRef
9.
go back to reference McConnell KJ, Hoffman KA, Quanbeck A, McCarty D. Management practices in substance abuse treatment programs. J Subst Abus Treat. 2009;37:79–89.CrossRef McConnell KJ, Hoffman KA, Quanbeck A, McCarty D. Management practices in substance abuse treatment programs. J Subst Abus Treat. 2009;37:79–89.CrossRef
12.
go back to reference Tsai TC, Jha AK, Gawande AA, Huckman RS, Bloom N, Sadun R. Hospital board and management practices are strongly related to hospital performance on clinical quality metrics. Health Aff Proj Hope. 2015;34:1304–11.CrossRef Tsai TC, Jha AK, Gawande AA, Huckman RS, Bloom N, Sadun R. Hospital board and management practices are strongly related to hospital performance on clinical quality metrics. Health Aff Proj Hope. 2015;34:1304–11.CrossRef
18.
go back to reference Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, et al. The primary care assessment survey: tests of data quality and measurement performance. Med Care. 1998;36:728–39.PubMedCrossRef Safran DG, Kosinski M, Tarlov AR, Rogers WH, Taira DH, Lieberman N, et al. The primary care assessment survey: tests of data quality and measurement performance. Med Care. 1998;36:728–39.PubMedCrossRef
22.
go back to reference Bitton A, Veillard JH, Basu L, Ratcliffe HL, Schwarz D, Hirschhorn LR. The 5S-5M-5C schematic: transforming primary care inputs to outcomes in low-income and middle-income countries. BMJ Glob Health. 2018;3(Suppl 3):e001020.PubMedPubMedCentralCrossRef Bitton A, Veillard JH, Basu L, Ratcliffe HL, Schwarz D, Hirschhorn LR. The 5S-5M-5C schematic: transforming primary care inputs to outcomes in low-income and middle-income countries. BMJ Glob Health. 2018;3(Suppl 3):e001020.PubMedPubMedCentralCrossRef
24.
go back to reference Rifkin SB. Examining the links between community participation and health outcomes: a review of the literature. Health Policy Plan. 2014;29(Suppl 2):ii98–106.PubMedPubMedCentralCrossRef Rifkin SB. Examining the links between community participation and health outcomes: a review of the literature. Health Policy Plan. 2014;29(Suppl 2):ii98–106.PubMedPubMedCentralCrossRef
25.
go back to reference Bitton A, Ratcliffe HL, Veillard JH, Kress DH, Barkley S, Kimball M, et al. Primary Health care as a Foundation for Strengthening Health Systems in low- and middle-income countries. J Gen Intern Med. 2017;32:566–71.PubMedCrossRef Bitton A, Ratcliffe HL, Veillard JH, Kress DH, Barkley S, Kimball M, et al. Primary Health care as a Foundation for Strengthening Health Systems in low- and middle-income countries. J Gen Intern Med. 2017;32:566–71.PubMedCrossRef
27.
go back to reference Agongo E, Agongo P, Enyimayew a, Adibo M, Mensah E. primary health care systems (PRIMASYS): comprehensive case study from Ghana. Geneva: World Health Organization. Agongo E, Agongo P, Enyimayew a, Adibo M, Mensah E. primary health care systems (PRIMASYS): comprehensive case study from Ghana. Geneva: World Health Organization.
30.
go back to reference Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.PubMedCrossRef Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.PubMedCrossRef
32.
go back to reference Kline P. An easy guide to factor analysis: Routledge; 1994. Kline P. An easy guide to factor analysis: Routledge; 1994.
33.
go back to reference Flora DB, Curran PJ. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods. 2004;9:466–91.PubMedPubMedCentralCrossRef Flora DB, Curran PJ. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods. 2004;9:466–91.PubMedPubMedCentralCrossRef
34.
go back to reference Olsson U. Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika. 1979;44:443–60.CrossRef Olsson U. Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika. 1979;44:443–60.CrossRef
35.
go back to reference Bartholomew DJ. Factor analysis for categorical data. J R Stat Soc Ser B Methodol. 1980;42:293–321. Bartholomew DJ. Factor analysis for categorical data. J R Stat Soc Ser B Methodol. 1980;42:293–321.
37.
go back to reference Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. 2005;10:173–8. Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. 2005;10:173–8.
38.
go back to reference Ford JK, MacCALLUM RC, Tait M. The application of exploratory factor analysis in applied psychology: a critical review and analysis. Pers Psychol. 1986;39:291–314.CrossRef Ford JK, MacCALLUM RC, Tait M. The application of exploratory factor analysis in applied psychology: a critical review and analysis. Pers Psychol. 1986;39:291–314.CrossRef
39.
go back to reference Tracy L. For want of trust a joint venture founders: A lesson in misuse of factor analysis; 1983. p. 346–53. Tracy L. For want of trust a joint venture founders: A lesson in misuse of factor analysis; 1983. p. 346–53.
42.
go back to reference Starfield B. Is primary care essential? Lancet Lond Engl. 1994;344:1129–33.CrossRef Starfield B. Is primary care essential? Lancet Lond Engl. 1994;344:1129–33.CrossRef
43.
go back to reference Epstein MJ, Buhovac AR. Making sustainability work: best practices in managing and measuring corporate social, environmental, and economic impacts. 2nd ed. San Francisco: Berrett-Koehler Publishers; 2014. Epstein MJ, Buhovac AR. Making sustainability work: best practices in managing and measuring corporate social, environmental, and economic impacts. 2nd ed. San Francisco: Berrett-Koehler Publishers; 2014.
44.
go back to reference Lloria MB, Moreno-Luzon MD. Organizational learning: proposal of an integrative scale and research instrument. J Bus Res. 2014;67:692–7.CrossRef Lloria MB, Moreno-Luzon MD. Organizational learning: proposal of an integrative scale and research instrument. J Bus Res. 2014;67:692–7.CrossRef
45.
go back to reference Breevaart K, Bakker AB, Demerouti E. Daily self-management and employee work engagement. J Vocat Behav. 2014;84:31–8.CrossRef Breevaart K, Bakker AB, Demerouti E. Daily self-management and employee work engagement. J Vocat Behav. 2014;84:31–8.CrossRef
46.
go back to reference Bradley S, Kamwendo F, Masanja H, de Pinho H, Waxman R, Boostrom C, et al. District health managers’ perceptions of supervision in Malawi and Tanzania. Hum Resour Health. 2013;11:43.PubMedPubMedCentralCrossRef Bradley S, Kamwendo F, Masanja H, de Pinho H, Waxman R, Boostrom C, et al. District health managers’ perceptions of supervision in Malawi and Tanzania. Hum Resour Health. 2013;11:43.PubMedPubMedCentralCrossRef
47.
go back to reference Agyepong IA. Reforming health service delivery at district level in Ghana: the perspective of a district medical officer. Health Policy Plan. 1999;14:59–69.PubMedCrossRef Agyepong IA. Reforming health service delivery at district level in Ghana: the perspective of a district medical officer. Health Policy Plan. 1999;14:59–69.PubMedCrossRef
50.
go back to reference Otero C, Luna D, Marcelo A, Househ M, Mandirola H, Curioso W, et al. Why patient centered care coordination is important in developing countries? Yearb Med Inform. 2015;10:30–3.PubMedPubMedCentral Otero C, Luna D, Marcelo A, Househ M, Mandirola H, Curioso W, et al. Why patient centered care coordination is important in developing countries? Yearb Med Inform. 2015;10:30–3.PubMedPubMedCentral
51.
go back to reference Miles A. Tailoring care to individuals and populations within resource-poor settings: a review and commentary on the World Health Organisation report people-Centred Care in low and Middle Income Countries. Int J Pers Centered Med. 2011;1:113–8.CrossRef Miles A. Tailoring care to individuals and populations within resource-poor settings: a review and commentary on the World Health Organisation report people-Centred Care in low and Middle Income Countries. Int J Pers Centered Med. 2011;1:113–8.CrossRef
52.
go back to reference Sixma HJ, Kerssens JJ, Campen CV, Peters L. Quality of care from the patients’ perspective: from theoretical concept to a new measuring instrument. Health Expect Int J Public Particip Health Care Health Policy. 1998;1:82–95. Sixma HJ, Kerssens JJ, Campen CV, Peters L. Quality of care from the patients’ perspective: from theoretical concept to a new measuring instrument. Health Expect Int J Public Particip Health Care Health Policy. 1998;1:82–95.
54.
go back to reference Stover B, Lubega F, Namubiru A, Bakengesa E, Luboga SA, Makumbi F, et al. Conducting a large public Health data collection project in Uganda: methods, tools, and lessons learned. J Res Pract. 2018;14. Stover B, Lubega F, Namubiru A, Bakengesa E, Luboga SA, Makumbi F, et al. Conducting a large public Health data collection project in Uganda: methods, tools, and lessons learned. J Res Pract. 2018;14.
55.
go back to reference Zimmerman LA, Bell SO, Li Q, Morzenti A, Anglewicz P, Group PPI, et al. Individual, community and service environment factors associated with modern contraceptive use in five sub-Saharan African countries: a multilevel, multinomial analysis using geographically linked data from PMA2020. PLoS One. 2019;14:e0218157.PubMedPubMedCentralCrossRef Zimmerman LA, Bell SO, Li Q, Morzenti A, Anglewicz P, Group PPI, et al. Individual, community and service environment factors associated with modern contraceptive use in five sub-Saharan African countries: a multilevel, multinomial analysis using geographically linked data from PMA2020. PLoS One. 2019;14:e0218157.PubMedPubMedCentralCrossRef
57.
go back to reference Bloom N, Van Reenen J. Why do Management practices differ across firms and countries? J Econ Perspect. 2010;24:203–24.CrossRef Bloom N, Van Reenen J. Why do Management practices differ across firms and countries? J Econ Perspect. 2010;24:203–24.CrossRef
Metadata
Title
Preliminary validation of the PRImary care facility Management Evaluation tool (PRIME-Tool), a national facility management survey implemented in Ghana
Authors
Jhanna Uy
Erlyn K. Macarayan
Hannah L. Ratcliffe
Kate Miller
Easmon Otupiri
John Koku Awoonor-Williams
Lisa R. Hirschhorn
Stuart R. Lipsitz
Dan Schwarz
Asaf Bitton
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-4768-8

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue