Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Cost Effectiveness and Resource Allocation
Published in: Cost Effectiveness and Resource Allocation 1/2018

Open Access 01-12-2018 | Research

A comprehensive map of the evidence on the performance evaluation indicators of public hospitals: a scoping study and best fit framework synthesis

Authors: Kimia Pourmohammadi, Nahid Hatam, Payam Shojaei, Peivand Bastani

Published in: Cost Effectiveness and Resource Allocation | Issue 1/2018

Login to get access

Abstract

Introduction

Key performance indicators are essential navigation tools for hospitals. They provide managers with valid information enabling them to identify institutional strengths and weaknesses and improve managerial performance. In this study, the synthesis of evidence relating to hospital performance indicators was carried out by means of a field review and the indicators were analyzed through the Best Fit Method.

Methods

The five-step approach of Arksey and O’Malley was used as follows: selection of the research question; search for related studies; selection and refinement of the studies; synthesis and tabulation of key information; derivation of the related summary and report. Applying the Best Fit Framework Synthesis Method, the initial themes and subthemes were created and a model of public hospitals performance evaluation finally generated.

Results

Forty-nine studies were considered eligible to form part of the synthesis. The final model included the efficiency/productivity, effectiveness and financial themes. The efficiency/productivity sub-themes incorporated human resources indicators, hospital beds, costs, operating room productivity, emergency rooms, ICU, radiology, labs, technology and equipment productivity. Other sub-themes relate to general indicators such as BOR, ALS, number of outpatients and hospitalized patients. Financial themes included profit, revenue, cash flow, cost, investment, assets, debt and liquidity. Concerning effectiveness, the indicators were categorized in terms of access (equity), safety, quality and responsiveness. The accountability indicators were classified into patient-centeredness, staff orientation, and social responsibility.

Conclusion

Hospital performance management is a multi-dimensional issue, each dimension having its own significance. Based on the evidence, indicators are dependent on the evaluation model employed, the evaluation objective, and the views of executive managers and participants in the study. Selection of the most appropriate indicators is therefore key to a comprehensive performance evaluation system.
Appendix
Available only for authorised users
Literature
1.
Pourmohammadi K, Shojaei P, Rahimi H, Bastani P. Evaluating the health system financing of the Eastern Mediterranean Region (EMR) countries using grey relation analysis and shannon entropy. Cost Eff Resour Alloc. 2018;16(1):31.PubMedPubMedCentralCrossRef
2.
World Health O. How can hospital performance be measured and monitored? How can hospital performance be measured and monitored? 2003; p. 17.
3.
Masoumpour SM, Rahimi SH, Kharazmi E, Kavousi Z, Mosalah NH, Abedi Z. Assessing waiting time in emergency department of Shahid Faghihi hospital, Shiraz and presenting appropriate strategies using quality function deployment (QFD) method, 2011–2012. Hakim Res J. 2013;16(2):159–68.
4.
Zarchi MR, Jabbari A, Rahimi SH, Shafaghat T, Abbasi S. Preparation and designing a checklist for health care marketing mix, with medical tourism approach. Int J Travel Med Glob Health. 2013;1:103–8.
5.
Bastani P, Vatankhah S, Salehi M. Performance ratio analysis: a national study on Iranian hospitals affiliated to ministry of Health and Medical Education. Iran J Public Health. 2013;42(8):876.PubMedPubMedCentral
6.
Shadpour K. Health sector reform in Islamic Republic of Iran. Hakim Res J. 2006;9(3):1–18.
7.
Gapenski LC, Pink GH. Understanding healthcare financial management. Chicago: Health Administration Press; 2007.
8.
Parkinson J, Tsasis P, Porporato M. A critical review of financial measures as reported in the Ontario hospital balanced scorecard. J Health Care Finance. 2007;34(2):48–56.PubMed
9.
Suarez V, Lesneski C, Denison D. Making the case for using financial indicators in local public health agencies. Am J Public Health. 2011;101(3):419–25.PubMedPubMedCentralCrossRef
10.
Novick LF, Morrow CB. A framework for public health administration and practice. Public Health Admin. 2008;2:35–68.
11.
Chen F-H, Hsu T-S, Tzeng G-H. A balanced scorecard approach to establish a performance evaluation and relationship model for hot spring hotels based on a hybrid MCDM model combining DEMATEL and ANP. Int J Hosp Manag. 2011;30(4):908–32.CrossRef
12.
B GWG. Role of analytical tools in airline flight safety management systems. Global Aviation Information Network; 2004.
13.
Watkins AL. Hospital financial ratio classification patterns revisited: upon considering nonfinancial information. J Acc Public Pol. 2000;19(1):73–95.CrossRef
14.
Rahimi H, Khammar-nia M, Kavosi Z, Eslahi M. Indicators of hospital performance evaluation: a systematic review. Int J Hosp Res. 2014;3(4):199–208.
15.
Pizzini MJ. The relation between cost-system design, managers’ evaluations of the relevance and usefulness of cost data, and financial performance: an empirical study of US hospitals. Acc Organ Soc. 2006;31(2):179–210.CrossRef
16.
Pro DD, Con BM. Should key performance indicators for clinical services be mandatory? Can J Hosp Pharm. 2011;6(1):55.
17.
Veillard J, Guisset A-L, Garcia-Barbero M. Selection of indicators for Hospital Performance Measurement: A report on the 3rd and 4th Workshop. Regional Office for Europe of the World Health Organization; 2003.
18.
Hilderink H, Hilderink HBM, editors. Scenario development methodology. 2013.
19.
Rahimi H, Kavosi Z, Shojaei P, Kharazmi E. Key performance indicators in hospital based on balanced scorecard model. J Health Manag Inform. 2016;4(1):17–24.
20.
Gu X, Itoh K. Performance indicators: healthcare professionals’ views. Int J Health Care Qual Assur. 2016;29(7):801–15.PubMedCrossRef
21.
Rahimi H, Bahmaei J, Shojaei P, Kavosi Z, Khavasi M. Developing a strategy map to improve public hospitals performance with balanced scorecard and dematel approach. Shiraz E Med J. 2018;19(7):e64056.
22.
23.
Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon Lasso and data envelopment analysis: a complementary approach to hospital performance measurement. Global J Health Sci. 2014;6(4):107.CrossRef
24.
Lotfi F, Kalhor R, Bastani P, Zadeh NS, Eslamian M, Dehghani MR, et al. Various indicators for the assessment of hospitals’ performance status: differences and similarities. Iran Red Cresc Med J. 2014;16(4):e12950.
25.
Goshtasebi A, Vahdaninia M, Gorgipour R, Samanpour A, Maftoon F, Farzadi F, et al. Assessing hospital performance by the Pabon Lasso Model. Iran J Public Health. 2009;38(2):119–24.
26.
Davis P, Milne B, Parker K, Hider P, Lay-Yee R, Cumming J, et al. Efficiency, effectiveness, equity (E3). Evaluating hospital performance in three dimensions. Health Policy. 2013;112(1):19–27.PubMedCrossRef
27.
Pink GH, Daniel I, Hall LM, McKillop I. Selection of key financial indicators: A literature, panel and survey approach. Law Governance. 2007;11(3):87.
28.
Xenos P, Yfantopoulos J, Nektarios M, Polyzos N, Tinios P, Constantopoulos A. Efficiency and productivity assessment of public hospitals in Greece during the crisis period 2009–2012. Cost Effect Resour Alloc. 2017;15(1):6.CrossRef
29.
Gholamzadeh Nikjoo R, Jabbari Beyrami H, Jannati A, Asghari Jaafarabadi M. Selecting hospital’s key performance indicators, using analytic hierarchy process technique. J Commun Health Res. 2013;2(1):30–8.
30.
Khalifa M, Khalid P. Developing strategic health care key performance indicators: a case study on a tertiary care hospital. Procedia Comput Sci. 2015;63:459–66.CrossRef
31.
McAlearney AS, Hefner JL, Sieck C, Rizer M, Huerta TR. Evidence-based management of ambulatory electronic health record system implementation: an assessment of conceptual support and qualitative evidence. Int J Med Inform. 2014;83(7):484–94.PubMedCrossRef
32.
Arndt M, Bigelow B. Evidence-based management in health care organizations: a cautionary note. Health Care Manage Rev. 2009;34(3):206–13.PubMedCrossRef
33.
Head BW. Reconsidering evidence-based policy: key issues and challenges. Policy Soc. 2010;29(2):77–94.CrossRef
34.
Tricco AC, Cardoso R, Thomas SM, Motiwala S, Sullivan S, Kealey MR, et al. Barriers and facilitators to uptake of systematic reviews by policy makers and health care managers: a scoping review. Implem Sci. 2015;11(1):4.CrossRef
35.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef
36.
37.
38.
Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inform Libr J. 2009;26(2):91–108.CrossRef
39.
Carroll C, Booth A, Cooper K. A worked example of” best fit” framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents. BMC Med Res Methodol. 2011;11(1):29.PubMedPubMedCentralCrossRef
40.
41.
Report on Government Services; PART E, CHAPTER 12: public hospitals. Australia: Australian Government productivity commission; 2018.
42.
43.
Braithwaite J, Hibbert P, Blakely B, Plumb J, Hannaford N, Long JC, et al. Health system frameworks and performance indicators in eight countries: a comparative international analysis. SAGE Open Med. 2017;5:1–10.CrossRef
44.
Mesabbah M, Arisha A. Performance management of the public healthcare services in Ireland: a review. Int J Health Care Qual Assur. 2016;29(2):209–35.PubMedCrossRef
45.
Büchner VA, Hinz V, Schreyögg J. Health systems: changes in hospital efficiency and profitability. Health Care Manag Sci. 2016;19(2):130–43.PubMedCrossRef
46.
Ramos MCA, Cruz LP, Kishima VC, Pollara WM, Lira ACO, Couttolenc BF. Performance evaluation of hospitals that provide care in the public health system, Brazil. Revista de saude publica. 2015;49:43.PubMedPubMedCentralCrossRef
47.
Basu A, Howell R, Gopinath D. Clinical performance indicators: intolerance for variety? Int J Health Care Qual Assur. 2010;23(4):436–49.PubMedCrossRef
48.
Simou E, Pliatsika P, Koutsogeorgou E, Roumeliotou A. Developing a national framework of quality indicators for public hospitals. Int J Health Plan Manag. 2014;29(3):e187.CrossRef
49.
Nabilou B, Yusefzadeh H, Rezapour A, Azar FEF, Safi PS, Asiabar AS, et al. The productivity and its barriers in public hospitals: case study of ran. Med J Islam Repub Iran. 2016;30:316.PubMedPubMedCentral
50.
51.
Schneider JE, Ohsfeldt RL, Morrisey MA, Li P, Miller TR, Zelner BA. Effects of specialty hospitals on the financial performance of general hospitals, 1997–2004. Inquiry. 2007;44(3):321–34.PubMedCrossRef
52.
Øvretveit J. Quality evaluation and indicator comparison in health care. Int J Health Plan Manag. 2001;16(3):229–41.CrossRef
53.
Toprak DK, Sahin B. The impacts of ISO 9000 quality management on the performance of public hospitals. Amme Idaresi Dergisi. 2013;46(3):113–40.
54.
Anand S, Bärnighausen T. Human resources and health outcomes: cross-country econometric study. Lancet. 2004;364(9445):1603–9.PubMedCrossRef
55.
Lin Q-L, Liu L, Liu H-C, Wang D-J. Integrating hierarchical balanced scorecard with fuzzy linguistic for evaluating operating room performance in hospitals. Expert Syst Appl. 2013;40(6):1917–24.CrossRef
56.
Attaallah AF, Elzamzamy OM, Phelps AL, Ranganthan P, Vallejo MC. Increasing operating room efficiency through electronic medical record analysis. J Perioper Pract. 2016;26(5):106–13.PubMedCrossRef
57.
Rahimi SH, Masoumpour M, Kharazmi E, Kavousi Z. Designing the Quality of Emergency Ward Services in Shirazs Shahid Faghihi Hospital Based on Quality Function Deployment Method (QFD) in 2011–2012. J Hosp. 2013;12(3):9–17.
58.
Kang H, Nembhard H, DeFlitch C, Pasupathy K. Assessment of emergency department efficiency using data envelopment analysis. IISE Trans Healthc Syst Eng. 2017;7(4):236–46.CrossRef
59.
Horwitz LI, Green J, Bradley EH. US emergency department performance on wait time and length of visit. Ann Emerg Med. 2010;55(2):133–41.PubMedCrossRef
60.
Nerenz D, Neil N. Performance measures for health care systems. Commissioned paper for the center for health management research. 2001.
61.
Janati A, Valizadeh S, Jafarabadi MA. Development of financial indicators of hospital performance. J Clin Res Govern. 2014;3:92–8.
62.
63.
Ioan B, Nestian AS, Tita S-M. Relevance of key performance indicators (KPIs) in a hospital performance management model. J East Eur Res Business Econ. 2012;2012:1.
64.
Aghaei Hashjin A, Kringos DS, Manoochehri J, Aryankhesal A, Klazinga NS. Development and impact of the Iranian hospital performance measurement program. BMC Health Serv Res. 2014;14:448.PubMedPubMedCentralCrossRef
65.
Oliveira DF, Arieta CEL, Temporini ER, Kara-José N. Quality of health care: patient satisfaction in a university hospital. Arquivos brasileiros de oftalmologia. 2006;69(5):731–6.PubMedCrossRef
66.
Gabriel CS, da Melo MRA, Rocha FLR, Bernardes A, Miguelaci T, de Silva MD. Use of performance indicators in the nursing service of a public hospital. Revista latino-americana de enfermagem. 2011;19(5):1247–54.PubMedCrossRef
67.
Keyvanara M, Sajadi HS. Social responsibility of the hospitals in Isfahan city, Iran: results from a cross-sectional survey. Int J Health Pol Manag. 2015;4(8):517.CrossRef
68.
McLoughlin V, Millar J, Mattke S, Franca M, Jonsson PM, Somekh D, et al. Selecting indicators for patient safety at the health system level in OECD countries. Int J Qual Health Care. 2006;18(suppl_1):14–20.PubMedCrossRef
69.
Fugaca NP, Cubas MR, Carvalho DR. Use of balanced indicators as a management tool in nursing. Revista latino-americana de enfermagem. 2015;23(6):1049–56.PubMedPubMedCentralCrossRef
70.
Ozgulbas N, Koyuncugil AS. Financial profiling of public hospitals: an application by data mining. Int J Health Plan Manag. 2009;24(1):69–83.CrossRef
71.
Hefford M, Crampton P, Foley J. Reducing health disparities through primary care reform: the New Zealand experiment. Health Policy. 2005;72(1):9–23.PubMedCrossRef
72.
Andersen RM, Davidson PL, Baumeister SE. Improving access to care. Changing the US health care system: Key issues in health services policy and management. 2013. p. 33.
73.
Australian Institute of Health and Welfare. Australia’s health 2010. Canberra; 2010.
74.
Bahmei J, Rahimi H, Rahgoshay I, Kavosi Z. Quality evaluation of emergency department services of Nemazee Hospital from the Patients’ Viewpoint. Taṣvīr-i salāmat. 2016;7(1):18–26.
75.
Raju PS, Lonial SC. The impact of service quality and marketing on financial performance in the hospital industry: an empirical examination. J Retail Consum Serv. 2002;9(6):335–48.CrossRef
76.
Nekoei-Moghadam M, Amiresmaili M. Hospital services quality assessment: hospitals of Kerman University of Medical Sciences, as a tangible example of a developing country. Int J Health Care Qual Assur. 2011;24(1):57–66.PubMedCrossRef
77.
Calisir F, Bayraktaroglu AE, Gumussoy CA, Kaya B. Effects of service quality dimensions including usability on perceived overall quality, customer satisfaction, and return intention in different hospital types. Int J Adv Oper Manag. 2014;6(4):309–23.
78.
Melo AI, Santinha G, Lima R. Measuring the Quality of Health Services Using SERVQUAL: Evidence From Portugal. Handbook of Research on Modernization and Accountability in Public Sector Management. Hershey: IGI Global; 2018. p. 300–18.
79.
Xenos P, Yfantopoulos J, Nektarios M, Polyzos N, Tinios P, Constantopoulos A. Efficiency and productivity assessment of public hospitals in Greece during the crisis period 2009–2012. Cost Eff Resour Alloc. 2017;15:6.PubMedPubMedCentralCrossRef
80.
Nabilou B, Yusefzadeh H, Rezapour A, Azar FE, Safi PS, Asiabar AS, et al. The productivity and its barriers in public hospitals: case study of Iran. Med J Islam Rep Iran. 2016;30(1):36–43.
81.
82.
Culica D, Prezio E. Hospital board infrastructure and functions: the role of governance in financial performance. Int J Environ Res Public Health. 2009;6(3):862–73.PubMedPubMedCentralCrossRef
83.
Alexander JA, Weiner BJ, Griffith J. Quality improvement and hospital financial performance. J Org Behav. 2006;27(7):1003–29.CrossRef
84.
Metadata
Title
A comprehensive map of the evidence on the performance evaluation indicators of public hospitals: a scoping study and best fit framework synthesis
Authors
Kimia Pourmohammadi
Nahid Hatam
Payam Shojaei
Peivand Bastani
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Cost Effectiveness and Resource Allocation / Issue 1/2018
Electronic ISSN: 1478-7547
DOI
https://doi.org/10.1186/s12962-018-0166-z

Other articles of this Issue 1/2018

Cost Effectiveness and Resource Allocation 1/2018 Go to the issue

Research

Cost-effectiveness of tiotropium versus omalizumab for uncontrolled allergic asthma in US

Review

Personalized medicine in colorectal cancer diagnosis and treatment: a systematic review of health economic evaluations

Research

Costs and cost-efficiency of a mobile cash transfer to prevent child undernutrition during the lean season in Burkina Faso: a mixed methods analysis from the MAM’Out randomized controlled trial

Research

Cost-effectiveness of colorectal cancer screening in Ukraine

Methodology

National cost study versus hospital cost accounting for organ recovery cost assessment in a French hospital group

Review

Cost effectiveness of HIV and sexual reproductive health interventions targeting sex workers: a systematic review