Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Are performance measurement systems useful? Perceptions from health care

Authors: Chiara Demartini, Sara Trucco

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Prior literature identified the use of Performance Measurement Systems (PMS) as crucial in addressing improved processes of care. Moreover, a strategic use of PMS has been found to enhance quality, compared to non-strategic use, although a clear understanding of this linkage is still to be achieved. This paper deals with the test of direct and indirect models related to the link between the strategic use of PMS and the level of improved processes in health care organizations. Indirect models were mediated by the degree of perceived managerial discretion.

Methods

A PLS analysis on a survey of 97 Italian managers working for health care organizations in the Lombardy region was conducted. The response rate was 77.6%.

Results

The strategic use of PMS in health care organizations directly and significantly (p < 0.001) enhances performance in terms of improved processes. Perceived managerial discretion is positively and significantly (p < 0.001) affected by the strategic use of PMS, whereas the mediation effect is non-significant.

Conclusions

This study contributes to the literature investigating the design and implementation of a non-financial measurement tool, such as the non-financial information included into a balanced scorecard (BSC), in health care organizations. Managers in health care organizations can benefit from the strategic use of PMS to effectively allocate their time to strategic opportunities and threats, which might arise and affect organizational, output-related performance, such as improving processes.
Appendix
Available only for authorised users
Literature
1.
Amaratunga D, Haigh R, Sarshar M, Baldry D. Application of the balanced score‐card concept to develop a conceptual framework to measure facilities management performance within NHS facilities. Int J Health Care Qual Assur. 2002;15(4):141–51.CrossRef
2.
Adcroft A, Willis R. The (un)intended outcome of public sector performance measurement. Int J Public Sect Manag. 2005;18(5):386–400.CrossRef
3.
Valderas JM, Fitzpatrick R, Roland M. Using health status to measure NHS performance: another step into the dark for the health reform in England. BMJ Qual Saf. 2012;21(4):352–3.CrossRefPubMed
4.
Elg M, Palmberg Broryd K, Kollberg B. Performance measurement to drive improvements in healthcare practice. Int J Oper Prod Manag. 2013;33(11/12):1623–51.CrossRef
5.
Neely A, Mills J, Platts K, Huw R, Gregory M, Bourne M, et al. Performance measurement system design: developing and testing a process‐based approach. Int J Oper Prod Manag. 2000;20(10):1119–45.CrossRef
6.
Ferrè F, Cuccurullo C, Lega F. The challenge and the future of health care turnaround plans: evidence from the Italian experience. Health Policy Amst Neth. 2012;106(1):3–9.CrossRef
7.
Trebble TM, Paul M, Hockey PM, Heyworth N, Humphrey R, Powell T, et al. Clinically led performance management in secondary healthcare: evaluating the attitudes of medical and non-clinical managers. BMJ Qual Saf. 2015;24(3):212–20.CrossRefPubMed
8.
Grigoroudis E, Orfanoudaki E, Zopounidis C. Strategic performance measurement in a healthcare organisation: A multiple criteria approach based on balanced scorecard. Omega. 2012;40(1):104–19.CrossRef
9.
Naranjo-Gil D. Strategic performance in hospitals: The use of the balanced scorecard by nurse managers. Health Care Manage Rev. 2009;34(2):161–70.CrossRefPubMed
10.
Schultz C, Zippel-Schultz B, Salomo S. Hospital innovation portfolios: Key determinants of size and innovativeness. Health Care Manage Rev. 2012;37(2):132–43.CrossRefPubMed
11.
Varabyova Y, Blankart CR, Torbica A, Schreyögg J. Comparing the Efficiency of Hospitals in Italy and Germany: Nonparametric Conditional Approach Based on Partial Frontier. Health Care Manag Sci. 2016;3:1–16.
12.
Berta P, Seghieri C, Vittadini G. Comparing health outcomes among hospitals: the experience of the Lombardy Region. Health Care Manag Sci. 2013;16(3):245–57.CrossRefPubMed
13.
14.
Zulu JM, Hurtig A-K, Kinsman J, Michelo C. Innovation in health service delivery: integrating community health assistants into the health system at district level in Zambia. BMC Health Serv Res. 2015;15:38.CrossRefPubMedPubMedCentral
15.
Abernethy MA, Stoelwinder JU. The role of professional control in the management of complex organizations. Account Organ Soc. 1995;20(1):1–17.CrossRef
16.
Mahlendorf MD, Kleinschmit F, Perego P. Relational effects of relative performance information: The role of professional identity. Account Organ Soc. 2014;39(5):331–47.CrossRef
17.
Simons R. How new top managers use control systems as levers of strategic renewal. Strateg Manag J. 1994;15(3):169–89.CrossRef
18.
Mutiganda JC. Budgetary governance and accountability in public sector organisations: An institutional and critical realism approach. Crit Perspect Account. 2013;24(7–8):518–31.CrossRef
19.
Hambrick DC, Abrahamson E. Assessing Managerial Discretion across Industries: A Multimethod Approach. Acad Manage J. 1995;38(5):1427–41.CrossRef
20.
Hambrick DC, Finkelstein S. Managerial discretion: A bridge between polar views of organizational outcomes. Res Organ Behav. 1987;9:369–406.
21.
Simons R. Strategic orientation and top management attention to control systems. Strateg Manag J. 1991;12(1):49–62.CrossRef
22.
Wangrow DB, Schepker DJ, Barker VL. Managerial Discretion An Empirical Review and Focus on Future Research Directions. J Manag. 2014;14:0149206314554214.
23.
24.
25.
Fattore G, Torbica A. Inpatient reimbursement system in Italy: How do tariffs relate to costs? Health Care Manag Sci. 2006;9(3):251–8.CrossRefPubMed
26.
Garavaglia G, Lettieri E, Agasisti T, Lopez S. Efficiency and quality of care in nursing homes: an Italian case study. Health Care Manag Sci. 2010;14(1):22–35.CrossRefPubMed
27.
Brenna E, Spandonaro F. Regional incentives and patient cross-border mobility: evidence from the Italian experience. Int J Health Policy Manag. 2015;4(6):363–72.CrossRefPubMedPubMedCentral
28.
Lo Scalzo A, Donatini A, Orzella L, Cicchetti A, Profili S, Maresso A. Italy: Health system review. In: Health systems in transition. Copenhagen: WHO regional office for Europe on behalf of the European observatory on health systems and policies; 2009.
29.
Nuti S, Seghieri C, Vainieri M. Assessing the effectiveness of a performance evaluation system in the public health care sector: some novel evidence from the Tuscany region experience. J Manag Gov. 2012;17(1):59–69.CrossRef
30.
Fusco D, Davoli M, Pinnarelli L, Colais P, D’Ovidio M, Basiglini A, et al. Il Programma Nazionale di valutazione Esiti (PNE). Breve guida alla consultazione. Monitor. 2012;XI:22.42.
31.
Cavalieri M, Gitto L, Guccio C. Reimbursement systems and quality of hospital care: an empirical analysis for Italy. Health Policy Amst Neth. 2013;111(3):273–89.CrossRef
32.
Macinati MS. The relationship between quality management systems and organizational performance in the Italian National Health Service. Health Policy Amst Neth. 2008;85(2):228–41.CrossRef
33.
Conforti D, Guerriero F, Guido R, Cerinic MM, Conforti ML. An optimal decision making model for supporting week hospital management. Health Care Manag Sci. 2010;14(1):74–88.CrossRefPubMed
34.
Ozcan YA, Tànfani E, Testi A. Improving the performance of surgery-based clinical pathways: a simulation-optimization approach. Health Care Manag Sci. 2016;7:1–15.
35.
Bisbe J, Batista-Foguet J-M, Chenhall R. Defining management accounting constructs: A methodological note on the risks of conceptual misspecification. Account Organ Soc. 2007;32(7–8):789–820.CrossRef
36.
Demartini C, Mella P. Beyond feedback control: the interactive use of performance management systems. Implications for process innovation in Italian healthcare organizations. Int J Health Plann Manage. 2014;8:e1–e30.
37.
38.
Cattinelli I, Bolzoni E, Barbieri C, Mari F, Martin-Guerrero JD, Soria-Olivas E, et al. Use of Self-Organizing Maps for Balanced Scorecard analysis to monitor the performance of dialysis clinic chains. Health Care Manag Sci. 2011;15(1):79–90.CrossRefPubMed
39.
Naranjo-Gil D, Hartmann F. How CEOs use management information systems for strategy implementation in hospitals. Health Policy. 2007;81(1):29–41.CrossRefPubMed
40.
Kacak H, Ozcan YA, Kavuncubasi S. A new examination of hospital performance after healthcare reform in Turkey: sensitivity and quality comparisons. Int J Public Policy. 2014;10(4):178–94.CrossRef
41.
Ketchen DJ, Palmer TB, Gamm LD. The role of performance referents in health services organizations. Health Care Manage Rev. 2001;26(4):19–26.CrossRefPubMed
42.
Georgescu I, Hartmann FGH. Sources of financial pressure and up coding behavior in French public hospitals. Health Policy. 2013;110(2–3):156–63.CrossRefPubMed
43.
Gregory S. William Pickles Lecture 2014: Cum Scientia Caritas — compassion with knowledge. Br J Gen Pract. 2015;65(630):36–7.CrossRefPubMed
44.
Carpenter MA, Golden BR. Perceived Managerial Discretion: A Study of Cause and Effect. Strateg Manag J. 1997;18(3):187–206.CrossRef
45.
Phillips RA, Berman SL, Elms H, Johnson-Cramer ME. Strategy, stakeholders and managerial discretion. Strateg Organ. 2010;8(2):176–83.CrossRef
46.
Hope O-K, Thomas WB, Vyas D. Financial Reporting Quality of U.S. Private and Public Firms. Account Rev. 2013;88(5):1715–42.CrossRef
47.
Kaplan RS, Norton DP. Transforming the Balanced Scorecard from Performance Measurement to Strategic Management: Part I. Account Horiz. 2001;15(1):87–104.CrossRef
48.
Zelman WN, Pink GH, Matthias CB. Use of the balanced scorecard in health care. J Health Care Finance. 2003;29(4):1–16.PubMed
49.
Naranjo-Gil D, Hartmann F. Management accounting systems, top management team heterogeneity and strategic change. Account Organ Soc. 2007;32(7–8):735–56.CrossRef
50.
Artz M, Homburg C, Rajab T. Performance-measurement system design and functional strategic decision influence: The role of performance-measure properties. Account Organ Soc. 2012;37(7):445–60.CrossRef
51.
Spence Laschinger HK, Shamian J. Staff Nurses’ and Nurse Managers’ Perceptions of Job-Related EMpowerment and Self-Efficacy. J Nurs Adm. 1994;24:10.CrossRef
52.
Hoff T. Deskilling and adaptation among primary care physicians using two work innovations. Health Care Manage Rev. 2011;36(4):338–48.CrossRefPubMed
53.
54.
55.
Dawes M, Sampson U. Knowledge management in clinical practice: a systematic review of information seeking behavior in physicians. Int J Med Inf. 2003;71(1):9–15.CrossRef
56.
Messiah A, Lacoste J, Gokalsing E, Shultz JM, Rodríguez de la Vega P, Castro G, et al. Mental Health Impact of Hosting Disaster Refugees: Analyses from a Random Sample Survey Among Haitians Living in Miami. South Med J. 2016;109(8):458–64.CrossRefPubMed
57.
58.
Armstrong JS, Overton TS. Estimating nonresponse bias in mail surveys. J Mark Res. 1977;396–402.
59.
Sapsford R. Survey Research. London: Sage; 2006. p. 292.
60.
Bartlett J, Kotrlik J, Higgins C. Organizational Research: Determining Appropriate Sample Size in Survey Research. Inf Technol Learn Perform J. 2001;19:1.
61.
Barclay DW, Higgins C, Thompson R. The partial least squares (PLS) approach to causal modeling: Personal computer adaptation and use as an illustration. Technol Stud. 1995;2(2):285–309.
62.
Dillman DA. Mail and Internet Surveys: The Tailored Design Method -- 2007 Update with New Internet, Visual, and Mixed-Mode Guide. New York: Wiley; 2006. p. 543.
63.
Riedler J, Braun-Fahrländer C, Eder W, Schreuer M, Waser M, Maisch S, et al. Exposure to farming in early life and development of asthma and allergy: a cross-sectional survey. Lancet Lond Engl. 2001;358(9288):1129–33.CrossRef
64.
Meredith C, Symonds P, Webster L, Lamont D, Pyper E, Gillis CR, et al. Information needs of cancer patients in west Scotland: cross sectional survey of patients’ views. BMJ. 1996;313(7059):724–6.CrossRefPubMedPubMedCentral
65.
Ellaway A, Macintyre S, Bonnefoy X. Graffiti, greenery, and obesity in adults: secondary analysis of European cross sectional survey. BMJ. 2005;331(7517):611–2.CrossRefPubMedPubMedCentral
66.
Abrahams SC, Keve ET. Normal probability plot analysis of error in measured and derived quantities and standard deviations. Acta Crystallogr A. 1971;27(2):157–65.CrossRef
67.
Lin I-F, Schaeffer NC. Using Survey Participants to Estimate the Impact of Nonparticipation. Public Opin Q. 1995;59(2):236.CrossRef
68.
Voigt LF, Koepsell TD, Daling JR. Characteristics of telephone survey respondents according to willingness to participate. Am J Epidemiol. 2003;157(1):66–73.CrossRefPubMed
69.
Kogut B, Kulatilaka N. Operating Flexibility, Global Manufacturing, and the Option Value of a Multinational Network. Manag Sci. 1994;40(1):123–39.CrossRef
70.
Govindarajan V. Appropriateness of accounting data in performance evaluation: An empirical examination of environmental uncertainty as an intervening variable. Account Organ Soc. 1984;9(2):125–35.CrossRef
71.
Ringle CM, Sarstedt M, Straub DW. Editor’s Comments: A Critical Look at the Use of PLS-SEM in MIS Quarterly. MIS Q. 2012;36(1):iii–xiv.
72.
73.
Hulland J. Use of partial least squares (PLS) in strategic management research: a review of four recent studies. Strateg Manag J. 1999;20(2):195–204.CrossRef
74.
Macinati MS, Anessi-Pessina E. Management accounting use and financial performance in public health-care organisations: Evidence from the Italian National Health Service. Health Policy. 2014;117(1):98–111.CrossRefPubMed
75.
Chin WW. The Partial Least Squares Approach to Structural Equation Modeling. In: Marcoulides GA, editor. Modern Methods for Business Research. Mahwah: Lawrence Erlbaum; 1998. p. 295–358.
76.
Podsakoff PM. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol. 2003;88(5):879–903.CrossRefPubMed
77.
Bisbe J, Otley D. The effects of the interactive use of management control systems on product innovation. Account Organ Soc. 2004;29(8):709–37.CrossRef
78.
Raisch S, Birkinshaw J, Probst G, Tushman ML. Organizational Ambidexterity: Balancing Exploitation and Exploration for Sustained Performance. Organ Sci. 2009;20(4):685–95.CrossRef
79.
Cho TS, Hambrick DC. Attention as the Mediator Between Top Management Team Characteristics and Strategic Change: The Case of Airline Deregulation. Organ Sci. 2006;17(4):453–69.CrossRef
80.
Langabeer JR, Yao E. The impact of chief executive officer optimism on hospital strategic decision making. Health Care Manage Rev. 2012;37(4):310–9.CrossRefPubMed
81.
Neriz L, Silva D, Ramis F, Nunez A. Tools to manage the decision-making process in operating rooms. BMC Health Serv Res. 2014;14(2):86.CrossRef
82.
Weisbrod BA. The Health Care Quadrilemma: An Essay on Technological Change, Insurance, Quality of Care, and Cost Containment. J Econ Lit. 1991;29(2):523–52.
83.
Mauro M, Cardamone E, Cavallaro G, Minvielle E, Rania F, Sicotte C, et al. Teaching hospital performance: Towards a community of shared values? Soc Sci Med. 2014;101:107–12.CrossRefPubMed
84.
Epstein L. Data-based decision-making at all managerial levels in health care: an integral part of evidence-based practice. BMC Health Serv Res. 2014;14(2):40.CrossRef
85.
Speiser SM, Malawer SS. American Tragedy: Damages for Mental Anguish of Bereaved Relatives in Wrongful Death Actions. Tulane Law Rev. 1976 1977;51:1.
86.
Rogelberg SG, Stanton JM. Introduction: Understanding and dealing with organizational survey nonresponse. Organ Res Methods. 2007;10(2):195–209.CrossRef
87.
88.
Syam SS, Côté MJ. A location–allocation model for service providers with application to not-for-profit health care organizations. Omega. 2010;38(3–4):157–66.CrossRef
89.
Chenhall RH. Management control systems design within its organizational context: findings from contingency-based research and directions for the future. Account Organ Soc. 2003;28(2–3):127–68.CrossRef
90.
91.
Siegel S. Nonparametric statistics for the behavioral sciences, vol. xvii. New York: McGraw-Hill; 1956. p. 312.
Metadata
Title
Are performance measurement systems useful? Perceptions from health care
Authors
Chiara Demartini
Sara Trucco
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2022-9

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue

Research article

Care-managers’ professional choices: ethical dilemmas and conflicting expectations

Research article

Cultural adaptation of a pediatric functional assessment for rehabilitation outcomes research

Study protocol

Effect of patient-initiated versus fixed-interval telePRO-based outpatient follow-up: study protocol for a pragmatic randomised controlled study

Research article

Factors associated with preferences for long-term care settings in old age: evidence from a population-based survey in Germany

Research article

Professional groups driving change toward patient-centred care: interprofessional working in stroke rehabilitation in Denmark

Research article

Stakeholder perspectives on the implementation of genetic carrier screening in a changing landscape