Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Are performance indicators used for hospital quality management: a qualitative interview study amongst health professionals and quality managers in The Netherlands

Authors: Daan Botje, Guus ten Asbroek, Thomas Plochg, Helen Anema, Dionne S. Kringos, Claudia Fischer, Cordula Wagner, Niek S. Klazinga

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Hospitals are under increasing pressure to share indicator-based performance information. These indicators can also serve as a means to promote quality improvement and boost hospital performance. Our aim was to explore hospitals’ use of performance indicators for internal quality management activities.

Methods

We conducted a qualitative interview study among 72 health professionals and quality managers in 14 acute care hospitals in The Netherlands. Concentrating on orthopaedic and oncology departments, our goal was to gain insight into data collection and use of performance indicators for two conditions: knee and hip replacement surgery and breast cancer surgery. The semi-structured interviews were recorded and summarised. Based on the data, themes were synthesised and the analyses were executed systematically by two analysts independently. The findings were validated through comparison.

Results

The hospitals we investigated collect data for performance indicators in different ways. Similarly, these hospitals have different ways of using such data to support their quality management, while some do not seem to use the data for this purpose at all. Factors like ‘linking pin champions’, pro-active quality managers and engaged medical specialists seem to make a difference. In addition, a comprehensive hospital data infrastructure with electronic patient records and robust data collection software appears to be a prerequisite to produce reliable external performance indicators for internal quality improvement.

Conclusions

Hospitals often fail to use performance indicators as a means to support internal quality management. Such data, then, are not used to its full potential. Hospitals are recommended to focus their human resource policy on ‘linking pin champions’, the engagement of professionals and a pro-active quality manager, and to invest in a comprehensive data infrastructure. Furthermore, the differences in data collection processes between Dutch hospitals make it difficult to draw comparisons between outcomes of performance indicators.
Appendix
Available only for authorised users
Literature
2.
go back to reference Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. JAMA. 2000;283(4):1866–74.CrossRefPubMed Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. JAMA. 2000;283(4):1866–74.CrossRefPubMed
3.
go back to reference Fung CH, Lim YW, Mattke S, Damberg C, Chekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148(2):111–23.CrossRefPubMed Fung CH, Lim YW, Mattke S, Damberg C, Chekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148(2):111–23.CrossRefPubMed
4.
go back to reference Anema HA, Kievit J, Fischer C, Steyerberg EW, Klazinga NS. Influences of hospital information systems, indicator data collection and computation on reported Dutch hospital performance indicator scores. BMC Health Serv Res. 2013;13:212.CrossRefPubMedPubMedCentral Anema HA, Kievit J, Fischer C, Steyerberg EW, Klazinga NS. Influences of hospital information systems, indicator data collection and computation on reported Dutch hospital performance indicator scores. BMC Health Serv Res. 2013;13:212.CrossRefPubMedPubMedCentral
5.
go back to reference Contadriopoulos D, Champagne F, Denis J-L. The multiple causal pathways between performance measures’ use and effects. Med Care Res Rev. 2014;71(1):3–20.CrossRef Contadriopoulos D, Champagne F, Denis J-L. The multiple causal pathways between performance measures’ use and effects. Med Care Res Rev. 2014;71(1):3–20.CrossRef
6.
go back to reference Lindenauer PK, Remus D, Roman S, Rothberg MB, Benjamin EM, Ma A, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med. 2007;356(5):486–96.CrossRefPubMed Lindenauer PK, Remus D, Roman S, Rothberg MB, Benjamin EM, Ma A, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med. 2007;356(5):486–96.CrossRefPubMed
8.
go back to reference Botje D, Klazinga NS, Suñol R, Groene O, Pfaff H, Mannion R, et al. Is having quality as an item on the executive board agenda associated with the implementation of quality management systems in European hospitals: a quantitative analysis. Int J Qual Health Care. 2014;26 Suppl 1:i92–9.CrossRef Botje D, Klazinga NS, Suñol R, Groene O, Pfaff H, Mannion R, et al. Is having quality as an item on the executive board agenda associated with the implementation of quality management systems in European hospitals: a quantitative analysis. Int J Qual Health Care. 2014;26 Suppl 1:i92–9.CrossRef
9.
go back to reference Fischer C, Anema HA, Klazinga NS. The validity of indicators for assessing quality of care: a review of the European literature on hospital readmission rate. Eur J Public Health. 2011;22(4):484–91.CrossRefPubMed Fischer C, Anema HA, Klazinga NS. The validity of indicators for assessing quality of care: a review of the European literature on hospital readmission rate. Eur J Public Health. 2011;22(4):484–91.CrossRefPubMed
10.
go back to reference Anema HA, van der Veer SN, Kievit J, Krol-Warmerdam E, Fischer C, Steyerberg E, et al. Influences of definition ambiguity on hospital performance indicator scores: examples from the Netherlands. Eur J Public Health. 2014;24(1):73–8.CrossRefPubMed Anema HA, van der Veer SN, Kievit J, Krol-Warmerdam E, Fischer C, Steyerberg E, et al. Influences of definition ambiguity on hospital performance indicator scores: examples from the Netherlands. Eur J Public Health. 2014;24(1):73–8.CrossRefPubMed
11.
go back to reference De Vos M, Graafmans W, Kooistra M, Meijboom B, van der Voort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009;21(2):119–29.CrossRefPubMed De Vos M, Graafmans W, Kooistra M, Meijboom B, van der Voort P, Westert G. Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009;21(2):119–29.CrossRefPubMed
12.
go back to reference Kringos DS, Anema HA, ten Asbroek AHA, Fischer C, Botje D, Kievit J, et al. [An evaluation of the reliability, validity and applicability of performance indicators for the quality of hospital care in the Netherlands] [report in Dutch]. AMC/UvA, Amsterdam. 2012. ISBN: 978 90 9027307 5. Kringos DS, Anema HA, ten Asbroek AHA, Fischer C, Botje D, Kievit J, et al. [An evaluation of the reliability, validity and applicability of performance indicators for the quality of hospital care in the Netherlands] [report in Dutch]. AMC/UvA, Amsterdam. 2012. ISBN: 978 90 9027307 5.
13.
go back to reference Halcomb EJ, Davidson PM. Is verbatim transcription of interview data always necessary? Appl Nurs Res. 2006;19:38–42.CrossRefPubMed Halcomb EJ, Davidson PM. Is verbatim transcription of interview data always necessary? Appl Nurs Res. 2006;19:38–42.CrossRefPubMed
14.
go back to reference Van Dishoeck AM, Lingsma HF, Mackenbach JP, Steyerberg EW. Random variation and rankability of hospitals using outcome indicators. BMJ Qual Saf. 2011;20:869–74.CrossRefPubMed Van Dishoeck AM, Lingsma HF, Mackenbach JP, Steyerberg EW. Random variation and rankability of hospitals using outcome indicators. BMJ Qual Saf. 2011;20:869–74.CrossRefPubMed
15.
go back to reference Gooiker GA, Veerbeek L, van der Geest LG, Stijnen T, Dekker JW, Nortier JW, et al. [The quality indicator “tumour positive surgical margin following breast-conserving surgery” does not provide transparent insight in care] [article in Dutch]. Ned Tijdschr Geneeskd. 2010;154:A1142.PubMed Gooiker GA, Veerbeek L, van der Geest LG, Stijnen T, Dekker JW, Nortier JW, et al. [The quality indicator “tumour positive surgical margin following breast-conserving surgery” does not provide transparent insight in care] [article in Dutch]. Ned Tijdschr Geneeskd. 2010;154:A1142.PubMed
16.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326:816–9.CrossRefPubMedPubMedCentral Campbell SM, Braspenning J, Hutchinson A, Marshall MN. Research methods used in developing and applying quality indicators in primary care. BMJ. 2003;326:816–9.CrossRefPubMedPubMedCentral
17.
go back to reference Lilford R, Mohammed MA, Spiegelhalter D, Thomson R. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004;363:1147–54.CrossRefPubMed Lilford R, Mohammed MA, Spiegelhalter D, Thomson R. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004;363:1147–54.CrossRefPubMed
18.
go back to reference Zegers M, de Bruijne MC, Spreeuwenberg P, Wagner C, Groenewegen PP, van der Wal G. Quality of patient record keeping: an indicator of the quality of care? BMJ Qual Saf. 2011;20(4):314–8.CrossRefPubMed Zegers M, de Bruijne MC, Spreeuwenberg P, Wagner C, Groenewegen PP, van der Wal G. Quality of patient record keeping: an indicator of the quality of care? BMJ Qual Saf. 2011;20(4):314–8.CrossRefPubMed
19.
go back to reference Evans SM, Lowinger JS, Privulis PC, Copnell B, Cameron PA. Prioritizing quality indicator development across the healthcare system: identifying what to measure. Intern Med J. 2009;39:648–54.CrossRefPubMed Evans SM, Lowinger JS, Privulis PC, Copnell B, Cameron PA. Prioritizing quality indicator development across the healthcare system: identifying what to measure. Intern Med J. 2009;39:648–54.CrossRefPubMed
20.
go back to reference Berwick DM. Disseminating innovations in health care. JAMA. 2013;289(15):1969–75.CrossRef Berwick DM. Disseminating innovations in health care. JAMA. 2013;289(15):1969–75.CrossRef
22.
go back to reference Conway PH, Mostashari F, Clancy C. The future of quality measurement for improvement and accountability. JAMA. 2013;309(21):2215.CrossRefPubMed Conway PH, Mostashari F, Clancy C. The future of quality measurement for improvement and accountability. JAMA. 2013;309(21):2215.CrossRefPubMed
23.
go back to reference Mainz J, Hansen AM, Palshof T, Bartels PD. National quality measurement using clinical indicators: the Danish National Indicator Project. J Surg Oncol. 2009;99(8):500–4.CrossRefPubMed Mainz J, Hansen AM, Palshof T, Bartels PD. National quality measurement using clinical indicators: the Danish National Indicator Project. J Surg Oncol. 2009;99(8):500–4.CrossRefPubMed
Metadata
Title
Are performance indicators used for hospital quality management: a qualitative interview study amongst health professionals and quality managers in The Netherlands
Authors
Daan Botje
Guus ten Asbroek
Thomas Plochg
Helen Anema
Dionne S. Kringos
Claudia Fischer
Cordula Wagner
Niek S. Klazinga
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1826-3

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue