Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

The association between quality system development stage and the implementation of process-level patient safety themes in Dutch hospitals: an observational study

Authors: Steffie M. van Schoten, Janneke Hoogervorst-Schilp, Peter P. Groenewegen, Peter Spreeuwenberg, Cordula Wagner

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Quality systems are believed to be positively related to quality and safety in healthcare. However, there is no convincing evidence for this relationship in the literature. This study aims to examine the association between the development stage of hospital quality systems and the implementation of patient safety themes at the process level.

Methods

This study combines data from a national survey on the development stage of quality systems in Dutch hospitals with results from an evaluation study of the Dutch Hospital Patient Safety Program. Data on the development stage of quality systems were collected in Dutch hospitals in 2011. A total of 73 quality coordinators completed a questionnaire (response rate 77%) covering five quality system domains: policy and strategy, human resource management, patient involvement, practice guidelines, and systematic quality improvement. Data were included on the implementation of five patient safety themes from the Dutch Hospital Safety Program. Process indicators for each theme were measured every four to six weeks, resulting in ten measurements in each hospital. Data were analyzed using multilevel analysis.

Results

The mean score for hospital quality system development was 2.30 (range 1 to 3). The mean scores for the various quality system domains ranged from 1.56 (Patient Involvement) to 2.66 (Human Resources Management). The mean percentages for the implementation of the patient safety themes ranged from 12% for the ‘Pain’ process indicator to 73% for execution of the ‘Time-Out Procedure’. The intraclass correlation coefficients of the intercept-only model ranged between 11.6 and 51.6, which indicates large differences between hospitals in the implementation of the patient safety themes. Positive associations between quality system development stage and implementation of patient safety themes were found for four of the five patient safety themes, although they were not statistically significant.

Conclusions

This study found no association between the development stage of a hospital quality system and the implementation of patient level safety themes at the process level. This rejects the hypothesis that quality improvement is caused by a positive relationship between structure (the quality system) and processes (the safety program implementation), which in their turn mold the quality of care at the patient level.
Literature
2.
3.
go back to reference Donabedian A. Evaluating the quality of medical care (reprinted from the Milbank Memorial Fund quarterly, vol 44, pg 166-203, 1966). Milbank Q. 2005;83(4):691–729.CrossRefPubMedPubMedCentral Donabedian A. Evaluating the quality of medical care (reprinted from the Milbank Memorial Fund quarterly, vol 44, pg 166-203, 1966). Milbank Q. 2005;83(4):691–729.CrossRefPubMedPubMedCentral
4.
go back to reference Wagner C, De Bakker DH, Groenewegen PP. A measuring instrument for evaluation of quality systems. Int J Qual Health Care. 1999;11(2):119–30.CrossRefPubMed Wagner C, De Bakker DH, Groenewegen PP. A measuring instrument for evaluation of quality systems. Int J Qual Health Care. 1999;11(2):119–30.CrossRefPubMed
5.
go back to reference Dückers M, Makai P, Vos L, Groenewegen P, Wagner C. Longitudinal analysis on the development of hospital quality management systems in the Netherlands. Int J Qual Health Care. 2009;21(5):330–40.CrossRefPubMed Dückers M, Makai P, Vos L, Groenewegen P, Wagner C. Longitudinal analysis on the development of hospital quality management systems in the Netherlands. Int J Qual Health Care. 2009;21(5):330–40.CrossRefPubMed
6.
go back to reference Sluijs EM, Wagner C. Progress in the implementation of quality Management in Dutch health care: 1995–2000. Int J Qual Health Care. 2003;15(3):223–34.CrossRefPubMed Sluijs EM, Wagner C. Progress in the implementation of quality Management in Dutch health care: 1995–2000. Int J Qual Health Care. 2003;15(3):223–34.CrossRefPubMed
7.
go back to reference van Schoten SM, Groenewegen PP, Wagner C. De ontwikkeling van kwaliteitssystemen in Nederlandse ziekenhuizen tussen 1995 en 2011. Tijdschrift voor gezondheidswetenschappen. 2013;91(8):489–96.CrossRef van Schoten SM, Groenewegen PP, Wagner C. De ontwikkeling van kwaliteitssystemen in Nederlandse ziekenhuizen tussen 1995 en 2011. Tijdschrift voor gezondheidswetenschappen. 2013;91(8):489–96.CrossRef
8.
go back to reference Wagner C, Gulácsi L, Takacs E, Outinen M. The implementation of quality management systems in hospitals: a comparison between three countries. BMC Health Serv Res. 2006;6(1):50.CrossRefPubMedPubMedCentral Wagner C, Gulácsi L, Takacs E, Outinen M. The implementation of quality management systems in hospitals: a comparison between three countries. BMC Health Serv Res. 2006;6(1):50.CrossRefPubMedPubMedCentral
9.
go back to reference Groene O, Mora N, Thompson A, Saez M, Casas M, Suñol R. Is the maturity of hospitals' quality improvement systems associated with measures of quality and patient safety? BMC Health Serv Res. 2011;11(1):344.CrossRefPubMedPubMedCentral Groene O, Mora N, Thompson A, Saez M, Casas M, Suñol R. Is the maturity of hospitals' quality improvement systems associated with measures of quality and patient safety? BMC Health Serv Res. 2011;11(1):344.CrossRefPubMedPubMedCentral
10.
go back to reference Lombarts M, Rupp I, Vallejo P, Klazinga NS, Suñol R. Differentiating between hospitals according to the “maturity” of quality improvement systems: a new classification scheme in a sample of European hospitals. Qual Saf Health Care. 2009;18(Suppl 1):i38–43.CrossRefPubMedPubMedCentral Lombarts M, Rupp I, Vallejo P, Klazinga NS, Suñol R. Differentiating between hospitals according to the “maturity” of quality improvement systems: a new classification scheme in a sample of European hospitals. Qual Saf Health Care. 2009;18(Suppl 1):i38–43.CrossRefPubMedPubMedCentral
11.
go back to reference Shaw CD, Groene O, Botje D, Sunol R, Kutryba B, Klazinga N, Bruneau C, Hammer A, Wang A, Arah OA. The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals. Int J Qual Health Care. 2014; (supplement 1):100–7. Shaw CD, Groene O, Botje D, Sunol R, Kutryba B, Klazinga N, Bruneau C, Hammer A, Wang A, Arah OA. The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals. Int J Qual Health Care. 2014; (supplement 1):100–7.
12.
go back to reference Shaw C, Groene O, Mora N, Sunol R. Accreditation and ISO certification: do they explain differences in quality management in European hospitals? Int J Qual Health Care. 2010;6:445–51. Shaw C, Groene O, Mora N, Sunol R. Accreditation and ISO certification: do they explain differences in quality management in European hospitals? Int J Qual Health Care. 2010;6:445–51.
13.
go back to reference Weiner BJ, Alexander JA, Baker LC, Shortell SM, Becker M. Quality improvement implementation and hospital performance on patient safety indicators. Med Care Res Rev. 2006;63(1):29–57.CrossRefPubMed Weiner BJ, Alexander JA, Baker LC, Shortell SM, Becker M. Quality improvement implementation and hospital performance on patient safety indicators. Med Care Res Rev. 2006;63(1):29–57.CrossRefPubMed
14.
go back to reference Weiner BJ, Alexander JA, Shortell SM, Baker LC, Becker M, Geppert JJ. Quality improvement implementation and hospital performance on quality indicators. Health Serv Res. 2006;41(2):307–34.CrossRefPubMedPubMedCentral Weiner BJ, Alexander JA, Shortell SM, Baker LC, Becker M, Geppert JJ. Quality improvement implementation and hospital performance on quality indicators. Health Serv Res. 2006;41(2):307–34.CrossRefPubMedPubMedCentral
15.
go back to reference Kunkel S, Rosenqvist U, Westerling R. Implementation strategies influence the structure, process and outcome of quality systems: an empirical study of hospital departments in Sweden. Qual Saf Health Care. 2009;18(1):49–54.CrossRefPubMed Kunkel S, Rosenqvist U, Westerling R. Implementation strategies influence the structure, process and outcome of quality systems: an empirical study of hospital departments in Sweden. Qual Saf Health Care. 2009;18(1):49–54.CrossRefPubMed
16.
go back to reference Kunkel S, Rosenqvist U, Westerling R. The structure of quality systems is important to the process and outcome, an empirical study of 386 hospital departments in Sweden. BMC Health Serv Res. 2007;7(1):104.CrossRefPubMedPubMedCentral Kunkel S, Rosenqvist U, Westerling R. The structure of quality systems is important to the process and outcome, an empirical study of 386 hospital departments in Sweden. BMC Health Serv Res. 2007;7(1):104.CrossRefPubMedPubMedCentral
17.
go back to reference Secanell M, Groene O, Arah OA, Lopez MA, Kutryba B, Pfaff H, Klazinga N, Wagner C, Kristensen S, Bartels PD. Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries. Int J Qual Health Care. 2014; (supplement 1):5–15. Secanell M, Groene O, Arah OA, Lopez MA, Kutryba B, Pfaff H, Klazinga N, Wagner C, Kristensen S, Bartels PD. Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries. Int J Qual Health Care. 2014; (supplement 1):5–15.
18.
go back to reference Groene O, Klazinga N, Wagner C, Arah OA, Thompson A, Bruneau C, Suñol R. Investigating organizational quality improvement systems, patient empowerment, organizational culture, professional involvement and the quality of care in European hospitals: the'Deepening our understanding of quality improvement in Europe (DUQuE)'project. BMC Health Serv Res. 2010;10(1):281.CrossRefPubMedPubMedCentral Groene O, Klazinga N, Wagner C, Arah OA, Thompson A, Bruneau C, Suñol R. Investigating organizational quality improvement systems, patient empowerment, organizational culture, professional involvement and the quality of care in European hospitals: the'Deepening our understanding of quality improvement in Europe (DUQuE)'project. BMC Health Serv Res. 2010;10(1):281.CrossRefPubMedPubMedCentral
19.
go back to reference Wagner C, Groene O, Thompson CA, Dersarkissian M, Klazinga NS, Arah OA, Suñol R, Klazinga N, Kringos DS, Lombarts K. DUQuE quality management measures: associations between quality management at hospital and pathway levels. Int J Qual Health Care. 2014;26(suppl 1):66–73.CrossRefPubMedPubMedCentral Wagner C, Groene O, Thompson CA, Dersarkissian M, Klazinga NS, Arah OA, Suñol R, Klazinga N, Kringos DS, Lombarts K. DUQuE quality management measures: associations between quality management at hospital and pathway levels. Int J Qual Health Care. 2014;26(suppl 1):66–73.CrossRefPubMedPubMedCentral
20.
go back to reference Blok Cd, Koster E, Schilp J, Wagner C: Implementatie VMS Veiligheidsprogramma: evaluatieonderzoek in Nederlandse ziekenhuizen. 2013. Blok Cd, Koster E, Schilp J, Wagner C: Implementatie VMS Veiligheidsprogramma: evaluatieonderzoek in Nederlandse ziekenhuizen. 2013.
21.
go back to reference Twisk JWR: Applied multilevel analysis: a practical guide: Cambridge University press; 2006.CrossRef Twisk JWR: Applied multilevel analysis: a practical guide: Cambridge University press; 2006.CrossRef
22.
go back to reference Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):22.CrossRefPubMedPubMedCentral Chaudoir SR, Dugan AG, Barr CHI. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(1):22.CrossRefPubMedPubMedCentral
23.
go back to reference Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations literature review and Delphi study. Int J Qual Health Care. 2004;16(2):107–23.CrossRefPubMed Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations literature review and Delphi study. Int J Qual Health Care. 2004;16(2):107–23.CrossRefPubMed
24.
go back to reference Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003;362(9391):1225–30.CrossRefPubMed Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003;362(9391):1225–30.CrossRefPubMed
25.
go back to reference Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6 Suppl):S57–60.PubMed Grol R, Wensing M. What drives change? Barriers to and incentives for achieving evidence-based practice. Med J Aust. 2004;180(6 Suppl):S57–60.PubMed
26.
go back to reference Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37.CrossRefPubMedPubMedCentral Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37.CrossRefPubMedPubMedCentral
27.
go back to reference Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7(1):35.CrossRefPubMedPubMedCentral Francis JJ, O'Connor D, Curran J. Theories of behaviour change synthesised into a set of theoretical groupings: introducing a thematic series on the theoretical domains framework. Implement Sci. 2012;7(1):35.CrossRefPubMedPubMedCentral
28.
go back to reference Groene O, Botje D, Suñol R, Lopez MA, Wagner C. A systematic review of instruments that assess the implementation of hospital quality management systems. Int J Qual Health Care. 2013;25(5):525–41.CrossRefPubMed Groene O, Botje D, Suñol R, Lopez MA, Wagner C. A systematic review of instruments that assess the implementation of hospital quality management systems. Int J Qual Health Care. 2013;25(5):525–41.CrossRefPubMed
Metadata
Title
The association between quality system development stage and the implementation of process-level patient safety themes in Dutch hospitals: an observational study
Authors
Steffie M. van Schoten
Janneke Hoogervorst-Schilp
Peter P. Groenewegen
Peter Spreeuwenberg
Cordula Wagner
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-2997-x

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue