Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Trends in patient satisfaction in Dutch university medical centers: room for improvement for all

Authors: Sophia M Kleefstra, Linda C Zandbelt, Hanneke JCJM de Haes, Rudolf B Kool

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Results of patient satisfaction research provide hospitals areas for quality improvement. Although it may take several years to achieve such improvement, not all hospitals analyze changes in patient satisfaction over time structurally. Consequently, they lack information from patients’ perspective on effectiveness of improvement programs. This study presents a trend analysis of the patient satisfaction scores in the eight university medical centers in the Netherlands. We focus on the trends, effect size and its consequences for improving patient-centered care.

Methods

The Core Questionnaire for the assessment of Patient satisfaction (COPS) was used in four large-scale nationwide comparative studies (2003–2009). Data were analyzed at a national level, and for each academic hospital separately. We analyzed the polynomial contrasts in the four measurements by performing an univariate analysis of variance (ANCOVA). The trend lines are presented graphically, with the means, SD, F-statistics and the standardized effect size including confidence intervals expressed by Cohen’s d. By analyzing the (logit transformed) percentages of very satisfied patients we examined the change scores.

Results

The dataset consisted of 58,055 inpatients and 79,498 outpatients. Significant positive trends were found on national level and hospital level, especially in outpatient departments. Improvement was especially seen on the dimensions “information” and “discharge and aftercare”. Not only university medical centers with a lower score at the start, but surprisingly some best practices and university medical centers with a high initial score improved.

Conclusions

We conclude that significant trends in patient satisfaction can be identified on a national and a hospital level, in inpatient and outpatient departments. The observed effect size expressed by Cohen’s d is rather small. Hospitals have found room for improvement, even hospitals with initial high satisfaction scores. We recommend that hospitals monitor their patient satisfaction scores over time and relate these to quality interventions and organizational changes. Furthermore, we recommend to expand the research to subgroups of unsatisfied patients to improve patient-centered care for all patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2012;344:e1717.CrossRefPubMedPubMedCentral Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2012;344:e1717.CrossRefPubMedPubMedCentral
2.
go back to reference Coulter A. Trends in patients' experience of the NHS. Oxford: Picker Institute Europe; 2006. Coulter A. Trends in patients' experience of the NHS. Oxford: Picker Institute Europe; 2006.
3.
go back to reference Davies EA, Meterko MM, Charns MP, Seibert ME, Cleary PD. Factors affecting the use of patient survey data for quality improvement in the Veterans Health Administration. BMC Health Serv Res. 2011;11:334.CrossRefPubMedPubMedCentral Davies EA, Meterko MM, Charns MP, Seibert ME, Cleary PD. Factors affecting the use of patient survey data for quality improvement in the Veterans Health Administration. BMC Health Serv Res. 2011;11:334.CrossRefPubMedPubMedCentral
4.
go back to reference Groene O. Patient centredness and quality improvement efforts in hospitals: rationale, measurement, implementation. Int J Qual Health Care. 2011;23:531–7.CrossRefPubMed Groene O. Patient centredness and quality improvement efforts in hospitals: rationale, measurement, implementation. Int J Qual Health Care. 2011;23:531–7.CrossRefPubMed
5.
go back to reference Reeves R, Seccombe I. Do patient surveys work? The influence of a national survey programme on local quality-improvement initiatives. Qual Saf Health Care. 2008;17:437–41.CrossRefPubMedPubMedCentral Reeves R, Seccombe I. Do patient surveys work? The influence of a national survey programme on local quality-improvement initiatives. Qual Saf Health Care. 2008;17:437–41.CrossRefPubMedPubMedCentral
6.
go back to reference Riiskjaer E, Ammentorp J, Nielsen JF, Kofoed PE. Patient surveys–a key to organizational change? Patient Educ Couns. 2010;78:394–401.CrossRefPubMed Riiskjaer E, Ammentorp J, Nielsen JF, Kofoed PE. Patient surveys–a key to organizational change? Patient Educ Couns. 2010;78:394–401.CrossRefPubMed
7.
go back to reference Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington DC: IOM; 2001. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington DC: IOM; 2001.
8.
go back to reference Barr JK, Giannotti TE, Sofaer S, Duquette CE, Waters WJ, Petrillo MK. Using public reports of patient satisfaction for hospital quality improvement. Health Serv Res. 2006;41:663–82.CrossRefPubMedPubMedCentral Barr JK, Giannotti TE, Sofaer S, Duquette CE, Waters WJ, Petrillo MK. Using public reports of patient satisfaction for hospital quality improvement. Health Serv Res. 2006;41:663–82.CrossRefPubMedPubMedCentral
9.
go back to reference Moret L, Nguyen JM, Pillet N, Falissard B, Lombrail P, Gasquet I. Improvement of psychometric properties of a scale measuring inpatient satisfaction with care: a better response rate and a reduction of the ceiling effect. BMC Health Serv Res. 2007;7:197.CrossRefPubMedPubMedCentral Moret L, Nguyen JM, Pillet N, Falissard B, Lombrail P, Gasquet I. Improvement of psychometric properties of a scale measuring inpatient satisfaction with care: a better response rate and a reduction of the ceiling effect. BMC Health Serv Res. 2007;7:197.CrossRefPubMedPubMedCentral
10.
go back to reference Cho SH, Kim CY. Trends in patient satisfaction from 1989–2003: adjusted for patient characteristics. Taehan Kanho Hakhoe Chi. 2007;37:171–8.PubMed Cho SH, Kim CY. Trends in patient satisfaction from 1989–2003: adjusted for patient characteristics. Taehan Kanho Hakhoe Chi. 2007;37:171–8.PubMed
11.
go back to reference Luxford K, Safran DG, Delbanco T. Promoting patient-centered care: a qualitative study of facilitators and barriers in healthcare organizations with a reputation for improving the patient experience. Int J Qual Health Care. 2011;23:510–5.CrossRefPubMed Luxford K, Safran DG, Delbanco T. Promoting patient-centered care: a qualitative study of facilitators and barriers in healthcare organizations with a reputation for improving the patient experience. Int J Qual Health Care. 2011;23:510–5.CrossRefPubMed
12.
go back to reference Patwardhan A, Spencer C. Are patient surveys valuable as a service-improvement tool in health services? An overview. Journal of Healthcare Leadership. 2012;2012:33–46.CrossRef Patwardhan A, Spencer C. Are patient surveys valuable as a service-improvement tool in health services? An overview. Journal of Healthcare Leadership. 2012;2012:33–46.CrossRef
13.
go back to reference Shaller D. Patient-centered care: what does it take? Report for the Picker Institute and The Commonwealth Fund. New York: The Commonwealth Fund; 2007. Ref Type: Report. Shaller D. Patient-centered care: what does it take? Report for the Picker Institute and The Commonwealth Fund. New York: The Commonwealth Fund; 2007. Ref Type: Report.
14.
go back to reference Draper M, Cohen P, Buchan H. Seeking consumer views: what use are results of hospital patient satisfaction surveys? Int J Qual Health Care. 2001;13:463–8.CrossRefPubMed Draper M, Cohen P, Buchan H. Seeking consumer views: what use are results of hospital patient satisfaction surveys? Int J Qual Health Care. 2001;13:463–8.CrossRefPubMed
15.
go back to reference Bjertnaes O, Skudal KE, Iversen HH. Classification of patients based on their evaluation of hospital outcomes: cluster analysis following a national survey in Norway. BMC Health Serv Res. 2013;13:73.CrossRefPubMedPubMedCentral Bjertnaes O, Skudal KE, Iversen HH. Classification of patients based on their evaluation of hospital outcomes: cluster analysis following a national survey in Norway. BMC Health Serv Res. 2013;13:73.CrossRefPubMedPubMedCentral
16.
go back to reference Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002;6:1–244.CrossRefPubMed Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002;6:1–244.CrossRefPubMed
17.
go back to reference Ware Jr JE, Hays RD. Methods for measuring patient satisfaction with specific medical encounters. Med Care. 1988;26:393–402.CrossRefPubMed Ware Jr JE, Hays RD. Methods for measuring patient satisfaction with specific medical encounters. Med Care. 1988;26:393–402.CrossRefPubMed
18.
go back to reference Friesner D, Neufelder D, Raisor J, Bozman CS. How to improve patient satisfaction when patients are already satisfied: a continuous process-improvement approach. Hosp Top. 2009;87:24–40.CrossRefPubMed Friesner D, Neufelder D, Raisor J, Bozman CS. How to improve patient satisfaction when patients are already satisfied: a continuous process-improvement approach. Hosp Top. 2009;87:24–40.CrossRefPubMed
19.
go back to reference Hendriks M, Spreeuwenberg P, Rademakers J, Delnoij DM. Dutch healthcare reform: did it result in performance improvement of health plans? A comparison of consumer experiences over time. BMC Heath Serv Res. 2009;9:167.CrossRef Hendriks M, Spreeuwenberg P, Rademakers J, Delnoij DM. Dutch healthcare reform: did it result in performance improvement of health plans? A comparison of consumer experiences over time. BMC Heath Serv Res. 2009;9:167.CrossRef
20.
go back to reference Kleefstra SM, Kool RB, Veldkamp CM, der Meer AC W-v, Mens MA, Blijham GH, et al. A core questionnaire for the assessment of patient satisfaction in academic hospitals in The Netherlands: development and first results in a nationwide study. Qual Saf Health Care. 2010;19:e24.PubMed Kleefstra SM, Kool RB, Veldkamp CM, der Meer AC W-v, Mens MA, Blijham GH, et al. A core questionnaire for the assessment of patient satisfaction in academic hospitals in The Netherlands: development and first results in a nationwide study. Qual Saf Health Care. 2010;19:e24.PubMed
21.
go back to reference Hendriks AA, Vrielink MR, Smets EM, Van Es SQ, de Haes JC. Improving the assessment of (in)patients' satisfaction with hospital care. Med Care. 2001;39:270–83.CrossRefPubMed Hendriks AA, Vrielink MR, Smets EM, Van Es SQ, de Haes JC. Improving the assessment of (in)patients' satisfaction with hospital care. Med Care. 2001;39:270–83.CrossRefPubMed
23.
go back to reference Dutch Hospital Data. Kengetallen Nederlandse Ziekenhuizen 2012. Utrecht: DHD; 2013. Dutch Hospital Data. Kengetallen Nederlandse Ziekenhuizen 2012. Utrecht: DHD; 2013.
24.
go back to reference Hendriks AA, Oort FJ, Vrielink MR, Smets EM. Reliability and validity of the Satisfaction with Hospital Care Questionnaire. Int J Qual Health Care. 2002;14:471–82.CrossRefPubMed Hendriks AA, Oort FJ, Vrielink MR, Smets EM. Reliability and validity of the Satisfaction with Hospital Care Questionnaire. Int J Qual Health Care. 2002;14:471–82.CrossRefPubMed
26.
go back to reference Hekkert KD, Cihangir S, Kleefstra SM, van den Berg B, Kool RB. Patient satisfaction revisited: a multilevel approach. Soc Sci Med. 2009;69:68–75.CrossRefPubMed Hekkert KD, Cihangir S, Kleefstra SM, van den Berg B, Kool RB. Patient satisfaction revisited: a multilevel approach. Soc Sci Med. 2009;69:68–75.CrossRefPubMed
27.
go back to reference Norman GR, Wyrwich KW, Patrick DL. The mathematical relationship among different forms of responsiveness coefficients. Qual Life Res. 2007;16:815–22.CrossRefPubMed Norman GR, Wyrwich KW, Patrick DL. The mathematical relationship among different forms of responsiveness coefficients. Qual Life Res. 2007;16:815–22.CrossRefPubMed
28.
go back to reference Cohen J. Statistical Power Analysis for the behavioral Sciences. Hillsdale, NJ England: Lawrence Erlbaum Associates Inc; 1988. Cohen J. Statistical Power Analysis for the behavioral Sciences. Hillsdale, NJ England: Lawrence Erlbaum Associates Inc; 1988.
29.
go back to reference Durlak JA. How to select, calculate, and interpret effect sizes. J Pediatr Psychol. 2009;34:917–28.CrossRefPubMed Durlak JA. How to select, calculate, and interpret effect sizes. J Pediatr Psychol. 2009;34:917–28.CrossRefPubMed
30.
31.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
32.
go back to reference Wamper KE, Sierevelt IN, Poolman RW, Bhandari M, Haverkamp D. The Harris hip score: Do ceiling effects limit its usefulness in orthopedics? Acta Orthop. 2010;81:703–7.CrossRefPubMedPubMedCentral Wamper KE, Sierevelt IN, Poolman RW, Bhandari M, Haverkamp D. The Harris hip score: Do ceiling effects limit its usefulness in orthopedics? Acta Orthop. 2010;81:703–7.CrossRefPubMedPubMedCentral
33.
go back to reference Kontopantelis E, Springate D, Reeves D, Ashcroft DM, Valderas JM, Doran T. Withdrawing performance indicators: retrospective analysis of general practice performance under UK Quality and Outcomes Framework. BMJ. 2014;348:g330.CrossRefPubMedPubMedCentral Kontopantelis E, Springate D, Reeves D, Ashcroft DM, Valderas JM, Doran T. Withdrawing performance indicators: retrospective analysis of general practice performance under UK Quality and Outcomes Framework. BMJ. 2014;348:g330.CrossRefPubMedPubMedCentral
34.
go back to reference Centraal Bureau voor de Statistiek (CBS): Statistics Netherlands. Monitor Consumentenvertrouwen 1990–2011: Consumer Confidence 1990-2011. Retrieved 04-11-2011 from https://www.cbs.nl Ref Type: Online Source Centraal Bureau voor de Statistiek (CBS): Statistics Netherlands. Monitor Consumentenvertrouwen 1990–2011: Consumer Confidence 1990-2011. Retrieved 04-11-2011 from https://​www.​cbs.​nl Ref Type: Online Source
38.
go back to reference Ikkersheim DE, Koolman X. Dutch healthcare reform: did it result in better patient experiences in hospitals? A comparison of the consumer quality index over time. BMC Health Serv Res. 2012;12:76.CrossRefPubMedPubMedCentral Ikkersheim DE, Koolman X. Dutch healthcare reform: did it result in better patient experiences in hospitals? A comparison of the consumer quality index over time. BMC Health Serv Res. 2012;12:76.CrossRefPubMedPubMedCentral
39.
go back to reference Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41:582–92.PubMed Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41:582–92.PubMed
40.
go back to reference Prentice D, Miller D. When small effects are impressive. Psychol Bull. 1992;112:160–4.CrossRef Prentice D, Miller D. When small effects are impressive. Psychol Bull. 1992;112:160–4.CrossRef
41.
go back to reference Yuan K-H, Maxwell S. On the post hoc power in testing mean differences. J Educ Behav Stat. 2005;30:141–67.CrossRef Yuan K-H, Maxwell S. On the post hoc power in testing mean differences. J Educ Behav Stat. 2005;30:141–67.CrossRef
42.
go back to reference Fraley RC, Vazire S. The N-pact factor: evaluating the quality of empirical journals with respect to sample size and statistical power. PLoS One. 2014;9:e109019.CrossRefPubMedPubMedCentral Fraley RC, Vazire S. The N-pact factor: evaluating the quality of empirical journals with respect to sample size and statistical power. PLoS One. 2014;9:e109019.CrossRefPubMedPubMedCentral
43.
go back to reference de Mheen PJ M-v, van Duijn-Bakker N, Kievit J. Surgical adverse outcomes and patients' evaluation of quality of care: inherent risk or reduced quality of care? Qual Saf Health Care. 2007;16:428–33.PubMedCentral de Mheen PJ M-v, van Duijn-Bakker N, Kievit J. Surgical adverse outcomes and patients' evaluation of quality of care: inherent risk or reduced quality of care? Qual Saf Health Care. 2007;16:428–33.PubMedCentral
44.
go back to reference Hewitson P, Skew A, Graham C, Jenkinson C, Coulter A. People with limiting long-term conditions report poorer experiences and more problems with hospital care. BMC Health Serv Res. 2014;14:33.CrossRefPubMedPubMedCentral Hewitson P, Skew A, Graham C, Jenkinson C, Coulter A. People with limiting long-term conditions report poorer experiences and more problems with hospital care. BMC Health Serv Res. 2014;14:33.CrossRefPubMedPubMedCentral
45.
go back to reference Riiskjaer E, Ammentorp J, Kofoed PE. The value of open-ended questions in surveys on patient experience: number of comments and perceived usefulness from a hospital perspective. Int J Qual Health Care. 2012;24:509–16.CrossRefPubMed Riiskjaer E, Ammentorp J, Kofoed PE. The value of open-ended questions in surveys on patient experience: number of comments and perceived usefulness from a hospital perspective. Int J Qual Health Care. 2012;24:509–16.CrossRefPubMed
46.
go back to reference Bjertnaes OA. The association between survey timing and patient-reported experiences with hospitals: results of a national postal survey. BMC Med Res Methodol. 2012;12:13.CrossRefPubMedPubMedCentral Bjertnaes OA. The association between survey timing and patient-reported experiences with hospitals: results of a national postal survey. BMC Med Res Methodol. 2012;12:13.CrossRefPubMedPubMedCentral
47.
48.
go back to reference Sitzia J, Wood N. Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998;10:311–7.CrossRefPubMed Sitzia J, Wood N. Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998;10:311–7.CrossRefPubMed
49.
go back to reference Lasek RJ, Barkley W, Harper DL, Rosenthal GE. An evaluation of the impact of nonresponse bias on patient satisfaction surveys. Med Care. 1997;35:646–52.CrossRefPubMed Lasek RJ, Barkley W, Harper DL, Rosenthal GE. An evaluation of the impact of nonresponse bias on patient satisfaction surveys. Med Care. 1997;35:646–52.CrossRefPubMed
50.
go back to reference Frank B, Sudo S, Enkawa T. Interpreting time series of patient satisfaction: macro vs. micro components. J Hosp Mark Public Relations. 2009;19:15–39.CrossRefPubMed Frank B, Sudo S, Enkawa T. Interpreting time series of patient satisfaction: macro vs. micro components. J Hosp Mark Public Relations. 2009;19:15–39.CrossRefPubMed
51.
go back to reference Das S, Chen MH, Warren N, Hodgson M. Do associations between employee self-reported organizational assessments and attitudinal outcomes change over time? An analysis of four Veterans Health Administration surveys using structural equation modelling. Health Econ. 2010;20:1507–22.CrossRefPubMed Das S, Chen MH, Warren N, Hodgson M. Do associations between employee self-reported organizational assessments and attitudinal outcomes change over time? An analysis of four Veterans Health Administration surveys using structural equation modelling. Health Econ. 2010;20:1507–22.CrossRefPubMed
52.
go back to reference Hibbard JH, Stockard J, Tusler M, Stockard J, Tusler M. Does publicizing hospital performance stimulate quality improvement efforts? Health Aff (Millwood). 2003;22:84–94.CrossRef Hibbard JH, Stockard J, Tusler M, Stockard J, Tusler M. Does publicizing hospital performance stimulate quality improvement efforts? Health Aff (Millwood). 2003;22:84–94.CrossRef
53.
go back to reference Davies E, Shaller D, Edgman-Levitan S, Safran DG, Oftedahl G, Sakowski J, et al. Evaluating the use of a modified CAHPS survey to support improvements in patient-centered care: lessons from a quality improvement collaborative. Health Expect. 2008;11:160–76.CrossRefPubMed Davies E, Shaller D, Edgman-Levitan S, Safran DG, Oftedahl G, Sakowski J, et al. Evaluating the use of a modified CAHPS survey to support improvements in patient-centered care: lessons from a quality improvement collaborative. Health Expect. 2008;11:160–76.CrossRefPubMed
Metadata
Title
Trends in patient satisfaction in Dutch university medical centers: room for improvement for all
Authors
Sophia M Kleefstra
Linda C Zandbelt
Hanneke JCJM de Haes
Rudolf B Kool
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0766-7

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue