Skip to main content
Top
Published in: BMC Health Services Research 1/2007

Open Access 01-12-2007 | Research article

Improvement of psychometric properties of a scale measuring inpatient satisfaction with care: a better response rate and a reduction of the ceiling effect

Authors: Leïla Moret, Jean-Michel Nguyen, Nathalie Pillet, Bruno Falissard, Pierre Lombrail, Isabelle Gasquet

Published in: BMC Health Services Research | Issue 1/2007

Login to get access

Abstract

Background

The objective was to solve two problems of an already validated scale measuring inpatient opinion on care: 1) a high non-response rate for some items due to the "not applicable" response option and 2) a skewed score distribution with high ceiling effect.

Methods

The EQS-H scale ("échelle de qualité des soins en hospitalisation") comprised 26 items and 2 sub-scales of 13 items each, 'quality of medical information' (MI) and 'relationships with staff and daily routine' (RS). Three studies were conducted: a first mono-centre study (n = 552, response rate = 83.4%, self-completion of the scale the day before discharge) to construct a shorter version of the scale without the items with high non-response rate and maintaining those useful to ensure good internal validity (construct, convergent and divergent) and reliability; a second mono-centre study (n = 1246, response rate = 77.9%, self-completion of the scale before discharge) to confirm psychometric properties of the new version; a third multi-centre national study (n = 886, response rate 41.7%, self-completion at home 15 days after discharge) to test a new response pattern in order to reduce ceiling effect.

Results

Six items having a non-response rate >20% were deleted, increasing rates of exhaustive response to all items from 15% to 48%. Factorial analysis supported the evidence for removing 4 more items to ensure good internal validity and reliability of the new version. These good results (initial variance explained: 43%; Cronbach's α: 0.80 (MI) and 0.81 (RS)) were confirmed by the second study. The new response format produced a normalisation of the 2 scores with a large decrease in ceiling effect (25% to 4% for MI subscale and 61% to 8% for RS). Psychometric properties of the final version were excellent: the 2 subscales (8 items each) explained 66% of the variance in principal component analysis, Cronbach's α were respectively 0.92 (MI) and 0.93 (RS).

Conclusion

The new version of the EQS-H has better psychometric properties than the previous one. Rates of missing values are lower, and score distribution is normalized. An English version of this scale focused on quality of medical information delivered and on relationship with staff already exists, and this could be useful to conduct cross-cultural studies of health care service quality.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ross C, Steward C, Sinacore J: A comparative study of seven measures of patient satisfaction. Medical Care. 1995, 33: 372-377. 10.1097/00005650-199504000-00006.CrossRef Ross C, Steward C, Sinacore J: A comparative study of seven measures of patient satisfaction. Medical Care. 1995, 33: 372-377. 10.1097/00005650-199504000-00006.CrossRef
2.
go back to reference Hendriks A, Oort F, Vrielink M, Smets E: Reliability and validity of the Satisfaction with Hospital Care Questionnaire. International Journal for Quality in Health Care. 2002, 14: 471-482. 10.1093/intqhc/14.6.471.PubMedCrossRef Hendriks A, Oort F, Vrielink M, Smets E: Reliability and validity of the Satisfaction with Hospital Care Questionnaire. International Journal for Quality in Health Care. 2002, 14: 471-482. 10.1093/intqhc/14.6.471.PubMedCrossRef
3.
go back to reference Pettersen K, Veenstra M, Guldvog B, Kolstad A: The Patient Experiences Questionnaire: developement, validity and reliability. International Journal for Quality in Health Care. 2004, 16 (6): 453-463. 10.1093/intqhc/mzh074.PubMedCrossRef Pettersen K, Veenstra M, Guldvog B, Kolstad A: The Patient Experiences Questionnaire: developement, validity and reliability. International Journal for Quality in Health Care. 2004, 16 (6): 453-463. 10.1093/intqhc/mzh074.PubMedCrossRef
4.
go back to reference Larson C, Nelson E, Gustafson D, Batalden P: The relationship between meeting patients' information needs and their satisfaction with hospital care and general health status outcomes. International Journal for Quality in Health Care. 1996, 8 (5): 447-456. 10.1093/intqhc/8.5.447.PubMedCrossRef Larson C, Nelson E, Gustafson D, Batalden P: The relationship between meeting patients' information needs and their satisfaction with hospital care and general health status outcomes. International Journal for Quality in Health Care. 1996, 8 (5): 447-456. 10.1093/intqhc/8.5.447.PubMedCrossRef
5.
go back to reference Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T: Patients' experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002, 11: 335-339. 10.1136/qhc.11.4.335.PubMedPubMedCentralCrossRef Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T: Patients' experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002, 11: 335-339. 10.1136/qhc.11.4.335.PubMedPubMedCentralCrossRef
6.
go back to reference Hendricks A, Vrielink M, Smets E, Van Es S, De Haes J: Improving the assessment of (in)patients' satisfaction with hospital care. Medical Care. 2001, 39 (3): 270-283. 10.1097/00005650-200103000-00007.CrossRef Hendricks A, Vrielink M, Smets E, Van Es S, De Haes J: Improving the assessment of (in)patients' satisfaction with hospital care. Medical Care. 2001, 39 (3): 270-283. 10.1097/00005650-200103000-00007.CrossRef
7.
go back to reference Gonzalez N, Quintana J, Bilbao A, Escobar A, Aizpuru F, Thompson A, Esteban C, San Sebastian J, De la Sierra E: Development and validation of an in-patient satisfaction question naire. International Journal for Quality in Health Care. 2005, 17 (6): 465-472. 10.1093/intqhc/mzi067.PubMedCrossRef Gonzalez N, Quintana J, Bilbao A, Escobar A, Aizpuru F, Thompson A, Esteban C, San Sebastian J, De la Sierra E: Development and validation of an in-patient satisfaction question naire. International Journal for Quality in Health Care. 2005, 17 (6): 465-472. 10.1093/intqhc/mzi067.PubMedCrossRef
9.
go back to reference Donabedian A: Evaluating the quality of medical care. Milbank Memorial Fund Quarterly. 1966, 44: 166-206. 10.2307/3348969.CrossRef Donabedian A: Evaluating the quality of medical care. Milbank Memorial Fund Quarterly. 1966, 44: 166-206. 10.2307/3348969.CrossRef
10.
go back to reference Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14 (3): 236-249.PubMed Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14 (3): 236-249.PubMed
11.
go back to reference Sitzia J, Wood N: Patient Satisfaction: A review of issues and concepts. Social Science & Medicine. 1997, 45: 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRef Sitzia J, Wood N: Patient Satisfaction: A review of issues and concepts. Social Science & Medicine. 1997, 45: 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRef
12.
go back to reference Kane RL, Maciejewski M, Finch M: The relationship of Patient Satisfaction with Care and Clinical Outcomes. Medical Care. 1997, 35: 714-730. 10.1097/00005650-199707000-00005.PubMedCrossRef Kane RL, Maciejewski M, Finch M: The relationship of Patient Satisfaction with Care and Clinical Outcomes. Medical Care. 1997, 35: 714-730. 10.1097/00005650-199707000-00005.PubMedCrossRef
13.
go back to reference Barlesi F, Boyer L, Doddoli C, Antoniotti S, Thomas P, Auquier P: The place of patient satisfaction in quality assessment of lung cancer thoracic surgery. Chest. 2005, 128 (5): 3475-81. 10.1378/chest.128.5.3475.PubMedCrossRef Barlesi F, Boyer L, Doddoli C, Antoniotti S, Thomas P, Auquier P: The place of patient satisfaction in quality assessment of lung cancer thoracic surgery. Chest. 2005, 128 (5): 3475-81. 10.1378/chest.128.5.3475.PubMedCrossRef
14.
go back to reference Vingerhoets E, Wensing M, Grol R: Feedback of patients' evaluations of general practice care: a randomised trial. Qual Health Care. 2001, 10 (4): 224-8. 10.1136/qhc.0100224...PubMedPubMedCentralCrossRef Vingerhoets E, Wensing M, Grol R: Feedback of patients' evaluations of general practice care: a randomised trial. Qual Health Care. 2001, 10 (4): 224-8. 10.1136/qhc.0100224...PubMedPubMedCentralCrossRef
15.
16.
go back to reference Hearnshaw H, Baker R, Cooper A, Eccles M, Soper J: The costs and benefits of asking patients for their opinions about general practice. Fam Pract. 1996, 13 (1): 52-8. 10.1093/fampra/13.1.52.PubMedCrossRef Hearnshaw H, Baker R, Cooper A, Eccles M, Soper J: The costs and benefits of asking patients for their opinions about general practice. Fam Pract. 1996, 13 (1): 52-8. 10.1093/fampra/13.1.52.PubMedCrossRef
17.
go back to reference Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. International Journal for Quality in Health Care. 1999, 11 (4): 319-328. 10.1093/intqhc/11.4.319.PubMedCrossRef Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. International Journal for Quality in Health Care. 1999, 11 (4): 319-328. 10.1093/intqhc/11.4.319.PubMedCrossRef
18.
go back to reference Labarere J, Francois P, Auquier P, Robert C, Fourny M: Development of a French inpatient satisfaction questionnaire. International Journal for Quality In Health Care. 2001, 13 (2): 99-108. 10.1093/intqhc/13.2.99.PubMedCrossRef Labarere J, Francois P, Auquier P, Robert C, Fourny M: Development of a French inpatient satisfaction questionnaire. International Journal for Quality In Health Care. 2001, 13 (2): 99-108. 10.1093/intqhc/13.2.99.PubMedCrossRef
19.
go back to reference Salomon L, Gasquet I, Mesbah M, Ravaud P: Construction of a scale measuring inpatient's opinion on quality of care. International Journal for Quality in Health Care. 1999, 11: 507-516. 10.1093/intqhc/11.6.507.PubMedCrossRef Salomon L, Gasquet I, Mesbah M, Ravaud P: Construction of a scale measuring inpatient's opinion on quality of care. International Journal for Quality in Health Care. 1999, 11: 507-516. 10.1093/intqhc/11.6.507.PubMedCrossRef
20.
go back to reference Gasquet I, Falissard B, Ravaud P: Impact of reminders and method of questionnaire distribution on patient response to mail-back satisfaction survey. Journal of Clinical Epidemiology. 2001, 54: 1174-1180. 10.1016/S0895-4356(01)00387-0.PubMedCrossRef Gasquet I, Falissard B, Ravaud P: Impact of reminders and method of questionnaire distribution on patient response to mail-back satisfaction survey. Journal of Clinical Epidemiology. 2001, 54: 1174-1180. 10.1016/S0895-4356(01)00387-0.PubMedCrossRef
21.
go back to reference Pourin C, Tricaud-Vialle S, Barberger-Gateau P: Validation d'un questionnaire de satisfaction des patients hospitalisés. Journal d'Economie Médicale. 2003, 21 (3): 167-181. Pourin C, Tricaud-Vialle S, Barberger-Gateau P: Validation d'un questionnaire de satisfaction des patients hospitalisés. Journal d'Economie Médicale. 2003, 21 (3): 167-181.
22.
go back to reference Antoniotti S, Simeoni M, Clément A, Sapin C, Auquier P: Evaluer la satisfaction des patients hospitalisés : conceptualiser un indicateur quantitatif. Revue Epidémiologie & Santé Publique. 2000, 48 (S3): 82. Antoniotti S, Simeoni M, Clément A, Sapin C, Auquier P: Evaluer la satisfaction des patients hospitalisés : conceptualiser un indicateur quantitatif. Revue Epidémiologie & Santé Publique. 2000, 48 (S3): 82.
23.
go back to reference Brédart A, Razavi D, Robertson C, Brognone S, Fonzo D, Petit J, De Haes J: Timing of patient satisfaction assessment: effect on questionniare acceptability, completeness of data, reliability and variability of scores. Patient Education and Counseling. 2002, 46: 131-136. 10.1016/S0738-3991(01)00152-5.PubMedCrossRef Brédart A, Razavi D, Robertson C, Brognone S, Fonzo D, Petit J, De Haes J: Timing of patient satisfaction assessment: effect on questionniare acceptability, completeness of data, reliability and variability of scores. Patient Education and Counseling. 2002, 46: 131-136. 10.1016/S0738-3991(01)00152-5.PubMedCrossRef
24.
go back to reference Nguyen Thi PL, Briançon S, Empereur F, Guillemin F: Factors determining inpatient satisfaction with care. Social Science & Medicine. 2002, 54: 493-504. 10.1016/S0277-9536(01)00045-4.CrossRef Nguyen Thi PL, Briançon S, Empereur F, Guillemin F: Factors determining inpatient satisfaction with care. Social Science & Medicine. 2002, 54: 493-504. 10.1016/S0277-9536(01)00045-4.CrossRef
25.
go back to reference Veillard J, Champagne F, Klazinga N, Kazandjian V, Arah O, Guisset A: A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. International Journal for Quality in Health Care. 2005, 17 (6): 487-496. 10.1093/intqhc/mzi072.PubMedCrossRef Veillard J, Champagne F, Klazinga N, Kazandjian V, Arah O, Guisset A: A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. International Journal for Quality in Health Care. 2005, 17 (6): 487-496. 10.1093/intqhc/mzi072.PubMedCrossRef
26.
go back to reference Ware JE, Hays RD: Methods for measuring patient satisfaction with specific medical encounters. Med Care. 1988, 26 (4): 393-404. 10.1097/00005650-198804000-00008.PubMedCrossRef Ware JE, Hays RD: Methods for measuring patient satisfaction with specific medical encounters. Med Care. 1988, 26 (4): 393-404. 10.1097/00005650-198804000-00008.PubMedCrossRef
27.
go back to reference Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technology Assessment. 2002, 6: 1-245.PubMedCrossRef Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technology Assessment. 2002, 6: 1-245.PubMedCrossRef
28.
go back to reference Nunnaly JC: Psychometric Theory. 1978, New York: McGraw-Hill, 2 Nunnaly JC: Psychometric Theory. 1978, New York: McGraw-Hill, 2
29.
go back to reference Campbell DT, Fiske DW: Convergent and discriminant validation by the multitrait-multimethode matrix. Psychological Bulletin. 1959, 56: 81-105. 10.1037/h0046016.PubMedCrossRef Campbell DT, Fiske DW: Convergent and discriminant validation by the multitrait-multimethode matrix. Psychological Bulletin. 1959, 56: 81-105. 10.1037/h0046016.PubMedCrossRef
30.
go back to reference Falissard B: Mesurer la subjectivité en santé: perspective méthodologique et statistique. Collection Evaluation et Statistique – Edition Masson. 2001 Falissard B: Mesurer la subjectivité en santé: perspective méthodologique et statistique. Collection Evaluation et Statistique – Edition Masson. 2001
31.
go back to reference Loelhin J: Latent variable models: an introduction to factor, path, and structural equation analysis. 2004, Mahwah, NJ: L Erlbaum Associates, xi-317. 4CrossRef Loelhin J: Latent variable models: an introduction to factor, path, and structural equation analysis. 2004, Mahwah, NJ: L Erlbaum Associates, xi-317. 4CrossRef
32.
go back to reference Crowely SL, Fan X: Structural Equation Modeling: basic concepts and applications in personality assessment research. J Pers Assess. 1997, 68 (3): 508-531. 10.1207/s15327752jpa6803_4.CrossRef Crowely SL, Fan X: Structural Equation Modeling: basic concepts and applications in personality assessment research. J Pers Assess. 1997, 68 (3): 508-531. 10.1207/s15327752jpa6803_4.CrossRef
33.
go back to reference Benthler PM: Comparative fit indices in structural models. Psychol Bull. 1990, 88: 588-606. 10.1037/0033-2909.88.3.588.CrossRef Benthler PM: Comparative fit indices in structural models. Psychol Bull. 1990, 88: 588-606. 10.1037/0033-2909.88.3.588.CrossRef
34.
go back to reference Anderson JC, Gerbing DW: The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika. 1984, 49 (2): 155-173. 10.1007/BF02294170.CrossRef Anderson JC, Gerbing DW: The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika. 1984, 49 (2): 155-173. 10.1007/BF02294170.CrossRef
35.
go back to reference Coste J, Guillemin F, Pouchot J, Fermanian J: Methodological Approaches to Shortening Composite Measurement Scales. J Clin Epidemiol. 1997, 50 (3): 247-252. 10.1016/S0895-4356(96)00363-0.PubMedCrossRef Coste J, Guillemin F, Pouchot J, Fermanian J: Methodological Approaches to Shortening Composite Measurement Scales. J Clin Epidemiol. 1997, 50 (3): 247-252. 10.1016/S0895-4356(96)00363-0.PubMedCrossRef
36.
go back to reference Streiner D, Norman G: Scaling responses. Health measurement scales A practical guide to their development and use. 1995, Oxford : Medical Edition Publication, 39-52. Second Streiner D, Norman G: Scaling responses. Health measurement scales A practical guide to their development and use. 1995, Oxford : Medical Edition Publication, 39-52. Second
37.
go back to reference Williams SJ, Calnan M: Convergence and divergence: assessing criteria of consumer satisfaction across general practice, dental and hospital care settings. Social Science & Medicine. 1991, 33: 707-716. 10.1016/0277-9536(91)90025-8.CrossRef Williams SJ, Calnan M: Convergence and divergence: assessing criteria of consumer satisfaction across general practice, dental and hospital care settings. Social Science & Medicine. 1991, 33: 707-716. 10.1016/0277-9536(91)90025-8.CrossRef
38.
go back to reference Cheng S, Yang M, Chiang T: Patient satisfaction with an recommendation of a hospital: effects of interpersonal and technical aspects of hospital care. International Journal for Quality in Health Care. 2003, 15 (4): 345-355. 10.1093/intqhc/mzg045.PubMedCrossRef Cheng S, Yang M, Chiang T: Patient satisfaction with an recommendation of a hospital: effects of interpersonal and technical aspects of hospital care. International Journal for Quality in Health Care. 2003, 15 (4): 345-355. 10.1093/intqhc/mzg045.PubMedCrossRef
39.
go back to reference Donabedian A: The quality of care: how can it be assessed?. JAMA. 1988, 260: 1743-1748. 10.1001/jama.260.12.1743.PubMedCrossRef Donabedian A: The quality of care: how can it be assessed?. JAMA. 1988, 260: 1743-1748. 10.1001/jama.260.12.1743.PubMedCrossRef
40.
go back to reference Boyer L, Francois P, Doutre E, Weil G, Labarere J: Perception and use of the results of patient satisfaction surveys by care providers in a French teaching hospital. Int J Qual Health Care. 2006, 18 (5): 359-64. 10.1093/intqhc/mzl029.PubMedCrossRef Boyer L, Francois P, Doutre E, Weil G, Labarere J: Perception and use of the results of patient satisfaction surveys by care providers in a French teaching hospital. Int J Qual Health Care. 2006, 18 (5): 359-64. 10.1093/intqhc/mzl029.PubMedCrossRef
41.
go back to reference Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys?. Int J Qual Health Care. 2001, 13 (6): 463-8. 10.1093/intqhc/13.6.463.PubMedCrossRef Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys?. Int J Qual Health Care. 2001, 13 (6): 463-8. 10.1093/intqhc/13.6.463.PubMedCrossRef
Metadata
Title
Improvement of psychometric properties of a scale measuring inpatient satisfaction with care: a better response rate and a reduction of the ceiling effect
Authors
Leïla Moret
Jean-Michel Nguyen
Nathalie Pillet
Bruno Falissard
Pierre Lombrail
Isabelle Gasquet
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2007
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-7-197

Other articles of this Issue 1/2007

BMC Health Services Research 1/2007 Go to the issue