Skip to main content
Top
Published in: BMC Health Services Research 1/2006

Open Access 01-12-2006 | Research article

Development and preliminary validation of a Greek-language outpatient satisfaction questionnaire with principal components and multi-trait analyses

Authors: Vassilis H Aletras, Efthemis A Papadopoulos, Dimitris A Niakas

Published in: BMC Health Services Research | Issue 1/2006

Login to get access

Abstract

Background

In the recent years there is a growing interest in Greece concerning the measurement of the satisfaction of patients who are visiting the outpatient clinics of National Health System (NHS) general acute hospitals. The aim of this study is therefore to develop a patient satisfaction questionnaire and provide its preliminary validation.

Methods

A questionnaire in Greek has been developed by literature review, researchers' on the spot observation and interviews. Pretesting has been followed by telephone surveys in two short-term general NHS hospitals in Macedonia, Greece. A proportional stratified random sample of 285 subjects and a second random sample of 100 outpatients, drawn on March 2004, have been employed for the analysis. These have resulted in scale creation via Principal Components Analysis and psychometric testing for internal consistency, test-retest and interrater reliability as well as construct validity.

Results

Four summated scales have emerged regarding the pure outpatient component of the patients' visits, namely medical examination, hospital environment, comfort and appointment time. Cronbach's alpha coefficients and Pearson, Spearman and intraclass correlations indicate a high degree of scale reliability and validity. Two other scales -lab appointment time and lab experience- capture the apparently distinct yet complementary visitor experience related to the radiographic and laboratory tests. Psychometric tests are equally promising, however, some discriminant validity differences lack statistical significance.

Conclusion

The instrument appears to be reliable and valid regarding the pure outpatient experience, whereas more research employing larger samples is required in order to establish the apparent psychometric properties of the complementary radiographic and laboratory-testing process, which is only relevant to about 25% of the subjects analysed here.
Literature
1.
go back to reference Niakas D, Theodorou M, Liaropoulos L: Can privatizing selected services benefit the public healthcare system?: the Greek case. Appl Health Econ Health Policy. 2005, 4: 153-157. 10.2165/00148365-200504030-00003.PubMedCrossRef Niakas D, Theodorou M, Liaropoulos L: Can privatizing selected services benefit the public healthcare system?: the Greek case. Appl Health Econ Health Policy. 2005, 4: 153-157. 10.2165/00148365-200504030-00003.PubMedCrossRef
2.
go back to reference Niakas D: The political economy of health care in Greece. Handbook of international health care systems. Edited by: Thai KV, Wimberley ET, Macmanus SM. 2002, New York: Marsel Dekker Niakas D: The political economy of health care in Greece. Handbook of international health care systems. Edited by: Thai KV, Wimberley ET, Macmanus SM. 2002, New York: Marsel Dekker
3.
go back to reference Peck DF: Survey of outpatient satisfaction in a general hospital. Health Bull (Edinb). 1993, 51: 63-66. Peck DF: Survey of outpatient satisfaction in a general hospital. Health Bull (Edinb). 1993, 51: 63-66.
4.
go back to reference Carey RG, Seibert JH: A patient survey system to measure quality improvement: questionnaire reliability and validity. Med Care. 1993, 31: 834-845.PubMedCrossRef Carey RG, Seibert JH: A patient survey system to measure quality improvement: questionnaire reliability and validity. Med Care. 1993, 31: 834-845.PubMedCrossRef
5.
go back to reference Avis M, Bond M, Arthur A: Exploring patient satisfaction with out-patient services. J Nurs Manag. 1995, 3: 59-65.PubMedCrossRef Avis M, Bond M, Arthur A: Exploring patient satisfaction with out-patient services. J Nurs Manag. 1995, 3: 59-65.PubMedCrossRef
6.
go back to reference Krueckeberg HF, Hubbert A: Attribute correlates of hospital outpatient satisfaction. J Ambul Care Mark. 1995, 6: 11-43.PubMedCrossRef Krueckeberg HF, Hubbert A: Attribute correlates of hospital outpatient satisfaction. J Ambul Care Mark. 1995, 6: 11-43.PubMedCrossRef
7.
go back to reference Lorentzon M, Salisbury C, Bruster S, Weston D: Listening to patients in the National Health Service: a selective review of literature on patients' views about outpatient services in British hospitals. J Nurs Manag. 1996, 4: 163-169. 10.1046/j.1365-2834.1996.02075.x.PubMedCrossRef Lorentzon M, Salisbury C, Bruster S, Weston D: Listening to patients in the National Health Service: a selective review of literature on patients' views about outpatient services in British hospitals. J Nurs Manag. 1996, 4: 163-169. 10.1046/j.1365-2834.1996.02075.x.PubMedCrossRef
8.
go back to reference McKinnon K, Crofts PD, Edwards R, Campion PD, Edwards RH: The outpatient experience: results of a patient feedback survey. Int J Health Care Qual Assur. 1998, 11: 156-160. 10.1108/09526869810230858.CrossRef McKinnon K, Crofts PD, Edwards R, Campion PD, Edwards RH: The outpatient experience: results of a patient feedback survey. Int J Health Care Qual Assur. 1998, 11: 156-160. 10.1108/09526869810230858.CrossRef
9.
go back to reference Newman RD, Gloyd S, Nyangezi JM, Machobo F, Muiser J: Satisfaction with outpatient health care services in Manica province, Mozambique. Health Policy Plan. 1998, 13: 174-180. 10.1093/heapol/13.2.174.PubMedCrossRef Newman RD, Gloyd S, Nyangezi JM, Machobo F, Muiser J: Satisfaction with outpatient health care services in Manica province, Mozambique. Health Policy Plan. 1998, 13: 174-180. 10.1093/heapol/13.2.174.PubMedCrossRef
10.
go back to reference Labarere J, Francois P, Bertrand D, Peyrin JC, Robert C, Fourny M: Outpatient satisfaction: validation of a French-language questionnaire: data quality and identification of associated factors. Clin Perform Qual Health Care. 1999, 7: 63-69.PubMed Labarere J, Francois P, Bertrand D, Peyrin JC, Robert C, Fourny M: Outpatient satisfaction: validation of a French-language questionnaire: data quality and identification of associated factors. Clin Perform Qual Health Care. 1999, 7: 63-69.PubMed
11.
go back to reference Loblaw DA, Bezjak A, Bunston T: Development and testing of a visit-specific patient satisfaction questionnaire: the Princess Margaret Hospital Satisfaction With Doctor Questionnaire. J Clin Oncol. 1999, 17: 1931-1938.PubMedCrossRef Loblaw DA, Bezjak A, Bunston T: Development and testing of a visit-specific patient satisfaction questionnaire: the Princess Margaret Hospital Satisfaction With Doctor Questionnaire. J Clin Oncol. 1999, 17: 1931-1938.PubMedCrossRef
12.
go back to reference Bodur S, Ozdemir YE, Kara F: Outpatient satisfaction with health centers in urban areas. Turkish Journal of Medical Science. 2002, 32: 409-414. Bodur S, Ozdemir YE, Kara F: Outpatient satisfaction with health centers in urban areas. Turkish Journal of Medical Science. 2002, 32: 409-414.
13.
go back to reference Borowsky SJ, Nelson DB, Fortney JC, Hedeen AN, Bradley JL, Chapko MK: VA community-based outpatient clinics: performance measures based on patient perceptions of care. Med Care. 2002, 40: 578-586. 10.1097/00005650-200207000-00004.PubMedCrossRef Borowsky SJ, Nelson DB, Fortney JC, Hedeen AN, Bradley JL, Chapko MK: VA community-based outpatient clinics: performance measures based on patient perceptions of care. Med Care. 2002, 40: 578-586. 10.1097/00005650-200207000-00004.PubMedCrossRef
14.
go back to reference De Brun C, Howell F, Bedford D, Corcoran R, Kelly A: Outpatient experiences in acute hospitals. Ir J Med Sci. 2002, 171: 89-93.PubMedCrossRef De Brun C, Howell F, Bedford D, Corcoran R, Kelly A: Outpatient experiences in acute hospitals. Ir J Med Sci. 2002, 171: 89-93.PubMedCrossRef
15.
go back to reference Harada ND, Villa VM, Andersen R: Satisfaction with VA and non-VA outpatient care among veterans. Am J Med Qua. 2002, 17: 155-164.CrossRef Harada ND, Villa VM, Andersen R: Satisfaction with VA and non-VA outpatient care among veterans. Am J Med Qua. 2002, 17: 155-164.CrossRef
16.
go back to reference Hiidenhovi H, Nojonen K, Laippala P: Measurement of outpatients' views of service quality in a Finnish university hospital. J Adv Nurs. 2002, 38: 59-67. 10.1046/j.1365-2648.2002.02146.x.PubMedCrossRef Hiidenhovi H, Nojonen K, Laippala P: Measurement of outpatients' views of service quality in a Finnish university hospital. J Adv Nurs. 2002, 38: 59-67. 10.1046/j.1365-2648.2002.02146.x.PubMedCrossRef
17.
go back to reference Dawn AG, Lee PP, Hall-Stone T, Gable W: Development of a patient satisfaction survey for outpatient care: a brief report. J Med Pract Manage. 2003, 19: 166-169.PubMed Dawn AG, Lee PP, Hall-Stone T, Gable W: Development of a patient satisfaction survey for outpatient care: a brief report. J Med Pract Manage. 2003, 19: 166-169.PubMed
18.
go back to reference Zandbelt LC, Smets EM, Oort FJ, Godfried MH, de Haes HC: Satisfaction with the outpatient encounter. J Gen Intern Med. 2004, 19: 088-1095. 10.1111/j.1525-1497.2004.30420.x.CrossRef Zandbelt LC, Smets EM, Oort FJ, Godfried MH, de Haes HC: Satisfaction with the outpatient encounter. J Gen Intern Med. 2004, 19: 088-1095. 10.1111/j.1525-1497.2004.30420.x.CrossRef
19.
go back to reference Krowinski WJ, Steiber SR: Measuring and managing patient satisfaction. 1996, Chicago: American Hospital Publishing, 2 Krowinski WJ, Steiber SR: Measuring and managing patient satisfaction. 1996, Chicago: American Hospital Publishing, 2
20.
go back to reference Willis GB: Cognitive interviewing: a tool for improving questionnaire design. 2004, Thousand Oaks, CA: Sage Publications Willis GB: Cognitive interviewing: a tool for improving questionnaire design. 2004, Thousand Oaks, CA: Sage Publications
21.
go back to reference Ware JE, Snyder MK, Wright WR, Davies AR: Defining and measuring patient satisfaction with medical care. Eval Program Plann. 1983, 6: 247-263. 10.1016/0149-7189(83)90005-8.PubMedCrossRef Ware JE, Snyder MK, Wright WR, Davies AR: Defining and measuring patient satisfaction with medical care. Eval Program Plann. 1983, 6: 247-263. 10.1016/0149-7189(83)90005-8.PubMedCrossRef
22.
go back to reference Meric HJ: The effect of scale form choice on psychometric properties of patient satisfaction measurement. Health Mark Q. 1994, 11: 27-39. 10.1300/J026v11n03_04.PubMedCrossRef Meric HJ: The effect of scale form choice on psychometric properties of patient satisfaction measurement. Health Mark Q. 1994, 11: 27-39. 10.1300/J026v11n03_04.PubMedCrossRef
23.
go back to reference Burroughs TE, Waterman BM, Gilin D, Adams D, McCollegan J, Cira J: Do on-site patient satisfaction surveys bias results?. Jt Comm J Qual Patient Saf. 2005, 31: 158-166.PubMed Burroughs TE, Waterman BM, Gilin D, Adams D, McCollegan J, Cira J: Do on-site patient satisfaction surveys bias results?. Jt Comm J Qual Patient Saf. 2005, 31: 158-166.PubMed
24.
go back to reference Hays RD, Ware JE: My medical care is better than yours. Social desirability and patient satisfaction ratings. Med Care. 1986, 24: 519-524.PubMedCrossRef Hays RD, Ware JE: My medical care is better than yours. Social desirability and patient satisfaction ratings. Med Care. 1986, 24: 519-524.PubMedCrossRef
25.
go back to reference Burroughs TE, Waterman BM, Cira J, Desikan R, Claiborne-Dunagan W: Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001, 27: 349-361.PubMed Burroughs TE, Waterman BM, Cira J, Desikan R, Claiborne-Dunagan W: Patient satisfaction measurement strategies: a comparison of phone and mail methods. Jt Comm J Qual Improv. 2001, 27: 349-361.PubMed
26.
go back to reference De Vries H, Elliott MN, Hepner KA, Keller SD, Hays RD: Equivalence of mail and telephone responses to the CAHPS hospital survey. Health Serv Res. 2005, 40 (Suppl): 2210-2139. De Vries H, Elliott MN, Hepner KA, Keller SD, Hays RD: Equivalence of mail and telephone responses to the CAHPS hospital survey. Health Serv Res. 2005, 40 (Suppl): 2210-2139.
27.
go back to reference Hepner KA, Brown JA, Hays RD: Comparison of mail and telephone in assessing patient experiences in receiving care from medical group practices. Eval Health Prof. 2005, 28: 377-389. 10.1177/0163278705281074.PubMedCrossRef Hepner KA, Brown JA, Hays RD: Comparison of mail and telephone in assessing patient experiences in receiving care from medical group practices. Eval Health Prof. 2005, 28: 377-389. 10.1177/0163278705281074.PubMedCrossRef
28.
go back to reference Niakas D, Gnardellis C, Theodorou M: Is there a problem with quality in the Greek hospital sector? preliminary results from a patient satisfaction survey. Health Serv Manage Res. 2004, 17: 62-69. 10.1258/095148404322772741.PubMedCrossRef Niakas D, Gnardellis C, Theodorou M: Is there a problem with quality in the Greek hospital sector? preliminary results from a patient satisfaction survey. Health Serv Manage Res. 2004, 17: 62-69. 10.1258/095148404322772741.PubMedCrossRef
29.
go back to reference Weeks MF, Kulka RA, Pierson SA: Optimal call scheduling for a telephone survey. Public Opin Q. 1987, 51: 540-549. 10.1086/269056.CrossRef Weeks MF, Kulka RA, Pierson SA: Optimal call scheduling for a telephone survey. Public Opin Q. 1987, 51: 540-549. 10.1086/269056.CrossRef
30.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3
31.
go back to reference Kline P: An easy guide to factor analysis. 1994, London: Routledge Kline P: An easy guide to factor analysis. 1994, London: Routledge
32.
go back to reference Ware JE, Gandek B: Methods for testing data quality, scaling assumptions and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998, 51: 945-952. 10.1016/S0895-4356(98)00085-7.PubMedCrossRef Ware JE, Gandek B: Methods for testing data quality, scaling assumptions and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998, 51: 945-952. 10.1016/S0895-4356(98)00085-7.PubMedCrossRef
33.
go back to reference Salekin RT, Rogers R, Sewell KW: Construct validity of psychopathy in a female offender sample: a multi-trait multimethod evaluation. J Abnorm Psychol. 1997, 106: 576-585. 10.1037/0021-843X.106.4.576.PubMedCrossRef Salekin RT, Rogers R, Sewell KW: Construct validity of psychopathy in a female offender sample: a multi-trait multimethod evaluation. J Abnorm Psychol. 1997, 106: 576-585. 10.1037/0021-843X.106.4.576.PubMedCrossRef
34.
go back to reference Perreault M, Katerelos TE, Sabourin S, Leichner P, Desmarais J: Information as a distinct dimension for satisfaction assessment of outpatient psychiatric services. Int J Health Care Qual Assur. 2001, 14: 111-120.CrossRef Perreault M, Katerelos TE, Sabourin S, Leichner P, Desmarais J: Information as a distinct dimension for satisfaction assessment of outpatient psychiatric services. Int J Health Care Qual Assur. 2001, 14: 111-120.CrossRef
35.
go back to reference Beattie PF, Pinto MB, Nelson MK, Nelson R: Patient satisfaction with outpatient physical therapy: instrument validation. Phys Ther. 2002, 82: 557-565.PubMedCrossRef Beattie PF, Pinto MB, Nelson MK, Nelson R: Patient satisfaction with outpatient physical therapy: instrument validation. Phys Ther. 2002, 82: 557-565.PubMedCrossRef
36.
go back to reference Westaway MS, Rheeder P, van Zyl DG, Seager JR: Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. Int J Qual Health Care. 2003, 15: 337-344. 10.1093/intqhc/mzg042.PubMedCrossRef Westaway MS, Rheeder P, van Zyl DG, Seager JR: Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. Int J Qual Health Care. 2003, 15: 337-344. 10.1093/intqhc/mzg042.PubMedCrossRef
37.
go back to reference Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.CrossRef Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.CrossRef
38.
go back to reference Helmstadter GC: Principles of psychological measurement. 1964, NewYork: Appleton-Century-Crofts Helmstadter GC: Principles of psychological measurement. 1964, NewYork: Appleton-Century-Crofts
39.
go back to reference McGraw KO, Wong SP: Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996, 1: 30-46. 10.1037/1082-989X.1.1.30.CrossRef McGraw KO, Wong SP: Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996, 1: 30-46. 10.1037/1082-989X.1.1.30.CrossRef
40.
go back to reference Crow R, Gage H, Hapmson S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6. Crow R, Gage H, Hapmson S, Hart J, Kimber A, Storey L, Thomas H: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6.
41.
go back to reference Garratt AM, Bjaertnes OA, Krogstad U, Gulbrandsen P: The outpatient experiences questionnaire (OPEQ): data quality, reliability, and validity in patients attending 52 Norwegian hospitals. Qual Saf Health Care. 2005, 14: 433-437. 10.1136/qshc.2005.014423.PubMedPubMedCentralCrossRef Garratt AM, Bjaertnes OA, Krogstad U, Gulbrandsen P: The outpatient experiences questionnaire (OPEQ): data quality, reliability, and validity in patients attending 52 Norwegian hospitals. Qual Saf Health Care. 2005, 14: 433-437. 10.1136/qshc.2005.014423.PubMedPubMedCentralCrossRef
42.
go back to reference Pouchot J, Trudeau E, Hellot SC, Meric G, Waeckel A, Goguel J: Development and psychometric validation of a new patient satisfaction instrument: the osteoARthritis Treatment Satisfaction (ARTS) questionnaire. Qual Life Res. 2005, 14: 1387-1399. 10.1007/s11136-004-5682-y.PubMedCrossRef Pouchot J, Trudeau E, Hellot SC, Meric G, Waeckel A, Goguel J: Development and psychometric validation of a new patient satisfaction instrument: the osteoARthritis Treatment Satisfaction (ARTS) questionnaire. Qual Life Res. 2005, 14: 1387-1399. 10.1007/s11136-004-5682-y.PubMedCrossRef
43.
go back to reference Bjorner JB, Damsgaard MT, Watt T, Groenvold M: Tests of data quality, scaling assumptions, and reliability of the Danish SF-36. J Clin Epidemiol. 1998, 51: 1001-1011. 10.1016/S0895-4356(98)00092-4.PubMedCrossRef Bjorner JB, Damsgaard MT, Watt T, Groenvold M: Tests of data quality, scaling assumptions, and reliability of the Danish SF-36. J Clin Epidemiol. 1998, 51: 1001-1011. 10.1016/S0895-4356(98)00092-4.PubMedCrossRef
44.
go back to reference Schene AH, Koeter M, Wijngaarden van B, Knudsen HC, Leese M, Ruggeri M, White IR, Vasquez-Barquero JL: Methodology of a multi-site reliability study. EPSILON Study 3. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry. 2000, Suppl 39: 15-20. 10.1192/bjp.177.39.s15.CrossRef Schene AH, Koeter M, Wijngaarden van B, Knudsen HC, Leese M, Ruggeri M, White IR, Vasquez-Barquero JL: Methodology of a multi-site reliability study. EPSILON Study 3. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry. 2000, Suppl 39: 15-20. 10.1192/bjp.177.39.s15.CrossRef
45.
go back to reference Steiger JH: Tests for comparing elements of a correlation matrix. Psychol Bull. 1980, 87: 245-251. 10.1037//0033-2909.87.2.245.CrossRef Steiger JH: Tests for comparing elements of a correlation matrix. Psychol Bull. 1980, 87: 245-251. 10.1037//0033-2909.87.2.245.CrossRef
46.
go back to reference Gonzalez N, Quintana JM, Bilbao A, Escobar A, Aizpuru F, Thompson A, Esteban C, San Sebastian JA, De la Sierra E: Development and validation of an in-patient satisfaction questionnaire. Int J Qual Health Care. 2005, 17: 465-472. 10.1093/intqhc/mzi067.PubMedCrossRef Gonzalez N, Quintana JM, Bilbao A, Escobar A, Aizpuru F, Thompson A, Esteban C, San Sebastian JA, De la Sierra E: Development and validation of an in-patient satisfaction questionnaire. Int J Qual Health Care. 2005, 17: 465-472. 10.1093/intqhc/mzi067.PubMedCrossRef
47.
go back to reference Kepentzis S, Gogosis K, Niakas D: An investigation of patient satisfaction and its determinants: the example of the outpatient clinics of six hospitals located in Attiki. Healthcare services, management and technology: selected papers from the 5th Hellenic Scientific Conference in Healthcare Management. Edited by: Niakas D. 2004, Mediforce: Athens [In Greek] Kepentzis S, Gogosis K, Niakas D: An investigation of patient satisfaction and its determinants: the example of the outpatient clinics of six hospitals located in Attiki. Healthcare services, management and technology: selected papers from the 5th Hellenic Scientific Conference in Healthcare Management. Edited by: Niakas D. 2004, Mediforce: Athens [In Greek]
Metadata
Title
Development and preliminary validation of a Greek-language outpatient satisfaction questionnaire with principal components and multi-trait analyses
Authors
Vassilis H Aletras
Efthemis A Papadopoulos
Dimitris A Niakas
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2006
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-6-66

Other articles of this Issue 1/2006

BMC Health Services Research 1/2006 Go to the issue