Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2010

Open Access 01-12-2010 | Research article

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ)

Authors: Rolf V Olsen, Andrew M Garratt, Hilde H Iversen, Oyvind A Bjertnaes

Published in: BMC Health Services Research | Issue 1/2010

Login to get access

Abstract

Background

The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.

Methods

Two national postal surveys of psychiatric outpatients took place in Norway in 2004 and 2007. The performance of the POPEQ, including item functioning and differential item functioning, was assessed by Rasch analysis. Principal component analysis of item residuals was used to assess the presence of subdimensions.

Results

6,677 (43.3%) and 11,085 (35.2%) psychiatric out patients responded to the questionnaire in 2004 and 2007, respectively. All items in the scale were retained after the Rasch analysis. The resulting scale had reasonably good fit to the Rasch model. The items performed the same for the two survey years and there was no differential item functioning relating to patient characteristics. Principal component analysis of the residuals confirmed that the measure to a high degree is unidimensional. However, the data also reflects three potential subscales, each relating to one of the three included aspects of health care.

Conclusions

The POPEQ had excellent psychometric properties and Rasch analysis further supported the construct validity of the scale by also identifying the three subdimensions originally included as components in the instrument development. The 11-item instrument is recommended in future research on psychiatric out-patient experiences. Future development may lead to the construction of more precise measures of the three subdomains that the POPEQ is based on.
Appendix
Available only for authorised users
Literature
1.
Brook RH, McGlynn EA, Cleary PD: Quality of health care. Part 2: measuring quality of care. N Engl J Med. 1996, 335: 966-970. 10.1056/NEJM199609263351311.CrossRefPubMed
2.
Marshall MN, Shekelle PG, McGlynn EA, Campbell S, Brook RH, Roland MO: Can health care quality indicators be transferred between countries?. Qual Saf Health Care. 2003, 12: 8-12. 10.1136/qhc.12.1.8.CrossRefPubMedPubMedCentral
3.
McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed
4.
Murray CJ, Frenk J: A framework for assessing the performance of health systems. Bull World Health Organ. 2000, 78: 717-731.PubMedPubMedCentral
5.
Kelly E, Hurst J: Health Care Quality Indicators Project: Conceptual framework paper. OECD Health Working Papers 23-2006. 2006, Paris, OECD, full_text. Ref Type: Report
6.
Garratt AM, Danielsen K, Solheim E: National and cross-national surveys of patient experiences: a structured review. 07-2008. 2008, Oslo, Norwegian Knowledge Centre for the Health Services, Ref Type: Report
7.
Giordano LA, Elliott MN, Goldstein E, Lehrman WG, Spencer PA: Development, implementation, and public reporting of the HCAHPS survey. Med Care Res Rev. 2010, 67: 27-37. 10.1177/1077558709341065.CrossRefPubMed
8.
Sitzia J: How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999, 11: 319-328. 10.1093/intqhc/11.4.319.CrossRefPubMed
9.
Sitzia JWN: Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998, 10: 311-317. 10.1093/intqhc/10.4.311.CrossRefPubMed
10.
Hargraves J, Wilson IB, Zaslavsky A, James C, Walker J, Cleary P: Adjusting for patient characteristics when analyzing reports from patients about hospital care. Med Care. 2001, 39: 635-641. 10.1097/00005650-200106000-00011.CrossRefPubMed
11.
O'Malley A, Zaslavsky A, Elliott M, Zaborski L, Cleary P: Case-Mix Adjustment of the CAHPS® Hospital Survey. Health Serv Res. 2005, 40: 2162-2181. 10.1111/j.1475-6773.2005.00470.x.CrossRefPubMedPubMedCentral
12.
Fisher WP, Karabatsos G: Fundamental Measurement for MEPS and CAHPS Quality of Care Scales. Rasch Measurement in Health Sciences. Edited by: Bezruczko N. 2005, Maple Grove: JAM Press, 373-410.
13.
Hahn EA, Cella D: Measuring Patient Satisfaction and Dissatisfaction. Rasch Measurement in Health Sciences. Edited by: Bezruczko N. 2005, Maple Grove: JAM Press, 132-151.
14.
Hays RD, Brown J, Brown LU, Spritzer KL, Crall JJ: Classical test theory and item response theory analyses of multi-item scales assessing parents' perceptions of their children's dental care. Med Care. 2006, 44: S60-S68. 10.1097/01.mlr.0000245144.90229.d0.CrossRefPubMed
15.
Morales LS, Reise SP, Hays RD: Evaluating the Equivalence of Health Care Ratings by Whites and Hispanics. [Article]. Med Care. 2000, 38: 517-527. 10.1097/00005650-200005000-00008.CrossRefPubMedPubMedCentral
16.
Yen M, Edwardson SR: Item-Response Theory Approach in Scale Development. [Miscellaneous Article]. Nurs Res. 1999, 48: 234-238. 10.1097/00006199-199907000-00008.CrossRefPubMed
17.
Scholle SH, Weisman CS, Anderson RT, Camacho F: The development and validation of the primary care satisfaction survey for women. Women's Health Issues. 2004, 14: 35-50. 10.1016/S1049-3867(04)00015-5.CrossRefPubMed
18.
Rasch G: Probabilistic Models for Some Intelligence and Attainment Tests. 1980, Chicago: MESA Press
19.
Garratt A, Bjorngaard JH, Dahle KA, Bjertnaes OA, Saunes IS, Ruud T: The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006, 60: 89-96. 10.1080/08039480600583464.CrossRefPubMed
20.
Groven G, Holmboe O, Helgeland J, Bjertnæs OA, Iversen H: Patient experiences with mental health outpatient clinics for adults. National results in 2007 and development from 2004. 2008, Oslo, Norwegian Knowledge Centre for the Health Services, 5: Ref Type: Report
21.
Attkisson CC, Greenfield TK: The Client Satisfaction Questionnaire-8 and the Service Satisfaction Questionnaire-30. Psychological testing: Treatment planning and outcome assessment. Edited by: Maruish M. 1994, San Francisco: Lawrence Erlbaum Associates, 402-420.
22.
Garratt AM, Andresen Ø, Krogstad U, Gulbrandsen P: The patient satisfaction instrument PasOpp in somatic out-patient clinics (in Norwegian). TidskriftNor Laegeforen. 2005, 125: 424.
23.
Guldvog B, Hofoss D, Pettersen KI: PS-RESKVA (Patient Satisfaction, Results and Quality) - patient satisfaction in hospitals (in Norwegian). Tidsskr Nor Laegeforen. 1998, 118: 386-391.PubMed
24.
Hall JA, Dornan MC: What patients like about their medical care and how often they are asked: A meta-analysis of the satisfaction literature. Sos Sci Med. 1988, 27: 935-939. 10.1016/0277-9536(88)90284-5.CrossRef
25.
Hansson L, Högland E: Patient satisfaction with psychiatric services. The development, reliability, and validity of two patient satisfaction questionnaires for use in inpatient and outpatient settings. Nord J Psychiatry. 1995, 49: 257-262. 10.3109/08039489509011915.CrossRef
26.
Pettersen KI, Veenstra M, Guldvog B, Kolstad A: The Patient Experiences Questionnaire: development, validity and reliability. Int J Qual Health Care. 2004, 16: 453-463. 10.1093/intqhc/mzh074.CrossRefPubMed
27.
Ruggeri M, Dall'angola R, Bisoffo G: Factor analysis of the Verona Service Satisfaction Scale-82 and development of reduced versions. Int J Meth Psychiat Res. 1996, 6: 23-38. 10.1002/(SICI)1234-988X(199604)6:1<23::AID-MPR147>3.3.CO;2-D.CrossRef
28.
Tennant A, Conaghan PG: The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper?. Arthritis Rheum. 2007, 57: 1358-1362. 10.1002/art.23108.CrossRefPubMed
29.
Rasch Measurement in Health Sciences. 2005, Maple Grove: JAM Press, --- Either first page or author must be supplied..
30.
31.
Masters GN: A Rasch model for partial credit scoring. Psychometrica. 1982, 47: 149-174. 10.1007/BF02296272.CrossRef
32.
Ostini R: Polytomous item response theory models. 2006, Thousand Oaks, Calif.: Sage PublicationsCrossRef
33.
Andrich D: Item Discrimination and Rasch-Andrich Thresholds Revisited. Rasch Measurement Transactions. 2006, 20: 1055-1057.
34.
Linacre JM: Winsteps Rasch Measurement version 3.69.1.16. 2010, --- Either ISSN or Journal title must be supplied.. Ref Type: Computer Program
35.
Linacre JM: What do Infit and Outfit, Mean-square and Standardized mean?. Rasch Measurement Transactions. 2002, 16: 878.
36.
Tristan A: An Adjustment for Sample Size in DIF Analysis. Rasch Measurement Transactions. 2006, 20: 1070-1071.
37.
Hagquist C, Andrich D: Is the Sense of Coherence-instrument applicable on adolescents? A latent trait analysis using Rasch-modelling. Personality and Individual Differences. 2004, 36: 955-968. 10.1016/S0191-8869(03)00164-8.CrossRef
38.
Hagquist C, Bruce M, Gustavsson JP: Using the Rasch model in nursing research: an introduction and illustrative example. Int J Nurs Stud. 2009, 46: 380-393. 10.1016/j.ijnurstu.2008.10.007.CrossRefPubMed
39.
Andrich D, Lyne A, Sheridan B, Luo G: RUMM 2020. 2003, Perth, RUMM Laboratory, Ref Type: Computer Program
40.
Wright BD: Local dependency, correlations and principal components. Rasch Measurement Transactions. 2009, 10: 509-511.
41.
Tennant A, Pallant JF: Unidimensionality Matters! (A Tale of Two Smiths?). Rasch Measurement Transactions. 2006, 20: 1048-1051.
42.
Smith EV: Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. J Appl Meas. 2002, 3: 205-231.PubMed
43.
Faber M, Bosch M, Wollersheim H, Leatherman S, Grol R: Public reporting in health care: how do consumers use quality-of-care information? A systematic review. Med Care. 2009, 47: 1-8. 10.1097/MLR.0b013e3181808bb5.CrossRefPubMed
44.
Peters E, Dieckmann N, Dixon A, Hibbard JH, Mertz CK: Less is more in presenting quality information to consumers. Med Care Res Rev. 2010, 64: 169-190. 10.1177/10775587070640020301.CrossRef
45.
Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T: Patients' experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002, 11: 335-339. 10.1136/qhc.11.4.335.CrossRefPubMedPubMedCentral
Metadata
Title
Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ)
Authors
Rolf V Olsen
Andrew M Garratt
Hilde H Iversen
Oyvind A Bjertnaes
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2010
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-10-282

Other articles of this Issue 1/2010

BMC Health Services Research 1/2010 Go to the issue

Research article

Patient safety in surgical environments: Cross-countries comparison of psychometric properties and results of the Norwegian version of the Hospital Survey on Patient Safety

Correspondence

Integrative care for the management of low back pain: use of a clinical care pathway

Research article

"Done more for me in a fortnight than anybody done in all me life." How welfare rights advice can help people with cancer

Research article

Effectiveness of maternal referral system in a rural setting: a case study from Rufiji district, Tanzania

Research article

Prioritisation criteria for the selection of new diagnostic technologies for evaluation

Research article

The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: a systematic review