Skip to main content
Top
Published in: BMC Health Services Research 1/2011

Open Access 01-12-2011 | Research article

The Generic Short Patient Experiences Questionnaire (GS-PEQ): identification of core items from a survey in Norway

Authors: Ingeborg Strømseng Sjetne, Oyvind A Bjertnaes, Rolf Vegar Olsen, Hilde Hestad Iversen, Geir Bukholm

Published in: BMC Health Services Research | Issue 1/2011

Login to get access

Abstract

Background

Questionnaires are commonly used to collect patient, or user, experiences with health care encounters; however, their adaption to specific target groups limits comparison between groups. We present the construction of a generic questionnaire (maximum of ten questions) for user evaluation across a range of health care services.

Methods

Based on previous testing of six group-specific questionnaires, we first constructed a generic questionnaire with 23 items related to user experiences. All questions included a "not applicable" response option, as well as a follow-up question about the item's importance. Nine user groups from one health trust were surveyed. Seven groups received questionnaires by mail and two by personal distribution. Selection of core questions was based on three criteria: applicability (proportion "not applicable"), importance (mean scores on follow-up questions), and comprehensiveness (content coverage, maximum two items per dimension).

Results

1324 questionnaires were returned providing subsample sizes ranging from 52 to 323. Ten questions were excluded because the proportion of "not applicable" responses exceeded 20% in at least one user group. The number of remaining items was reduced to ten by applying the two other criteria. The final short questionnaire included items on outcome (2), clinician services (2), user involvement (2), incorrect treatment (1), information (1), organisation (1), and accessibility (1).

Conclusion

The Generic Short Patient Experiences Questionnaire (GS-PEQ) is a short, generic set of questions on user experiences with specialist health care that covers important topics for a range of groups. It can be used alone or with other instruments in quality assessment or in research. The psychometric properties and the relevance of the GS-PEQ in other health care settings and countries need further evaluation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Garratt AM, Solheim E, Danielsen K: National and cross-national surveys of patient experiences: a structured review. 2008, Oslo, The Norwegian Knowledge Centre for the Health Services, Report from the Knowledge Centre no 07-2008 Garratt AM, Solheim E, Danielsen K: National and cross-national surveys of patient experiences: a structured review. 2008, Oslo, The Norwegian Knowledge Centre for the Health Services, Report from the Knowledge Centre no 07-2008
2.
go back to reference Valentine N, Darby C, Bonsel GJ: Which aspects of non-clinical quality of care are most important? Results from WHO's general population surveys of "health systems responsiveness" in 41 countries. Soc Sci Med. 2008, 66: 1939-1950. 10.1016/j.socscimed.2007.12.002.CrossRefPubMed Valentine N, Darby C, Bonsel GJ: Which aspects of non-clinical quality of care are most important? Results from WHO's general population surveys of "health systems responsiveness" in 41 countries. Soc Sci Med. 2008, 66: 1939-1950. 10.1016/j.socscimed.2007.12.002.CrossRefPubMed
3.
go back to reference Giordano LA, Elliott MN, Goldstein E, Lehrman WG, Spencer PA: Development, implementation, and public reporting of the HCAHPS survey. Med Care Res Rev. 2010, 67: 27-37. 10.1177/1077558709341065.CrossRefPubMed Giordano LA, Elliott MN, Goldstein E, Lehrman WG, Spencer PA: Development, implementation, and public reporting of the HCAHPS survey. Med Care Res Rev. 2010, 67: 27-37. 10.1177/1077558709341065.CrossRefPubMed
4.
go back to reference Paddock LE, Veloski J, Chatterton ML, Gevirtz FO, Nash DB: Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management. Diabetes Care. 2000, 23: 951-956. 10.2337/diacare.23.7.951.CrossRefPubMed Paddock LE, Veloski J, Chatterton ML, Gevirtz FO, Nash DB: Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management. Diabetes Care. 2000, 23: 951-956. 10.2337/diacare.23.7.951.CrossRefPubMed
5.
go back to reference Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys?. Int J Qual Health Care. 2001, 13: 463-468. 10.1093/intqhc/13.6.463.CrossRefPubMed Draper M, Cohen P, Buchan H: Seeking consumer views: what use are results of hospital patient satisfaction surveys?. Int J Qual Health Care. 2001, 13: 463-468. 10.1093/intqhc/13.6.463.CrossRefPubMed
6.
go back to reference Kosinski M, Bayliss MS, Bjorner JB, Ware JE, Garber WH, Batenhorst A, et al: A six-item short-form survey for measuring headache impact: the HIT-6. Qual Life Res. 2003, 12: 963-974. 10.1023/A:1026119331193.CrossRefPubMed Kosinski M, Bayliss MS, Bjorner JB, Ware JE, Garber WH, Batenhorst A, et al: A six-item short-form survey for measuring headache impact: the HIT-6. Qual Life Res. 2003, 12: 963-974. 10.1023/A:1026119331193.CrossRefPubMed
7.
go back to reference Ware J, Kosinski M, Dewey JE, Gandek B: How to Score and Interpret Single-Item Health Status Measures: A Manual for Users of the SF-8 ™ Health Survey. 2001, Lincoln, RI: QualityMetric Incorporated Ware J, Kosinski M, Dewey JE, Gandek B: How to Score and Interpret Single-Item Health Status Measures: A Manual for Users of the SF-8 ™ Health Survey. 2001, Lincoln, RI: QualityMetric Incorporated
9.
go back to reference Wilde LB, Larsson G: Development of a short form of the Quality from the Patient's Perspective (QPP) questionnaire. J Clin Nurs. 2002, 11: 681-687. 10.1046/j.1365-2702.2002.00640.x.CrossRef Wilde LB, Larsson G: Development of a short form of the Quality from the Patient's Perspective (QPP) questionnaire. J Clin Nurs. 2002, 11: 681-687. 10.1046/j.1365-2702.2002.00640.x.CrossRef
10.
go back to reference Darby C, Valentine N, Murray CJL, de Silva A: World Health Organisation (WHO): strategy for the measurement of responsiveness. 2000, Geneva, World Health Organisation. Global Programme on Evidence for Health Policy Discussion Paper Series, No. 23 Darby C, Valentine N, Murray CJL, de Silva A: World Health Organisation (WHO): strategy for the measurement of responsiveness. 2000, Geneva, World Health Organisation. Global Programme on Evidence for Health Policy Discussion Paper Series, No. 23
11.
go back to reference Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al: Increasing response rates to postal questionnaires: systematic review. BMJ. 2002, 324: 1183-10.1136/bmj.324.7347.1183.CrossRefPubMedPubMedCentral Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al: Increasing response rates to postal questionnaires: systematic review. BMJ. 2002, 324: 1183-10.1136/bmj.324.7347.1183.CrossRefPubMedPubMedCentral
12.
go back to reference Pettersen KI, Veenstra M, Guldvog B, Kolstad A: The Patient Experiences Questionnaire: development, validity and reliability. Int J Qual Health Care. 2004, 16: 453-463. 10.1093/intqhc/mzh074.CrossRefPubMed Pettersen KI, Veenstra M, Guldvog B, Kolstad A: The Patient Experiences Questionnaire: development, validity and reliability. Int J Qual Health Care. 2004, 16: 453-463. 10.1093/intqhc/mzh074.CrossRefPubMed
13.
go back to reference Oltedal S, Garratt A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M: The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Public Health. 2007, 35: 540-547. 10.1080/14034940701291724.CrossRefPubMed Oltedal S, Garratt A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M: The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Public Health. 2007, 35: 540-547. 10.1080/14034940701291724.CrossRefPubMed
14.
go back to reference Garratt A, Bjertnaes O, Krogstad U, Gulbrandsen P: The OutPatient Experiences Questionnaire (OPEQ): data quality, reliability, and validity in patients attending 52 Norwegian hospitals. Qual Saf Health Care. 2005, 14: 433-437. 10.1136/qshc.2005.014423.CrossRefPubMedPubMedCentral Garratt A, Bjertnaes O, Krogstad U, Gulbrandsen P: The OutPatient Experiences Questionnaire (OPEQ): data quality, reliability, and validity in patients attending 52 Norwegian hospitals. Qual Saf Health Care. 2005, 14: 433-437. 10.1136/qshc.2005.014423.CrossRefPubMedPubMedCentral
15.
go back to reference Garratt A, Danielsen K, Bjertnaes O, Ruud T: PasOpp - en metode for å måle brukererfaringer i psykisk helsevern [PIPEQ--a method for measurement of user satisfaction in mental health services]. Tidsskr Nor Laegeforen. 2006, 126: 1478-1480.PubMed Garratt A, Danielsen K, Bjertnaes O, Ruud T: PasOpp - en metode for å måle brukererfaringer i psykisk helsevern [PIPEQ--a method for measurement of user satisfaction in mental health services]. Tidsskr Nor Laegeforen. 2006, 126: 1478-1480.PubMed
16.
go back to reference Garratt A, Bjorngaard JH, Dahle KA, Bjertnaes OA, Saunes IS, Ruud T: The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006, 60: 89-96. 10.1080/08039480600583464.CrossRefPubMed Garratt A, Bjorngaard JH, Dahle KA, Bjertnaes OA, Saunes IS, Ruud T: The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006, 60: 89-96. 10.1080/08039480600583464.CrossRefPubMed
17.
go back to reference Garratt A, Bjertnaes O, Barlinn J: Parent experiences of paediatric care (PEPC) questionnaire: reliability and validity following a national survey. Acta Paediatr. 2007, 96: 246-252.CrossRefPubMed Garratt A, Bjertnaes O, Barlinn J: Parent experiences of paediatric care (PEPC) questionnaire: reliability and validity following a national survey. Acta Paediatr. 2007, 96: 246-252.CrossRefPubMed
18.
go back to reference Bjertnaes O, Garratt A, Helgeland J, Holmboe O, Dahle KA, Hanssen-Bauer K, et al: Foresattes vurdering av barne- og ungdomspsykiatriske poliklinikker [Parent assessment of outpatient child and adolescent mental health services for children and adolescents). Tidsskr Nor Laegeforen. 2008, 128: 1041-1045.PubMed Bjertnaes O, Garratt A, Helgeland J, Holmboe O, Dahle KA, Hanssen-Bauer K, et al: Foresattes vurdering av barne- og ungdomspsykiatriske poliklinikker [Parent assessment of outpatient child and adolescent mental health services for children and adolescents). Tidsskr Nor Laegeforen. 2008, 128: 1041-1045.PubMed
19.
go back to reference Oltedal S, Helgeland J, Garratt A: Pasienters erfaringer med døgnenheter ved somatiske sykehus. Metodedokumentasjon for nasjonal undersøkelse i 2006 [Inpatient experiences in somatic hospitals. Documentation of methods used in the national survey in 2006]. 2007, Oslo, The Norwegian Knowledge Centre for the Health Services, PasOpp-rapport Nr.2 Oltedal S, Helgeland J, Garratt A: Pasienters erfaringer med døgnenheter ved somatiske sykehus. Metodedokumentasjon for nasjonal undersøkelse i 2006 [Inpatient experiences in somatic hospitals. Documentation of methods used in the national survey in 2006]. 2007, Oslo, The Norwegian Knowledge Centre for the Health Services, PasOpp-rapport Nr.2
20.
go back to reference Garratt AM, Helgeland J, Gulbrandsen P: Five-point scales outperform 10-point scales in a randomized comparison of item scaling for the Patient Experiences Questionnaire. J Clin Epidemiol. 2010 Garratt AM, Helgeland J, Gulbrandsen P: Five-point scales outperform 10-point scales in a randomized comparison of item scaling for the Patient Experiences Questionnaire. J Clin Epidemiol. 2010
21.
go back to reference Nathorst-Boos J, Munck IM, Eckerlund I, Ekfeldt-Sandberg C: An evaluation of the QSP and the QPP: two methods for measuring patient satisfaction. Int J Qual Health Care. 2001, 13: 257-264. 10.1093/intqhc/13.3.257.CrossRefPubMed Nathorst-Boos J, Munck IM, Eckerlund I, Ekfeldt-Sandberg C: An evaluation of the QSP and the QPP: two methods for measuring patient satisfaction. Int J Qual Health Care. 2001, 13: 257-264. 10.1093/intqhc/13.3.257.CrossRefPubMed
22.
go back to reference Danielsen K, Garratt A, Kornør H: Måling av brukererfaringer med avhengighetsbehandling: En litteraturgjennomgang av validerte måleinstrumenter [The measurement of patient experiences in alchohol and substance dependency treatment. A literature review of validated measurement tools]. 2007, Oslo, The Norwegian Knowledge Centre for the Health Services Danielsen K, Garratt A, Kornør H: Måling av brukererfaringer med avhengighetsbehandling: En litteraturgjennomgang av validerte måleinstrumenter [The measurement of patient experiences in alchohol and substance dependency treatment. A literature review of validated measurement tools]. 2007, Oslo, The Norwegian Knowledge Centre for the Health Services
23.
go back to reference Valentine N, Prasad A, Rice N, Robone S, Chatterji S: Health systems responsiveness: a measure of the acceptability of health-care processes and systems from the user's perspective. Performance Measurement for Health System Improvement. Edited by: Smith, PC., Mossialos E, Papanicolas I, Leatherman Se. 2009, Cambridge: Cambridge University Press, 138-186. Valentine N, Prasad A, Rice N, Robone S, Chatterji S: Health systems responsiveness: a measure of the acceptability of health-care processes and systems from the user's perspective. Performance Measurement for Health System Improvement. Edited by: Smith, PC., Mossialos E, Papanicolas I, Leatherman Se. 2009, Cambridge: Cambridge University Press, 138-186.
24.
go back to reference Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-74.PubMed Fitzpatrick R, Davey C, Buxton MJ, Jones DR: Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998, 2: i-74.PubMed
25.
go back to reference Fitzpatrick R: Measurement issues in health-related quality of life: Challenges for health psychology. Psychol Health. 2000, 15: 99-108. 10.1080/08870440008400291.CrossRef Fitzpatrick R: Measurement issues in health-related quality of life: Challenges for health psychology. Psychol Health. 2000, 15: 99-108. 10.1080/08870440008400291.CrossRef
26.
go back to reference McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed
27.
go back to reference Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: Mc-Graw Hill, 3 Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: Mc-Graw Hill, 3
28.
go back to reference Vogt DS, King DW, King LA: Focus groups in psychological assessment: enhancing content validity by consulting members of the target population. Psychol Assess. 2004, 16: 231-243.CrossRefPubMed Vogt DS, King DW, King LA: Focus groups in psychological assessment: enhancing content validity by consulting members of the target population. Psychol Assess. 2004, 16: 231-243.CrossRefPubMed
30.
go back to reference Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45: 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRefPubMed Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45: 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRefPubMed
31.
go back to reference Smith GT, McCarthy DM, Anderson KG: On the sins of short-form development. Psychol Assess. 2000, 12: 102-111.CrossRefPubMed Smith GT, McCarthy DM, Anderson KG: On the sins of short-form development. Psychol Assess. 2000, 12: 102-111.CrossRefPubMed
32.
go back to reference Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14: 236-249.PubMed Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14: 236-249.PubMed
33.
go back to reference de Boer D, Delnoij D, Rademakers J: Do patient experiences on priority aspects of health care predict their global rating of quality of care? A study in five patient groups. Health Expect. 2010 de Boer D, Delnoij D, Rademakers J: Do patient experiences on priority aspects of health care predict their global rating of quality of care? A study in five patient groups. Health Expect. 2010
34.
go back to reference Reeves R, Seccombe I: Do patient surveys work? The influence of a national survey programme on local quality-improvement initiatives. Qual Saf Health Care. 2008, 17: 437-441. 10.1136/qshc.2007.022749.CrossRefPubMedPubMedCentral Reeves R, Seccombe I: Do patient surveys work? The influence of a national survey programme on local quality-improvement initiatives. Qual Saf Health Care. 2008, 17: 437-441. 10.1136/qshc.2007.022749.CrossRefPubMedPubMedCentral
35.
go back to reference Peytremann-Bridevaux I, Scherer F, Peer L, Cathieni F, Bonsack C, Clθopas A, et al: Satisfaction of patients hospitalised in psychiatric hospitals: a randomised comparison of two psychiatric-specific and one generic satisfaction questionnaires. BMC Health Serv Res. 2006, 6: 108-10.1186/1472-6963-6-108.CrossRefPubMedPubMedCentral Peytremann-Bridevaux I, Scherer F, Peer L, Cathieni F, Bonsack C, Clθopas A, et al: Satisfaction of patients hospitalised in psychiatric hospitals: a randomised comparison of two psychiatric-specific and one generic satisfaction questionnaires. BMC Health Serv Res. 2006, 6: 108-10.1186/1472-6963-6-108.CrossRefPubMedPubMedCentral
36.
go back to reference Asch DA, Jedrziewski MK, Christakis NA: Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRefPubMed Asch DA, Jedrziewski MK, Christakis NA: Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997, 50: 1129-1136. 10.1016/S0895-4356(97)00126-1.CrossRefPubMed
37.
go back to reference Lasek RJ, Barkley W, Harper DL, Rosenthal GE: An evaluation of the impact of nonresponse bias on patient satisfaction surveys. Med Care. 1997, 35: 646-652. 10.1097/00005650-199706000-00009.CrossRefPubMed Lasek RJ, Barkley W, Harper DL, Rosenthal GE: An evaluation of the impact of nonresponse bias on patient satisfaction surveys. Med Care. 1997, 35: 646-652. 10.1097/00005650-199706000-00009.CrossRefPubMed
38.
go back to reference Guldvog B, Hofoss D, Pettersen KI, Ebbesen J, Ronning OM: PS-RESKVA -pasienttilfredshet i sykehus [PS-RESKVA -patient satisfaction in hospitals]. Tidsskr Nor Laegeforen. 1998, 118: 386-391.PubMed Guldvog B, Hofoss D, Pettersen KI, Ebbesen J, Ronning OM: PS-RESKVA -pasienttilfredshet i sykehus [PS-RESKVA -patient satisfaction in hospitals]. Tidsskr Nor Laegeforen. 1998, 118: 386-391.PubMed
39.
go back to reference Dahle KA, Iversen H, Sjetne IS, Oltedal S: Do non-respondents' characteristics and experiences differ from those of respondents? Poster at the the 25th International Conference by the Society for Quality in Health Care (ISQua). 2008, Copenhagen Dahle KA, Iversen H, Sjetne IS, Oltedal S: Do non-respondents' characteristics and experiences differ from those of respondents? Poster at the the 25th International Conference by the Society for Quality in Health Care (ISQua). 2008, Copenhagen
40.
go back to reference Iversen H, Dahle KA, Holmboe O: Using telephone interviews to explore potential non-response bias in a national postal survey. Poster at the the 26th International Conference by the Society for Quality in Health Care (ISQua). 2009, Dublin Iversen H, Dahle KA, Holmboe O: Using telephone interviews to explore potential non-response bias in a national postal survey. Poster at the the 26th International Conference by the Society for Quality in Health Care (ISQua). 2009, Dublin
41.
go back to reference Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6: 1-244. 10.1007/978-94-010-0481-7_1.CrossRefPubMed Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al: The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002, 6: 1-244. 10.1007/978-94-010-0481-7_1.CrossRefPubMed
42.
go back to reference Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2003, Oxford: Oxford University Press, 3 Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2003, Oxford: Oxford University Press, 3
43.
go back to reference Rahmqvist M: Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Health Care. 2001, 13: 385-390. 10.1093/intqhc/13.5.385.CrossRefPubMed Rahmqvist M: Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Health Care. 2001, 13: 385-390. 10.1093/intqhc/13.5.385.CrossRefPubMed
Metadata
Title
The Generic Short Patient Experiences Questionnaire (GS-PEQ): identification of core items from a survey in Norway
Authors
Ingeborg Strømseng Sjetne
Oyvind A Bjertnaes
Rolf Vegar Olsen
Hilde Hestad Iversen
Geir Bukholm
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2011
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-88

Other articles of this Issue 1/2011

BMC Health Services Research 1/2011 Go to the issue