Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
BMC Psychiatry
Published in: BMC Psychiatry 1/2015

Open Access 01-12-2015 | Research article

PIPEQ-OS – an instrument for on-site measurements of the experiences of inpatients at psychiatric institutions

Authors: Oyvind Bjertnaes, Hilde Hestad Iversen, Johanne Kjollesdal

Published in: BMC Psychiatry | Issue 1/2015

Login to get access

Abstract

Background

The Psychiatric Inpatient Patient Experience Questionnaire (PIPEQ) was developed for post-discharge measurements of experiences, but the low response rates associated with post-discharge surveys restrict their usefulness. A new questionnaire was developed based on the PIPEQ for on-site measurements of patient experiences: the PIPEQ-OS. The aim of this study was to psychometrically test the PIPEQ-OS using data from a nationally representative survey conducted in Norway in 2014.

Methods

Data were collected using a nationally representative patient-experience survey; 25 % of the institutions in each of the 4 health regions in Norway were randomly selected, yielding a total of 26 institutions. The PIPEQ-OS questionnaire was completed by patients on-site on an agreed day in week 37 of 2014. Item missing and ceiling effects were assessed, and factor analysis was used to assess the structure of the items included in the PIPEQ-OS. The scales were tested for internal consistency reliability, test–retest reliability and construct validity.

Results

The initial sample comprised 857 patients. Of these, 60 were excluded for ethical reasons and 57 were excluded because they were absent on the day of the survey. Of the remaining 740 patients, 552 (74.6 % of the included population) returned the questionnaire. Low levels of missing or “not applicable” responses were found for 18 of the 21 items (<20 %), and 20 of 21 items were below the ceiling-effect criterion. Psychometric testing identified three scales: structure and facilities (six items), patient-centred interaction (six items) and outcomes (five items). All scales met the criterion of 0.7 for Cronbach’s alpha (range: 0.79–0.91) and test–retest reliability (range: 0.83–0.84). The construct validity of the scales was supported by 14 of 15 significant associations with variables known to be related to psychiatric inpatient experiences.

Conclusions

The PIPEQ-OS comprises three scales with satisfactory internal consistency reliability and construct validity. This instrument can be used for on-site assessments of psychiatric inpatient patient experiences, but further research is needed to evaluate its usefulness as basis for external quality indicators.
Literature
1.
Valentine N, Darby C, Bonsel GJ. Which aspects of non-clinical quality of care are most important? Results from WHO’s general population surveys of “health systems responsiveness” in 41 countries. Soc Sci Med. 2008;66(9):1939–50.CrossRefPubMed
2.
Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD Health Care Quality Indicators Project. Int J Qual Health Care. 2006;18 Suppl 1:5–13.CrossRefPubMed
3.
Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3(1):e001570.CrossRefPubMedPubMedCentral
4.
Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002;6(32):1–244.CrossRefPubMed
5.
Garratt AM, Solheim E, Danielsen K. National and Cross-National Surveys of Patient Experiences: A Structured Review. In: Rapport: Nasjonalt kunnskapssenter for helsetjenesten. 2008.
6.
Ruggeri M. Patients’ and relatives’ satisfaction with psychiatric services: the state of the art of its measurement. Soc Psychiatry Psychiatr Epidemiol. 1994;29(5):212–27.CrossRefPubMed
7.
Lebow JL. Research assessing consumer satisfaction with mental health treatment: a review of findings. Eval Program Plann. 1983;6(3–4):211–36.CrossRefPubMed
8.
Powell RA, Holloway F, Lee J, Sitzia J. Satisfaction research and the uncrowned king: challenges and future directions. J Ment Health. 2004;13(1):11–20.CrossRef
9.
Boyer L, Baumstarck-Barrau K, Cano N, Zendjidjian X, Belzeaux R, Limousin S, et al. Assessment of psychiatric inpatient satisfaction: a systematic review of self-reported instruments. Eur Psychiatry. 2009;24(8):540–9.CrossRefPubMed
10.
Madan A, Fowler JC, Allen JG, Ellis TE, Hardesty S, Groat M, et al. Assessing and addressing patient satisfaction in a longer-term inpatient psychiatric hospital: preliminary findings on the Menninger Quality of Care measure and methodology. Qual Manag Health Care. 2014;23(3):178–87.CrossRefPubMed
11.
Zendjidjian XY, Auquier P, Lançon C, Loundou A, Parola N, Faugère M, et al. The SATISPSY-22: Development and validation of a French hospitalized patients’ satisfaction questionnaire in psychiatry. Eur Psychiatry. 2015;30(1):172–8.CrossRefPubMed
12.
Richardson M, Katsakou C, Torres-González F, Onchev G, Kallert T, Priebe S. Factorial validity and measurement equivalence of the Client Assessment of Treatment Scale for psychiatric inpatient care - a study in three European countries. Psychiatry Res. 2011;188(1):156–60.CrossRefPubMed
13.
Evans J, Rose D, Flach C, Csipke E, Glossop H, McCrone P, et al. VOICE: developing a new measure of service users’ perceptions of inpatient care, using a participatory methodology. J Ment Health. 2012;21(1):57–71.CrossRefPubMedPubMedCentral
14.
Sitzia J. How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999;11(4):319–28.CrossRefPubMed
15.
Garratt A, Danielsen K, Bjertnaes ØA, Ruud T. PIPEQ--a method for measurement of user satisfaction in mental health services. Tidsskr Nor Laegeforen. 2006;126(11):1478–80.PubMed
16.
Bjertnaes ØA, Garratt A, Johannessen JO. Data collection methods and results in user surveys in mental health care. Tidsskr Nor Laegeforen. 2006;126(11):1481–3.PubMed
17.
Dahle KA, Holmboe O, Helgeland J. Brukererfaringer med døgnenheter i psykisk helsevern - Resultater og vurderinger etter en nasjonal undersøkelse i 2005. In: Rapport: Nasjonalt kunnskapssenter for helsetjenesten. 2006.
18.
Sjetne IS, Bjertnaes OA, Olsen RV, Iversen HH, Bukholm G. The Generic Short Patient Experiences Questionnaire (GS-PEQ): identification of core items from a survey in Norway. BMC Health Serv Res. 2011;11:88.CrossRefPubMedPubMedCentral
19.
Groves RM. Nonresponse rates and nonresponse bias in household surveys. Public Opin Q. 2006;70(5):646–75.CrossRef
20.
Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008.PubMed
21.
Sitzia J, Wood N. Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998;10(4):311–7.CrossRefPubMed
22.
Howie JG, Heaney DJ, Maxwell M, Walker JJ. A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998;15(2):165–71.CrossRefPubMed
23.
Haugum M, Iversen HH. Pasienterfaringer med døgnopphold innen tverrfaglig spesialisert rusbehandling – resultater etter en nasjonal undersøkelse i 2014. In: Rapport: Nasjonalt kunnskapssenter for helsetjenesten. 2014.
24.
Hamilton LC. Regression With Graphics: A Second Course in Applied Statistics. In: Pacific Grove, Calif.: Brooks/Cole. 1992.
25.
Bjertnaes OA, Lyngstad I, Malterud K, Garratt A. The Norwegian EUROPEP questionnaire for patient evaluation of general practice: data quality, reliability and construct validity. Fam Pract. 2011;28(3):342–9.CrossRefPubMed
26.
Ruiz MA, Pardo A, Rejas J, Soto J, Villasante F, Aranguren JL. Development and validation of the “Treatment Satisfaction with Medicines Questionnaire” (SATMED-Q). Value Health. 2008;11(5):913–26.CrossRefPubMed
27.
Nunnally JC, Bernstein IH. Psychometric Theory. 3rd edn. McGraw-Hill Series in Psychology. New York: McGraw-Hill; 1994.
28.
Smith D, Roche E, O’Loughlin K, Brennan D, Madigan K, Lyne J, et al. Satisfaction with services following voluntary and involuntary admission. J Ment Health. 2014;23(1):38–45.CrossRefPubMed
29.
Katsakou C, Bowers L, Amos T, Morriss R, Rose D, Wykes T, et al. Coercion and treatment satisfaction among involuntary patients. Psychiatr Serv. 2010;61(3):286–92.CrossRefPubMed
30.
Parker G, Paterson A, Fletcher K, McClure G, Berk M. Construct validity of the Experiences of Therapy Questionnaire (ETQ). BMC Psychiatry. 2014;14:369.CrossRefPubMedPubMedCentral
31.
Bjertnaes OA, Sjetne IS, Iversen HH. Overall patient satisfaction with hospitals: effects of patient-reported experiences and fulfilment of expectations. BMJ Qual Saf. 2012;21(1):39–46.CrossRefPubMed
32.
Bjertnaes OA. The association between survey timing and patient-reported experiences with hospitals: results of a national postal survey. BMC Med Res Methodol. 2012;12:13.CrossRefPubMedPubMedCentral
33.
Bjertnaes O. Patient-reported experiences with hospitals: comparison of proxy and patient scores using propensity-score matching. Int J Qual Health Care. 2014;26(1):34–40.CrossRefPubMed
34.
Garratt AM, Helgeland J, Gulbrandsen P. Five-point scales outperform 10-point scales in a randomized comparison of item scaling for the Patient Experiences Questionnaire. J Clin Epidemiol. 2011;64(2):200–7.CrossRefPubMed
35.
Iversen HH, Holmboe O, Bjertnaes OA. The Cancer Patient Experiences Questionnaire (CPEQ): reliability and construct validity following a national survey to assess hospital cancer care from the patient perspective. BMJ Open. 2012;2:5.CrossRef
36.
Garratt AM, Bjertnaes OA, Holmboe O, Hanssen-Bauer K. Parent experiences questionnaire for outpatient child and adolescent mental health services (PEQ-CAMHS Outpatients): reliability and validity following a national survey. Child Adolesc Psychiatry Ment Health. 2011;5:18.CrossRefPubMedPubMedCentral
37.
Bjertnaes O, Skudal KE, Iversen HH, Lindahl AK. The Patient-Reported Incident in Hospital Instrument (PRIH-I): assessments of data quality, test-retest reliability and hospital-level reliability. BMJ Qual Saf. 2013;22(9):743–51.CrossRefPubMedPubMedCentral
38.
Donabedian A. The quality of care. How can it be assessed? 1988. Arch Pathol Lab Med. 1997;121(11):1145–50.PubMed
39.
Gerteis M, Edgman-Levitan S, Daley J, Delbanco TL. Through the Patient’s Eyes: Understanding and Promoting Patient-Centered Care. 1st edn. The Jossey-Bass Health Series. San Francisco: Jossey-Bass; 1993.
40.
Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2(14). i–iv, 1–74.
41.
Hayhurst KP, Massie JA, Dunn G, Lewis SW, Drake RJ. Validity of subjective versus objective quality of life assessment in people with schizophrenia. BMC Psychiatry. 2014;14:365.CrossRefPubMedPubMedCentral
42.
Baiano M, Salvo P, Righetti P, Cereser L, Baldissera E, Camponogara I, et al. Exploring health-related quality of life in eating disorders by a cross-sectional study and a comprehensive review. BMC Psychiatry. 2014;14:165.CrossRefPubMedPubMedCentral
43.
Haugum M, Danielsen K, Iversen HH, Bjertnaes O. The use of data from national and other large-scale user experience surveys in local quality work: a systematic review. Int J Qual Health Care. 2014;6(6):592–605.CrossRef
44.
Davies E, Cleary PD. Hearing the patient’s voice? Factors affecting the use of patient survey data in quality improvement. Qual Saf Health Care. 2005;14(6):428–32.CrossRefPubMedPubMedCentral
45.
Anastario MP, Rodriguez HP, Gallagher PM, Cleary PD, Shaller D, Rogers WH, et al. A randomized trial comparing mail versus in-office distribution of the CAHPS Clinician and Group Survey. Health Serv Res. 2010;45(5 Pt 1):1345–59.CrossRefPubMedPubMedCentral
46.
Burroughs TE, Waterman BM, Gilin D, Adams D, McCollegan J, Cira J. Do on-site patient satisfaction surveys bias results? Jt Comm J Qual Patient Saf. 2005;31(3):158–66.PubMed
47.
Gribble RK, Haupt C. Quantitative and qualitative differences between handout and mailed patient satisfaction surveys. Med Care. 2005;43(3):276–81.CrossRefPubMed
48.
Lin OS, Schembre DB, Ayub K, Gluck M, McCormick SE, Patterson DJ, et al. Patient satisfaction scores for endoscopic procedures: impact of a survey-collection method. Gastrointest Endosc. 2007;65(6):775–81.CrossRefPubMed
Metadata
Title
PIPEQ-OS – an instrument for on-site measurements of the experiences of inpatients at psychiatric institutions
Authors
Oyvind Bjertnaes
Hilde Hestad Iversen
Johanne Kjollesdal
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2015
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-015-0621-8

Other articles of this Issue 1/2015

BMC Psychiatry 1/2015 Go to the issue

Research article

Sertraline plus deanxit to treat patients with depression and anxiety in chronic somatic diseases: a randomized controlled trial

Research article

Prevalence and factors associated with Posttraumatic Stress Disorder seven years after the conflict in three districts in northern Uganda (The Wayo-Nero Study)

Research article

The impact of age differences in couples on depressive symptoms: evidence from the Korean longitudinal study of aging (2006–2012)

Research article

Reduced cortical thickness in right Heschl’s gyrus associated with auditory verbal hallucinations severity in first-episode schizophrenia

Research article

Using films as a psychoeducation tool for patients with schizophrenia: a pilot study using a quasi-experimental pre-post design

Research article

What are the factors associated with depressive symptoms among orphans and vulnerable children in Cambodia?