Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Psychiatry
Published in: BMC Psychiatry 1/2017

Open Access 01-12-2017 | Research article

Patient experiences questionnaire for interdisciplinary treatment for substance dependence (PEQ-ITSD): reliability and validity following a national survey in Norway

Authors: Mona Haugum, Hilde Hestad Iversen, Oyvind Bjertnaes, Anne Karin Lindahl

Published in: BMC Psychiatry | Issue 1/2017

Login to get access

Abstract

Background

Patient experiences are an important aspect of health care quality, but there is a lack of validated instruments for their measurement in the substance dependence literature. A new questionnaire to measure inpatients’ experiences of interdisciplinary treatment for substance dependence has been developed in Norway. The aim of this study was to psychometrically test the new questionnaire, using data from a national survey in 2013.

Methods

The questionnaire was developed based on a literature review, qualitative interviews with patients, expert group discussions and pretesting. Data were collected in a national survey covering all residential facilities with inpatients in treatment for substance dependence in 2013. Data quality and psychometric properties were assessed, including ceiling effects, item missing, exploratory factor analysis, and tests of internal consistency reliability, test-retest reliability and construct validity.

Results

The sample included 978 inpatients present at 98 residential institutions. After correcting for excluded patients (n = 175), the response rate was 91.4%. 28 out of 33 items had less than 20.5% of missing data or replies in the “not applicable” category. All but one item met the ceiling effect criterion of less than 50.0% of the responses in the most favorable category. Exploratory factor analysis resulted in three scales: “treatment and personnel”, “milieu” and “outcome”. All scales showed satisfactory internal consistency reliability (Cronbach’s alpha ranged from 0.75-0.91) and test-retest reliability (ICC ranged from 0.82-0.85). 17 of 18 significant associations between single variables and the scales supported construct validity of the PEQ-ITSD.

Conclusion

The content validity of the PEQ-ITSD was secured by a literature review, consultations with an expert group and qualitative interviews with patients. The PEQ-ITSD was used in a national survey in Norway in 2013 and psychometric testing showed that the instrument had satisfactory internal consistency reliability and construct validity.
Literature
1.
Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3:e001570.
2.
Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health technology assessment (Winchester, England). 2002;6(32):1-244.
3.
Carlson MJ, Gabriel RM. Patient satisfaction, use of services, and one-year outcomes in publicly funded substance abuse treatment. Psychiatr Serv. 2001;52(9):1230–6.CrossRefPubMed
4.
Hser YI, Evans E, Huang D, Anglin DM. Relationship between drug treatment services, retention, and outcomes. Psychiatr Serv. 2004;55(7):767–74.CrossRefPubMed
5.
Marchand KI, Oviedo-Joekes E, Guh D, Brissette S, Marsh DC, Schechter MT. Client satisfaction among participants in a randomized trial comparing oral methadone and injectable diacetylmorphine for long-term opioid-dependency. BMC Health Serv Res. 2011;11:174.CrossRefPubMedPubMedCentral
6.
Ries RK, Jaffe C, Comtois KA, Kitchell M. Treatment satisfaction compared with outcome in severe dual disorders. Community Ment Health J. 1999;35(3):213–21.CrossRefPubMed
7.
Trujols J, Iraurgi I, Oviedo-Joekes E, Guardia-Olmos J. A critical analysis of user satisfaction surveys in addiction services: Opioid maintenance treatment as a representative case study. Patient Prefer Adher. 2014;8:107–17.CrossRef
8.
Garratt A, Solheim E, Danielsen K. National and cross-national surveys of patient experiences : a structured review. Oslo: Nasjonalt kunnskapssenter for helsetjenesten; 2008.
9.
Eisen SV, Shaul JA, Leff HS, Stringfellow V, Clarridge BR, Cleary PD. Toward a national consumer survey: evaluation of the CABHS and MHSIP instruments. J Behav Health Serv Res. 2001;28(3):347–69.CrossRefPubMed
10.
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 4th ed. New York, NY: Oxford University Press; 2008.CrossRef
11.
Sitzia J. How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999;11(4):319–28.CrossRefPubMed
12.
Pettersen KI, Veenstra M, Guldvog B, Kolstad A. The Patient Experiences Questionnaire: development, validity and reliability. Int J Qual Health Care. 2004;16(6):453–63.CrossRefPubMed
13.
Oltedal S, Garratt A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M. The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Public Health. 2007;35(5):540–7.CrossRefPubMed
14.
Iversen HH, Holmboe O, Bjertnaes OA. The Cancer Patient Experiences Questionnaire (CPEQ): reliability and construct validity following a national survey to assess hospital cancer care from the patient perspective. BMJ Open. 2012;2:e001437.
15.
Garratt AM, Bjertnaes OA, Barlinn J. Parent experiences of paediatric care (PEPC) questionnaire: Reliability and validity following a national survey. Acta Paediatr. 2007;96(2):246–52.CrossRefPubMed
16.
Bjertnaes O, Iversen HH, Kjollesdal J. PIPEQ-OS--an instrument for on-site measurements of the experiences of inpatients at psychiatric institutions. BMC Psychiatry. 2015;15:234.CrossRefPubMedPubMedCentral
17.
Garratt A, Bjorngaard JH, Dahle KA, Bjertnaes OA, Saunes IS, Ruud T. The Psychiatric Out-Patient Experiences Questionnaire (POPEQ): data quality, reliability and validity in patients attending 90 Norwegian clinics. Nord J Psychiatry. 2006;60(2):89–96.CrossRefPubMed
18.
Garratt AM, Bjertnaes OA, Holmboe O, Hanssen-Bauer K. Parent experiences questionnaire for outpatient child and adolescent mental health services (PEQ-CAMHS Outpatients): reliability and validity following a national survey. J Child Adolesc Psychiatr Ment Health Nurs. 2011;5:18.CrossRef
19.
Garratt AM, Danielsen K, Forland O, Hunskaar S. The Patient Experiences Questionnaire for Out-of-Hours Care (PEQ-OHC): data quality, reliability, and validity. Scand J Prim Health Care. 2010;28(2):95–101.CrossRefPubMedPubMedCentral
20.
Sjetne IS, Iversen HH, Kjollesdal JG. A questionnaire to measure women's experiences with pregnancy, birth and postnatal care: instrument development and assessment following a national survey in Norway. BMC Pregnancy Childbirth. 2015;15:182.CrossRefPubMedPubMedCentral
21.
Bjertnaes OA, Garratt A, Nessa J. The GPs' Experiences Questionnaire (GPEQ): reliability and validity following a national survey to assess GPs' views of district psychiatric services. Fam Pract. 2007;24(4):336–42.CrossRefPubMed
22.
Sjetne IS, Bjertnaes OA, Olsen RV, Iversen HH, Bukholm G. The Generic Short Patient Experiences Questionnaire (GS-PEQ): identification of core items from a survey in Norway. BMC Health Serv Res. 2011;11:88.CrossRefPubMedPubMedCentral
23.
Holcomb WR, Parker JC, Leong GB. Outcomes of inpatients treated on a VA psychiatric unit and a substance abuse treatment unit. Psychiatr Serv. 1997;48(5):699–704.CrossRefPubMed
24.
Marsden J, Stewart D, Gossop M, Rolfe A, Bacchus L, Griffiths P, et al. Assessing client satisfaction with treatment for substance use problems and the development of the Treatment Perceptions Questionnaire (TPQ). Addict Res. 2000;8(5):455–70.CrossRef
25.
De Los Cobos JP, Valero S, Haro G, Fidel G, Escuder G, Trujols J, et al. Development and psychometric properties of the Verona Service Satisfaction Scale for methadone-treated opioid-dependent patients (VSSS-MT). Drug Alcohol Depend. 2002;68(2):209–14.CrossRef
26.
De Wilde EF, Hendriks VM. The Client Satisfaction Questionnaire: psychometric properties in a Dutch addict population. Eur Addict Res. 2005;11(4):157–62.CrossRefPubMed
27.
Hubley AM, Palepu A. Injection Drug User Quality of Life Scale (IDUQOL): findings from a content validation study. Health Qual Life Outcomes. 2007;5:46.CrossRefPubMedPubMedCentral
28.
De Los Cobos JP, Trujols J, Sinol N, Batlle F. Development and validation of the scale to assess satisfaction with medications for addiction treatment-methadone for heroin addiction (SASMAT-METHER). Drug Alcohol Depend. 2014;142:79–85.CrossRef
29.
Kasprow WJ, Frisman L, Rosenheck RA. Homeless veterans' satisfaction with residential treatment. Psychiatr Serv. 1999;50(4):540–5.CrossRefPubMed
30.
Donovan DM, Kadden RM, DiClemente CC, Carroll KM. Client satisfaction with three therapies in the treatment of alcohol dependence: Results from Project MATCH. Am J Addict. 2002;11(4):291–307.CrossRefPubMed
31.
Long CG, Williams M, Midgley M, Hollin CR. Within-program factors as predictors of drinking outcome following cognitive-behavioral treatment. Addict Behav. 2000;25(4):573–8.CrossRefPubMed
32.
Danielsen K, Garratt A, Kornør H. Måling av brukererfaringer med avhengighetsbehandling : en litteraturgjennomgang av validerte måleinstrumenter. Oslo: Nasjonalt kunnskapssenter for helsetjenesten; 2007.
33.
Dahle KA, Iversen HH. Utvikling av metode for å måle pasienterfaringer med døgnopphold innen tverrfaglig spesialisert rusbehandling. Oslo: Nasjonalt kunnskapssenter for helsetjenesten; 2011.
34.
Howie JG, Heaney DJ, Maxwell M, Walker JJ. A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998;15(2):165–71.CrossRefPubMed
35.
Haugum M, Iversen HH, Bjertnæs ØA. Pasienterfaringer med døgnopphold innen tverrfaglig spesialisert rusbehandling – resultater etter en nasjonal undersøkelse i 2013. PasOpp-rapport nr. 7 − 2013. Oslo: Nasjonalt kunnskapssenter for helsetjenesten; 2013.
36.
Helse- og omsorgsdepartementet. Samhandlingsreformen - Rett behandling – på rett sted – til rett tid. St.meld. nr. 47 (2008-2009).
37.
Dahle KA, Holmboe O, Helgeland J. Brukererfaringer med døgnenheter i psykisk helsevern. Resultater og vurderinger etter en nasjonal undersøkelse i 2005. Oslo: Nasjonalt kunnskapssenter for helsetjenesten; 2006.
38.
Bjertnaes OA, Lyngstad I, Malterud K, Garratt A. The Norwegian EUROPEP questionnaire for patient evaluation of general practice: data quality, reliability and construct validity. Fam Pract. 2011;28(3):342–9.CrossRefPubMed
39.
Ruiz MA, Pardo A, Rejas J, Soto J, Villasante F, Aranguren JL. Development and validation of the "Treatment Satisfaction with Medicines Questionnaire" (SATMED-Q). Value Health. 2008;11(5):913–26.CrossRefPubMed
40.
41.
Fayers PM, Machin D. Quality of Life: Assessment, Analysis, and Interpretation. Chichester: Wiley; 2000.
42.
Landgraf JM, Abetz L, Ware Jr JE. Child Health Questionnaire (CHQ): A User's Manual. 1st ed. Boston, MA: The Health Institute, New England Medical Center; 1996.
43.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
44.
Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis. 7th ed. Essex: Pearson Education Limited; 2014.
45.
Eselius LL, Cleary PD, Zaslavsky AM, Huskamp HA, Busch SH. Case-mix adjustment of consumer reports about managed behavioral health care and health plans. Health Serv Res. 2008;43(6):2014–32.CrossRefPubMedPubMedCentral
46.
Morris ZS, McKeganey N. Client perceptions of drug treatment services in Scotland. Drugs. 2007;14(1):49–60.
47.
Cernovsky ZZ, O'Reilly RL, Pennington M. Sensation seeking scales and consumer satisfaction with a substance abuse treatment program. J Clin Psychol. 1997;53(8):779–84.CrossRefPubMed
48.
Chan M, Sorensen JL, Guydish J, Tajima B, Acampora A. Client satisfaction with drug abuse day treatment versus residential care. J Drug Issues. 1997;27(2):367–77.CrossRef
49.
Sanders L, Trinh C, Sherman B, Banks S. Assessment of client satisfaction in a peer counseling substance abuse treatment program for pregnant and postpartum women. Eval Program Plann. 1998;21(3):287–96.CrossRef
50.
Groves RM, Fowler Jr FJ, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey methodology. 2nd ed. Hoboken, N.J.: Wiley; 2009.
51.
Sitzia J, Wood N. Response rate in patient satisfaction research: an analysis of 210 published studies. Int J Qual Health Care. 1998;10(4):311–7.CrossRefPubMed
52.
Bjertnæs ØA, Garratt A, Johannessen JO. Innsamlingsmåte og resultater i brukerundersøkelser i psykisk helsevern. Tidsskr Nor Laegeforen. 2006;126(11):1481–3.PubMed
53.
Gribble RK, Haupt C. Quantitative and qualitative differences between handout and mailed patient satisfaction surveys. Med Care. 2005;43(3):276–81.CrossRefPubMed
54.
Anastario MP, Rodriguez HP, Gallagher PM, Cleary PD, Shaller D, Rogers WH, et al. A randomized trial comparing mail versus in-office distribution of the CAHPS Clinician and Group Survey. Health Serv Res. 2010;45(5 Pt 1):1345–59.CrossRefPubMedPubMedCentral
Metadata
Title
Patient experiences questionnaire for interdisciplinary treatment for substance dependence (PEQ-ITSD): reliability and validity following a national survey in Norway
Authors
Mona Haugum
Hilde Hestad Iversen
Oyvind Bjertnaes
Anne Karin Lindahl
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2017
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-017-1242-1

Other articles of this Issue 1/2017

BMC Psychiatry 1/2017 Go to the issue

Research article

Association of schizophrenia onset age and white matter integrity with treatment effect of D-cycloserine: a randomized placebo-controlled double-blind crossover study

Research article

How do healthcare professionals interview patients to assess suicide risk?

Research article

Examining differences in cognitive and affective theory of mind between persons with high and low extent of somatic symptoms: an experimental study

Research article

Possible factors influencing the duration of hospital stay in patients with psychiatric disorders attempting suicide by jumping

Research article

Comorbid post-traumatic stress disorder in alcohol use disorder: relationships to demography, drinking and neuroimmune profile

Research article

Low prevalence of lipid metabolism abnormalities in APOE ε2-genotype and male patients 60 years or older with schizophrenia