Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Evaluating patient experiences in decentralised acute care using the Picker Patient Experience Questionnaire; methodological and clinical findings

Authors: Ann-Chatrin Linqvist Leonardsen, Vigdis Abrahamsen Grøndahl, Waleed Ghanima, Espen Storeheier, Anders Schönbeck, Thor-Asbjørn Løken, Nina Carine Mikkelsen Bakken, Guro Steine Letting, Réné Holst, Lars-Petter Jelsness-Jørgensen

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Decentralised acute care services have, through the establishment of municipality acute wards (MAWs), been launched in Norway. The aim is to provide treatment for patients who otherwise would need hospitalisation. Currently there is a lack of studies investigating patient experiences in such services. The aims of this study were therefore to a) translate and validate the Picker Patient Experience Questionnaire (PPE-15) in Norwegian, and b) assess patient experiences in decentralised acute care, and potential factors associated with these experiences.

Methods

Patients were recruited from five municipal acute wards in southeastern Norway during the period from June 2014 to June 2015. Data on socio-demographics, length of stay and comorbidity (Charlson comorbidity index (CCI)) were collected. Patients completed the Picker Patient Experience Questionnaire (PPE-15) and the EuroQOL 5-dimension, 3-level version. Convergent validity of the PPE-15 was assessed by correlation of items in PPE-15 and the Nordic Patient Experience Questionnaire (NORPEQ). A retest of the PPE-15 was performed in a subgroup of patients approximately 3 weeks after baseline assessment. Test-retest agreement was assessed with Cohens’ unweighted Kappa.

Results

A total of 479 patients responded, median age 78.0 years and 41.8% men. A total of 68 patients participated in the retest. Testing of convergent validity revealed an overall weak to moderate correlation. Kappa statistics showed from fair to good test-retest agreement. Most problems were related to continuity and transition, while fewest problems were related to respect for patient preferences. A higher Charlson comorbidity score was the only variable that was negatively associated with patient experience.

Conclusion

Patients reported problems in several items of the PPE-15 after discharge from decentralised acute wards. The findings from the current study may be helpful for planning ways to improve quality of care, e.g., by providing feedback to healthcare personnel or by using patient experience as a quality indicator.
Appendix
Available only for authorised users
Literature
1.
NHS Institute for Innovation and Improvement. The patient experience book. A collection of the NHS Institute for Innovation and Improvement guidance and support. Coventry: University of Warwick Science Park; 2013.
2.
Doyle C, Lennox L, Bell D. A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open. 2013;3(1):e001570.CrossRefPubMedPubMedCentral
3.
Rathert C, Brandt J, Williams ES. Putting the ‘patient’ in patient safety: a qualitative study of consumer experiences. Health Expect. 2012;15(3):327–36.CrossRefPubMed
4.
Bjertnaes O, Sjetne I, Iversen H. Overall patient satisfaction with hospitals: effects of patient-reported experiences and fulfilment of expectations. BMJ Qual Saf. 2012;21(1):39–46.CrossRefPubMed
5.
Garratt A. National and cross-national surveys of patient experiences. Oslo: Nasjonalt kunnskapssenter for helsetjenesten [Norwegian Knowledge Centre for the Health Services]; 2008.
6.
LaVela S, Gallan A. Evaluation and measurement of patient experience. Pat Exp J. 2014;1(1):28–36.
7.
8.
Ahmed F, Burt J, Roland M. Measuring patient experience: concepts and methods. Patient. 2014;7(3):235–41.CrossRefPubMed
9.
Salisbury C, Wallace M, Montgomery A. Patients’experience and satisfaction in primary care: a secondary analysis using multilevel modelling. BMJ. 2010;341:5004.CrossRef
10.
Grøndahl V, Wilde-Larsson B, Hall-Lord M, Karlsson I. A pattern approach to analysing patients' satisfaction and quality of care perceptions in hospital. Int J Pers Cent Med. 2011;1(4):766–75.
11.
Johnson M, Rodriguez H, Solorio M. Case-mix adjustment and the comparison of community health center performance on patient experience measures. Health Serv Res. 2010;45:670–90.CrossRefPubMedPubMedCentral
12.
Paddison C, Saunders C, Abel G, Payne R, Campbell J, Roland M. Why do patients with multimorbidity in England report worse experiences in primary care? Evidence from the general practice patient survey. BMJ Open. 2015;5(3):e006172.CrossRefPubMedPubMedCentral
13.
Grøndahl VA, Karlsson I, Hall-Lord ML, Appelgren J, Wilde-Larsson B. Quality of care from patients’ perspective: impact of the combination of person-related and external objective care conditions. J Clin Nurs. 2011;20(17–18):2540–51.CrossRefPubMed
14.
Skudal K, Garratt A, Eriksson B, Leinonen T, Simonsen J, Bjertnaes O. The Nordic patient experiences questionnaire (NORPEQ): cross-national comparison of data quality, internal consistency and validity in four Nordic countries. BMJ Open. 2012;2(3):e000864. doi:10.​1136/​bmjopen-2012-000864.
15.
Wiig S, Storm M, Aase K, Gjestsen MT, Solheim M, Harthug S, et al. Investigating the use of patient involvement and patient experience in quality improvement in Norway: rethoric or reality? BMC Health Serv Res. 2013;13:206.CrossRefPubMedPubMedCentral
16.
Norwegian department of health and care. Nasjonal helse- og omsorgsplan [national health and care plan] Oslo: 2010-11. Report No. 16.
17.
18.
Norsk forening for allmennmedisin [Norwegian Association for General Practice]. Medisinskfaglig veileder for kommunale akutte døgnplasser [ medical guidelines for municipal acute wards]. Oslo: Den norske legeforening [the Norwegian Medical Association]; 2014.
19.
Skinner M. Øyeblikkelig hjelp døgnopphold. Oppsummering av kunnskap og erfaringer fra de første fire årene med kommunalt øyeblikkelig hjelp døgnopphold [acute care wards. Summarisation of knowledge and experiences from the four first years of municipal acute care units]. Gjøvik: Høgskolen i Gjøvik; 2015.
20.
Young J. The development of intermediate care services in England. Arch Gerontol Geriatr. 2009;49(Suppl 2):S21–5.CrossRefPubMed
21.
Primary Care Foundation. Urgent care centres: what works best? A discussion paper. 2012.
22.
Li P, Schneider JE, Ward MM. Effect of critical access hospital conversion on patient safety. Health Serv Res. 2015; 42(6):2089–108.
23.
Martinsen B, Norlyk A, Lomborg K. Experiences of intermediate care among older people: a phenomenological study. Br J Comm Nurs. 2015;20(2):74–9.CrossRef
24.
Leonardsen A, del Busso L, Grøndahl V, Ghanima W, Barach P, Jelsness-Jørgensen L. A qualitative study of patient experiences with decentralised acute healthcare services. Scand J Prim Health Care 2016; 34(3): 317-324.
25.
Leonardsen A, Del Busso L, Grøndahl V, Jelsness-Jørgensen L. “It’s a whole human being”: a qualitative study of care experiences among patients treated in decentralised healthcare services. EJPCH. 2017;5(1):82–7.CrossRef
26.
Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987;40(5):373–83.CrossRefPubMed
27.
Jenkinson C, Coulter A, Bruster S. The picker patient experience questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health Care. 2002;14(5):353–8.CrossRefPubMed
28.
Jenkinson C, Coulter A, Reeves R, Bruster S, Richards N. Properties of the picker patient experience questionnaire in a randomized controlled trial of long versus short form survey instruments. J Pub Health Med. 2003;25(3):197–201.CrossRef
29.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005; 8(294–104).
30.
Mokkink L, Terwee C, Patrick D, Alonso J, Stratford P, Knol D, et al. The COSMIN checklist for assessing the methodological quality of studies in measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRefPubMedPubMedCentral
31.
Polit D, Beck C. Nursing research principles and methods. 9th ed. Baltimore: Lippincott Williams & Wilkins; 2012.
32.
EuroQol Group. EuroQol- a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.CrossRef
33.
34.
Rabin R, de Charro F. EQ-5D-SD: a measure of health status from the Euroqol group. Ann Med. 2001;33(5):337–43.CrossRefPubMed
35.
Oltedal S, Garratt A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M. The NORPEQ patient experiences questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Pub Health. 2007;35(5):540–7.CrossRef
36.
Paiva C, Barroso E, Carneseca E, de Padua SC, dos Santos F, Lopez R, et al. A critical analysis of test-retest reliability in instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med Res Methodol. 2014;14(8). https://​doi.​org/​10.​1186/​1471-2288-14-8.
37.
McHugh M. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82.CrossRef
38.
Nelder J, Wedderburn R. Generalized Linear Models. J Royal Stat Soc. 1972;135(3):370–84.CrossRef
39.
Roberts M, Campbell J, Abel G, Davey A, Elmore N, Maramba I, et al. Understanding high and low patient experience scores in primary care: analysis of patients’ survey data for general practices and individual doctors. BMJ. 2014;349:g6034.CrossRefPubMedPubMedCentral
40.
McCulloch C, Searle S. Generalized, linear and mixed models. New York: Wiley; 2001.
41.
IBM Corporation. IBM SPSS statistics for windows, version 21.0. New York: Armonk; 2012.
42.
Höglund A. Vad tycker patienten om vården? Delrapport från en provstudie med picker-metoden [what do patients think about their care? Part report from a test study with the picker method]. Lund: Sociologiska instituten; 1998.
43.
44.
Parlour R, Slater P, Mccormack B, Gallen A, Kavanagh P. The relationship between positive patient experience in acute hospitals and person-centred care. Int J Res Nurs. 2014;5(1):25–34.
45.
O’Leary K, Killarney A, Hansen L, Jones S, Malladi M, Marks K, et al. Effect of patient-centred bedside rounds on hospitalised patients’ decision control, activation and satisfaction with care. BMJ Qual Saf. 2015;25(12):921–8.CrossRefPubMed
46.
Gerteis M, Edgman-Levitan S, Daley J, Delbanco T. Through the patient's eyes: understanding and promoting patient -centered care. San Fransisco: Jossey-Bass; 1993.
47.
Naylor M. Nursing intervention research and quality of care: influencing the future of healthcare. Nurs Res. 2003;52(6):380–5.CrossRefPubMed
48.
Apel E, OḾalley T, Greenwald J. Hospital discharge and readmission. 2016. Available from: uptodate.com. Accessed 6 June 2016.
49.
Garcia-Caballos M, Ramos-Diaz F, Jimenez-Moleon JJ, Bueno-Cavanillas A. Drug-related problems in older people after hospital discharge and interventions to reduce them. Age Ageing. 2010;39(4):430–8.CrossRefPubMed
50.
Midlov P, Holmdahl L, Eriksson T, Bergkvist A, Ljungberg B, Widner H, et al. Medication report reduces number of medication errors when elderly patients are discharged from hospital. PWS. 2008;30(1):92–8.PubMed
51.
Olson DP, Windish DM. Communication discrepancies between physicians and hospitalized patients. Arch Intern Med. 2010;170(15):1302–7.CrossRefPubMed
52.
Siemsen I, Madsen M, Pedersen L, Michaelsen L, Pedersen A, Andersen H, et al. Factors that impact on the safety of patient handovers: an interview study. Scand J Publ Health. 2012;40:439–48.CrossRef
53.
Krol MW, DeBoer D, Sixma H, Van Der Hoek L, Rademakers JJ, Delnoij DM. Patient experiences of inhospital care: a department matter and a hospital matter. Int J Qual Health Care. 2015;27(1):17–25.CrossRefPubMed
54.
Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002;6:1–244.CrossRefPubMed
55.
Xiao H, Barber J. The effect of perceived health status on patient satisfaction. Value Health. 2008;11(4):719–25.CrossRefPubMed
56.
Glynn L, Byrne M, Newell J, Murphy A. The effect of health status on patient's satisfaction with out-of-hours care provided by a family doctor co-operative. Fam Pract. 2004;21(6):677–83.CrossRefPubMed
57.
Danielsen K, Bjertnaes OA, Garratt A, Forland O, Iversen HH, Hunskaar S. The association between demographic factors, user reported experiences and user satisfaction: results from three casualty clinics in Norway. BMC Fam Pract. 2010;11:73-2296-11-73.CrossRef
58.
Valderas J, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. Ann Fam Med. 2009;7(4):357–63.CrossRefPubMedPubMedCentral
59.
Fried L, Ferrucci L, Darer J, Williamson J, Anderson G. Untangling the concepts of disability, frailty and comorbidity: implications for improved targeting and care. J Gerontol A Biol Sci Med Sci. 2004;59(3):255–63.CrossRefPubMed
60.
61.
French K. Methodological considerations in hospital patient opinion surveys. Int J Nurs Stud. 2003;40(5):525–41.CrossRefPubMed
62.
Barron D, West E, Reeves R, Hawkes D. It takes patience and persistence to get negative feedback about patients' experiences: a secondary analysis of national inpatient survey. BMC Health Serv Res. 2014;14(153). doi:10.​1186/​1472-696-14-153.
63.
Stucky B, Periera C, de Vet H, Terwee C, Mokkink L, Knol D. Measurement in medicine: a practical guide. Qual Life Res. 2012;21(2):371–3.CrossRef
64.
Polit D. Getting serious about test-retest reliability: a critique of retest research and some recommendations. Qual Life Res. 2014;23(6):1713–20.CrossRefPubMed
65.
Lyratzopoulos G, Elliott M, Barbiere J, Henderson M, Staetsky L, Paddison C, et al. Understanding ethnic and other socio-demographic differences in patient experience of primary care: evidence from the English general practice patient survey. BMJ Qual Saf. 2012;21:21–9.CrossRefPubMed
66.
Saunders C, Abel G, Lyratzopoulos G. What explains worse patient experience in London? Evidence from secondary analysis of the cancer patient experience survey. BMJ Open. 2016;4. doi:10.​1136/​bmjopen-293-004039.
Metadata
Title
Evaluating patient experiences in decentralised acute care using the Picker Patient Experience Questionnaire; methodological and clinical findings
Authors
Ann-Chatrin Linqvist Leonardsen
Vigdis Abrahamsen Grøndahl
Waleed Ghanima
Espen Storeheier
Anders Schönbeck
Thor-Asbjørn Løken
Nina Carine Mikkelsen Bakken
Guro Steine Letting
Réné Holst
Lars-Petter Jelsness-Jørgensen
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2614-4

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue

Research article

The effectiveness of community-based coordinating interventions in dementia care: a meta-analysis and subgroup analysis of intervention components

Research article

Measuring medication adherence in patients with incident hypertension: a retrospective cohort study

Study protocol

Introduction of microsystems in a level 3 neonatal intensive care unit—an interprofessional approach

Research article

Selective enrollment in Disease Management Programs for coronary heart disease in Germany – An analysis based on cross-sectional survey and administrative claims data

Research article

Quality of anticoagulation management with warfarin among outpatients in a tertiary hospital in Addis Ababa, Ethiopia: a retrospective cross-sectional study

Study protocol

Evaluating a Dutch cardiology primary care plus intervention on the Triple Aim outcomes: study design of a practice-based quantitative and qualitative research