Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Systematic Reviews
Published in: Systematic Reviews 1/2015

Open Access 01-12-2015 | Research

Instruments to measure patient experience of healthcare quality in hospitals: a systematic review

Authors: Michelle Beattie, Douglas J. Murphy, Iain Atherton, William Lauder

Published in: Systematic Reviews | Issue 1/2015

Login to get access

Abstract

Background

Improving and sustaining the quality of hospital care is an international challenge. Patient experience data can be used to target improvement and research. However, the use of patient experience data has been hindered by confusion over multiple instruments (questionnaires) with unknown psychometric testing and utility.

Methods

We conducted a systematic review and utility critique of questionnaires to measure patient experience of healthcare quality in hospitals. Databases (Medical Literature Analysis and Retrieval System (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Psychological Information (PsychINFO) and Web of Knowledge until end of November 2013) and grey literature were scrutinised. Inclusion criteria were applied to all records with a 10 % sample independently checked. Critique included (1) application of COSMIN checklists to assess the quality of each psychometric study, (2) critique of psychometric results of each study using Terwee et al. criteria and (3) development and critique of additional aspects of utility for each instrument. Two independent reviewers completed each critique. Synthesis included combining findings in a utility matrix.

Results

We obtained 1157 records. Of these, 26 papers measuring patient experience of hospital quality of care were identified examining 11 international instruments. We found evidence of extensive theoretical/development work. The quality of methods and results was variable but mostly of a high standard. Additional aspects of utility found that (1) cost efficiency was mostly poor, due to the resource necessary to obtain reliable samples; (2) acceptability of most instruments was good and (3) educational impact was variable, with evidence on the ease of use, for approximately half of the questionnaires.

Conclusions

Selecting the right patient experience instrument depends on a balanced consideration of aspects of utility, aided by the matrix. Data required for high stakes purposes requires a high degree of reliability and validity, while those used for quality improvement may tolerate lower levels of reliability in favour of other aspects of utility (educational impact, cost and acceptability).

Systematic review registration

PROSPERO CRD42013006754
Appendix
Available only for authorised users
Literature
1.
Agency for Healthcare Research and Quality. HCAHPS Fact Sheet CAHPS Hospital Survey. USA; 2012.
2.
3.
Bannignan K, Watson R. Reliability and validity in a nutshell. Jn Clin Nurs. 2009;18:3237–43.CrossRef
4.
Beattie M, Lauder W, Atherton I, Murphy D. Instruments to measure patient experience of health care quality in hospitals: a systematic review protocol. Syst Rev. 2014;3:4.CrossRefPubMedPubMedCentral
5.
Beattie M, Shepherd A, Howieson B. Do the Institute of Medicines’ (IOM) dimensions of quality capture the current meaning of quality in health care?—an integrative review. J Res Nurs. 2012;18:288–304.CrossRef
6.
Boyd J. The 2006 inpatients importance study. Oxford, Picker Institute Europe: The Acute Co-ordination Centre for the NHS Acute Patient Survey Programme; 2007.
7.
Castle NG, Brown J, Hepner K, Hays R. Review of the literature on survey instruments used to collect data on hospital patients’ perceptions of care. Health Serv Res. 2005;40:1996–2017.CrossRefPubMedPubMedCentral
8.
Centers for Medicare and Medicaid (CMS). CAHPS Hospital Survey (HCAHPS) quality assurance guidelines. Baltimore: CMS; 2013.
9.
Cleary P, Edgman-Levitan S, Robert M. Patient evaluate their hospital care: a national survey. Health Aff. 1991;10:254–67.CrossRef
10.
Coaley K. An introduction to psychological assessment and psychometrics. London: Sage publications; 2014.
11.
Coulter A, Fitzpatrick R, Cornwell J. The point of care measures of patients’ experience in hospital: purpose, methods and uses. The Kings fund. 2009. p. 1–32.
12.
Council of Medical Speciality Societies. The measurement of health care performance: a primer from the CMSS. USA: United Health Services Inc; 2007.
13.
DeCourcy A, West E, Barron D. The National Adult Inpatient Survey conducted in the English National Health Service from 2002 to 2009: how have the data been used and what do we know as a result? BMC Health Serv Res. 2012;12:71.CrossRefPubMedPubMedCentral
14.
Department of Health. Patients first and foremost: the initial government response to the report of the Mid Staffordshire NHS Foundation Trust Public Inquiry. London: Stationary Office; 2013.
15.
DeVet H, Terwee C, Mokkink L, Knol D. Measurement in medicine. New York: Cambridge University Press; 2011.CrossRef
16.
Donabedian A. Explorations in quality assessment and monitoring, Vol. 1, The definition of quality and approaches to its assessment. Ann Arbour: Health Admin Press; 1980.
17.
Foundation H. Measuring patient experience: No. 18, evidence scan. Health Foundation: England; 2013.
18.
Francis R. Report of the Mid Staffordshire NHS Foundation Trust Public Inquiry. London: Stationary Office; 2013.
19.
Gerteis M, Edgman-Levitan S, Delbanco T. Through the patient’s eyes. Theoretical development of what defines quality from the patients’ perspective. San Francisco: Jossey-Bass; 1993.
20.
Giordano L, Ellito M, Goldstein E, Lehrman E, Spencer P. Development, implementation and public reporting of the HCAHPS Survey. Med Care Res Rev. 2009;67:27–37.CrossRefPubMed
21.
Groene O, Botje D, Sunol R, Andree-Lopez M, Wagner C. A systematic review of instruments that assess the implementation of hospital quality management systems. Int J Qual Health Care. 2013;25:525–41.CrossRefPubMed
22.
Hospital Authority. Patient satisfaction survey in Hong Kong Hospital Authority; Final Report. Hong Kong; 2010
23.
Institute of Medicine (IOM). Crossing the quality chasm: a new health system for 21st century. Washington DC: National Academy Press; 2001.
24.
Jenkinson C, Coulter A, Reeves R, Bruster S, Richards N. Properties of the Picker Patient Experience questionnaire in a randomized controlled trial of long versus short form survey instruments. J Public Health Med. 2003;25:197–201.CrossRefPubMed
25.
Jenkinson C, Coulter A, Bruster S. The Picker Patient Experience Questionnaire: development and validation using data from in-patient surveys in five countries. Int J Qual Health C. 2002;14:353–8.CrossRef
26.
Keller S, O'Malley A, Hays RD, Mathew RA, Zaslavsky AM, Hepner AM, et al. Methods used to streamline the CAHPS Hospital Survey. Health Serv Res. 2005;40:2057–77.CrossRefPubMedPubMedCentral
27.
Larsson BW, Larsson G. Development of a short form of the Quality from the Patient’s Perspective (QPP) questionnaire. J Clin Nurs. 2002;11:681–7.CrossRefPubMed
28.
Larsson G, Larsson BW, Munck IME. Refinement of the questionnaire ‘quality of care from the patient’s perspective’ using structural equation modelling. Scand J Caring Sci. 1998;12:111–8.PubMed
29.
30.
Locock L, Robert G, Boaz A, Vougioukalou S, Shuldham C, Fielden J, et al. Using a national archive of patient experience narratives to promote local patient-based co-design. J Health Serv Res Policy. 2014;4:200–7.CrossRef
31.
Luxford K. What does the patient know about quality? Int Jn Qual Health Care. 2012;24:439–40.CrossRef
32.
Manary MP, Boulding W, Staelin R, Glickman SW. The patient experience and health outcomes. N Engl J Med. 2013;368:201–3.CrossRefPubMed
33.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62:1006–12.CrossRefPubMed
34.
Mokkink L, Terwee C, Patrick D, Alonso J, Stratford P, Knol D, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19:539–49.CrossRefPubMedPubMedCentral
35.
Murphy DJ, Bruce DA, Mercer SW, Eva KW. The reliability of workplace-based assessment in postgraduate medical education and training: a national evaluation in general practice in the United Kingdom. Adv Health Sci Edu. 2009;14:219–32.CrossRef
36.
O’Malley AJ, Zaslavsky AM, Hays RD, Hepner KA, Keller S, Cleary PD. Exploratory factor analyses of the CAHPS Hospital Pilot Survey responses across and within medical, surgical and obstetric services. Health Serv Res. 2005;40:2078–94.CrossRefPubMedPubMedCentral
37.
Oltedal S, Garrat A, Bjertnaes O, Bjornsdottir M, Freil M, Sachs M. The NORPEQ patient experience questionnaire: data quality, internal consistency and validity following a Norwegian inpatient survey. Scand J Caring Sci. 2007;35:540–7.
38.
Osse B, Vernooij-Dassen M, Schade E, Grol R. A practical instrument to explore patients’ needs in palliative care: the problems and needs in palliative care. Palliative Med. 2007;21:391–9.CrossRef
39.
Pettersen KL, Veenstra M, Guldvog B, Kolstad A. The Patient Experiences Questionnaire: development. Int J Qual Health C. 2004;16:453–63.CrossRef
40.
Picker Institute Europe. Guidance manual for the NHS Adult Inpatient Survey 2012. Oxford: Picker Institute Europe; 2012.
41.
Rao KD, Peters DH, Bandeen-Roche K. Towards patient-centered health services in India—a scale to measure patient perceptions of quality. Int J Qual Health C. 2006;18:414–21.CrossRef
42.
Reeves R, Coulter A, Jenkinson C, Cartwright J, Bruster S, Richard N. Development and pilot testing of instruments for use in the acute NHS Trust Inpatient Survey Programme. Oxford: Picker Institute; 2002.
43.
44.
Schroder A, Larsson B, Ahlstrom G. Psychometric properties of the instrument quality in psychiatric care and descriptions of quality of care among in-patients. IJHCQA. 2010;23:554–70.
45.
46.
47.
Sizmur S, Redding D. Core domains for measuring inpatients’ experience of care. Oxford: Picker Institute Europe; 2012.
48.
Sofaer S, Crofton C, Goldstein E, Hoy E, Crabb J. What do consumers want to know about the quality of care in hospitals? Health Serv Res. 2005;40:2018–36.CrossRefPubMedPubMedCentral
49.
Streiner DL, Norman GR. Health measurement scales (3rd ed.). Oxford: Oxford Medical Publications; 2003.
50.
Terwee CB, Bot SD, de Boer M, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status instruments. J Clin Epidemiol. 2007;60:34–42.CrossRefPubMed
51.
Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HCW. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21:651–7.CrossRefPubMed
52.
Van der Vleuten C. The assessment of professional competence: developments, research and practical implications. Adv in Health Sci Educ. 1996;1:41–67.CrossRef
53.
Webster TR, Mantopoulos J, Jackson E, Cole-Lewis H, Kidane L, Kebede A, et al. A brief questionnaire for assessing patient healthcare experiences in low-income settings. Int J Qual Health C. 2011;23:258–68.CrossRef
54.
55.
Wilde B, Larsson G, Larsson M, Starrin B. Quality of care: development of a patient-centred questionnaire based on a grounded theory model. Scand J Caring Sci. 1994;8:39–48.CrossRefPubMed
56.
Wilde B, Starrin B, Larsson G, Larsson M. Quality of care from a patient perspective: a grounded theory study. Scand J Caring Sci. 1993;7:113–20.CrossRefPubMed
57.
58.
Williams B, Coyle J, Healy D. The meaning of patient satisfaction: an explanation of high reported levels. Soc Sci Med. 1998;47:1351–9.CrossRefPubMed
59.
Wong EL, Coulter A, Cheung AW, Yam CH, Yeoh EK, Griffiths SM. Validation of inpatient experience questionnaire. Int J Qual Health C. 2013;25:443–51.
Metadata
Title
Instruments to measure patient experience of healthcare quality in hospitals: a systematic review
Authors
Michelle Beattie
Douglas J. Murphy
Iain Atherton
William Lauder
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2015
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-015-0089-0

Other articles of this Issue 1/2015

Systematic Reviews 1/2015 Go to the issue

Protocol

Repurposed therapeutic agents targeting the Ebola virus: a protocol for a systematic review

Protocol

Quality and performance measures of strain on intensive care capacity: a protocol for a systematic review

Protocol

NatHER: protocol for systematic evaluation of trends in survival among patients with HER2-positive advanced breast cancer

Research

Managing the incidence of selective reporting bias: a survey of Cochrane review groups

Protocol

Use of inhaled corticosteroids for the prevention and/or treatment of bronchopulmonary dysplasia in preterm infants: a systematic review protocol

Protocol

Technology-adaptable interventions for treating depression in adults with cognitive impairments: protocol for a systematic review