Skip to main content
Top
Published in: BMC Primary Care 1/2014

Open Access 01-12-2014 | Research article

Tools for measuring patient safety in primary care settings using the RAND/UCLA appropriateness method

Authors: Brian G Bell, Rachel Spencer, Anthony J Avery, Stephen M Campbell

Published in: BMC Primary Care | Issue 1/2014

Login to get access

Abstract

Background

The majority of patient contacts occur in general practice but general practice patient safety has been poorly described and under-researched to date compared to hospital settings. Our objective was to produce a set of patient safety tools and indicators that can be used in general practices in any healthcare setting and develop a ‘toolkit’ of feasible patient safety measures for general practices in England.

Methods

A RAND/UCLA Appropriateness Method exercise was conducted with a panel of international experts in general practice patient safety. Statements were developed from an extensive systematic literature review of patient safety in general practice. We used standard RAND/UCLA Appropriateness Method rating methods to identify necessary items for assessing patient safety in general practice, framed in terms of the Structure-Process-Outcome taxonomy. Items were included in the toolkit if they received an overall panel median score of ≥7 with agreement (no more than two panel members rating the statement outside a 3-point distribution around the median).

Results

Of 205 identified statements, the panel rated 101 as necessary for assessing the safety of general practices. Of these 101 statements, 73 covered structures or organisational issues, 22 addressed processes and 6 focused on outcomes.

Conclusions

We developed and tested tools that can lead to interventions to improve safety outcomes in general practice. This paper reports the first attempt to systematically develop a patient safety toolkit for general practice, which has the potential to improve safety, cost effectiveness and patient experience, in any healthcare system.
Appendix
Available only for authorised users
Literature
3.
go back to reference Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20 (3): 231-236. 10.1093/fampra/cmg301.CrossRefPubMed Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20 (3): 231-236. 10.1093/fampra/cmg301.CrossRefPubMed
4.
go back to reference Wynia MK, Classen DC: Improving ambulatory patient safety: learning from the last decade, moving ahead in the next. JAMA. 2011, 306 (22): 2504-2505.CrossRefPubMed Wynia MK, Classen DC: Improving ambulatory patient safety: learning from the last decade, moving ahead in the next. JAMA. 2011, 306 (22): 2504-2505.CrossRefPubMed
5.
go back to reference Avery A, Ghaleb M, Barber N, Franklin BD, Armstrong SJ, Serumaga B, Dhillon S, Freyer A, Howard R, Talabi O, Mehta RL: The prevalence and nature of prescribing and monitoring errors in English general practice: a retrospective case note review. Br J Gen Pract. 2013, 63 (613): 543-553. 10.3399/bjgp13X670679.CrossRef Avery A, Ghaleb M, Barber N, Franklin BD, Armstrong SJ, Serumaga B, Dhillon S, Freyer A, Howard R, Talabi O, Mehta RL: The prevalence and nature of prescribing and monitoring errors in English general practice: a retrospective case note review. Br J Gen Pract. 2013, 63 (613): 543-553. 10.3399/bjgp13X670679.CrossRef
6.
go back to reference Bhasale A: The wrong diagnosis: identifying causes of potentially adverse events in general practice using incident monitoring. Fam Pract. 1998, 15 (4): 308-318. 10.1093/fampra/15.4.308.CrossRefPubMed Bhasale A: The wrong diagnosis: identifying causes of potentially adverse events in general practice using incident monitoring. Fam Pract. 1998, 15 (4): 308-318. 10.1093/fampra/15.4.308.CrossRefPubMed
8.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall MN: Research methods used in developing and applying quality indicators in primary care. Br Med J. 2003, 326 (7393): 816-819. 10.1136/bmj.326.7393.816.CrossRef Campbell SM, Braspenning J, Hutchinson A, Marshall MN: Research methods used in developing and applying quality indicators in primary care. Br Med J. 2003, 326 (7393): 816-819. 10.1136/bmj.326.7393.816.CrossRef
9.
go back to reference Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, Loo M, McDonnell J, Vader JP, Kahan JP, The RAND/UCLA Appropriateness Method User’s Manual: The RAND/UCLA Appropriateness Method User’s Manual. 2001, Santa Monica, CA: RAND Europe Fitch K, Bernstein SJ, Aguilar MD, Burnand B, LaCalle JR, Lazaro P, Loo M, McDonnell J, Vader JP, Kahan JP, The RAND/UCLA Appropriateness Method User’s Manual: The RAND/UCLA Appropriateness Method User’s Manual. 2001, Santa Monica, CA: RAND Europe
10.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009, 62 (10): 1006-1012. 10.1016/j.jclinepi.2009.06.005.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009, 62 (10): 1006-1012. 10.1016/j.jclinepi.2009.06.005.CrossRefPubMed
12.
go back to reference Campbell S, Chauhan U, Lester H: Primary Medical Care Provider Accreditation (PMCPA): Pilot evaluation. Br J Gen Pract. 2010, 60 (576): 295-304. 10.3399/bjgp10X514800.CrossRefPubMed Campbell S, Chauhan U, Lester H: Primary Medical Care Provider Accreditation (PMCPA): Pilot evaluation. Br J Gen Pract. 2010, 60 (576): 295-304. 10.3399/bjgp10X514800.CrossRefPubMed
13.
go back to reference Broge B, Boffin N, Marshall M, Elwyn G, Vodopivec-Jamsek V, Gerlach FM, Samuelson M, Grol R: Testing a European set of indicators for the evaluation of the management of primary care practices. Fam Pract. 2006, 23 (1): 137-147.PubMed Broge B, Boffin N, Marshall M, Elwyn G, Vodopivec-Jamsek V, Gerlach FM, Samuelson M, Grol R: Testing a European set of indicators for the evaluation of the management of primary care practices. Fam Pract. 2006, 23 (1): 137-147.PubMed
14.
go back to reference Avery AJ, Dex GM, Mulvaney C, Serumaga B, Spencer R, Lester HE, Campbell SM: Development of prescribing-safety indicators for GPs using the RAND Appropriateness Method. Br J Gen Pract. 2011, 61 (589): e526-e536.CrossRefPubMedPubMedCentral Avery AJ, Dex GM, Mulvaney C, Serumaga B, Spencer R, Lester HE, Campbell SM: Development of prescribing-safety indicators for GPs using the RAND Appropriateness Method. Br J Gen Pract. 2011, 61 (589): e526-e536.CrossRefPubMedPubMedCentral
15.
go back to reference Schnipper JL, Liang CL, Hamann C, Karson AS, Palchuk MB, McCartney PC, Sherlock M, Turchin A, Bates DW: Development of a tool within the electronic medical record to facilitate medication reconciliation after hospital discharge. J Am Med Inform Assoc. 2011, 18 (3): 309-313. 10.1136/amiajnl-2010-000040.CrossRefPubMedPubMedCentral Schnipper JL, Liang CL, Hamann C, Karson AS, Palchuk MB, McCartney PC, Sherlock M, Turchin A, Bates DW: Development of a tool within the electronic medical record to facilitate medication reconciliation after hospital discharge. J Am Med Inform Assoc. 2011, 18 (3): 309-313. 10.1136/amiajnl-2010-000040.CrossRefPubMedPubMedCentral
16.
go back to reference Donabedian A: Methods for deriving criteria for assessing the quality of medical care. Med Care Rev. 1980, 37 (7): 653-698.PubMed Donabedian A: Methods for deriving criteria for assessing the quality of medical care. Med Care Rev. 1980, 37 (7): 653-698.PubMed
17.
go back to reference Campbell S, Roland M, Buetow S: Defining quality of care. Soc Sci Med. 2000, 51 (11): 1611-1625. 10.1016/S0277-9536(00)00057-5.CrossRefPubMed Campbell S, Roland M, Buetow S: Defining quality of care. Soc Sci Med. 2000, 51 (11): 1611-1625. 10.1016/S0277-9536(00)00057-5.CrossRefPubMed
20.
go back to reference Campbell S, Kontopantelis E, Hannon K, Burke M, Barber A, Lester HE: Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework. BMC Fam Pract. 2011, 12: 85-10.1186/1471-2296-12-85.CrossRefPubMedPubMedCentral Campbell S, Kontopantelis E, Hannon K, Burke M, Barber A, Lester HE: Framework and indicator testing protocol for developing and piloting quality indicators for the UK quality and outcomes framework. BMC Fam Pract. 2011, 12: 85-10.1186/1471-2296-12-85.CrossRefPubMedPubMedCentral
21.
go back to reference Shekelle PG, Pronovost PJ, Wachter RM, McDonald KM, Schoelles K, Dy SM, Shojania K, Reston JT, Adams AS, Angood PB, Bates DW, Bickman L, Carayon P, Donaldson L, Duan H, Farley DO, Greenhalgh T, Haughom JL, Lake E, Lilford R, Lohr KN, Meyer GS, Miller MR, Neuhauser DV, Ryan G, Saint S, Shortell SM, Stevens DP, Walshe K: The top patient safety strategies that can be encouraged for adoption now. Ann Intern Med. 2013, 158 (5 Pt 2): 365-368.CrossRefPubMed Shekelle PG, Pronovost PJ, Wachter RM, McDonald KM, Schoelles K, Dy SM, Shojania K, Reston JT, Adams AS, Angood PB, Bates DW, Bickman L, Carayon P, Donaldson L, Duan H, Farley DO, Greenhalgh T, Haughom JL, Lake E, Lilford R, Lohr KN, Meyer GS, Miller MR, Neuhauser DV, Ryan G, Saint S, Shortell SM, Stevens DP, Walshe K: The top patient safety strategies that can be encouraged for adoption now. Ann Intern Med. 2013, 158 (5 Pt 2): 365-368.CrossRefPubMed
23.
go back to reference Modak I, Sexton J, Lux T, Helmreich R, Thomas E: Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire–ambulatory version. J Gen Intern Med. 2007, 22 (1): 1-5. 10.1007/s11606-007-0114-7.CrossRefPubMedPubMedCentral Modak I, Sexton J, Lux T, Helmreich R, Thomas E: Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire–ambulatory version. J Gen Intern Med. 2007, 22 (1): 1-5. 10.1007/s11606-007-0114-7.CrossRefPubMedPubMedCentral
24.
go back to reference Cox S, Holden J: A retrospective review of significant events reported in one district in 2004-2005. Br J Gen Pract. 2007, 57 (542): 732-736.PubMedPubMedCentral Cox S, Holden J: A retrospective review of significant events reported in one district in 2004-2005. Br J Gen Pract. 2007, 57 (542): 732-736.PubMedPubMedCentral
25.
go back to reference Avery AJ, Savelyich BSP, Sheikh A, Cantrill J, Morris CJ, Fernando B, Bainbridge M, Horsfield P, Teasdale S: Identifying and establishing consensus on the most important safety features of GP computer systems: e-Delphi study. Inform Prim Care. 2005, 13 (1): 3-12.PubMed Avery AJ, Savelyich BSP, Sheikh A, Cantrill J, Morris CJ, Fernando B, Bainbridge M, Horsfield P, Teasdale S: Identifying and establishing consensus on the most important safety features of GP computer systems: e-Delphi study. Inform Prim Care. 2005, 13 (1): 3-12.PubMed
27.
go back to reference Entwistle VA, McCaughan D, Watt IS, Birks Y, Hall J, Peat M, Williams B, Wright J: Speaking up about safety concerns: multi-setting qualitative study of patients’ views and experiences. Qual Saf Health Care. 2010, 19 (6): e33-PubMed Entwistle VA, McCaughan D, Watt IS, Birks Y, Hall J, Peat M, Williams B, Wright J: Speaking up about safety concerns: multi-setting qualitative study of patients’ views and experiences. Qual Saf Health Care. 2010, 19 (6): e33-PubMed
28.
go back to reference Donabedian A: Explorations in quality assessment and monitoring. Vol. 1. The definition of quality and approaches to its assessment. 1980, Ann Arbor, Mich: Health Administration Press Donabedian A: Explorations in quality assessment and monitoring. Vol. 1. The definition of quality and approaches to its assessment. 1980, Ann Arbor, Mich: Health Administration Press
29.
go back to reference Avery A, Savelyich B, Sheikh A, Morris C, Bowler I, Teasdale S: Improving general practice computer systems for patient safety: qualitative study of key stakeholders. Qual Saf Health Care. 2007, 16 (1): 28-33. 10.1136/qshc.2006.018192.CrossRefPubMedPubMedCentral Avery A, Savelyich B, Sheikh A, Morris C, Bowler I, Teasdale S: Improving general practice computer systems for patient safety: qualitative study of key stakeholders. Qual Saf Health Care. 2007, 16 (1): 28-33. 10.1136/qshc.2006.018192.CrossRefPubMedPubMedCentral
30.
go back to reference Bergkvist A, Midlöv P, Höglund P, Larsson L, Eriksson TA: multi-intervention approach on drug therapy can lead to a more appropriate drug use in the elderly. LIMM-Landskrona Integrated Medicines Management. J Eval Clin Pract. 2009, 15 (4): 660-667. 10.1111/j.1365-2753.2008.01080.x.CrossRefPubMed Bergkvist A, Midlöv P, Höglund P, Larsson L, Eriksson TA: multi-intervention approach on drug therapy can lead to a more appropriate drug use in the elderly. LIMM-Landskrona Integrated Medicines Management. J Eval Clin Pract. 2009, 15 (4): 660-667. 10.1111/j.1365-2753.2008.01080.x.CrossRefPubMed
31.
go back to reference Singh R, Singh A, Fox C, Seldan Taylor J, Rosenthal T, Singh G: Computer visualisation of patient safety in primary care: a systems approach adapted from management science and engineering. Inform Prim Care. 2005, 13 (2): 135-144.PubMed Singh R, Singh A, Fox C, Seldan Taylor J, Rosenthal T, Singh G: Computer visualisation of patient safety in primary care: a systems approach adapted from management science and engineering. Inform Prim Care. 2005, 13 (2): 135-144.PubMed
32.
go back to reference Hinrichsen V, Kruskal B, O'Brien M, Lieu T, Platt R: Using electronic medical records to enhance detection and reporting of vaccine adverse events. J Am Med Inform Assoc. 2007, 14 (6): 731-735. 10.1197/jamia.M2232.CrossRefPubMedPubMedCentral Hinrichsen V, Kruskal B, O'Brien M, Lieu T, Platt R: Using electronic medical records to enhance detection and reporting of vaccine adverse events. J Am Med Inform Assoc. 2007, 14 (6): 731-735. 10.1197/jamia.M2232.CrossRefPubMedPubMedCentral
33.
go back to reference Kirk S, Parker D, Claridge T, Esmail A, Marshall M: Patient safety culture in primary care: developing a theoretical framework for practical use. Qual Saf Health Care. 2007, 16 (4): 313-320. 10.1136/qshc.2006.018366.CrossRefPubMedPubMedCentral Kirk S, Parker D, Claridge T, Esmail A, Marshall M: Patient safety culture in primary care: developing a theoretical framework for practical use. Qual Saf Health Care. 2007, 16 (4): 313-320. 10.1136/qshc.2006.018366.CrossRefPubMedPubMedCentral
34.
go back to reference Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Cresswell K, Eden M, Elliott RA, Howard R, Kendrick D, Morris CJ, Prescott RJ, Swanwick G, Franklin M, Putman K, Boyd M, Sheikh A: A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012, 7;379(9823);1310-9 Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Cresswell K, Eden M, Elliott RA, Howard R, Kendrick D, Morris CJ, Prescott RJ, Swanwick G, Franklin M, Putman K, Boyd M, Sheikh A: A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012, 7;379(9823);1310-9
Metadata
Title
Tools for measuring patient safety in primary care settings using the RAND/UCLA appropriateness method
Authors
Brian G Bell
Rachel Spencer
Anthony J Avery
Stephen M Campbell
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2014
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-15-110

Other articles of this Issue 1/2014

BMC Primary Care 1/2014 Go to the issue