Skip to main content
Top
Published in: BMC Primary Care 1/2012

Open Access 01-12-2012 | Research article

Maximising harm reduction in early specialty training for general practice: validation of a safety checklist

Authors: Paul Bowie, John McKay, Moya Kelly

Published in: BMC Primary Care | Issue 1/2012

Login to get access

Abstract

Background

Making health care safer is a key policy priority worldwide. In specialty training, medical educators may unintentionally impact on patient safety e.g. through failures of supervision; providing limited feedback on performance; and letting poorly developed behaviours continue unchecked. Doctors-in-training are also known to be susceptible to medical error. Ensuring that all essential educational issues are addressed during training is problematic given the scale of the tasks to be undertaken. Human error and the reliability of local systems may increase the risk of safety-critical topics being inadequately covered. However adherence to a checklist reminder may improve the reliability of task delivery and maximise harm reduction. We aimed to prioritise the most safety-critical issues to be addressed in the first 12-weeks of specialty training in the general practice environment and validate a related checklist reminder.

Methods

We used mixed methods with different groups of GP educators (n = 127) and specialty trainees (n = 9) in two Scottish regions to prioritise, develop and validate checklist content. Generation and refinement of checklist themes and items were undertaken on an iterative basis using a range of methods including small group work in dedicated workshops; a modified-Delphi process; and telephone interviews. The relevance of potential checklist items was rated using a 4-point scale content validity index to inform final inclusion.

Results

14 themes (e.g. prescribing safely; dealing with medical emergency; implications of poor record keeping; and effective & safe communication) and 47 related items (e.g. how to safety-net face-to-face or over the telephone; knowledge of practice systems for results handling; recognition of harm in children) were judged to be essential safety-critical educational issues to be covered. The mean content validity index ratio was 0.98.

Conclusion

A checklist was developed and validated for educational supervisors to assist in the reliable delivery of safety-critical educational issues in the opening 12-week period of training, and aligned with national curriculum competencies. The tool can also be adapted for use as a self-assessment instrument by trainees to guide patient safety-related learning needs. Dissemination and implementation of the checklist and self-rating scale are proceeding on a national, voluntary basis with plans to evaluate its feasibility and educational impact.
Appendix
Available only for authorised users
Literature
1.
go back to reference Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events andnegligence in hospitalized patients. Results of the Harvard MedicalPractice Study. N Engl J Med. 1991, 324: 370-376. 10.1056/NEJM199102073240604.CrossRefPubMed Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events andnegligence in hospitalized patients. Results of the Harvard MedicalPractice Study. N Engl J Med. 1991, 324: 370-376. 10.1056/NEJM199102073240604.CrossRefPubMed
2.
go back to reference World Health Organization: Patient safety research: better knowledge for better care. 2009, WHO, Geneva World Health Organization: Patient safety research: better knowledge for better care. 2009, WHO, Geneva
3.
go back to reference Department of Health: An organisation with amemory: report of an expert group on learning from adverse events in the NHS. 2000, HMSO, London Department of Health: An organisation with amemory: report of an expert group on learning from adverse events in the NHS. 2000, HMSO, London
4.
go back to reference Department of Health: Doing less harm:improving the safety and quality of care through reporting, analysing and learning from adverse incidents involving NHS patients – Key requirements for healthcare providers. 2001, HMSO, London Department of Health: Doing less harm:improving the safety and quality of care through reporting, analysing and learning from adverse incidents involving NHS patients – Key requirements for healthcare providers. 2001, HMSO, London
5.
go back to reference Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20 (3): 231-236. 10.1093/fampra/cmg301.CrossRefPubMed Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20 (3): 231-236. 10.1093/fampra/cmg301.CrossRefPubMed
6.
go back to reference McKay J, Bradley N, Lough M, Bowie P: A review of significant events analysed in general medical practice: implications for the quality and safety of patient care. BMC Fam Pract. 2009, 10: 61-10.1186/1471-2296-10-61.CrossRefPubMedPubMedCentral McKay J, Bradley N, Lough M, Bowie P: A review of significant events analysed in general medical practice: implications for the quality and safety of patient care. BMC Fam Pract. 2009, 10: 61-10.1186/1471-2296-10-61.CrossRefPubMedPubMedCentral
7.
go back to reference Elder NC, Dovey SM: Classification of medical errors and preventable adverse events in primary care: a synthesis of the literature. J Fam Pract. 2002, 51: 927-932.PubMed Elder NC, Dovey SM: Classification of medical errors and preventable adverse events in primary care: a synthesis of the literature. J Fam Pract. 2002, 51: 927-932.PubMed
8.
go back to reference Makeham MAB, Dovey SM, County M, Kidd MR: An international taxonomy for errors in general practice: a pilot study. Med J Aust. 2002, 177: 68-72.PubMed Makeham MAB, Dovey SM, County M, Kidd MR: An international taxonomy for errors in general practice: a pilot study. Med J Aust. 2002, 177: 68-72.PubMed
9.
go back to reference Dovey SM, Meyers DS, Phillips RL, et al: A preliminary taxonomy of medical errors in family practice. Qual Saf Health Care. 2002, 11: 233e8-CrossRef Dovey SM, Meyers DS, Phillips RL, et al: A preliminary taxonomy of medical errors in family practice. Qual Saf Health Care. 2002, 11: 233e8-CrossRef
11.
go back to reference Health Protection Scotland: NHS Scotland National HAI Prevalence Survey Final Report. Volume 2 of 2. NHS Scotland National HAI Prevalence Survey Protocol. Health Protection Scotland: NHS Scotland National HAI Prevalence Survey Final Report. Volume 2 of 2. NHS Scotland National HAI Prevalence Survey Protocol.
12.
go back to reference National Patient Safety Agency: Seven steps to patient safety for primary care. 2005, NPSA, London National Patient Safety Agency: Seven steps to patient safety for primary care. 2005, NPSA, London
15.
go back to reference Kilminster SM, Jolly BC: Effective supervision in clinical practice settings: a literature review. Med Educ. 2000, 34: 827-840. 10.1046/j.1365-2923.2000.00758.x.CrossRefPubMed Kilminster SM, Jolly BC: Effective supervision in clinical practice settings: a literature review. Med Educ. 2000, 34: 827-840. 10.1046/j.1365-2923.2000.00758.x.CrossRefPubMed
16.
go back to reference Bruijn M, Busari JO, Wolf BHM: Quality of clinical supervision as perceived by specialist registrars in a university and district teaching hospital. Med Educ. 2006, 40: 1002-1008. 10.1111/j.1365-2929.2006.02559.x.CrossRefPubMed Bruijn M, Busari JO, Wolf BHM: Quality of clinical supervision as perceived by specialist registrars in a university and district teaching hospital. Med Educ. 2006, 40: 1002-1008. 10.1111/j.1365-2929.2006.02559.x.CrossRefPubMed
17.
go back to reference Kilminster SM, Jolly BC, Grant J, et al: Good supervision: guiding the clinical educator of the 21st century. 2000, University of Sheffield, Sheffield, Department of Health Publication; European Working Time Directive, 2008 Kilminster SM, Jolly BC, Grant J, et al: Good supervision: guiding the clinical educator of the 21st century. 2000, University of Sheffield, Sheffield, Department of Health Publication; European Working Time Directive, 2008
18.
go back to reference Dornan T, Ashcroft DM, Heathfield H, Lewis PJ, Miles J, Taylor D, Tully MP, Wass V: FINAL report: An in depth investigation into causes of prescribing errors by foundation trainees in relation to their medical education - EQUIP study. 2009, General Medical Council, UK Dornan T, Ashcroft DM, Heathfield H, Lewis PJ, Miles J, Taylor D, Tully MP, Wass V: FINAL report: An in depth investigation into causes of prescribing errors by foundation trainees in relation to their medical education - EQUIP study. 2009, General Medical Council, UK
19.
go back to reference Kennedy TJ, Lingard L, Baker GR, et al: Clinical oversight: conceptualizing the relationship between supervision and safety. J Gen Intern Med. 2007, 22: 1080e5-CrossRef Kennedy TJ, Lingard L, Baker GR, et al: Clinical oversight: conceptualizing the relationship between supervision and safety. J Gen Intern Med. 2007, 22: 1080e5-CrossRef
20.
go back to reference Van der Vleuten CP, Schuwirth LW: Assessing professional competence: From methods to programmes. Med Educ. 2005, 39 (3): 309-317. 10.1111/j.1365-2929.2005.02094.x.CrossRefPubMed Van der Vleuten CP, Schuwirth LW: Assessing professional competence: From methods to programmes. Med Educ. 2005, 39 (3): 309-317. 10.1111/j.1365-2929.2005.02094.x.CrossRefPubMed
21.
go back to reference Smith VC, Wiener-Ogilvie S: Describing the learning climate of general practice training: the learner’s perspective. Educ Prim Care. 2009, 20 (6): 435-440.CrossRefPubMed Smith VC, Wiener-Ogilvie S: Describing the learning climate of general practice training: the learner’s perspective. Educ Prim Care. 2009, 20 (6): 435-440.CrossRefPubMed
22.
go back to reference Zwart DLM, Heddema WS, Vermeulen MI, van Rensen ELJ, Verheij TJM, Kalkman CJ: Lessons learnt from incidents reported by post graduate trainees in Dutch general practice: A prospective cohor tstudy. BMJ Qual Saf. 2011, 20: 857e862-doi:10.1136/bmjqs.2010.045484 Zwart DLM, Heddema WS, Vermeulen MI, van Rensen ELJ, Verheij TJM, Kalkman CJ: Lessons learnt from incidents reported by post graduate trainees in Dutch general practice: A prospective cohor tstudy. BMJ Qual Saf. 2011, 20: 857e862-doi:10.1136/bmjqs.2010.045484
23.
go back to reference Singh H, Thomas EJ, Petersen LA, et al: Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007, 167: 2030e6- Singh H, Thomas EJ, Petersen LA, et al: Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007, 167: 2030e6-
24.
go back to reference Reason JT: Understanding adverse events: the human factor. Clinical risk management. Enhancing patient safety. Edited by: Vincent CA. 2001, Blackwell BMJ books, London, 9-30. 2 Reason JT: Understanding adverse events: the human factor. Clinical risk management. Enhancing patient safety. Edited by: Vincent CA. 2001, Blackwell BMJ books, London, 9-30. 2
25.
go back to reference National Patient Safety Agency: WHO Surgical Safety Checklist. 2009, NPSA, London National Patient Safety Agency: WHO Surgical Safety Checklist. 2009, NPSA, London
26.
go back to reference Shillito J, Arfanis K, Smith A: Checking in healthcare safety: theoretical basis and practical application. Int J Health Care Qual Assur. 2010, 23: 699-707. 10.1108/09526861011081831.CrossRefPubMed Shillito J, Arfanis K, Smith A: Checking in healthcare safety: theoretical basis and practical application. Int J Health Care Qual Assur. 2010, 23: 699-707. 10.1108/09526861011081831.CrossRefPubMed
27.
go back to reference Semel ME, Resch S, Haynes AB, Funk LM, Bader A, Berry WR, Weiser TG, Gawande AA: Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. Health Aff (Millwood). 2010, 29: 1593-1599. 10.1377/hlthaff.2009.0709.CrossRef Semel ME, Resch S, Haynes AB, Funk LM, Bader A, Berry WR, Weiser TG, Gawande AA: Adopting a surgical safety checklist could save money and improve the quality of care in U.S. hospitals. Health Aff (Millwood). 2010, 29: 1593-1599. 10.1377/hlthaff.2009.0709.CrossRef
28.
go back to reference Hales BM, Pronovost PJ: The checklist tool for error management and performance improvement. J Crit Care. 2006, 21: 231e5-CrossRef Hales BM, Pronovost PJ: The checklist tool for error management and performance improvement. J Crit Care. 2006, 21: 231e5-CrossRef
30.
go back to reference O’Beirne M, Sterling P, Zwicker K, et al: Safety incidents in family medicine. BMJ Qual Saf. 2011, 20: 1005-1010. 10.1136/bmjqs-2011-000105.CrossRefPubMed O’Beirne M, Sterling P, Zwicker K, et al: Safety incidents in family medicine. BMJ Qual Saf. 2011, 20: 1005-1010. 10.1136/bmjqs-2011-000105.CrossRefPubMed
31.
go back to reference Jacobs S, O’Beirne M, Derfiingher LP, et al: Errors and adverse events in family medicine: developing and validating a Canadian taxonomy of errors. Can Fam Physician. 2007, 53: 271e6-271e270. Jacobs S, O’Beirne M, Derfiingher LP, et al: Errors and adverse events in family medicine: developing and validating a Canadian taxonomy of errors. Can Fam Physician. 2007, 53: 271e6-271e270.
32.
go back to reference De Wet C, Bowie P: A preliminary study to develop and test a global trigger tool to identify undetected error and patient harm in primary care records. Postgrad Med J. 2009, 85: 176-180. 10.1136/pgmj.2008.075788.CrossRefPubMed De Wet C, Bowie P: A preliminary study to develop and test a global trigger tool to identify undetected error and patient harm in primary care records. Postgrad Med J. 2009, 85: 176-180. 10.1136/pgmj.2008.075788.CrossRefPubMed
33.
go back to reference Hoffmann B, Beyer M, Rohe J, et al: ‘Every error counts’: a web-based incident reporting and learning system for general practice. Qual Saf Health Care. 2008, 17 (4): 307-312. 10.1136/qshc.2006.018440.CrossRefPubMed Hoffmann B, Beyer M, Rohe J, et al: ‘Every error counts’: a web-based incident reporting and learning system for general practice. Qual Saf Health Care. 2008, 17 (4): 307-312. 10.1136/qshc.2006.018440.CrossRefPubMed
34.
go back to reference Yaghmaie F: Content validity and its estimation. J Med Educ. 2003, 3 (1): 23-25. Yaghmaie F: Content validity and its estimation. J Med Educ. 2003, 3 (1): 23-25.
35.
go back to reference Weick K, Kathleen M: Managing the Unexpected-Assuring High Performance in an Age of Complexity. 2001, Jossey-Bass, San Francisco, CA, USA Weick K, Kathleen M: Managing the Unexpected-Assuring High Performance in an Age of Complexity. 2001, Jossey-Bass, San Francisco, CA, USA
36.
go back to reference Degani A, Wiener E: Human Factors of Flight-Deck Checklists: The normal Checklist. 1990, NASA, Moffet Field, California Degani A, Wiener E: Human Factors of Flight-Deck Checklists: The normal Checklist. 1990, NASA, Moffet Field, California
37.
go back to reference Haynes AB, Weiser TG, Berry WR, et al: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491e9-CrossRef Haynes AB, Weiser TG, Berry WR, et al: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491e9-CrossRef
38.
go back to reference Rao K, Lucas DN, Robinson PN: Surgical safety checklists in obstetrics. Int J Obstet Anesth. 2010, 19: 235e40-CrossRef Rao K, Lucas DN, Robinson PN: Surgical safety checklists in obstetrics. Int J Obstet Anesth. 2010, 19: 235e40-CrossRef
39.
go back to reference Gawande A: The checklist: if something so simple can transform intensive care, what else can it do?. New Yorker. 2007, 10: 86e101- Gawande A: The checklist: if something so simple can transform intensive care, what else can it do?. New Yorker. 2007, 10: 86e101-
40.
go back to reference Bosk CL, Dixon-Woods M, Goeschel CA, Pronovost PJ: The art of medicine: Reality check for checklists. Lancet. 2009, 374: 444-445. 10.1016/S0140-6736(09)61440-9.CrossRefPubMed Bosk CL, Dixon-Woods M, Goeschel CA, Pronovost PJ: The art of medicine: Reality check for checklists. Lancet. 2009, 374: 444-445. 10.1016/S0140-6736(09)61440-9.CrossRefPubMed
41.
go back to reference de Wet C, Johnson P, Mash R, McConnachie A, Bowie P: Measuring perceptions of safety climate in primary care: a cross-sectional study. . 2010, 18 (1): 135-42. Epub 2010 Sep 22 de Wet C, Johnson P, Mash R, McConnachie A, Bowie P: Measuring perceptions of safety climate in primary care: a cross-sectional study. . 2010, 18 (1): 135-42. Epub 2010 Sep 22
42.
go back to reference Campbell SM, Hann M, Hacker J, Burns C, Oliver D, Thapar A, Mead M, Safran DS, Roland MO: Identifying predictors of high quality care in English general practice: observational study. Br Med J. 2001, 323 (7316): 784-787. 10.1136/bmj.323.7316.784.CrossRef Campbell SM, Hann M, Hacker J, Burns C, Oliver D, Thapar A, Mead M, Safran DS, Roland MO: Identifying predictors of high quality care in English general practice: observational study. Br Med J. 2001, 323 (7316): 784-787. 10.1136/bmj.323.7316.784.CrossRef
43.
go back to reference Apekey TA, McSorley G, Tilling M, Siriwardena AN: Room for improvement? Leadership, innovation culture and uptake of quality improvement methods in general practice. J Eval Clin Pract. 2011, 17 (2): 311-318. 10.1111/j.1365-2753.2010.01447.x.CrossRefPubMed Apekey TA, McSorley G, Tilling M, Siriwardena AN: Room for improvement? Leadership, innovation culture and uptake of quality improvement methods in general practice. J Eval Clin Pract. 2011, 17 (2): 311-318. 10.1111/j.1365-2753.2010.01447.x.CrossRefPubMed
44.
go back to reference Colthart I, Bagnall G, Evans A, et al: The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide no. 10. Med Teach. 2008, 30: 124-145. 10.1080/01421590701881699.CrossRefPubMed Colthart I, Bagnall G, Evans A, et al: The effectiveness of self-assessment on the identification of learner needs, learner activity, and impact on clinical practice: BEME Guide no. 10. Med Teach. 2008, 30: 124-145. 10.1080/01421590701881699.CrossRefPubMed
45.
go back to reference Davis DA, Mazmanian PE, Fordis M, et al: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296: 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed Davis DA, Mazmanian PE, Fordis M, et al: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296: 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed
46.
go back to reference Overeem K, Faber M, Arah O, et al: Doctor performance assessment in daily practice: does it help doctors or not? A systematic review. Med Educ. 2007, 41: 1039-1049. 10.1111/j.1365-2923.2007.02897.x.CrossRefPubMed Overeem K, Faber M, Arah O, et al: Doctor performance assessment in daily practice: does it help doctors or not? A systematic review. Med Educ. 2007, 41: 1039-1049. 10.1111/j.1365-2923.2007.02897.x.CrossRefPubMed
47.
go back to reference Mackenzie P, Anthony S: The role of the GP trainer:medico-legal aspects. Clin Gov: An Int J. 2009, 14 (1): 74-79. 10.1108/14777270910933479.CrossRef Mackenzie P, Anthony S: The role of the GP trainer:medico-legal aspects. Clin Gov: An Int J. 2009, 14 (1): 74-79. 10.1108/14777270910933479.CrossRef
Metadata
Title
Maximising harm reduction in early specialty training for general practice: validation of a safety checklist
Authors
Paul Bowie
John McKay
Moya Kelly
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2012
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/1471-2296-13-62

Other articles of this Issue 1/2012

BMC Primary Care 1/2012 Go to the issue