Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Nurses’ evaluation of physicians’ non-clinical performance in emergency departments: advantages, disadvantages and lessons learned

Authors: Mohamad Alameddine, Afif Mufarrij, Miriam Saliba, Yara Mourad, Rima Jabbour, Eveline Hitti

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Peer evaluation is increasingly used as a method to assess physicians’ interpersonal and communication skills. We report on experience with soliciting registered nurses’ feedback on physicians’ non-clinical performance in the ED of a large academic medical center in Lebanon.

Methods

We utilized a secondary analysis of a de-identified database of ED nurses’ assessment of physicians’ non-clinical performance coupled with an evaluation of interventions carried out as a result of this evaluation. The database was compiled as part of quality/performance improvement initiatives using a cross-sectional design to survey registered nurses working at the ED. The survey instrument included open ended and closed ended questions assessing physicians’ communication, professionalism and leadership skills. Three episodes of evaluation were carried out over an 18 month period. Physicians were provided with a communication training carried out after the first cycle of evaluation and a detailed feedback on their assessment by nurses after each evaluation cycle. A paired t-test was carried out to compare mean evaluation scores between the three cycles of evaluation. Thematic analysis of nurses’ qualitative comments was carried out.

Results

A statistically significant increase in the averages of skills was observed between the first and second evaluations, followed by a significant decrease in the averages of the three skills between the second and third evaluations. Personalized feedback to ED physicians and communication training initially contributed to a significant positive impact on improving ED physicians’ non-clinical skills as perceived by the ED nurses. Yet, gains achieved were lost upon reaching the third cycle of evaluation. However, the thematic analysis of the nurses’ qualitative responses portrays a decrease in concerns across the various dimensions of non-clinical performance.

Conclusions

Nurses’ evaluation of the non-clinical performance of physicians has the potential of improving communication, professionalism and leadership skills amongst physicians. For improvement to be realized in a sustainable manner, such programs may need to be offered in a staged and incremental manner over a long period of time with proper dedication of resources and timely monitoring and evaluation of outcomes. Department directors need to be trained on providing peer evaluation feedback in a constructive manner.
Literature
1.
go back to reference Landon BE, Normand SL, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290(9):1183–9.CrossRefPubMed Landon BE, Normand SL, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290(9):1183–9.CrossRefPubMed
2.
go back to reference Margolis MJ, De Champlain AF, Klass DJ. Setting examination-level standards for a performance-based assessment of physicians’ clinical skills. Acad Med. 1998;73(10 Suppl):S114–6.CrossRefPubMed Margolis MJ, De Champlain AF, Klass DJ. Setting examination-level standards for a performance-based assessment of physicians’ clinical skills. Acad Med. 1998;73(10 Suppl):S114–6.CrossRefPubMed
3.
go back to reference Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13 Suppl 1:i85–90.CrossRefPubMedPubMedCentral Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13 Suppl 1:i85–90.CrossRefPubMedPubMedCentral
4.
go back to reference Patterson F, Ferguson E, Lane P, Farrell K, Martlew J, Wells A. A competency model for general practice: implications for selection, training, and development. Br J Gen Pract. 2000;50(452):188–93.PubMedPubMedCentral Patterson F, Ferguson E, Lane P, Farrell K, Martlew J, Wells A. A competency model for general practice: implications for selection, training, and development. Br J Gen Pract. 2000;50(452):188–93.PubMedPubMedCentral
5.
go back to reference Sherbino J, Bandiera G, Frank JR. Assessing competence in emergency medicine trainees: an overview of effective methodologies. CJEM. 2008;10(4):365–71.CrossRefPubMed Sherbino J, Bandiera G, Frank JR. Assessing competence in emergency medicine trainees: an overview of effective methodologies. CJEM. 2008;10(4):365–71.CrossRefPubMed
7.
go back to reference Crossley J, Davies H. Doctors’ consultations with children and their parents: a model of competencies, outcomes and confounding influences. Med Educ. 2005;39(8):807–19.CrossRefPubMed Crossley J, Davies H. Doctors’ consultations with children and their parents: a model of competencies, outcomes and confounding influences. Med Educ. 2005;39(8):807–19.CrossRefPubMed
8.
go back to reference Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143–51.CrossRefPubMed Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143–51.CrossRefPubMed
9.
go back to reference Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002;287(2):226–35.CrossRefPubMed Epstein RM, Hundert EM. Defining and assessing professional competence. JAMA. 2002;287(2):226–35.CrossRefPubMed
10.
go back to reference Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof. 2003;23(1):4–12.CrossRefPubMed Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof. 2003;23(1):4–12.CrossRefPubMed
11.
go back to reference Young GJ, Charns MP, Desai K, Khuri SF, Forbes MG, Henderson W, et al. Patterns of coordination and clinical outcomes: a study of surgical services. Health Serv Res. 1998;33(5 Pt 1):1211–36.PubMedPubMedCentral Young GJ, Charns MP, Desai K, Khuri SF, Forbes MG, Henderson W, et al. Patterns of coordination and clinical outcomes: a study of surgical services. Health Serv Res. 1998;33(5 Pt 1):1211–36.PubMedPubMedCentral
12.
go back to reference Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA, et al. Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. Health Serv Res. 2002;37(6):1553–81.CrossRefPubMedPubMedCentral Morey JC, Simon R, Jay GD, Wears RL, Salisbury M, Dukes KA, et al. Error reduction and performance improvement in the emergency department through formal teamwork training: evaluation results of the MedTeams project. Health Serv Res. 2002;37(6):1553–81.CrossRefPubMedPubMedCentral
13.
go back to reference Flin R, O’Connor P, Crichton M. Safety at the sharp end: a guide to nontechnical skills: Aldershot. UK: Ashgate; 2008. Flin R, O’Connor P, Crichton M. Safety at the sharp end: a guide to nontechnical skills: Aldershot. UK: Ashgate; 2008.
14.
go back to reference Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993;269(13):1655–60.CrossRefPubMed Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larson EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993;269(13):1655–60.CrossRefPubMed
15.
go back to reference Bracken DW, Timmreck CW. Success and sustainability: a systems view of multisource feedback. The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes. 2001;478:494. Bracken DW, Timmreck CW. Success and sustainability: a systems view of multisource feedback. The handbook of multisource feedback: The comprehensive resource for designing and implementing MSF processes. 2001;478:494.
16.
go back to reference Al Ansari A, Donnon T, Al Khalifa K, Darwish A, Violato C. The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis. Adv Med Educ Pract. 2014;5:39–51.CrossRefPubMedPubMedCentral Al Ansari A, Donnon T, Al Khalifa K, Darwish A, Violato C. The construct and criterion validity of the multi-source feedback process to assess physician performance: a meta-analysis. Adv Med Educ Pract. 2014;5:39–51.CrossRefPubMedPubMedCentral
17.
go back to reference Brinkman WB, Geraghty SR, Lanphear BP, Khoury JC. Effect of multi-source feedback on resident communication skills and professionalism: a randomised controlled trial. Arch Pediatr Adolesc Med. 2007;161:44.CrossRefPubMed Brinkman WB, Geraghty SR, Lanphear BP, Khoury JC. Effect of multi-source feedback on resident communication skills and professionalism: a randomised controlled trial. Arch Pediatr Adolesc Med. 2007;161:44.CrossRefPubMed
18.
go back to reference Pressel DM, Rappaport DI, Watson N. Nurses’ assessment of pediatric physicians: are hospitalists different? J Healthc Manag. 2008;53(1):14–24. discussion 24–5.PubMed Pressel DM, Rappaport DI, Watson N. Nurses’ assessment of pediatric physicians: are hospitalists different? J Healthc Manag. 2008;53(1):14–24. discussion 24–5.PubMed
19.
20.
go back to reference Nofziger AC, Naumburg EH, Davis BJ, Mooney CJ, Epstein RM. Impact of peer assessment on the professional development of medical students: a qualitative study. Acad Med. 2010;85(1):140–7.CrossRefPubMed Nofziger AC, Naumburg EH, Davis BJ, Mooney CJ, Epstein RM. Impact of peer assessment on the professional development of medical students: a qualitative study. Acad Med. 2010;85(1):140–7.CrossRefPubMed
22.
go back to reference Bret J, Atwater L. 360-degree feedback: accuracy, reactions and perceptions of usefulness. J Appl Psychol. 2001;86:930.CrossRef Bret J, Atwater L. 360-degree feedback: accuracy, reactions and perceptions of usefulness. J Appl Psychol. 2001;86:930.CrossRef
23.
go back to reference Cosby KS, Croskerry P. Profiles in patient safety: authority gradients in medical error. Acad Emerg Med. 2004;11(12):1341–5.CrossRefPubMed Cosby KS, Croskerry P. Profiles in patient safety: authority gradients in medical error. Acad Emerg Med. 2004;11(12):1341–5.CrossRefPubMed
24.
go back to reference El-Jardali F, Makhoul J, Jamal D, Ranson MK, Kronfol NM, Tchaghchagian V. Eliciting policymakers’ and stakeholders’ opinions to help shape health system research priorities in the Middle East and North Africa region. Health Policy Plan. 2010;25(1):15–27.CrossRefPubMed El-Jardali F, Makhoul J, Jamal D, Ranson MK, Kronfol NM, Tchaghchagian V. Eliciting policymakers’ and stakeholders’ opinions to help shape health system research priorities in the Middle East and North Africa region. Health Policy Plan. 2010;25(1):15–27.CrossRefPubMed
25.
go back to reference Fallowfield L, Jenkins V, Farewell V, Solis-Trapala I. Enduring impact of communication skills training: results of a 12-month follow-up. Br J Cancer. 2003;89(8):1445–9.CrossRefPubMedPubMedCentral Fallowfield L, Jenkins V, Farewell V, Solis-Trapala I. Enduring impact of communication skills training: results of a 12-month follow-up. Br J Cancer. 2003;89(8):1445–9.CrossRefPubMedPubMedCentral
26.
go back to reference Sargeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J. Challenges in multisource feedback: intended and unintended outcomes. Med Educ. 2007;41(6):583–91.CrossRefPubMed Sargeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J. Challenges in multisource feedback: intended and unintended outcomes. Med Educ. 2007;41(6):583–91.CrossRefPubMed
27.
go back to reference Sargeant J, Mann K, Sinclair D, Van der Vleuten C, Metsemakers J. Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use. Adv Health Sci Educ Theory Pract. 2008;13(3):275–88.CrossRefPubMed Sargeant J, Mann K, Sinclair D, Van der Vleuten C, Metsemakers J. Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use. Adv Health Sci Educ Theory Pract. 2008;13(3):275–88.CrossRefPubMed
29.
go back to reference Seago J. Professional communication. In: Hughes R, editor. Patient safety and quality: an evidence-based handbook for nurses Hughes RD edition. Rockville (MD): Agency for Healthcare Research and Quality; 2008. Seago J. Professional communication. In: Hughes R, editor. Patient safety and quality: an evidence-based handbook for nurses Hughes RD edition. Rockville (MD): Agency for Healthcare Research and Quality; 2008.
30.
go back to reference Fletcher C. Performance appraisal and management: the developing research agenda. J Occup Organ Psychol. 2001;74:473–87.CrossRef Fletcher C. Performance appraisal and management: the developing research agenda. J Occup Organ Psychol. 2001;74:473–87.CrossRef
31.
go back to reference Knowles MS, Holton EF, Swanson RA. The adult learner. Gulf Publishing: Houston; 1998. Knowles MS, Holton EF, Swanson RA. The adult learner. Gulf Publishing: Houston; 1998.
Metadata
Title
Nurses’ evaluation of physicians’ non-clinical performance in emergency departments: advantages, disadvantages and lessons learned
Authors
Mohamad Alameddine
Afif Mufarrij
Miriam Saliba
Yara Mourad
Rima Jabbour
Eveline Hitti
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0733-3

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue