Skip to main content
Top
Published in: Journal of General Internal Medicine 5/2019

01-05-2019 | Perspective

Entrustment Ratings in Internal Medicine Training: Capturing Meaningful Supervision Decisions or Just Another Rating?

Authors: Rose Hatala, MD, MSc, Shiphra Ginsburg, MD, PhD, Karen E. Hauer, MD, PhD, Andrea Gingerich, ND, MMEd, PhD

Published in: Journal of General Internal Medicine | Issue 5/2019

Login to get access

Abstract

The implementation of Entrustable Professional Activities has led to the simultaneous development of assessment based on a supervisor’s entrustment of a learner to perform these activities without supervision. While entrustment may be intuitive when we consider the direct observation of a procedural task, the current implementation of rating scales for internal medicine’s non-procedural tasks, based on entrustability, may not translate into meaningful learner assessment. In these Perspectives, we outline a number of potential concerns with ad hoc entrustability assessments in internal medicine post-graduate training: differences in the scope of procedural vs. non-procedural tasks, acknowledgement of the type of clinical oversight common within internal medicine, and the limitations of entrustment language. We point towards potential directions for inquiry that would require us to clarify the purpose of the entrustability assessment, reconsider each of the fundamental concepts of entrustment in internal medicine supervision and explore the use of descriptive rather than numeric assessment approaches.
Literature
1.
go back to reference Frank JR, Snell LS, ten Cate O, et al. Competency-based medical education: theory to practice. Med Teach. 2010; 32:638–645.CrossRefPubMed Frank JR, Snell LS, ten Cate O, et al. Competency-based medical education: theory to practice. Med Teach. 2010; 32:638–645.CrossRefPubMed
2.
go back to reference ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–547.CrossRefPubMed ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–547.CrossRefPubMed
3.
go back to reference ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002.CrossRefPubMed ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002.CrossRefPubMed
4.
go back to reference Hauer KE, Oza SK, Kogan JR, et al. How clinical supervisors develop trust in their trainees: a qualitative study. Med Educ. 2015;49(8):783–795.CrossRefPubMed Hauer KE, Oza SK, Kogan JR, et al. How clinical supervisors develop trust in their trainees: a qualitative study. Med Educ. 2015;49(8):783–795.CrossRefPubMed
5.
go back to reference Goldszmidt M, Faden L, Dornan T, Van Merrienboer J, Bordage G, Lingard L. Attending physician variability: a model of four supervisory styles. Acad Med. 2015;90(11):1541–1546.CrossRefPubMed Goldszmidt M, Faden L, Dornan T, Van Merrienboer J, Bordage G, Lingard L. Attending physician variability: a model of four supervisory styles. Acad Med. 2015;90(11):1541–1546.CrossRefPubMed
6.
go back to reference Kogan JR, Conforti LN, Bernabeo E, Iobst W, Holmboe E. How faculty members experience workplace-based assessment rater training: a qualitative study. Med Educ. 2015;49(7):692–708.CrossRefPubMed Kogan JR, Conforti LN, Bernabeo E, Iobst W, Holmboe E. How faculty members experience workplace-based assessment rater training: a qualitative study. Med Educ. 2015;49(7):692–708.CrossRefPubMed
7.
go back to reference Gingerich A, Daniels V, Farrell L, Olsen S-R, Kennedy T, Hatala R. Beyond hands-on and hands-off: supervisory approaches and entrustment on the inpatient ward. Med Educ. 2018;91(2):1028–1040. Gingerich A, Daniels V, Farrell L, Olsen S-R, Kennedy T, Hatala R. Beyond hands-on and hands-off: supervisory approaches and entrustment on the inpatient ward. Med Educ. 2018;91(2):1028–1040.
8.
go back to reference Rekman J, Gofton W, Dudek N, Gofton T, Hamstra SJ. Entrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment. Acad Med. 2016;91(2):186–190.CrossRefPubMed Rekman J, Gofton W, Dudek N, Gofton T, Hamstra SJ. Entrustability Scales: Outlining Their Usefulness for Competency-Based Clinical Assessment. Acad Med. 2016;91(2):186–190.CrossRefPubMed
9.
go back to reference Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Med Educ. 2011;45(6):560–569.CrossRefPubMed Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Med Educ. 2011;45(6):560–569.CrossRefPubMed
10.
go back to reference Beard JD, Marriott J, Purdie H, Crossley J. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess. 2011;15(1):1–194.CrossRef Beard JD, Marriott J, Purdie H, Crossley J. Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess. 2011;15(1):1–194.CrossRef
11.
go back to reference MacEwan MJ, Dudek NL, Wood TJ, Gofton WT. Continued Validation of the O-SCORE (Ottawa Surgical Competency Operating Room Evaluation): Use in the simulated environment. Teach Learn Med. 2015;28(1):72–79.CrossRef MacEwan MJ, Dudek NL, Wood TJ, Gofton WT. Continued Validation of the O-SCORE (Ottawa Surgical Competency Operating Room Evaluation): Use in the simulated environment. Teach Learn Med. 2015;28(1):72–79.CrossRef
12.
go back to reference Sebok-Syer SS, Chahine S, Watling CJ, Goldszmidt M, Cristancho S, Lingard L. Considering the interdependence of clinical performance: implications for assessment and entrustment. Med Educ. 2018;52(9):970–980. Sebok-Syer SS, Chahine S, Watling CJ, Goldszmidt M, Cristancho S, Lingard L. Considering the interdependence of clinical performance: implications for assessment and entrustment. Med Educ. 2018;52(9):970–980.
13.
go back to reference Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: The experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86(5):591–598.CrossRefPubMed Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: The experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86(5):591–598.CrossRefPubMed
14.
go back to reference ten Cate O, Hart D, Ankel F, et al. Entrustment Decision Making in Clinical Training. Acad Med. 2016;91(2):191–198.CrossRefPubMed ten Cate O, Hart D, Ankel F, et al. Entrustment Decision Making in Clinical Training. Acad Med. 2016;91(2):191–198.CrossRefPubMed
15.
go back to reference Duijn CCMA, Welink LS, Bok HGJ, ten Cate OTJ. When to trust our learners? Clinical teachers' perceptions of decision variables in the entrustment process. Perspect Med Educ. 2018;7(3):192–199.CrossRefPubMedPubMedCentral Duijn CCMA, Welink LS, Bok HGJ, ten Cate OTJ. When to trust our learners? Clinical teachers' perceptions of decision variables in the entrustment process. Perspect Med Educ. 2018;7(3):192–199.CrossRefPubMedPubMedCentral
16.
go back to reference Holmboe ES. Realizing the Promise of Competency-Based Medical Education. Acad Med. 2015;90(4):411–413.CrossRefPubMed Holmboe ES. Realizing the Promise of Competency-Based Medical Education. Acad Med. 2015;90(4):411–413.CrossRefPubMed
17.
go back to reference Kennedy TJT, Lingard L, Baker GR, Kitchen L, Regehr G. Clinical oversight: conceptualizing the relationship between supervision and safety. J Gen Intern Med. 2007;22(8):1080–1085.CrossRefPubMedPubMedCentral Kennedy TJT, Lingard L, Baker GR, Kitchen L, Regehr G. Clinical oversight: conceptualizing the relationship between supervision and safety. J Gen Intern Med. 2007;22(8):1080–1085.CrossRefPubMedPubMedCentral
18.
go back to reference Kane MT. Validating the Interpretations and Uses of Test Scores. J Educ Meas. 2013;50(1):1–73.CrossRef Kane MT. Validating the Interpretations and Uses of Test Scores. J Educ Meas. 2013;50(1):1–73.CrossRef
19.
go back to reference Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane's framework. Med Educ. 2015;49(6):560–575.CrossRefPubMed Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane's framework. Med Educ. 2015;49(6):560–575.CrossRefPubMed
20.
go back to reference ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39(12):1176–1177.CrossRefPubMed ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39(12):1176–1177.CrossRefPubMed
21.
go back to reference Warm EJ, Mathis BR, Held JD, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014;29(8):1177–1182.CrossRefPubMedPubMedCentral Warm EJ, Mathis BR, Held JD, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014;29(8):1177–1182.CrossRefPubMedPubMedCentral
22.
go back to reference Warm EJ, Held JD, Hellmann M, et al. Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency. Acad Med. 2016;91(10):1398–1405.CrossRefPubMed Warm EJ, Held JD, Hellmann M, et al. Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency. Acad Med. 2016;91(10):1398–1405.CrossRefPubMed
23.
go back to reference Halman S, Rekman J, Wood T, Baird A, Gofton W, Dudek N. Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine. BMC Med Educ. 2018; 18:218.CrossRefPubMedPubMedCentral Halman S, Rekman J, Wood T, Baird A, Gofton W, Dudek N. Avoid reinventing the wheel: implementation of the Ottawa Clinic Assessment Tool (OCAT) in Internal Medicine. BMC Med Educ. 2018; 18:218.CrossRefPubMedPubMedCentral
24.
go back to reference Cook DA, Kuper A, Hatala R, Ginsburg S. When assessment data are words: validity evidence for qualitative educational assessments. Acad Med. 2016; 91:1359–1369. Cook DA, Kuper A, Hatala R, Ginsburg S. When assessment data are words: validity evidence for qualitative educational assessments. Acad Med. 2016; 91:1359–1369.
25.
go back to reference Holmboe ES. Competency-based medical education and the ghost of Kuhn. Academic Medicine. 2018;93(3):350–353.CrossRefPubMed Holmboe ES. Competency-based medical education and the ghost of Kuhn. Academic Medicine. 2018;93(3):350–353.CrossRefPubMed
Metadata
Title
Entrustment Ratings in Internal Medicine Training: Capturing Meaningful Supervision Decisions or Just Another Rating?
Authors
Rose Hatala, MD, MSc
Shiphra Ginsburg, MD, PhD
Karen E. Hauer, MD, PhD
Andrea Gingerich, ND, MMEd, PhD
Publication date
01-05-2019
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 5/2019
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-019-04878-y

Other articles of this Issue 5/2019

Journal of General Internal Medicine 5/2019 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.