Skip to main content
Top
Published in: Journal of General Internal Medicine 9/2015

01-09-2015 | Innovation and Improvement: Innovations in Medical Education

Using a Curricular Vision to Define Entrustable Professional Activities for Medical Student Assessment

Authors: Karen E. Hauer, MD, Christy Boscardin, PhD, Tracy B. Fulton, PhD, Catherine Lucey, MD, Sandra Oza, MD, MA, Arianne Teherani, PhD

Published in: Journal of General Internal Medicine | Issue 9/2015

Login to get access

Abstract

Background

The new UCSF Bridges Curriculum aims to prepare students to succeed in today’s health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice.

Aim

To design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity.

Setting

University of California, San Francisco, School of Medicine.

Participants

Nineteen medical educators participated; 14 completed both rounds of a Delphi survey.

Program Description

Authors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA.

Program Evaluation

For 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %.

Discussion

We demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity.
Appendix
Available only for authorised users
Literature
2.
go back to reference Schuwirth LW, van der Vleuten CP. General overview of the theories used in assessment: AMEE Guide No. 57. Med Teach. 2011;33:783–97.CrossRefPubMed Schuwirth LW, van der Vleuten CP. General overview of the theories used in assessment: AMEE Guide No. 57. Med Teach. 2011;33:783–97.CrossRefPubMed
3.
go back to reference Howley LD, Wilson WG. Direct observation of students during clerkship rotations: a multiyear descriptive study. Acad Med. 2004;79:276–80.CrossRefPubMed Howley LD, Wilson WG. Direct observation of students during clerkship rotations: a multiyear descriptive study. Acad Med. 2004;79:276–80.CrossRefPubMed
4.
go back to reference Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: the experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86:591–8.CrossRefPubMed Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: the experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86:591–8.CrossRefPubMed
7.
go back to reference Boyce P, Spratt C, Davies M, McEvoy P. Using entrustable professional activities to guide curriculum development in Psychiatry training. BMC Med Educ. 2011;11:96.PubMedCentralCrossRefPubMed Boyce P, Spratt C, Davies M, McEvoy P. Using entrustable professional activities to guide curriculum development in Psychiatry training. BMC Med Educ. 2011;11:96.PubMedCentralCrossRefPubMed
8.
9.
go back to reference Beeson MS, Warrington S, Bradford-Saffles A, Hart D. Entrustable professional activities: making sense of the emergency medicine milestones. J Emerg Med. 2014;47:441–52.CrossRefPubMed Beeson MS, Warrington S, Bradford-Saffles A, Hart D. Entrustable professional activities: making sense of the emergency medicine milestones. J Emerg Med. 2014;47:441–52.CrossRefPubMed
10.
go back to reference Hauer KE, Soni K, Cornett P, et al. Developing entrustable professional activities as the basis for assessment of competence in an internal medicine residency: a feasibility study. J Gen Intern Med. 2013;28:1110–4.PubMedCentralCrossRefPubMed Hauer KE, Soni K, Cornett P, et al. Developing entrustable professional activities as the basis for assessment of competence in an internal medicine residency: a feasibility study. J Gen Intern Med. 2013;28:1110–4.PubMedCentralCrossRefPubMed
11.
go back to reference Hirsh DA, Holmboe ES, ten Cate O. Time to trust: longitudinal integrated clerkships and entrustable professional activities. Acad Med. 2014;89(2):201–4.CrossRefPubMed Hirsh DA, Holmboe ES, ten Cate O. Time to trust: longitudinal integrated clerkships and entrustable professional activities. Acad Med. 2014;89(2):201–4.CrossRefPubMed
12.
go back to reference Chen HC, Sheu L, O’Sullivan P, Ten Cate O, Teherani A. Legitimate workplace roles and activities for early learners. Med Educ. 2014;48(2):136–45.CrossRefPubMed Chen HC, Sheu L, O’Sullivan P, Ten Cate O, Teherani A. Legitimate workplace roles and activities for early learners. Med Educ. 2014;48(2):136–45.CrossRefPubMed
14.
go back to reference American Psychological Association, American Educational Research Association, and National Council on Measurement in Education. Standards for Educational & Psychological Tests. American Psychological Association; 2014. American Psychological Association, American Educational Research Association, and National Council on Measurement in Education. Standards for Educational & Psychological Tests. American Psychological Association; 2014.
15.
go back to reference Lucey CR. Medical education: part of the problem and part of the solution. JAMA Intern Med. 2013;23(173):1639–43.CrossRef Lucey CR. Medical education: part of the problem and part of the solution. JAMA Intern Med. 2013;23(173):1639–43.CrossRef
16.
go back to reference Ten Cate O, Scheele F. Viewpoint: Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–7.CrossRefPubMed Ten Cate O, Scheele F. Viewpoint: Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–7.CrossRefPubMed
17.
go back to reference Englander R, Cameron T, Ballard AJ, Dodge J, Bull J, Aschenbrener CA. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 2013;88:1088–94.CrossRefPubMed Englander R, Cameron T, Ballard AJ, Dodge J, Bull J, Aschenbrener CA. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 2013;88:1088–94.CrossRefPubMed
18.
go back to reference Meade LB, Caverzagie KJ, Swing SR, et al. Playing with curricular milestones in the educational sandbox: Q-sort results from an internal medicine educational collaborative. Acad Med. 2013;88:1142–8.CrossRefPubMed Meade LB, Caverzagie KJ, Swing SR, et al. Playing with curricular milestones in the educational sandbox: Q-sort results from an internal medicine educational collaborative. Acad Med. 2013;88:1142–8.CrossRefPubMed
19.
go back to reference Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30:459–67.CrossRefPubMed Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30:459–67.CrossRefPubMed
21.
go back to reference Lurie SJ, Mooney CJ, Lyness JM. Commentary: pitfalls in assessment of competency-based educational objectives. Acad Med. 2011;86:412–414.CrossRefPubMed Lurie SJ, Mooney CJ, Lyness JM. Commentary: pitfalls in assessment of competency-based educational objectives. Acad Med. 2011;86:412–414.CrossRefPubMed
22.
go back to reference Mulder H, Ten Cate O, Daalder R, Berkvens J. Building a competency-based workplace curriculum around entrustable professional activities: the case of physician assistant training. Med Teach. 2010;32:e453–9.CrossRefPubMed Mulder H, Ten Cate O, Daalder R, Berkvens J. Building a competency-based workplace curriculum around entrustable professional activities: the case of physician assistant training. Med Teach. 2010;32:e453–9.CrossRefPubMed
23.
go back to reference Warm EJ, Mathis BR, Held JD, Pai S, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014;29:1177–82.PubMedCentralCrossRefPubMed Warm EJ, Mathis BR, Held JD, Pai S, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014;29:1177–82.PubMedCentralCrossRefPubMed
Metadata
Title
Using a Curricular Vision to Define Entrustable Professional Activities for Medical Student Assessment
Authors
Karen E. Hauer, MD
Christy Boscardin, PhD
Tracy B. Fulton, PhD
Catherine Lucey, MD
Sandra Oza, MD, MA
Arianne Teherani, PhD
Publication date
01-09-2015
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 9/2015
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-015-3264-z

Other articles of this Issue 9/2015

Journal of General Internal Medicine 9/2015 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.