Skip to main content
Top
Published in: Perspectives on Medical Education 3/2018

Open Access 01-06-2018 | Original Article

When to trust our learners? Clinical teachers’ perceptions of decision variables in the entrustment process

Authors: Chantal C. M. A. Duijn, Lisanne S. Welink, Harold G. J. Bok, Olle T. J. ten Cate

Published in: Perspectives on Medical Education | Issue 3/2018

Login to get access

Abstract

Introduction

Clinical training programs increasingly use entrustable professional activities (EPAs) as focus of assessment. However, questions remain about which information should ground decisions to trust learners. This qualitative study aimed to identify decision variables in the workplace that clinical teachers find relevant in the elaboration of the entrustment decision processes. The findings can substantiate entrustment decision-making in the clinical workplace.

Methods

Focus groups were conducted with medical and veterinary clinical teachers, using the structured consensus method of the Nominal Group Technique to generate decision variables. A ranking was made based on a relevance score assigned by the clinical teachers to the different decision variables. Field notes, audio recordings and flip chart lists were analyzed and subsequently translated and, as a form of axial coding, merged into one list, combining the decision variables that were similar in their meaning.

Results

A list of 11 and 17 decision variables were acknowledged as relevant by the medical and veterinary teacher groups, respectively. The focus groups yielded 21 unique decision variables that were considered relevant to inform readiness to perform a clinical task on a designated level of supervision. The decision variables consisted of skills, generic qualities, characteristics, previous performance or other information. We were able to group the decision variables into five categories: ability, humility, integrity, reliability and adequate exposure.

Discussion

To entrust a learner to perform a task at a specific level of supervision, a supervisor needs information to support such a judgement. This trust cannot be credited on a single case at a single moment of assessment, but requires different variables and multiple sources of information. This study provides an overview of decision variables giving evidence to justify the multifactorial process of making an entrustment decision.
Literature
1.
go back to reference Albanese AM. Challenges in using rater judgements in medical education. J Eval Clin Pract. 2000;6:305–19.CrossRef Albanese AM. Challenges in using rater judgements in medical education. J Eval Clin Pract. 2000;6:305–19.CrossRef
2.
go back to reference Massie J, Ali JM. Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings. Adv Health Sci Educ Theory Pract. 2016;21:455–73.CrossRef Massie J, Ali JM. Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings. Adv Health Sci Educ Theory Pract. 2016;21:455–73.CrossRef
3.
go back to reference Govaerts MJ, Van der Vleuten CPM, Schuwirth LW, Muijtjens AM. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract. 2007;12:239–60.CrossRef Govaerts MJ, Van der Vleuten CPM, Schuwirth LW, Muijtjens AM. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract. 2007;12:239–60.CrossRef
4.
go back to reference Choo KJ, Arora VM, Barach P, et al. How do supervising physicians decide to entrust residents with unsupervised tasks? A qualitative analysis. J Hosp Med. 2014;9:169–75.CrossRef Choo KJ, Arora VM, Barach P, et al. How do supervising physicians decide to entrust residents with unsupervised tasks? A qualitative analysis. J Hosp Med. 2014;9:169–75.CrossRef
5.
go back to reference Gingerich A, Kogan J, Yeates P, et al. Seeing the ‘black box’ differently: assessor cognition from three research perspectives. Med Educ. 2014;48:1055–68.CrossRef Gingerich A, Kogan J, Yeates P, et al. Seeing the ‘black box’ differently: assessor cognition from three research perspectives. Med Educ. 2014;48:1055–68.CrossRef
6.
go back to reference Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 2014;89:721–7.CrossRef Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 2014;89:721–7.CrossRef
7.
go back to reference ten Cate O, Hart D, Ankel F, et al. Entrustment decision making in clinical training. Acad Med. 2016;91:191–8.CrossRef ten Cate O, Hart D, Ankel F, et al. Entrustment decision making in clinical training. Acad Med. 2016;91:191–8.CrossRef
8.
go back to reference Hauer KE, ten Cate O, Boscardin C, et al. Understanding trust as an essential element of trainee supervision and learning in the workplace. Adv Health Sci Educ Theory Pract. 2014;19:435–56. Hauer KE, ten Cate O, Boscardin C, et al. Understanding trust as an essential element of trainee supervision and learning in the workplace. Adv Health Sci Educ Theory Pract. 2014;19:435–56.
9.
go back to reference Hauer KE, Oza SK, Kogan JR, et al. How clinical supervisors develop trust in their trainees: a qualitative study. Med Educ. 2015;49:783–95.CrossRef Hauer KE, Oza SK, Kogan JR, et al. How clinical supervisors develop trust in their trainees: a qualitative study. Med Educ. 2015;49:783–95.CrossRef
10.
go back to reference ten Cate O. Entrustability of professional activities and competency-bases training. Med Educ. 2005;39:1176–7.CrossRef ten Cate O. Entrustability of professional activities and competency-bases training. Med Educ. 2005;39:1176–7.CrossRef
11.
go back to reference ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–7.CrossRef ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–7.CrossRef
12.
go back to reference ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using entrustable professional activities (EPAs): AMEE guide no. 99. Med Teach. 2015;37:983–1002.CrossRef ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using entrustable professional activities (EPAs): AMEE guide no. 99. Med Teach. 2015;37:983–1002.CrossRef
13.
go back to reference ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013;5:157–8.CrossRef ten Cate O. Nuts and bolts of entrustable professional activities. J Grad Med Educ. 2013;5:157–8.CrossRef
14.
go back to reference Brown DR, Warren JB, Hyderi A, et al. Finding a path to entrustment in undergraduate medical education: a progress report from the AAMC Core Entrustable Professional Activities for Entering Residency entrustment concept group. Acad Med. 2017;92:774–9.CrossRef Brown DR, Warren JB, Hyderi A, et al. Finding a path to entrustment in undergraduate medical education: a progress report from the AAMC Core Entrustable Professional Activities for Entering Residency entrustment concept group. Acad Med. 2017;92:774–9.CrossRef
15.
go back to reference Ten Cate O. Entrustment decisions: bringing the patient into the assessment equation. Acad Med. 2017;201792:736–8.CrossRef Ten Cate O. Entrustment decisions: bringing the patient into the assessment equation. Acad Med. 2017;201792:736–8.CrossRef
16.
go back to reference Kennedy TJ, Regehr G, Baker GR, Lingard L. Point-of-care assessment of medical trainee competence for independent clinical work. Acad Med. 2008;83(10 Suppl):89–92.CrossRef Kennedy TJ, Regehr G, Baker GR, Lingard L. Point-of-care assessment of medical trainee competence for independent clinical work. Acad Med. 2008;83(10 Suppl):89–92.CrossRef
17.
go back to reference Sterkenburg A, Barach P, Kalkman C, et al. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85:1408–17.CrossRef Sterkenburg A, Barach P, Kalkman C, et al. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85:1408–17.CrossRef
18.
go back to reference Dijksterhuis MG, Voorhuis M, Teunissen PW, et al. Assessment of competence and progressive independence in postgraduate clinical training. Med Educ. 2009;43:1156–65.CrossRef Dijksterhuis MG, Voorhuis M, Teunissen PW, et al. Assessment of competence and progressive independence in postgraduate clinical training. Med Educ. 2009;43:1156–65.CrossRef
19.
go back to reference Wijnen-Meijer M, van der Schaaf M, Nillesen K, et al. Essential facets of competence that enable trust in graduates: a Delphi study among physician educators in the Netherlands. J Grad Med Educ. 2013;5:46–53.CrossRef Wijnen-Meijer M, van der Schaaf M, Nillesen K, et al. Essential facets of competence that enable trust in graduates: a Delphi study among physician educators in the Netherlands. J Grad Med Educ. 2013;5:46–53.CrossRef
20.
go back to reference Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Med Educ. 2011;45:560–9.CrossRef Crossley J, Johnson G, Booth J, Wade W. Good questions, good answers: construct alignment improves the performance of workplace-based assessment scales. Med Educ. 2011;45:560–9.CrossRef
21.
go back to reference Weller J, Castanelli D, Chen Y, Jolly B. Making robust assessments of specialist trainees’ workplace performance. Br J Anaesth. 2017;118:207–14.CrossRef Weller J, Castanelli D, Chen Y, Jolly B. Making robust assessments of specialist trainees’ workplace performance. Br J Anaesth. 2017;118:207–14.CrossRef
22.
go back to reference Weller J, Misur M, Nicolson S, et al. Can I leave the theatre? A key to more reliable workplace-based assessment. Br J Anaesth. 2014;112:1083–91.CrossRef Weller J, Misur M, Nicolson S, et al. Can I leave the theatre? A key to more reliable workplace-based assessment. Br J Anaesth. 2014;112:1083–91.CrossRef
23.
go back to reference Kogan JR, Conforti L, Bernabeo E, et al. Opening the black box of clinical skills assessment via observation: a conceptual model. Med Educ. 2011;45:1048–60.CrossRef Kogan JR, Conforti L, Bernabeo E, et al. Opening the black box of clinical skills assessment via observation: a conceptual model. Med Educ. 2011;45:1048–60.CrossRef
24.
go back to reference Yeates P, O’Neill P, Mann K, Eva K. Seeing the same thing differently. Adv Health Sci Educ Theory Pract. 2013;18:325–41.CrossRef Yeates P, O’Neill P, Mann K, Eva K. Seeing the same thing differently. Adv Health Sci Educ Theory Pract. 2013;18:325–41.CrossRef
25.
go back to reference Berendonk C, Stalmeijer RE, Schuwirth LW. Expertise in performance assessment: assessors’ perspectives. Adv Health Sci Educ Theory Pract. 2013;18:559–71.CrossRef Berendonk C, Stalmeijer RE, Schuwirth LW. Expertise in performance assessment: assessors’ perspectives. Adv Health Sci Educ Theory Pract. 2013;18:559–71.CrossRef
26.
go back to reference Mayer RC, Davis JH, Schoorman FD. An integrative model of organizational trust. Acad Manage Rev. 1995;20:709–34.CrossRef Mayer RC, Davis JH, Schoorman FD. An integrative model of organizational trust. Acad Manage Rev. 1995;20:709–34.CrossRef
27.
go back to reference ten Cate O. Entrustment as assessment: recognizing the ability, the right, and the duty to act. J Grad Med Educ. 2016;8:261–2.CrossRef ten Cate O. Entrustment as assessment: recognizing the ability, the right, and the duty to act. J Grad Med Educ. 2016;8:261–2.CrossRef
28.
go back to reference Rabiee F. Focus-group interview and data analysis. Proc Nutr Soc. 2004;63(4):655–60.CrossRef Rabiee F. Focus-group interview and data analysis. Proc Nutr Soc. 2004;63(4):655–60.CrossRef
29.
go back to reference O’Neil MJ, Jackson L. Nominal group technique: a process for initiating curriculum development in higher education. Stud High Educ. 1983;8:129–38.CrossRef O’Neil MJ, Jackson L. Nominal group technique: a process for initiating curriculum development in higher education. Stud High Educ. 1983;8:129–38.CrossRef
31.
go back to reference ten Cate O, Hoff RG. From case-based to entrustment-based discussions. Clin Teach. 2017;14:385–9.CrossRef ten Cate O, Hoff RG. From case-based to entrustment-based discussions. Clin Teach. 2017;14:385–9.CrossRef
32.
go back to reference Teddlie C, Yu F. Mixed methods sampling: a typology with examples. J Mix Methods Res. 2007;1:77–100. Teddlie C, Yu F. Mixed methods sampling: a typology with examples. J Mix Methods Res. 2007;1:77–100.
33.
go back to reference Tiyyagura G, Balmer D, Chaudoin L, et al. The greater good: how supervising physicians make entrustment decisions in the pediatric emergency department. Acad Pediatr. 2014;14:597–602.CrossRef Tiyyagura G, Balmer D, Chaudoin L, et al. The greater good: how supervising physicians make entrustment decisions in the pediatric emergency department. Acad Pediatr. 2014;14:597–602.CrossRef
34.
go back to reference Schuwirth LW, Van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011;33:478–85.CrossRef Schuwirth LW, Van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Med Teach. 2011;33:478–85.CrossRef
35.
go back to reference van der Vleuten CPM, Schuwirth L, Driessen E, et al. A model for programmatic assessment fit for purpose. Med Teach. 2012;34:205–14.CrossRef van der Vleuten CPM, Schuwirth L, Driessen E, et al. A model for programmatic assessment fit for purpose. Med Teach. 2012;34:205–14.CrossRef
36.
go back to reference Bok HG, Teunissen PW, Favier RP, et al. Programmatic assessment of competency-based workplace learning: when theory meets practice. BMC Med Educ. 2013;13:123.CrossRef Bok HG, Teunissen PW, Favier RP, et al. Programmatic assessment of competency-based workplace learning: when theory meets practice. BMC Med Educ. 2013;13:123.CrossRef
37.
go back to reference Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 2009;302:1316–26.CrossRef Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 2009;302:1316–26.CrossRef
Metadata
Title
When to trust our learners? Clinical teachers’ perceptions of decision variables in the entrustment process
Authors
Chantal C. M. A. Duijn
Lisanne S. Welink
Harold G. J. Bok
Olle T. J. ten Cate
Publication date
01-06-2018
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 3/2018
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-018-0430-0

Other articles of this Issue 3/2018

Perspectives on Medical Education 3/2018 Go to the issue