Skip to main content
Top
Published in: Perspectives on Medical Education 5/2015

Open Access 01-10-2015 | Original Article

Putting performance in context: the perceived influence of environmental factors on work-based performance

Authors: Lynfa Stroud, Pier Bryden, Bochra Kurabi, Shiphra Ginsburg

Published in: Perspectives on Medical Education | Issue 5/2015

Login to get access

Abstract

Introduction

Context shapes behaviours yet is seldom considered when assessing competence. Our objective was to explore attending physicians’ and trainees’ perceptions of the Internal Medicine Clinical Teaching Unit (CTU) environment and how they thought contextual factors affected their performance.

Method

29 individuals recently completing CTU rotations participated in nine level-specific focus groups (2 with attending physicians, 3 with senior and 2 with junior residents, and 2 with students). Participants were asked to identify environmental factors on the CTU and to describe how these factors influenced their own performance across CanMEDS roles. Discussions were analyzed using constructivist grounded theory.

Results

Five major contextual factors were identified: Busyness, Multiple Hats, Other People, Educational Structures, and Hospital Resources and Policies. Busyness emerged as the most important, but all factors had a substantial perceived impact on performance. Participants felt their performance on the Manager and Scholar roles was most affected by environmental factors (mostly negatively, due to decreased efficiency and impact on learning).

Conclusions

In complex workplace environments, numerous factors shape performance. These contextual factors and their impact need to be considered in observations and judgements made about performance in the workplace, as without this understanding conclusions about competency may be flawed.
Appendix
Available only for authorised users
Literature
4.
go back to reference van der Vleuten CP, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.CrossRef van der Vleuten CP, Schuwirth LW. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.CrossRef
5.
go back to reference Lingard L. What we see and don’t see when we look at ‘competence’: notes on a god term. Adv in Health Sci Educ. 2009;14:625–58.CrossRef Lingard L. What we see and don’t see when we look at ‘competence’: notes on a god term. Adv in Health Sci Educ. 2009;14:625–58.CrossRef
6.
go back to reference Govaerts M, van der Vleuten CPM. Validity in work-based assessment: expanding our horizons. Med Educ. 2013;47:1164–74.CrossRef Govaerts M, van der Vleuten CPM. Validity in work-based assessment: expanding our horizons. Med Educ. 2013;47:1164–74.CrossRef
7.
go back to reference Govaerts MJB, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: rethinking the nature of In-training assessment. Adv in Health Sci Educ. 2007;12:239–60.CrossRef Govaerts MJB, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: rethinking the nature of In-training assessment. Adv in Health Sci Educ. 2007;12:239–60.CrossRef
8.
go back to reference Kuper A, Reeves S, Albert M, Hodges BD. Assessment: do we need to broaden our methodological horizons? Med Educ. 2007;41:1121–3.CrossRef Kuper A, Reeves S, Albert M, Hodges BD. Assessment: do we need to broaden our methodological horizons? Med Educ. 2007;41:1121–3.CrossRef
9.
go back to reference Handfield-Jones RS, Mann KV, Challis ME, et al. Linking assessment to learning: a new route to quality assurance in medical practice. Med Educ. 2002;36:949–58.CrossRef Handfield-Jones RS, Mann KV, Challis ME, et al. Linking assessment to learning: a new route to quality assurance in medical practice. Med Educ. 2002;36:949–58.CrossRef
10.
go back to reference Durning SJ, Artino AR, Boulet JR, Dorrance K, Van der Vleuten CPM, Schuwirth LWT. The impact of selected contextual factors on experts’ clinical reasoning performance (does context impact clinical reasoning performance in experts?). Adv Health Sci Educ Theory Pract. 2012;17:65–79.CrossRef Durning SJ, Artino AR, Boulet JR, Dorrance K, Van der Vleuten CPM, Schuwirth LWT. The impact of selected contextual factors on experts’ clinical reasoning performance (does context impact clinical reasoning performance in experts?). Adv Health Sci Educ Theory Pract. 2012;17:65–79.CrossRef
11.
go back to reference Ginsburg S, Bernabeo E, Ross KM, Holmboe ES. ‘It depends’: results of a qualitative study investigating how practicing internists approach professional dilemmas. Acad Med. 2012;87:1–9.CrossRef Ginsburg S, Bernabeo E, Ross KM, Holmboe ES. ‘It depends’: results of a qualitative study investigating how practicing internists approach professional dilemmas. Acad Med. 2012;87:1–9.CrossRef
12.
go back to reference Norcini J. Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005;39:880–9.CrossRef Norcini J. Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005;39:880–9.CrossRef
13.
go back to reference Lurie SJ, Mooney CJ, Lyness JM. Measurement of the general competencies of the Accreditation Council for Graduate Medical Education: a systematic review. Acad Med. 2009;84:301–9.CrossRef Lurie SJ, Mooney CJ, Lyness JM. Measurement of the general competencies of the Accreditation Council for Graduate Medical Education: a systematic review. Acad Med. 2009;84:301–9.CrossRef
14.
go back to reference Hoff TJ, Pohl H, Bartfield J. Creating a learning environment to produce competent residents: the roles of culture and context. Acad Med. 2004;79:532–40.CrossRef Hoff TJ, Pohl H, Bartfield J. Creating a learning environment to produce competent residents: the roles of culture and context. Acad Med. 2004;79:532–40.CrossRef
15.
go back to reference Ten Cate O, Snell L, Carraccio C. Medical competence: the interplay between individual ability and the health care environment. Med Teach. 2010;32:669–75.CrossRef Ten Cate O, Snell L, Carraccio C. Medical competence: the interplay between individual ability and the health care environment. Med Teach. 2010;32:669–75.CrossRef
16.
go back to reference Crossley J, Jolly B. Making sense of work-based assessment: ask the right questions, in the right way, of the right people. Med Educ. 2012;46:28–37.CrossRef Crossley J, Jolly B. Making sense of work-based assessment: ask the right questions, in the right way, of the right people. Med Educ. 2012;46:28–37.CrossRef
17.
go back to reference Lurie SJ. History and practice of competency-based assessment. Med Educ. 2012;46:49–57.CrossRef Lurie SJ. History and practice of competency-based assessment. Med Educ. 2012;46:49–57.CrossRef
18.
go back to reference Ginsburg S, McIlroy J, Oulanova O, Eva K, Regehr G. Towards authentic clinical evaluation: pitfalls in the pursuit of competencies. Acad Med. 2010;85:780–6.CrossRef Ginsburg S, McIlroy J, Oulanova O, Eva K, Regehr G. Towards authentic clinical evaluation: pitfalls in the pursuit of competencies. Acad Med. 2010;85:780–6.CrossRef
19.
go back to reference Charmaz K. Constructing Grounded Theory: a practical guide through qualitative analysis. London: Sage Publications; 2009. Charmaz K. Constructing Grounded Theory: a practical guide through qualitative analysis. London: Sage Publications; 2009.
20.
go back to reference Charmaz K. Constructing Grounded Theory: a practical guide through qualitative analysis. London: Sage Publications; 2009. pp. 42–71. (Coding in grounded theory practice). Charmaz K. Constructing Grounded Theory: a practical guide through qualitative analysis. London: Sage Publications; 2009. pp. 42–71. (Coding in grounded theory practice).
21.
22.
go back to reference Sturman MC, Cashen LH, Ceramie RA. The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings. J Appl Psychol. 2005;90:269–83.CrossRef Sturman MC, Cashen LH, Ceramie RA. The impact of job complexity and performance measurement on the temporal consistency, stability, and test-retest reliability of employee job performance ratings. J Appl Psychol. 2005;90:269–83.CrossRef
23.
go back to reference Lingard L. Rethinking competence in context of teamwork. In: Hodges BD, Lingard L, editors. The question of competence: reconsidering medical education in the Twenty-First Century. London: Cornell University Press; 2012. pp. 42–70. Lingard L. Rethinking competence in context of teamwork. In: Hodges BD, Lingard L, editors. The question of competence: reconsidering medical education in the Twenty-First Century. London: Cornell University Press; 2012. pp. 42–70.
24.
go back to reference Ginsburg S, Gold W, Cavalcanti RB, Kurabi B, McDonald-Blumer H. Competencies ‘plus’: the nature of written comments on internal medicine residents’ evaluation forms. Acad Med. 2011;86(10 Suppl):S30–4.CrossRef Ginsburg S, Gold W, Cavalcanti RB, Kurabi B, McDonald-Blumer H. Competencies ‘plus’: the nature of written comments on internal medicine residents’ evaluation forms. Acad Med. 2011;86(10 Suppl):S30–4.CrossRef
25.
go back to reference Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: the experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86:591–8.CrossRef Bernabeo EC, Holtman MC, Ginsburg S, Rosenbaum JR, Holmboe ES. Lost in transition: the experience and impact of frequent changes in the inpatient learning environment. Acad Med. 2011;86:591–8.CrossRef
26.
go back to reference Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach. 2005;27:326–31.CrossRef Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach. 2005;27:326–31.CrossRef
27.
go back to reference Boor K, van der Vleuten C, Teunissen P, Scherpbier A, Scheele F. Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach. 2011;33:820–7.CrossRef Boor K, van der Vleuten C, Teunissen P, Scherpbier A, Scheele F. Development and analysis of D-RECT, an instrument measuring residents’ learning climate. Med Teach. 2011;33:820–7.CrossRef
28.
go back to reference Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: a systematic review. Med Teach. 2010;32:947–52.CrossRef Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: a systematic review. Med Teach. 2010;32:947–52.CrossRef
29.
go back to reference Van der Vleuten CPM. When I say… context specificity. Med Educ. 2014;48:234–5.CrossRef Van der Vleuten CPM. When I say… context specificity. Med Educ. 2014;48:234–5.CrossRef
Metadata
Title
Putting performance in context: the perceived influence of environmental factors on work-based performance
Authors
Lynfa Stroud
Pier Bryden
Bochra Kurabi
Shiphra Ginsburg
Publication date
01-10-2015
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 5/2015
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-015-0209-5

Other articles of this Issue 5/2015

Perspectives on Medical Education 5/2015 Go to the issue