Skip to main content
Top
Published in: BMC Medicine 1/2017

Open Access 01-12-2017 | Research article

A randomised trial of the influence of racial stereotype bias on examiners’ scores, feedback and recollections in undergraduate clinical exams

Published in: BMC Medicine | Issue 1/2017

Login to get access

Abstract

Background

Asian medical students and doctors receive lower scores on average than their white counterparts in examinations in the UK and internationally (a phenomenon known as “differential attainment”). This could be due to examiner bias or to social, psychological or cultural influences on learning or performance. We investigated whether students’ scores or feedback show influence of ethnicity-related bias; whether examiners unconsciously bring to mind (activate) stereotypes when judging Asian students’ performance; whether activation depends on the stereotypicality of students’ performances; and whether stereotypes influence examiner memories of performances.

Methods

This is a randomised, double-blinded, controlled, Internet-based trial. We created near-identical videos of medical student performances on a simulated Objective Structured Clinical Exam using British Asian and white British actors. Examiners were randomly assigned to watch performances from white and Asian students that were either consistent or inconsistent with a previously described stereotype of Asian students’ performance. We compared the two examiner groups in terms of the following: the scores and feedback they gave white and Asian students; how much the Asian stereotype was activated in their minds (response times to Asian-stereotypical vs neutral words in a lexical decision task); and whether the stereotype influenced memories of student performances (recognition rates for real vs invented stereotype-consistent vs stereotype-inconsistent phrases from one of the videos).

Results

Examiners responded to Asian-stereotypical words (716 ms, 95% confidence interval (CI) 702–731 ms) faster than neutral words (769 ms, 95% CI 753–786 ms, p < 0.001), suggesting Asian stereotypes were activated (or at least active) in examiners’ minds. This occurred regardless of whether examiners observed stereotype-consistent or stereotype-inconsistent performances. Despite this stereotype activation, student ethnicity had no influence on examiners’ scores; on the feedback examiners gave; or on examiners’ memories for one performance.

Conclusions

Examiner bias does not appear to explain the differential attainment of Asian students in UK medical schools. Efforts to ensure equality should focus on social, psychological and cultural factors that may disadvantage learning or performance in Asian and other minority ethnic students.
Appendix
Available only for authorised users
Literature
1.
go back to reference Haq I, Higham J, Morris R, Dacre J. Effect of ethnicity and gender on performance in undergraduate medical examinations. Med Educ. 2005;39(11):1126–8.CrossRefPubMed Haq I, Higham J, Morris R, Dacre J. Effect of ethnicity and gender on performance in undergraduate medical examinations. Med Educ. 2005;39(11):1126–8.CrossRefPubMed
2.
go back to reference Stegers-Jager KM, Steyerberg EW, Cohen-Schotanus J, Themmen APN. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46(6):575–85.CrossRefPubMed Stegers-Jager KM, Steyerberg EW, Cohen-Schotanus J, Themmen APN. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46(6):575–85.CrossRefPubMed
3.
go back to reference Kleshinski J, Khuder SA, Shapiro JI, Gold JP. Impact of preadmission variables on USMLE step 1 and step 2 performance. Adv Heal Sci Educ. 2009;14(1):69–78.CrossRef Kleshinski J, Khuder SA, Shapiro JI, Gold JP. Impact of preadmission variables on USMLE step 1 and step 2 performance. Adv Heal Sci Educ. 2009;14(1):69–78.CrossRef
4.
go back to reference Kay-Lambkin F, Pearson S-A, Rolfe I. The influence of admissions variables on first year medical school performance: a study from Newcastle University. Australia Med Educ. 2002;36(2):154–9.CrossRefPubMed Kay-Lambkin F, Pearson S-A, Rolfe I. The influence of admissions variables on first year medical school performance: a study from Newcastle University. Australia Med Educ. 2002;36(2):154–9.CrossRefPubMed
5.
go back to reference Woolf K, Potts HWW, McManus IC. Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis. BMJ. 2011;342:d901.CrossRefPubMedPubMedCentral Woolf K, Potts HWW, McManus IC. Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis. BMJ. 2011;342:d901.CrossRefPubMedPubMedCentral
6.
go back to reference Woolf K, Haq I, McManus IC, Higham J, Dacre J. Exploring the underperformance of male and minority ethnic medical students in first year clinical examinations. Adv Health Sci Educ. 2008;13(5):607–16.CrossRef Woolf K, Haq I, McManus IC, Higham J, Dacre J. Exploring the underperformance of male and minority ethnic medical students in first year clinical examinations. Adv Health Sci Educ. 2008;13(5):607–16.CrossRef
7.
go back to reference Wass V, Roberts C, Hoogenboom R, Jones R, Van der Vleuten C. Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study. BMJ. 2003;326(7393):800–3.CrossRefPubMedPubMedCentral Wass V, Roberts C, Hoogenboom R, Jones R, Van der Vleuten C. Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study. BMJ. 2003;326(7393):800–3.CrossRefPubMedPubMedCentral
10.
go back to reference Greenwald A, Banaji M. Implicit social cognition: attitudes, self-esteem, and stereotypes. Psychol Rev. 1995;102(1):4–27.CrossRefPubMed Greenwald A, Banaji M. Implicit social cognition: attitudes, self-esteem, and stereotypes. Psychol Rev. 1995;102(1):4–27.CrossRefPubMed
11.
go back to reference Woolf K, Cave J, Greenhalgh T, Dacre J. Ethnic stereotypes and the underachievement of UK medical students from ethnic minorities: qualitative study. BMJ. 2008;337:a1220.CrossRefPubMedPubMedCentral Woolf K, Cave J, Greenhalgh T, Dacre J. Ethnic stereotypes and the underachievement of UK medical students from ethnic minorities: qualitative study. BMJ. 2008;337:a1220.CrossRefPubMedPubMedCentral
12.
go back to reference Macrae CN, Bodenhausen GV. Social cognition: thinking categorically about others. Soc Cogn. 2000;51:93–120. Macrae CN, Bodenhausen GV. Social cognition: thinking categorically about others. Soc Cogn. 2000;51:93–120.
13.
go back to reference Bodenhausen GV, Todd AR. Social cognition. Cogn Sci. 2010;1:160–71. Bodenhausen GV, Todd AR. Social cognition. Cogn Sci. 2010;1:160–71.
14.
go back to reference Bodenhausen GV, Wyer RS. Effects of stereotypes on decision making and information-processing strategies. J Pers Soc Psychol. 1985;48(2):267–82.CrossRefPubMed Bodenhausen GV, Wyer RS. Effects of stereotypes on decision making and information-processing strategies. J Pers Soc Psychol. 1985;48(2):267–82.CrossRefPubMed
15.
go back to reference Stangor C, McMillan D. Memory for expectancy-congruent and expectancy-incongruent information: a review of the social and social developmental literatures. Psychol Bull. 1992;111(1):42–61.CrossRef Stangor C, McMillan D. Memory for expectancy-congruent and expectancy-incongruent information: a review of the social and social developmental literatures. Psychol Bull. 1992;111(1):42–61.CrossRef
16.
go back to reference Fyock J, Stangor C. The role of memory biases in stereotype maintenance. Br J Soc Psychol. 1994;33(3):331–43.CrossRefPubMed Fyock J, Stangor C. The role of memory biases in stereotype maintenance. Br J Soc Psychol. 1994;33(3):331–43.CrossRefPubMed
17.
go back to reference Kunda Z, Spencer SJ. When do stereotypes come to mind and when do they color judgment? A goal-based theoretical framework for stereotype activation and application. Psychol Bull. 2003;129(4):522–44.CrossRefPubMed Kunda Z, Spencer SJ. When do stereotypes come to mind and when do they color judgment? A goal-based theoretical framework for stereotype activation and application. Psychol Bull. 2003;129(4):522–44.CrossRefPubMed
18.
go back to reference Macrae CN, Milne AB, Bodenhausen GV. Stereotypes as energy-saving devices: a peek inside the cognitive toolbox. J Pers Soc Psychol. 1994;66(1):37–47.CrossRef Macrae CN, Milne AB, Bodenhausen GV. Stereotypes as energy-saving devices: a peek inside the cognitive toolbox. J Pers Soc Psychol. 1994;66(1):37–47.CrossRef
19.
go back to reference Tavares W, Eva KW. Impact of rating demands on rater-based assessments of clinical competence. Educ Prim. 2014;25(6):308–18.CrossRef Tavares W, Eva KW. Impact of rating demands on rater-based assessments of clinical competence. Educ Prim. 2014;25(6):308–18.CrossRef
20.
go back to reference Yeates P, Cardell J, Byrne G, Eva KW. Relatively speaking: contrast effects influence assessors’ scores and narrative feedback. Med Educ. 2015;49:909–19.CrossRefPubMed Yeates P, Cardell J, Byrne G, Eva KW. Relatively speaking: contrast effects influence assessors’ scores and narrative feedback. Med Educ. 2015;49:909–19.CrossRefPubMed
22.
go back to reference Denney ML, Freeman A, Wakeford R. MRCGP CSA: are the examiners biased, favouring their own by sex, ethnicity, and degree source? Br J Gen Pract. 2013;63(616):718–25.CrossRef Denney ML, Freeman A, Wakeford R. MRCGP CSA: are the examiners biased, favouring their own by sex, ethnicity, and degree source? Br J Gen Pract. 2013;63(616):718–25.CrossRef
23.
go back to reference Sinclair L, Kunda Z. Reactions to a black professional: motivated inhibition and activation of conflicting stereotypes. J Pers Soc Psychol. 1999;77(5):885–904.CrossRefPubMed Sinclair L, Kunda Z. Reactions to a black professional: motivated inhibition and activation of conflicting stereotypes. J Pers Soc Psychol. 1999;77(5):885–904.CrossRefPubMed
24.
go back to reference Mussweiler T, Epstude K. Relatively fast! Efficiency advantages of comparative thinking. J Exp Psychol Gen. 2009;138(1):1–21.CrossRefPubMed Mussweiler T, Epstude K. Relatively fast! Efficiency advantages of comparative thinking. J Exp Psychol Gen. 2009;138(1):1–21.CrossRefPubMed
26.
go back to reference Vaughan S, Sanders T, Crossley N, O’Neill P, Wass V. Bridging the gap: the roles of social capital and ethnicity in medical student achievement. Med Educ. 2015;49(1):114–23.CrossRefPubMed Vaughan S, Sanders T, Crossley N, O’Neill P, Wass V. Bridging the gap: the roles of social capital and ethnicity in medical student achievement. Med Educ. 2015;49(1):114–23.CrossRefPubMed
27.
go back to reference Burgess DJ, Warren J, Phelan S, Dovidio J, van Ryn M. Stereotype threat and health disparities: what medical educators and future physicians need to know. J Gen Intern Med. 2010;25(2):169–77.CrossRefPubMedCentral Burgess DJ, Warren J, Phelan S, Dovidio J, van Ryn M. Stereotype threat and health disparities: what medical educators and future physicians need to know. J Gen Intern Med. 2010;25(2):169–77.CrossRefPubMedCentral
29.
go back to reference Moskowitz GB, Li P. Egalitarian goals trigger stereotype inhibition: a proactive form of stereotype control. J Exp Soc Psychol. 2011;47(1):103–16.CrossRef Moskowitz GB, Li P. Egalitarian goals trigger stereotype inhibition: a proactive form of stereotype control. J Exp Soc Psychol. 2011;47(1):103–16.CrossRef
30.
go back to reference Kunda Z. The case for motivated reasoning. Psychol Bull [Internet]. 1990;108(3):480–98.CrossRef Kunda Z. The case for motivated reasoning. Psychol Bull [Internet]. 1990;108(3):480–98.CrossRef
Metadata
Title
A randomised trial of the influence of racial stereotype bias on examiners’ scores, feedback and recollections in undergraduate clinical exams
Publication date
01-12-2017
Published in
BMC Medicine / Issue 1/2017
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-017-0943-0

Other articles of this Issue 1/2017

BMC Medicine 1/2017 Go to the issue