Skip to main content
Top
Published in: Perspectives on Medical Education 5/2017

Open Access 01-10-2017 | Eye-Opener

Fairness: the hidden challenge for competency-based postgraduate medical education programs

Authors: Colleen Y. Colbert, Judith C. French, Mary Elizabeth Herring, Elaine F. Dannefer

Published in: Perspectives on Medical Education | Issue 5/2017

Login to get access

Abstract

Competency-based medical education systems allow institutions to individualize teaching practices to meet the needs of diverse learners. Yet, the focus on continuous improvement and individualization of curricula does not exempt programs from treating learners in a fair manner. When learners fail to meet key competencies and are placed on probation or dismissed from training programs, issues of fairness may form the basis of their legal claims. In a literature search, we found no in-depth examination of fairness. In this paper, we utilize a systems lens to examine fairness within postgraduate medical education contexts, focusing on educational opportunities, assessment practices, decision-making processes, fairness from a legal standpoint, and fairness in the context of the learning environment. While we provide examples of fairness issues within US training programs, concerns regarding fairness are relevant in any medical education system which utilizes a competency-based education framework.
Assessment oversight committees and annual programmatic evaluations, while recommended, will not guarantee fairness within postgraduate medical education programs, but they can provide a window into ‘hidden’ threats to fairness, as everything from training experiences to assessment practices may be examined by these committees. One of the first steps programs can take is to recognize that threats to fairness may exist in any educational program, including their own, and begin conversations about how to address these issues.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ramani S, Post SE, Konings K, Mann K, Katz JT, van der Vleuten C. ‘It’s not just the culture’: a qualitative study exploring residents’ perceptions of the impact of institutional culture on feedback. Teach Learn Med. 2016;21:1–9. Ramani S, Post SE, Konings K, Mann K, Katz JT, van der Vleuten C. ‘It’s not just the culture’: a qualitative study exploring residents’ perceptions of the impact of institutional culture on feedback. Teach Learn Med. 2016;21:1–9.
2.
go back to reference Hawkins RE, Welcher CM, Holmboe ES, et al. Implementation of competency-based medical education: are we addressing the concerns and challenges? Med Educ. 2015;49:1086–102.CrossRef Hawkins RE, Welcher CM, Holmboe ES, et al. Implementation of competency-based medical education: are we addressing the concerns and challenges? Med Educ. 2015;49:1086–102.CrossRef
3.
go back to reference Chan T, Sherbino J. The McMaster modular assessment program (McMap). A theoretically grounded work-based assessment system for an emergency medicine resident program. Acad Med. 2015;90:900–5.CrossRef Chan T, Sherbino J. The McMaster modular assessment program (McMap). A theoretically grounded work-based assessment system for an emergency medicine resident program. Acad Med. 2015;90:900–5.CrossRef
4.
go back to reference Frank JF, Mungroo R, Ahmad Y, Wang M, De Rossi S, Horsley T. Toward a definition of competency-based education in medicine: a systematic review of published definitions. Med Teach. 2010;32:631–7.CrossRef Frank JF, Mungroo R, Ahmad Y, Wang M, De Rossi S, Horsley T. Toward a definition of competency-based education in medicine: a systematic review of published definitions. Med Teach. 2010;32:631–7.CrossRef
5.
go back to reference Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32:676–82.CrossRef Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32:676–82.CrossRef
6.
go back to reference Morcke AM, Dornan T, Eika B. Outcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidence. Adv Health Sci Educ Theory Pract. 2013;18:851–63.CrossRef Morcke AM, Dornan T, Eika B. Outcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidence. Adv Health Sci Educ Theory Pract. 2013;18:851–63.CrossRef
7.
go back to reference Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32:638–45.CrossRef Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32:638–45.CrossRef
8.
go back to reference Spady WG. The concept and implications of competency based education. Educ Leadersh. 1978;36:16–22. Spady WG. The concept and implications of competency based education. Educ Leadersh. 1978;36:16–22.
9.
go back to reference Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system – rationale and benefits. N Engl J Med. 2012;366:1051–6.CrossRef Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system – rationale and benefits. N Engl J Med. 2012;366:1051–6.CrossRef
10.
go back to reference Altahawi F, Sisk B, Poloskey S, Hicks C, Dannefer EF. Student perspectives on assessment: experience in a competency-based portfolio system. Med Teach. 2012;34:221–5.CrossRef Altahawi F, Sisk B, Poloskey S, Hicks C, Dannefer EF. Student perspectives on assessment: experience in a competency-based portfolio system. Med Teach. 2012;34:221–5.CrossRef
11.
go back to reference van der Vleuten CP, Dannefer EF. Toward a systems approach to assessment. Med Teach. 2012;34:185–6.CrossRef van der Vleuten CP, Dannefer EF. Toward a systems approach to assessment. Med Teach. 2012;34:185–6.CrossRef
13.
go back to reference Jamieson T, Hemmer P, Pangaro LN. Legal aspects of assigning failing grades. In: Pangaro LN, McGaphie WC, editors. Handbook on medical student evaluation and assessment. Alliance for Clinical Education. North Syracuse: Gegensatz; 2015. pp. 251–62. Jamieson T, Hemmer P, Pangaro LN. Legal aspects of assigning failing grades. In: Pangaro LN, McGaphie WC, editors. Handbook on medical student evaluation and assessment. Alliance for Clinical Education. North Syracuse: Gegensatz; 2015. pp. 251–62.
14.
go back to reference Wilkerson JR, Lang WS. Portfolios, the pied piper of teacher certification assessments: legal and psychometric issues. Educ Policy Anal Arch. 2003;11:1–30.CrossRef Wilkerson JR, Lang WS. Portfolios, the pied piper of teacher certification assessments: legal and psychometric issues. Educ Policy Anal Arch. 2003;11:1–30.CrossRef
17.
go back to reference Nabors C, Peterson SJ, Forman L, et al. Operationalizing the internal medicine milestones – an early status report. J Grad Med Educ. 2013;5:130–7.CrossRef Nabors C, Peterson SJ, Forman L, et al. Operationalizing the internal medicine milestones – an early status report. J Grad Med Educ. 2013;5:130–7.CrossRef
18.
go back to reference Cole NS, Zieky MJ. The new faces of fairness. J Educ Meas. 2001;38:369–82.CrossRef Cole NS, Zieky MJ. The new faces of fairness. J Educ Meas. 2001;38:369–82.CrossRef
19.
go back to reference American Educational Research Association. Standards for educational and psychological testing/American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Washington: American Educational Research Association; 2014. American Educational Research Association. Standards for educational and psychological testing/American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Washington: American Educational Research Association; 2014.
20.
go back to reference Bierer SB, Dannefer E. Does students’ gender, citizenship, or verbal ability affect fairness of portfolio-based promotion decisions? Results from one medical school. Acad Med. 2011;86:773–7.CrossRef Bierer SB, Dannefer E. Does students’ gender, citizenship, or verbal ability affect fairness of portfolio-based promotion decisions? Results from one medical school. Acad Med. 2011;86:773–7.CrossRef
21.
go back to reference Lam TCM. Fairness in performance assessment. ERIC Digest. ED 391982. 1995. Lam TCM. Fairness in performance assessment. ERIC Digest. ED 391982. 1995.
22.
go back to reference Gipps CV. Beyond testing: towards a theory of educational assessment. London: The Falmer Press; 1994, pp 148–57. Gipps CV. Beyond testing: towards a theory of educational assessment. London: The Falmer Press; 1994, pp 148–57.
23.
go back to reference Suskie L. Fair assessment practices: giving students equitable opportunities to demonstrate learning. AAHE Bull. 2000;52:1–6. Suskie L. Fair assessment practices: giving students equitable opportunities to demonstrate learning. AAHE Bull. 2000;52:1–6.
24.
go back to reference Barr KP, Massagli TL. New challenges for the graduate medical educator: implementing the milestones. Am J Phys Med Rehabil. 2014;93:624–31.CrossRef Barr KP, Massagli TL. New challenges for the graduate medical educator: implementing the milestones. Am J Phys Med Rehabil. 2014;93:624–31.CrossRef
25.
go back to reference Armstrong EG, Mackey M, Spear S. Medical education as a process management problem. Acad Med. 2004;79(8):728.CrossRef Armstrong EG, Mackey M, Spear S. Medical education as a process management problem. Acad Med. 2004;79(8):728.CrossRef
26.
go back to reference Holmboe E. Direct observation of students’ clinical skills. In: Pangaro LN, McGaphie WC, editors. Handbook on medical student evaluation and assessment. Alliance for Clinical Education. North Syracuse: Gegensatz; 2015. pp. 97–112. Holmboe E. Direct observation of students’ clinical skills. In: Pangaro LN, McGaphie WC, editors. Handbook on medical student evaluation and assessment. Alliance for Clinical Education. North Syracuse: Gegensatz; 2015. pp. 97–112.
27.
go back to reference French JC, Dannefer EF, Colbert CY. A systematic approach to building a fully operational clinical competency committee. J Surg Educ. 2014;71:e22–e7.CrossRef French JC, Dannefer EF, Colbert CY. A systematic approach to building a fully operational clinical competency committee. J Surg Educ. 2014;71:e22–e7.CrossRef
29.
go back to reference Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 2014;89:721–7.CrossRef Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Acad Med. 2014;89:721–7.CrossRef
30.
go back to reference Linn RL, Baker EL, Dunbar SB. Complex, performance-based assessment: expectations and validation criteria. Educ Res. 1991;20:15–21.CrossRef Linn RL, Baker EL, Dunbar SB. Complex, performance-based assessment: expectations and validation criteria. Educ Res. 1991;20:15–21.CrossRef
31.
go back to reference Downing SM. Threats to the validity of clinical teaching assessments: What about rater error? Med Educ. 2005;39:350–5.CrossRef Downing SM. Threats to the validity of clinical teaching assessments: What about rater error? Med Educ. 2005;39:350–5.CrossRef
33.
go back to reference Pedhazur EJ, Schmelkin LP. Construct validation. In: Pedhazur EJ, editor. Measurement, design, and analysis. An integrated approach. Hillsdale: Erlbaum; 1991. pp. 52–80. Pedhazur EJ, Schmelkin LP. Construct validation. In: Pedhazur EJ, editor. Measurement, design, and analysis. An integrated approach. Hillsdale: Erlbaum; 1991. pp. 52–80.
34.
go back to reference Schouten BC, Meeuwesen L. Cultural differences in medical communication: a review of the literature. Patient Educ Couns. 2006;64:21–34.CrossRef Schouten BC, Meeuwesen L. Cultural differences in medical communication: a review of the literature. Patient Educ Couns. 2006;64:21–34.CrossRef
35.
go back to reference Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15:270–92.CrossRef Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003;15:270–92.CrossRef
36.
go back to reference Hays RB, Hamlin G, Crane L. Twelve tips for increasing the defensibility of assessment decisions. Med Teach. 2015;37:433–6.CrossRef Hays RB, Hamlin G, Crane L. Twelve tips for increasing the defensibility of assessment decisions. Med Teach. 2015;37:433–6.CrossRef
37.
go back to reference Gingerich A, Regehr G, Eva KW. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 2011;86:S1–S7.CrossRef Gingerich A, Regehr G, Eva KW. Rater-based assessments as social judgments: rethinking the etiology of rater errors. Acad Med. 2011;86:S1–S7.CrossRef
38.
go back to reference Thomas MR, Beckman TJ, Mauck KF, Cha SS, Thomas KG. Group assessments of resident physicians improve reliability and decrease halo error. J Gen Intern Med. 2011;7:759–64.CrossRef Thomas MR, Beckman TJ, Mauck KF, Cha SS, Thomas KG. Group assessments of resident physicians improve reliability and decrease halo error. J Gen Intern Med. 2011;7:759–64.CrossRef
39.
go back to reference Hodges B. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 2013;35:564–8.CrossRef Hodges B. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 2013;35:564–8.CrossRef
40.
go back to reference Eva KW, Hodges BD. Scylla or Charybdis? Can we navigate between objectification and judgment in assessment? Med Educ. 2012;46:914–9.CrossRef Eva KW, Hodges BD. Scylla or Charybdis? Can we navigate between objectification and judgment in assessment? Med Educ. 2012;46:914–9.CrossRef
41.
go back to reference Brateanu A, Thomascik J, Koncilja K, Spencer AL, Colbert CY. Using continuous quality improvement techniques to evaluate and enhance an internal medicine residency program’s assessment system. Am J Med. 2017; doi:10.1016/j.amjmed.2017.02.007. Brateanu A, Thomascik J, Koncilja K, Spencer AL, Colbert CY. Using continuous quality improvement techniques to evaluate and enhance an internal medicine residency program’s assessment system. Am J Med. 2017; doi:10.​1016/​j.​amjmed.​2017.​02.​007.
42.
go back to reference Hauer KE, Chesluk B, Iobst W, et al. Reviewing residents’ competence: a qualitative study of the role of clinical competency committees in performance assessment. Acad Med. 2015;90:1084–92.CrossRef Hauer KE, Chesluk B, Iobst W, et al. Reviewing residents’ competence: a qualitative study of the role of clinical competency committees in performance assessment. Acad Med. 2015;90:1084–92.CrossRef
43.
go back to reference Colbert CY, Dannefer EF, French JC. Clinical Competency Committees and assessment: changing the conversation in graduate medical education. J Grad Med Educ. 2015;7:162–5.CrossRef Colbert CY, Dannefer EF, French JC. Clinical Competency Committees and assessment: changing the conversation in graduate medical education. J Grad Med Educ. 2015;7:162–5.CrossRef
44.
go back to reference van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.CrossRef van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39:309–17.CrossRef
46.
go back to reference Univ. of Missouri v. Horowitz. 435 U.S. 78 (98 S. Ct. 948, 55 L.Ed.2d 124) 1978. https://www.law.cornell.edu/supremecourt/text/435/78. Accessed 26 May 2016. Univ. of Missouri v. Horowitz. 435 U.S. 78 (98 S. Ct. 948, 55 L.Ed.2d 124) 1978. https://​www.​law.​cornell.​edu/​supremecourt/​text/​435/​78.​ Accessed 26 May 2016.
48.
go back to reference Hernandez v. Overlook Hospital, 149 N.J. 68, 692 A.2d 971 (N.J. S. Ct. 1997). Hernandez v. Overlook Hospital, 149 N.J. 68, 692 A.2d 971 (N.J. S. Ct. 1997).
49.
go back to reference Wayne SJ, Fortner SA, Kitzes JA, Timm C, Kalishman S. Cause or effect? The relationship between student perception of the medical school learning environment and academic performance on USMLE Step 1. Med Teach. 2013;35:376–80.CrossRef Wayne SJ, Fortner SA, Kitzes JA, Timm C, Kalishman S. Cause or effect? The relationship between student perception of the medical school learning environment and academic performance on USMLE Step 1. Med Teach. 2013;35:376–80.CrossRef
50.
go back to reference Bierer SB, Dannefer EF. The learning environment counts: longitudinal qualitative analysis of study strategies adopted by first-year medical students in a competency-based educational program. Acad Med. 2016;91:S44–S52.CrossRef Bierer SB, Dannefer EF. The learning environment counts: longitudinal qualitative analysis of study strategies adopted by first-year medical students in a competency-based educational program. Acad Med. 2016;91:S44–S52.CrossRef
51.
go back to reference Genn JM. AMEE Medical Education Guide No. 23 (Part I): Curriculum, environment, climate, quality and change in medical education – a unifying perspective. Med Teach. 2001;23:337–44.CrossRef Genn JM. AMEE Medical Education Guide No. 23 (Part I): Curriculum, environment, climate, quality and change in medical education – a unifying perspective. Med Teach. 2001;23:337–44.CrossRef
52.
go back to reference London M, Smither JW. Feedback orientation, feedback culture, and the longitudinal performance management process. Hum Resour Manage Rev. 2002;12:81–100.CrossRef London M, Smither JW. Feedback orientation, feedback culture, and the longitudinal performance management process. Hum Resour Manage Rev. 2002;12:81–100.CrossRef
53.
go back to reference Carmeli A, Brueller D, Dutton JE. Learning behaviours in the workplace: the role of high-quality interpersonal relationships and psychological safety. Syst Res Behav Sci. 2009;26:81–98.CrossRef Carmeli A, Brueller D, Dutton JE. Learning behaviours in the workplace: the role of high-quality interpersonal relationships and psychological safety. Syst Res Behav Sci. 2009;26:81–98.CrossRef
54.
go back to reference Kost A, Combs H, Smith S, et al. A proposed conceptual framework and investigation of upward feedback receptivity in medical education. Teach Learn Med. 2015;27:359–61.CrossRef Kost A, Combs H, Smith S, et al. A proposed conceptual framework and investigation of upward feedback receptivity in medical education. Teach Learn Med. 2015;27:359–61.CrossRef
56.
go back to reference Jennings ML, Slavin SJ. Resident wellness matters: optimizing resident education and wellness through the learning environment. Acad Med. 2015;90:1246–50.CrossRef Jennings ML, Slavin SJ. Resident wellness matters: optimizing resident education and wellness through the learning environment. Acad Med. 2015;90:1246–50.CrossRef
60.
go back to reference Crutcher RA, Szafran O, Woloschuk W, et al. Family medicine graduates’ perceptions of intimidation, harassment, and discrimination during residency training. BMC Med Educ. 2011;11:1–7.CrossRef Crutcher RA, Szafran O, Woloschuk W, et al. Family medicine graduates’ perceptions of intimidation, harassment, and discrimination during residency training. BMC Med Educ. 2011;11:1–7.CrossRef
61.
go back to reference Stratton T, McLaughlin MA, Witte FM, et al. Does students’ exposure to gender discrimination and sexual harassment in medical school affect specialty choice and residency program selection? Acad Med. 2005;80:400–8.CrossRef Stratton T, McLaughlin MA, Witte FM, et al. Does students’ exposure to gender discrimination and sexual harassment in medical school affect specialty choice and residency program selection? Acad Med. 2005;80:400–8.CrossRef
62.
go back to reference Fnais N, Soobiah C, Chen MH, et al. Harassment and discrimination in medical training: a systematic review and meta-analysis. Acad Med. 2014;89:817–27.CrossRef Fnais N, Soobiah C, Chen MH, et al. Harassment and discrimination in medical training: a systematic review and meta-analysis. Acad Med. 2014;89:817–27.CrossRef
63.
go back to reference Lee KP, Kelz RR, Dube B, Morris JB. Attitude and perceptions of the other underrepresented minority in surgery. J Surg Educ. 2014;71:e47–e52.CrossRef Lee KP, Kelz RR, Dube B, Morris JB. Attitude and perceptions of the other underrepresented minority in surgery. J Surg Educ. 2014;71:e47–e52.CrossRef
64.
go back to reference Mansh M, Garcia G, Lunn MR. From patients to providers: changing the culture in medicine toward sexual and gender minorities. Acad Med. 2015;90:574–80.CrossRef Mansh M, Garcia G, Lunn MR. From patients to providers: changing the culture in medicine toward sexual and gender minorities. Acad Med. 2015;90:574–80.CrossRef
65.
66.
go back to reference Desimone LM, LeFloch KC. Are we asking the right questions? Using cognitive interviews to improve surveys in education research. Educ Eval Policy Anal. 2004;26:1–22.CrossRef Desimone LM, LeFloch KC. Are we asking the right questions? Using cognitive interviews to improve surveys in education research. Educ Eval Policy Anal. 2004;26:1–22.CrossRef
67.
go back to reference Groves RM, Fowler FJ Jr, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey Methodology, 2nd ed. Hoboken: John Wiley and Sons; 2009. Groves RM, Fowler FJ Jr, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey Methodology, 2nd ed. Hoboken: John Wiley and Sons; 2009.
69.
go back to reference Presser S, Couper MP, Lessler JT, et al. Methods for testing and evaluating survey questions. Public Opin Q. 2004;68:109–30.CrossRef Presser S, Couper MP, Lessler JT, et al. Methods for testing and evaluating survey questions. Public Opin Q. 2004;68:109–30.CrossRef
70.
go back to reference Ginsburg S, van der Vleuten C, Eva KW, Lingard L. Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports. Adv Health. Sci Educ. 2016;21:175–88. Ginsburg S, van der Vleuten C, Eva KW, Lingard L. Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports. Adv Health. Sci Educ. 2016;21:175–88.
71.
go back to reference Pien L, Taylor CA, Traboulsi E, Nielsen CA. A pilot study of a ‘resident educator and life-long learner’ program: using a faculty train-the-trainer program. J Grad Med Educ. 2011;3:332–6.CrossRef Pien L, Taylor CA, Traboulsi E, Nielsen CA. A pilot study of a ‘resident educator and life-long learner’ program: using a faculty train-the-trainer program. J Grad Med Educ. 2011;3:332–6.CrossRef
72.
go back to reference Hattie J, Temperley H. The power of feedback. Rev Educ Res. 2007;77:81–112.CrossRef Hattie J, Temperley H. The power of feedback. Rev Educ Res. 2007;77:81–112.CrossRef
73.
go back to reference French JC, Colbert CY, Pien LC, et al. Targeted feedback in the milestones era: utilization of the ask-tell-ask feedback model to promote reflection and self-assessment. J Surg Educ. 2015;72:e274–e9.CrossRef French JC, Colbert CY, Pien LC, et al. Targeted feedback in the milestones era: utilization of the ask-tell-ask feedback model to promote reflection and self-assessment. J Surg Educ. 2015;72:e274–e9.CrossRef
74.
go back to reference Bierer SB, Dannefer EF, Tetzlaff JE. Time to loosen the apron strings: cohort-based evaluation of a learner driven remediation model at one medical school. J Gen Intern Med. 2015;30:1339–43.CrossRef Bierer SB, Dannefer EF, Tetzlaff JE. Time to loosen the apron strings: cohort-based evaluation of a learner driven remediation model at one medical school. J Gen Intern Med. 2015;30:1339–43.CrossRef
Metadata
Title
Fairness: the hidden challenge for competency-based postgraduate medical education programs
Authors
Colleen Y. Colbert
Judith C. French
Mary Elizabeth Herring
Elaine F. Dannefer
Publication date
01-10-2017
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 5/2017
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-017-0359-8

Other articles of this Issue 5/2017

Perspectives on Medical Education 5/2017 Go to the issue