Skip to main content
Top
Published in: BMC Emergency Medicine 1/2019

Open Access 01-12-2019 | Emergency Medicine | Debate

Towards developing a consensus assessment framework for global emergency medicine fellowships

Authors: Haiko Kurt Jahn, James Kwan, Gerard O’Reilly, Heike Geduld, Katherine Douglass, Andrea Tenner, Lee Wallis, Janis Tupesis, Hani O. Mowafi

Published in: BMC Emergency Medicine | Issue 1/2019

Login to get access

Abstract

Background

The number of Global Emergency Medicine (GEM) Fellowship training programs are increasing worldwide. Despite the increasing number of GEM fellowships, there is not an agreed upon approach for assessment of GEM trainees.

Main body

In order to study the lack of standardized assessment in GEM fellowship training, a working group was established between the International EM Fellowship Consortium (IEMFC) and the International Federation for Emergency Medicine (IFEM). A needs assessment survey of IEMFC members and a review were undertaken to identify assessment tools currently in use by GEM fellowship programs; what relevant frameworks exist; and common elements used by programs with a wide diversity of emphases. A consensus framework was developed through iterative working group discussions. Thirty-two of 40 GEM fellowships responded (80% response). There is variability in the use and format of formal assessment between programs. Thirty programs reported training GEM fellows in the last 3 years (94%). Eighteen (56%) reported only informal assessments of trainees. Twenty-seven (84%) reported regular meetings for assessment of trainees. Eleven (34%) reported use of a structured assessment of any sort for GEM fellows and, of these, only 2 (18%) used validated instruments modified from general EM residency assessment tools. Only 3 (27%) programs reported incorporation of formal written feedback from partners in other countries. Using these results along with a review of the available assessment tools in GEM the working group developed a set of principles to guide GEM fellowship assessments along with a sample assessment for use by GEM fellowship programs seeking to create their own customized assessments.

Conclusion

There are currently no widely used assessment frameworks for GEM fellowship training. The working group made recommendations for developing standardized assessments aligned with competencies defined by the programs, that characterize goals and objectives of training, and document progress of trainees towards achieving those goals. Frameworks used should include perspectives of multiple stakeholders including partners in other countries where trainees conduct field work. Future work may evaluate the usability, validity and reliability of assessment frameworks in GEM fellowship training.
Literature
1.
go back to reference Arnold JL, Holliman CJ. Lessons learned from international emergency medicine development. Emergency Medicine Clinics. 2005;23(1):133–47.CrossRef Arnold JL, Holliman CJ. Lessons learned from international emergency medicine development. Emergency Medicine Clinics. 2005;23(1):133–47.CrossRef
2.
go back to reference Bayram J, Rosborough S, Bartels S, et al. Core curricular elements for fellowship training in international emergency medicine. Acad Emerg Med. 2010;17(7):748–57.CrossRef Bayram J, Rosborough S, Bartels S, et al. Core curricular elements for fellowship training in international emergency medicine. Acad Emerg Med. 2010;17(7):748–57.CrossRef
3.
go back to reference Mitchell R. Training in global emergency care: international experience and potential models for Australasia. Winston Churchill Memorial Trust of Australia: Med Report to the Winston Churchill Memorial Trust of Australia; 2015. Mitchell R. Training in global emergency care: international experience and potential models for Australasia. Winston Churchill Memorial Trust of Australia: Med Report to the Winston Churchill Memorial Trust of Australia; 2015.
4.
go back to reference Kwan J, Jouriles N, Singer A, et al. Designing assessment Programmes for the model curriculum for emergency medicine specialists. Cjem. 2015;17(4):462–7.CrossRef Kwan J, Jouriles N, Singer A, et al. Designing assessment Programmes for the model curriculum for emergency medicine specialists. Cjem. 2015;17(4):462–7.CrossRef
5.
go back to reference Hobgood C, Anantharaman V, Bandiera G, et al. International Federation for Emergency Medicine Model Curriculum for emergency medicine specialists. Emergency medicine Australasia : EMA. 2011;23(5):541–53.CrossRef Hobgood C, Anantharaman V, Bandiera G, et al. International Federation for Emergency Medicine Model Curriculum for emergency medicine specialists. Emergency medicine Australasia : EMA. 2011;23(5):541–53.CrossRef
8.
go back to reference Jogerst K, Callender B, Adams V, et al. Identifying interprofessional global health competencies for 21st-century health professionals. Ann Glob Health. 2015;81(2):239–47.CrossRef Jogerst K, Callender B, Adams V, et al. Identifying interprofessional global health competencies for 21st-century health professionals. Ann Glob Health. 2015;81(2):239–47.CrossRef
9.
go back to reference Douglass KA, Jacquet GA, Hayward AS, et al. Development of a Global Health milestones tool for learners in emergency medicine: a pilot project. AEM Educ Train. 2017;1(4):269–79.CrossRef Douglass KA, Jacquet GA, Hayward AS, et al. Development of a Global Health milestones tool for learners in emergency medicine: a pilot project. AEM Educ Train. 2017;1(4):269–79.CrossRef
10.
go back to reference Longstaff B, Waterfield C. Ritman D, et al. Health Education England: Toolkit for the collection of evidence of knowledge and skills gained through participation in an international health project; 2015. Longstaff B, Waterfield C. Ritman D, et al. Health Education England: Toolkit for the collection of evidence of knowledge and skills gained through participation in an international health project; 2015.
11.
go back to reference Frank JR. The CanMEDS 2005 physician competency framework: better standards, better physicians, better care. In:2005. Frank JR. The CanMEDS 2005 physician competency framework: better standards, better physicians, better care. In:2005.
12.
go back to reference Dyne PL, Strauss RW, Rinnert S. Systems-based practice: the sixth core competency. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1270–7.CrossRef Dyne PL, Strauss RW, Rinnert S. Systems-based practice: the sixth core competency. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1270–7.CrossRef
13.
go back to reference VanRooyen MJ, Clem KJ, Holliman CJ, Wolfson AB, Green G, Kirsch TD. Proposed fellowship training program in international emergency medicine. Acad Emerg Med. 1999;6(2):145–9.CrossRef VanRooyen MJ, Clem KJ, Holliman CJ, Wolfson AB, Green G, Kirsch TD. Proposed fellowship training program in international emergency medicine. Acad Emerg Med. 1999;6(2):145–9.CrossRef
14.
go back to reference Jacquet GA, Vu A, Ewen WB, et al. Fellowships in international emergency medicine in the USA: a comparative survey of program directors' and fellows' perspectives on the curriculum. Postgrad Med J. 2014;90(1059):3–7.CrossRef Jacquet GA, Vu A, Ewen WB, et al. Fellowships in international emergency medicine in the USA: a comparative survey of program directors' and fellows' perspectives on the curriculum. Postgrad Med J. 2014;90(1059):3–7.CrossRef
15.
go back to reference Eichbaum Q. The problem with competencies in global health education. Academic medicine : journal of the Association of American Medical Colleges. 2015;90(4):414–7.CrossRef Eichbaum Q. The problem with competencies in global health education. Academic medicine : journal of the Association of American Medical Colleges. 2015;90(4):414–7.CrossRef
16.
go back to reference Beeson M, Christopher T, Heidt J, et al. The emergency medicine milestones project. American Board of Emergency Medicine: Lansing; 2016. Beeson M, Christopher T, Heidt J, et al. The emergency medicine milestones project. American Board of Emergency Medicine: Lansing; 2016.
18.
go back to reference Couillard J, Garon S, Riznic J. The logical framework approach–millennium. Proj Manag J. 2009;40(4):31–44.CrossRef Couillard J, Garon S, Riznic J. The logical framework approach–millennium. Proj Manag J. 2009;40(4):31–44.CrossRef
19.
go back to reference General Medical Council. (2010). Workplace Based Assessment: A guide for implementation. In:2010. General Medical Council. (2010). Workplace Based Assessment: A guide for implementation. In:2010.
20.
go back to reference Cydulka RK, Emerman CL, Jouriles NJ. Evaluation of resident performance and intensive bedside teaching during direct observation. Acad Emerg Med Off J Soc Acad Emerg Med. 1996;3(4):345–51.CrossRef Cydulka RK, Emerman CL, Jouriles NJ. Evaluation of resident performance and intensive bedside teaching during direct observation. Acad Emerg Med Off J Soc Acad Emerg Med. 1996;3(4):345–51.CrossRef
21.
go back to reference Hayden SR, Dufel S, Shih R. Definitions and competencies for practice-based learning and improvement. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1242–8.CrossRef Hayden SR, Dufel S, Shih R. Definitions and competencies for practice-based learning and improvement. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1242–8.CrossRef
22.
go back to reference Jouriles N, Burdick W, Hobgood C. Clinical assessment in emergency medicine. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1289–94.CrossRef Jouriles N, Burdick W, Hobgood C. Clinical assessment in emergency medicine. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1289–94.CrossRef
23.
go back to reference Larkin GL, Binder L, Houry D, Adams J. Defining and evaluating professionalism: a core competency for graduate emergency medicine education. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1249–56.CrossRef Larkin GL, Binder L, Houry D, Adams J. Defining and evaluating professionalism: a core competency for graduate emergency medicine education. Acad Emerg Med Off J Soc Acad Emerg Med. 2002;9(11):1249–56.CrossRef
24.
go back to reference Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE guide no. 31. Medical teacher. 2007;29(9):855–71.CrossRef Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE guide no. 31. Medical teacher. 2007;29(9):855–71.CrossRef
25.
go back to reference Boelen C. Prospects for change in medical education in the twenty-first century. Academic medicine : journal of the Association of American Medical Colleges. 1995;70(7 Suppl):S21–8 discussion S29.CrossRef Boelen C. Prospects for change in medical education in the twenty-first century. Academic medicine : journal of the Association of American Medical Colleges. 1995;70(7 Suppl):S21–8 discussion S29.CrossRef
26.
go back to reference Wass V, der Vleuten C, In Y, Carter Y, Jackson N. Assessment in medical education and training 1. In: Medical Education and Training: Oxford University Press; 2008. p. 358. Wass V, der Vleuten C, In Y, Carter Y, Jackson N. Assessment in medical education and training 1. In: Medical Education and Training: Oxford University Press; 2008. p. 358.
27.
go back to reference Schuwirth LWT, Van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Medical teacher. 2011;33(6):478–85.CrossRef Schuwirth LWT, Van der Vleuten CPM. Programmatic assessment: from assessment of learning to assessment for learning. Medical teacher. 2011;33(6):478–85.CrossRef
28.
go back to reference van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39(3):309–17.CrossRef van der Vleuten CPM, Schuwirth LWT. Assessing professional competence: from methods to programmes. Med Educ. 2005;39(3):309–17.CrossRef
29.
go back to reference Van der Vleuten CP, Schuwirth LW, Scheele F, Driessen EW, Hodges B. The assessment of professional competence:building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 2010;24(6):703–19.CrossRef Van der Vleuten CP, Schuwirth LW, Scheele F, Driessen EW, Hodges B. The assessment of professional competence:building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 2010;24(6):703–19.CrossRef
30.
go back to reference van der Vleuten CPM, Schuwirth LWT, Driessen EW, et al. A model for programmatic assessment fit for purpose. Medical teacher. 2012;34(3):205–14.CrossRef van der Vleuten CPM, Schuwirth LWT, Driessen EW, et al. A model for programmatic assessment fit for purpose. Medical teacher. 2012;34(3):205–14.CrossRef
Metadata
Title
Towards developing a consensus assessment framework for global emergency medicine fellowships
Authors
Haiko Kurt Jahn
James Kwan
Gerard O’Reilly
Heike Geduld
Katherine Douglass
Andrea Tenner
Lee Wallis
Janis Tupesis
Hani O. Mowafi
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2019
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-019-0286-6

Other articles of this Issue 1/2019

BMC Emergency Medicine 1/2019 Go to the issue