Top

International Journal of Emergency Medicine

Published in:

Open Access 01-03-2010 | Original Research Article

Learner perception of oral and written examinations in an international medical training program

Authors: Sean P. Kelly, Scott G. Weiner, Philip D. Anderson, Julie Irish, Greg Ciottone, Riccardo Pini, Stefano Grifoni, Peter Rosen, Kevin M. Ban

Published in: International Journal of Emergency Medicine | Issue 1/2010

Abstract

Background

There are an increasing number of training programs in emergency medicine involving different countries or cultures. Many examination types, both oral and written, have been validated as useful assessment tools around the world; but learner perception of their use in the setting of cross-cultural training programs has not been described.

Aims

The goal of this study was to evaluate learner perception of four common examination methods in an international educational curriculum in emergency medicine.

Methods

Twenty-four physicians in a cross-cultural training program were surveyed to determine learner perception of four different examination methods: structured oral case simulations, multiple-choice tests, semi-structured oral examinations, and essay tests. We also describe techniques used and barriers faced.

Results

There was a 100% response rate. Learners reported that all testing methods were useful in measuring knowledge and clinical ability and should be used for accreditation and future training programs. They rated oral examinations as significantly more useful than written in measuring clinical abilities (p < 0.01). Compared to the other three types of examinations, learners ranked oral case simulations as the most useful examination method for assessing learners’ fund of knowledge and clinical ability (p < 0.01).

Conclusions

Physician learners in a cross-cultural, international training program perceive all four written and oral examination methods as useful, but rate structured oral case simulations as the most useful method for assessing fund of knowledge and clinical ability.

Available only for authorised users

Epstein RM (2007) Assessment in medical education. N Engl J Med 356(4):387–396PubMedCrossRef

Townsend AH, McLlvenny S, Miller CJ et al (2001) The use of an objective structured clinical examination (OSCE) for formative and summative assessment in a general practice clinical attachment and its relationship to final medical school examination performance. Med Educ 35(9):841–846PubMedCrossRef

Patil NG, Saing H, Wong J (2003) Role of OSCE in evaluation of practical skills. Med Teach 25(3):271–272PubMedCrossRef

Jefferies A, Simmons B, Tabak D et al (2007) Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training. Med Teach 29(2–3):183–191PubMedCrossRef

Govindan VK (2008) Enhancing communication skills using an OSCE and peer review. Med Educ 42(5):535–536PubMedCrossRef

BLS Healthcare Provider Course (2008). Available via: http://www.americanheart.org/presenter.jhtml?identifier=3011975. Accessed 3 May 2008

ACLS Provider Course (2008). Available via: http://www.americanheart.org/presenter.jhtml?identifier=3011972. Accessed 3 May 2008

Pediatric Advanced Life Support Course -- PALS (2008). Available via: http://www.americanheart.org/presenter.jhtml?identifier=3012001. Accessed 3 May 2008

Sauer J, Hodges B, Santhouse A et al (2005) The OSCE has landed: one small step for British psychiatry? Acad Psychiatry 29(3):310–315PubMedCrossRef

10.

Power DV, Harris IB, Swentko W et al (2006) Comparing rural-trained medical students with their peers: performance in a primary care OSCE. Teach Learn Med 18(3):196–202PubMedCrossRef

11.

Reinhart MA (1995) Advantages to using the oral examination. In: Mancall EL, Bashook PG (eds) Assessing clinical reasoning: the oral examination and alternative methods. American Board of Medical Specialties, Evanston, pp 31–39

12.

Solomon DJ, Reinhart MA, Bridgham RG et al (1990) An assessment of an oral examination format for evaluating clinical competence in emergency medicine. Acad Med 65(9 Suppl):S43–S44PubMedCrossRef

13.

Bianchi L, Gallagher EJ, Korte R et al (2003) Interexaminer agreement on the American Board of Emergency Medicine oral certification examination. Ann Emerg Med 41(6):859–864PubMedCrossRef

14.

Wang N, Witt EA, Schnipke D (2006) Rejoinder: a further discussion of job analysis and use of KSAs in developing licensure and certification examinations. Educational Measurement: Issues and Practice 25(2)

15.

Walubo A, Burch V, Parmar P et al (2003) A model for selecting assessment methods for evaluating medical students in African medical schools. Acad Med 78(9):899–906PubMedCrossRef

16.

Epstein RM, Dannefer EF, Nofziger AC et al (2004) Comprehensive assessment of professional competence: the Rochester experiment. Teach Learn Med 16(2):186–196PubMedCrossRef

17.

Norman GR, Van der Vleuten CP, De Graaff E (1991) Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability. Med Educ 25(2):119–126PubMedCrossRef

18.

Korthuis PT, Nekhlyudov L, Ziganshin AU et al (2002) Implementation of a cross-cultural evidence-based medicine curriculum. Med Teach 24(4):444–446PubMedCrossRef

19.

Kolb S, Reichert J, Hege I et al (2007) European dissemination of a web- and case-based learning system for occupational medicine: NetWoRM Europe. Int Arch Occup Environ Health 80(6):553–557PubMedCrossRef

20.

Wass V, Wakeford R, Neighbour R et al (2003) Achieving acceptable reliability in oral examinations: an analysis of the Royal College of General Practitioners membership examination’s oral component. Med Educ 37(2):126–131PubMedCrossRef

21.

Ban KM, Pini R, Sanchez LD et al (2007) The Tuscan Emergency Medicine Initiative. Ann Emerg Med 50(6):726–732PubMedCrossRef

22.

American Board of Emergency Medicine (2008) Available via: http://www.abem.org/public/. Accessed 9 May 2008

23.

Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9 Suppl):S63–S67PubMedCrossRef

24.

Kearney RA, Puchalski SA, Yang HY et al (2002) The inter-rater and intra-rater reliability of a new Canadian oral examination format in anesthesia is fair to good. Can J Anaesth 49(3):232–236PubMedCrossRef

25.

Davis MH, Karunathilake I (2005) The place of the oral examination in today’s assessment systems. Med Teach 27(4):294–297PubMedCrossRef

26.

Swing SR (2002) Assessing the ACGME general competencies: general considerations and assessment methods. Acad Emerg Med 9(11):1278–1288PubMedCrossRef

27.

Anastakis DJ, Cohen R, Reznick RK (1991) The structured oral examination as a method for assessing surgical residents. Am J Surg 162(1):67–70PubMedCrossRef

28.

Papadakis MA (2004) The step 2 clinical-skills examination. N Engl J Med 350(17):1703–1705PubMedCrossRef

29.

Weiner SG, Kelly SP, Rosen P, Ban KM (2008) The eight Cs: a guide to success in an international emergency medicine educational collaboration. Acad Emerg Med 15:678–682PubMedCrossRef

Title: Learner perception of oral and written examinations in an international medical training program
Authors: Sean P. Kelly
Scott G. Weiner
Philip D. Anderson
Julie Irish
Greg Ciottone
Riccardo Pini
Stefano Grifoni
Peter Rosen
Kevin M. Ban
Publication date: 01-03-2010
Publisher: Springer Berlin Heidelberg
Published in: International Journal of Emergency Medicine / Issue 1/2010
Print ISSN: 1865-1372
Electronic ISSN: 1865-1380
DOI: https://doi.org/10.1007/s12245-009-0147-2

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Learner perception of oral and written examinations in an international medical training program

Abstract

Background

Aims

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Aims

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2010

Unusual cause of severe toxic methemoglobinemia in an infant: a case report

Perceived confidence in the FAST exam before and after an educational intervention in a developing country

Daytime running lights in the USA: what is the impact on vehicle crashes in Minnesota?

Severe abdominal pain as a result of acute gastric volvulus

Accidental tramline bruising and rib fractures

Lessons from the recent case of CO poisoning due to shisha (hookah, narghile) tobacco smoking in Singapore