Abstract
Objective
Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program.
Methods
A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically.
Results
As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %).
Conclusions
Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.
Similar content being viewed by others
References
Loschen EL. Using the objective structured clinical examination in a psychiatry residency. Acad Psychiatry. 1993;17:95–104.
Famuyiwa OO, Zachariah MP, Ilechukwu STC. The objective structured clinical exam in psychiatry. Med Educ. 1991;25:45–50.
Hodges B, Lofchy J. Evaluating psychiatry clinical clerks with a mini-objective structured clinical examination. Acad Psychiatry. 1997;21:219–25.
Robinson DJ. A training and examination program to prepare psychiatric residents for OSCE-style exams. Acad Psychiatry. 2009;33:331–4.
Thompson CM. Will the CASC stand the test? A review and critical evaluation of the new MRCPsych clinical examination. Psychiatrist. 2009;33:145–8.
Schowalter JE. Standardized patients: a future possibility? Am Board Psychiatry Neurol Newsl. 2001;7:3.
Taghva A, Mir-Sepassi GR, Zarghami M. A brief report on the implementation of an objective structured clinical examination (OSCE) in the 2006 Iranian Board of Psychiatry Examination. Iran J Psychiatry Behav Sci. 2007;1:39–40.
Al Sinawi H, Al Sharbati M, Obaid Y, et al. Preparing and conducting objective structured clinical examination for Oman medical specialty board R1–R4 residents. Oman Med J. 2012;27:246–8.
Hodges B, Regehr G, Hanson M, et al. The objective structured clinical examination for evaluating psychiatric clinical clerks. Acad Med. 1997;72:715–21.
Hodges B, Regehr G, Hanson M, et al. Validation of an objective structured clinical examination in psychiatry. Acad Med. 1998;73:910–2.
Hanson M, Hodges B, McNaughton N, et al. The integration of child psychiatry into a psychiatry clerkship OSCE. Can J Psychiatry. 1998;43:614–8.
Hodges B, Hanson M, McNaughton N, et al. What do psychiatry residents think of an OSCE? Acad Psychiatry. 1999;23:198–204.
McNaughton N, Tiberius R, Hodges B. Effects of portraying psychologically and emotionally complex standardized patient roles. Teach Learn Med. 1999;11:135–41.
Hanson M, Tiberius R, Hodges B, et al. Adolescent standardized patients: methods of selection and assessment of benefits and risks. Teach Learn Med. 2002;14:104–13.
Hanson M, Tiberius R, Hodges B, et al. Implications of suicide contagion for the selection of adolescent standardized patients. Acad Med. 2002;77:S100–2.
Hodges B, Hanson M, McNaughton N, et al. Creating, monitoring and improving a psychiatry OSCE: a guide for faculty. Acad Psychiatry. 2002;26:134–61.
Sauer J, Hodges B, Santhouse A, et al. The OSCE has landed: one small step for British psychiatry? Acad Psychiatry. 2005;29:310–5.
Barrows HS, Abrahamson S. The programmed patient: a technique for appraising student performance in clinical neurology. J Med Educ. 1964;39:802–5.
Harden RM, Stevenson M, Downie WW, et al. Assessment of clinical competence using objective structured examinations. Br Med J. 1975;1:447–51.
Hodges BD. The objective structured clinical examination: a socio-history. Koln: LAP; 2009.
Park RS, Chibnall JT, Blaskiewicz RJ, et al. Construct validity of an objective structured clinical examination (OSCE) in psychiatry: associations with the clinical skills examination and other indicators. Acad Psychiatry. 2004;28:122–8.
Walters K, Osborn D, Raven P. The development, validity and reliability of a multimodality objective structured clinical examination in psychiatry. Med Educ. 2005;39:292–8.
Vaidya NA. Psychiatry clerkship objective structured clinical examination is here to stay. Acad Psychiatry. 2008;32:177–9.
Amr M, Amin T. Assessment methods of an undergraduate psychiatry course at a Saudi university. Sultan Qaboos Univ Med J. 2012;12:214–20.
Ismail WSW, ZamZam R, Jaafar NRN, et al. Objective structured clinical examination (OSCE) in psychiatry new curriculum undergraduate posting and its standard setting procedure: an experience in Universiti Kebangsaan Malaysia (Ukm). ASEAN J Psychiatry. 2010;11:118–27.
Benning T, Broadhurst M. The long case is dead—long live the long case loss of the Mrcpsych long case and holism in psychiatry. Psychiatrist. 2007;31:441–2.
Rasoulian M, Taghva A, Panaghi L, et al. A qualitative study of psychiatrists’ view about a pilot objective structured clinical examination (OSCE) in Iran. Iran J Psychiatry Behav Sci. 2007;1:27–9.
Marwaha S. Objective structured clinical examinations (OSCEs), psychiatry and the clinical assessment of skills and competencies (CASC) same evidence, different judgment. BMC Psychiatry. 2011;11:85.
Taghva A, Panaghi L, Rasoulian M, et al. Evaluation of reliability and validity of the psychiatry OSCE in Iran. Acad Psychiatry. 2010;34:154–7.
Yudkowsky R. Should we use standardized patients instead of real patients for high-stakes exams in psychiatry? Acad Psychiatry. 2002;26:187–92.
Taghva A, Bolhari J, Bahador H, et al. How to run psychiatry OSCE in three days. Iran J Psychiatry Behav Sci. 2008;2:5–9.
Ramchandani D. End of third-year objective structured clinical examination: boon or bane? Acad Psychiatry. 2008;32:173–6.
Birndorf CA, Kaye ME. Teaching the mental status examination to medical students by using a standardized patient in a large group setting. Acad Psychiatry. 2002;26:180–3.
Dave S. Simulation in psychiatric teaching. Adv Psychiatr Treat. 2012;18:292–8.
Hall MJ, Adamo G, McCurry L, et al. Use of standardized patients to enhance a psychiatry clerkship. Acad Med. 2004;79:28–31.
Sadeghi M, Taghva A, Mirsepassi G, et al. How do examiners and examinees think about role-playing of standardized patients in an OSCE setting? Acad Psychiatry. 2007;31:358–62.
Brenner A. Uses and limitations of simulated patients in psychiatric education. Acad Psychiatry. 2009;33:112–9.
Krahn LE, Bostwick JM, Sutor B, et al. The challenge of empathy: a pilot study of the use of standardized patients to teach introductory psychopathology to medical students. Acad Psychiatry. 2002;26:26–30.
Merckelbach H, Merten T. A note on cognitive dissonance and malingering. Clin Neuropsychol. 2012;26:1217–29.
Boerjan M, Boone F, Anthierens S, et al. The impact of repeated simulation on health and healthcare perceptions of simulated patients. Patient Educ Couns. 2008;73:22–7.
Bokken L, van Dalen J, Rethans JJ. The impact of simulation on people who act as simulated patients: a focus group study. Med Educ. 2006;40:781–6.
Gerzina HA, Porfeli EJ. Mindfulness as a predictor of positive reappraisal and burnout in standardized patients. Teach Learn Med. 2012;24:309–14.
Hodges BD, McNaughton N. Who should be an OSCE examiner? Acad Psychiatry. 2009;33:282–4.
Whelan P, Church L, Kadry K. Using standardized patients’ marks in scoring postgraduate psychiatry OSCEs. Acad Psychiatry. 2009;33:319–22.
Melding P, Coverdale J, Robinson E. A ‘fair play’? Comparison of an objective structured clinical examination of final year medical students training in psychiatry and their supervisors’ appraisals. Australas Psychiatry. 2002;10:344–7.
McMullen I, Checinski K, Halliwell S, et al. Peer observation in simulated CASC events and its effects on learning. Psychiatrist. 2013;37:111–5.
Wallace J, Rao R, Haslam R. Simulated patients and objective structured clinical examinations: review of their use in medical education. Adv Psychiatr Treat. 2002;8:342–8.
Yak A, Abdul-Hamid WK, Chad R. The objective structured clinical examination (OSCE). Psychiatrist. 2004;28:265–6.
Rudland J, Wilkinson T, Smith-Han K, et al. “You can do it late at night or in the morning. You can do it at home, I did it with my flatmate”. The educational impact of an OSCE. Med Teach. 2008;30:206–11.
Zahid MA, Al-Zayed A, Ohaeri J, et al. Introducing the objective structured clinical examination (OSCE) in the undergraduate psychiatric curriculum: evaluation after one year. Acad Psychiatry. 2011;35(6):365–9.
Brewin J, Cantwell R. Implementing the OSCE in Nottingham. Psychiatrist. 1997;21:30–2.
Acknowledgments
The authors would like to thank colleagues at the University of Toronto who have supported, adapted and sustained the original psychiatry OSCE for 20 years, including Drs. Jodi Lofchy, Raed Hawa, and Andrea Waddell.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hodges, B.D., Hollenberg, E., McNaughton, N. et al. The Psychiatry OSCE: A 20-Year Retrospective. Acad Psychiatry 38, 26–34 (2014). https://doi.org/10.1007/s40596-013-0012-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40596-013-0012-8