Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Perspectives on Medical Education
Published in: Perspectives on Medical Education 2/2015

Open Access 01-04-2015 | Original Article

User reception of a simple online multisource feedback tool for residents

Authors: Lonneke Alofs, Jorike Huiskes, Maas Jan Heineman, Caroline Buis, Manon Horsman, Lars van der Plank, Olle ten Cate

Published in: Perspectives on Medical Education | Issue 2/2015

Login to get access

Abstract

Receiving feedback on daily clinical activities, in whatever form, is crucial for the development of clinical proficiency. Multisource or 360-degree feedback procedures have been recommended to include various co-workers as sources of feedback. In 2008, a web-based multisource feedback (MSF) tool for medical residents was developed at the University Medical Center Utrecht and launched nationally in the Netherlands and has been widely used since then. In 2012, an evaluation was carried out to collect opinions on its use, on the quality of the instrument and on its experienced effectiveness. We approached 408 residents and 59 residency programme directors with an anonymous online survey.
Completed surveys were received from 108 residents (26 %) and 22 programme directors (37 %). The tool was well received among the respondents and proved to be a simple, efficient and effective instrument to prepare for information-rich progress interviews of programme directors with their residents. Despite a relatively low response rate, indications were found for the effectiveness of MSF use at four levels of Kirkpatrick’s hierarchy based on user impressions: reaction, learning, behaviour change, and impact. This MSF tool, designed for effective formative feedback, was found to meet its purpose and was well received.
Literature
1.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;87(7):S63–7.
2.
Norcini JJ, Blank LL, Duffy FD, Fortna GS. Academia and clinic the Mini-CEX: a method for assessing clinical skills. Ann Intern Med. 2003;138:476–81.CrossRefPubMed
3.
4.
Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment a systematic review. JAMA. 2009;302(12):1316–26.CrossRefPubMed
5.
Eva KW, Regehr G. Self-assessment in the health professions: a reformulation and research agenda. Acad Med. 2005;80(10 Suppl):S46–54.
6.
Sargeant J, Armson H, Chesluk B, et al. The processes and dimensions of informed self-assessment: a conceptual model. Acad Med. 2010;85(7):1212–20.CrossRefPubMed
7.
Hirsh D, Ogur B, Thibault GE, Cox M. ‘Continuity’ as an organizing principle for clinical education reform. N Engl J Med. 2007;356(8):858–66.CrossRefPubMed
8.
Lockyer J. Multisource feedback in the assessment of physician competencies. J Contin Educ Health Prof. 2003;23(1):4–12.CrossRefPubMed
9.
Horsman MA, Ten Cate TJ. Richtlijn multisource feedback voor de aios [Guideline Multisource Feedback For Residents—in Dutch]. J Med Educ. 2010;29(2):3–8.
10.
11.
Horsman MA, ten Cate TJ. Achtergronden bij de Richtlijn multisource feedback voor de aios [Background information abour the guidelines for multisource feedback for residents- in Dutch]. Netherlands J Med Educ. 2010;29(2):1–52.
12.
Frank JR. The CanMEDS 2005 physician competency framework: Better standards, better physicians, better care. Ottawa: Royal College of Physicians and Surgeons in Canada; 2005.
13.
Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs: the four levels, 3rd ed. Berkeley: Berrett-Koehler Publishers, Inc; 2006.
14.
Norman G. Likert scales, levels of measurement and the ‘laws’ of statistics. Adv Health Sci Educ Theory Pract. 2010;15(5):625–32.CrossRefPubMed
15.
Kirschner PA, van Merriënboer JJG. Do learners really know best? Urban legends in education. Educ Psychol. 2013;48(3):169–83.CrossRef
16.
Ten Cate O. What happens to the student? The neglected variable in educational outcome research. Adv Health Sci Educ Theory Pract. 2001;6(1):81–8.CrossRefPubMed
17.
Lockyer J. Multisource feedback: can it meet criteria for good assessment? J Contin Educ Health Prof. 2013;33(2):89–98.CrossRefPubMed
18.
Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Heal Sci Educ. 1996;1(1):41–67.CrossRef
19.
Violato C, Lockyer J, Fidler H. Multisource feedback: a method of assessing surgical practice. Br Med J. 2003;326(7388):546–8.CrossRef
20.
Wilkinson JR, Crossley JGM, Wragg A, Mills P, Cowan G, Wade W. Implementing workplace-based assessment across the medical specialties in the United Kingdom. Med Educ. 2008;42(4):364–73.CrossRefPubMed
21.
Donnon T, Al Ansari A, Al Alawi S, Violato C. The reliability, validity, and feasibility of multisource feedback physician assessment: a systematic review. Acad Med. 2014;89(3):511–6.CrossRefPubMed
22.
Richmond M, Canavan C, Holtman M, Katsufrakis P. Feasibility of implementing a standardized multisource feedback program in the graduate medical education environment. J Grad Med Educ. 2011;3(4):511–6.CrossRefPubMedCentralPubMed
23.
Ramsey PG, Wenrich MD, Carline JD, Inui TS, Larsen EB, LoGerfo JP. Use of peer ratings to evaluate physician performance. JAMA. 1993;269(13):1655–60.CrossRefPubMed
24.
Sargeant J, Mann K, Sinclair D, Van der Vleuten C, Metsemakers J. Understanding the influence of emotions and reflection upon multisource feedback acceptance and use. Adv Health Sci Educ Theory Pract. 2008;13(3):275–88.CrossRefPubMed
Metadata
Title
User reception of a simple online multisource feedback tool for residents
Authors
Lonneke Alofs
Jorike Huiskes
Maas Jan Heineman
Caroline Buis
Manon Horsman
Lars van der Plank
Olle ten Cate
Publication date
01-04-2015
Publisher
Bohn Stafleu van Loghum
Published in
Perspectives on Medical Education / Issue 2/2015
Print ISSN: 2212-2761
Electronic ISSN: 2212-277X
DOI
https://doi.org/10.1007/s40037-015-0173-0

Other articles of this Issue 2/2015

Perspectives on Medical Education 2/2015 Go to the issue

The Writer’s Craft

Enlisting the power of the verb

Commentary

Reflecting upon multisource feedback as ‘assessment for learning’

Letter

The issue of ‘informed consent’ in medical student introductions

Show and Tell

‘From scared to prepared’: targeted structured induction training during the transition from medical school to foundation doctor

Letter

Who can do without patients?

Health Care and the Arts

Palliative medicine fellows attend to compassion fatigue using John Stone’s ‘Talking to the Family’