Skip to main content
Top
Published in: Journal of General Internal Medicine 6/2009

Open Access 01-06-2009 | Original Article

Teaching Feedback to First-year Medical Students: Long-term Skill Retention and Accuracy of Student Self-assessment

Authors: Marieke Kruidering-Hall, PhD, Patricia S. O’Sullivan, EdD, Calvin L. Chou, MD, PhD

Published in: Journal of General Internal Medicine | Issue 6/2009

Login to get access

ABSTRACT

BACKGROUND

Giving and receiving feedback are critical skills and should be taught early in the process of medical education, yet few studies discuss the effect of feedback curricula for first-year medical students.

OBJECTIVES

To study short-term and long-term skills and attitudes of first-year medical students after a multidisciplinary feedback curriculum.

DESIGN

Prospective pre- vs. post-course evaluation using mixed-methods data analysis.

PARTICIPANTS

First-year students at a public university medical school.

INTERVENTIONS

We collected anonymous student feedback to faculty before, immediately after, and 8 months after the curriculum and classified comments by recommendation (reinforcing/corrective) and specificity (global/specific). Students also self-rated their comfort with and quality of feedback. We assessed changes in comments (skills) and self-rated abilities (attitudes) across the three time points.

MEASUREMENTS AND MAIN RESULTS

Across the three time points, students’ evaluation contained more corrective specific comments per evaluation [pre-curriculum mean (SD) 0.48 (0.99); post-curriculum 1.20 (1.7); year-end 0.95 (1.5); p = 0.006]. Students reported increased skill and comfort in giving and receiving feedback and at providing constructive feedback (p < 0.001). However, the number of specific comments on year-end evaluations declined [pre 3.35 (2.0); post 3.49 (2.3); year-end 2.8 (2.1)]; p = 0.008], as did students’ self-rated ability to give specific comments.

CONCLUSION

Teaching feedback to early medical students resulted in improved skills of delivering corrective specific feedback and enhanced comfort with feedback. However, students’ overall ability to deliver specific feedback decreased over time.
Literature
1.
go back to reference Bienstock JL, Katz NT, Cox SM, Hueppchen N, Erickson S, Puscheck EE. To the point: medical education reviews–providing feedback. Am J Obstet Gynecol. 2007;196(6):508–13.PubMedCrossRef Bienstock JL, Katz NT, Cox SM, Hueppchen N, Erickson S, Puscheck EE. To the point: medical education reviews–providing feedback. Am J Obstet Gynecol. 2007;196(6):508–13.PubMedCrossRef
2.
go back to reference Branch WT, Paranjape A. Feedback and reflection: teaching methods for clinical settings. Acad Med. 2002;77(12):1185–8.PubMedCrossRef Branch WT, Paranjape A. Feedback and reflection: teaching methods for clinical settings. Acad Med. 2002;77(12):1185–8.PubMedCrossRef
4.
go back to reference van de Ridder JMM, Stokking KM, McGaghie WC, ten Cate OTJ. What is feedback in clinical education. Med Educ. 2008;42(2):189–97.PubMedCrossRef van de Ridder JMM, Stokking KM, McGaghie WC, ten Cate OTJ. What is feedback in clinical education. Med Educ. 2008;42(2):189–97.PubMedCrossRef
5.
go back to reference Askew S, Lodge C. Gifts, ping-pong and loops - linking feedback and learning. In: Askew S, ed. Feedback for Learning. London: Routledge/Falmer; 2000:1–17. Askew S, Lodge C. Gifts, ping-pong and loops - linking feedback and learning. In: Askew S, ed. Feedback for Learning. London: Routledge/Falmer; 2000:1–17.
6.
go back to reference Cole KA, Barker LR, Kolodner K, Williamson P, Wright SM, Kern DE. Faculty development in teaching skills: an intensive longitudinal model. Acad Med. 2004;79(5):469–80.PubMedCrossRef Cole KA, Barker LR, Kolodner K, Williamson P, Wright SM, Kern DE. Faculty development in teaching skills: an intensive longitudinal model. Acad Med. 2004;79(5):469–80.PubMedCrossRef
7.
go back to reference Hewson MG, Little ML. Giving feedback in medical education: verification of recommended techniques. J Gen Intern Med. 1998;13(2):111–6.PubMedCrossRef Hewson MG, Little ML. Giving feedback in medical education: verification of recommended techniques. J Gen Intern Med. 1998;13(2):111–6.PubMedCrossRef
8.
9.
go back to reference Salerno SM, Jackson JL, O’Malley PG. Interactive faculty development seminars improve the quality of written feedback in ambulatory teaching. J Gen Intern Med. 2003;18(10):831–4.PubMedCrossRef Salerno SM, Jackson JL, O’Malley PG. Interactive faculty development seminars improve the quality of written feedback in ambulatory teaching. J Gen Intern Med. 2003;18(10):831–4.PubMedCrossRef
10.
11.
go back to reference Regan-Smith M, Hirschmann K, Iobst W. Direct observation of faculty with feedback: an effective means of improving patient-centered and learner-centered teaching skills. Teach Learn Med. 2007;19(3):278–86.PubMed Regan-Smith M, Hirschmann K, Iobst W. Direct observation of faculty with feedback: an effective means of improving patient-centered and learner-centered teaching skills. Teach Learn Med. 2007;19(3):278–86.PubMed
12.
go back to reference Kern DE, Thomas PA, Howard DM, Bass EB. Curriculum development for medical education: a six-step approach. Baltimore: The Johns Hopkins University Press; 2000. Kern DE, Thomas PA, Howard DM, Bass EB. Curriculum development for medical education: a six-step approach. Baltimore: The Johns Hopkins University Press; 2000.
13.
go back to reference Shue CK, Arnold L, Stern DT. Maximizing participation in peer assessment of professionalism: the students speak. Acad Med. 2005;80(10 Suppl):S1–5.PubMedCrossRef Shue CK, Arnold L, Stern DT. Maximizing participation in peer assessment of professionalism: the students speak. Acad Med. 2005;80(10 Suppl):S1–5.PubMedCrossRef
14.
go back to reference Arnold L, Shue CK, Kalishman S, Prislin M, Pohl C, Pohl H, Stern DT. Can there be a single system for peer assessment of professionalism among medical students? A multi-institutional study. Acad Med. 2007;82(6):578–86.PubMedCrossRef Arnold L, Shue CK, Kalishman S, Prislin M, Pohl C, Pohl H, Stern DT. Can there be a single system for peer assessment of professionalism among medical students? A multi-institutional study. Acad Med. 2007;82(6):578–86.PubMedCrossRef
15.
go back to reference Spickard A III, Corbett EC Jr, Schorling JB. Improving residents’ teaching skills and attitudes toward teaching. J Gen Intern Med. 1996;11(8):475–80.PubMedCrossRef Spickard A III, Corbett EC Jr, Schorling JB. Improving residents’ teaching skills and attitudes toward teaching. J Gen Intern Med. 1996;11(8):475–80.PubMedCrossRef
16.
go back to reference Salerno SM, O’Malley PG, Pangaro LN, Wheeler GA, Moores LK, Jackson JL. Faculty development seminars based on the one-minute preceptor improve feedback in the ambulatory setting. J Gen Intern Med. 2002;17(10):779–87.PubMedCrossRef Salerno SM, O’Malley PG, Pangaro LN, Wheeler GA, Moores LK, Jackson JL. Faculty development seminars based on the one-minute preceptor improve feedback in the ambulatory setting. J Gen Intern Med. 2002;17(10):779–87.PubMedCrossRef
17.
go back to reference Morrison EH, Rucker L, Boker JR, Gabbert CC, Hubbell FA, Hitchcock MA, Prislin MD. The effect of a 13-hour curriculum to improve residents’ teaching skills: a randomized trial. Ann Intern Med. 2004;141(4):257–63.PubMed Morrison EH, Rucker L, Boker JR, Gabbert CC, Hubbell FA, Hitchcock MA, Prislin MD. The effect of a 13-hour curriculum to improve residents’ teaching skills: a randomized trial. Ann Intern Med. 2004;141(4):257–63.PubMed
18.
go back to reference Haber RJ, Bardach NS, Vedanthan R, Gillum LA, Haber LA, Dhaliwal GS. Preparing fourth-year medical students to teach during internship. J Gen Intern Med. 2006;21(5):518–20.PubMedCrossRef Haber RJ, Bardach NS, Vedanthan R, Gillum LA, Haber LA, Dhaliwal GS. Preparing fourth-year medical students to teach during internship. J Gen Intern Med. 2006;21(5):518–20.PubMedCrossRef
19.
go back to reference Holmboe ES, Fiebach NF, Galaty L, Huot S. The effectiveness of a focused educational intervention on resident evaluations from faculty: a randomized controlled trial. J Gen Intern Med. 2001;16(7):427–34.PubMedCrossRef Holmboe ES, Fiebach NF, Galaty L, Huot S. The effectiveness of a focused educational intervention on resident evaluations from faculty: a randomized controlled trial. J Gen Intern Med. 2001;16(7):427–34.PubMedCrossRef
20.
go back to reference Sluijsmans DMA, Brand-Gruwel S, Van Merriënboer JJG. Peer assessment training in teacher education. Assessment Eval Higher Educ. 2002;27(5):443–54.CrossRef Sluijsmans DMA, Brand-Gruwel S, Van Merriënboer JJG. Peer assessment training in teacher education. Assessment Eval Higher Educ. 2002;27(5):443–54.CrossRef
21.
go back to reference Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Appl Psychol Meas. Howard GS; 1979;3(1):1–23.18.CrossRef Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Appl Psychol Meas. Howard GS; 1979;3(1):1–23.18.CrossRef
22.
go back to reference Berbano EP, Browning R, Pangaro L, Jackson JL. The impact of the Stanford faculty development program on ambulatory teaching behavior. J Gen Intern Med. 2006;21(5):430–4.PubMedCrossRef Berbano EP, Browning R, Pangaro L, Jackson JL. The impact of the Stanford faculty development program on ambulatory teaching behavior. J Gen Intern Med. 2006;21(5):430–4.PubMedCrossRef
23.
go back to reference Knight AM, Carrese JA, Wright SM. Qualitative assessment of the long-term impact of a faculty development program in teaching skills. Med Educ. 2007;41(6):592–600.PubMedCrossRef Knight AM, Carrese JA, Wright SM. Qualitative assessment of the long-term impact of a faculty development program in teaching skills. Med Educ. 2007;41(6):592–600.PubMedCrossRef
24.
go back to reference Menachery EP, Knight AM, Kolodner K, Wright SM. Physician characteristics associated with proficiency in feedback skills. J Gen Intern Med. 2006;21(5):440–6.PubMedCrossRef Menachery EP, Knight AM, Kolodner K, Wright SM. Physician characteristics associated with proficiency in feedback skills. J Gen Intern Med. 2006;21(5):440–6.PubMedCrossRef
25.
go back to reference Rudy DW, Fejfar MC, Griffith CH 3rd, Wilson JF. Self- and peer assessment in a first-year communication and interviewing course. Eval Health Prof. 2001;24(4):436–45.PubMed Rudy DW, Fejfar MC, Griffith CH 3rd, Wilson JF. Self- and peer assessment in a first-year communication and interviewing course. Eval Health Prof. 2001;24(4):436–45.PubMed
26.
go back to reference Afonso NM, Cardozo LJ, Mascarenhas OA, Aranha ANF, Shah C. Are anonymous evaluations a better assessment of faculty teaching performance? A comparative analysis of open and anonymous evaluation processes. Fam Med. 2005;37(1):43–7.PubMed Afonso NM, Cardozo LJ, Mascarenhas OA, Aranha ANF, Shah C. Are anonymous evaluations a better assessment of faculty teaching performance? A comparative analysis of open and anonymous evaluation processes. Fam Med. 2005;37(1):43–7.PubMed
27.
go back to reference Suchman AL, Williamson PR, Litzelman DK, Frankel RM, Mossbarger DL, Inui TS. Relationship-centered care initiative discovery team toward an informal curriculum that teaches professionalism: transforming the social environment of a medical school. J Gen Intern Med. 2004;19(5 Pt 2):501–4.PubMedCrossRef Suchman AL, Williamson PR, Litzelman DK, Frankel RM, Mossbarger DL, Inui TS. Relationship-centered care initiative discovery team toward an informal curriculum that teaches professionalism: transforming the social environment of a medical school. J Gen Intern Med. 2004;19(5 Pt 2):501–4.PubMedCrossRef
28.
go back to reference Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094–102.PubMedCrossRef Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006;296(9):1094–102.PubMedCrossRef
29.
go back to reference Srinivasan M, Hauer KE, Der-Martirosian C, Wilkes M, Gesundheit N. Does feedback matter? Practice-based learning for medical students after a multi-institutional clinical performance examination. Med Educ. 2007;41(9):857–65.PubMedCrossRef Srinivasan M, Hauer KE, Der-Martirosian C, Wilkes M, Gesundheit N. Does feedback matter? Practice-based learning for medical students after a multi-institutional clinical performance examination. Med Educ. 2007;41(9):857–65.PubMedCrossRef
30.
go back to reference Langendyk V. Not knowing that they do not know: self-assessment accuracy of third-year medical students. Med Educ. 2006;40(2):173–9.PubMedCrossRef Langendyk V. Not knowing that they do not know: self-assessment accuracy of third-year medical students. Med Educ. 2006;40(2):173–9.PubMedCrossRef
31.
go back to reference Prins FJ, Sluijsmans DMA, Kirschner PA. Feedback for general practitioners in training: Styles, quality and preferences. Adv Health Sci Educ Theory Pract. 2006;11(3):289–303.PubMedCrossRef Prins FJ, Sluijsmans DMA, Kirschner PA. Feedback for general practitioners in training: Styles, quality and preferences. Adv Health Sci Educ Theory Pract. 2006;11(3):289–303.PubMedCrossRef
32.
go back to reference Fitzgerald JT, White CB, Gruppen LD. A longitudinal study of self-assessment accuracy. Med Educ. 2003;37(7):645–9.PubMedCrossRef Fitzgerald JT, White CB, Gruppen LD. A longitudinal study of self-assessment accuracy. Med Educ. 2003;37(7):645–9.PubMedCrossRef
33.
go back to reference Custers EJFM. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ Theory Pract 2008; published ahead of print; doi: 10.1007/s10459-008-9101-y. Latest date of access 3/31/09. Custers EJFM. Long-term retention of basic science knowledge: a review study. Adv Health Sci Educ Theory Pract 2008; published ahead of print; doi: 10.1007/s10459-008-9101-y. Latest date of access 3/31/09.
34.
go back to reference van Wyk JM, McLean M. Maximising the value of feedback for individual facilitator and faculty development. Med Teach. 2007;26(1):e26–31. van Wyk JM, McLean M. Maximising the value of feedback for individual facilitator and faculty development. Med Teach. 2007;26(1):e26–31.
35.
go back to reference Schum TR, Yindra KJ. Relationship between systematic feedback to faculty and ratings of clinical teaching. Acad Med. 1996;71(10):1100–2.PubMedCrossRef Schum TR, Yindra KJ. Relationship between systematic feedback to faculty and ratings of clinical teaching. Acad Med. 1996;71(10):1100–2.PubMedCrossRef
37.
go back to reference Elnicki MD, Layne RD, Ogden PE, Morris DK. Oral versus written feedback in medical clinic. J Gen Intern Med. 1998;13(3):155–8.PubMedCrossRef Elnicki MD, Layne RD, Ogden PE, Morris DK. Oral versus written feedback in medical clinic. J Gen Intern Med. 1998;13(3):155–8.PubMedCrossRef
Metadata
Title
Teaching Feedback to First-year Medical Students: Long-term Skill Retention and Accuracy of Student Self-assessment
Authors
Marieke Kruidering-Hall, PhD
Patricia S. O’Sullivan, EdD
Calvin L. Chou, MD, PhD
Publication date
01-06-2009
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue 6/2009
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-009-0983-z

Other articles of this Issue 6/2009

Journal of General Internal Medicine 6/2009 Go to the issue

Reflections

REFLECTION

Letter to the Editor

Literacy Medication Labels

Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.