Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Journal of General Internal Medicine
Published in: Journal of General Internal Medicine 12/2010

Open Access 01-12-2010 | Reviews

Assessing the Quality of Clinical Teachers

A Systematic Review of Content and Quality of Questionnaires for Assessing Clinical Teachers

Authors: Cornelia R. M. G. Fluit, MD, MEdSci, Sanneke Bolhuis, PhD, Richard Grol, PhD, Roland Laan, MD, PhD, Michel Wensing, PhD

Published in: Journal of General Internal Medicine | Issue 12/2010

Login to get access

Abstract

Background

Learning in a clinical environment differs from formal educational settings and provides specific challenges for clinicians who are teachers. Instruments that reflect these challenges are needed to identify the strengths and weaknesses of clinical teachers.

Objective

To systematically review the content, validity, and aims of questionnaires used to assess clinical teachers.

Data Sources

MEDLINE, EMBASE, PsycINFO and ERIC from 1976 up to March 2010.

Review Methods

The searches revealed 54 papers on 32 instruments. Data from these papers were documented by independent researchers, using a structured format that included content of the instrument, validation methods, aims of the instrument, and its setting.

Results

Aspects covered by the instruments predominantly concerned the use of teaching strategies (included in 30 instruments), supporter role (29), role modeling (27), and feedback (26). Providing opportunities for clinical learning activities was included in 13 instruments. Most studies referred to literature on good clinical teaching, although they failed to provide a clear description of what constitutes a good clinical teacher. Instrument length varied from 1 to 58 items. Except for two instruments, all had to be completed by clerks/residents. Instruments served to provide formative feedback ( instruments) but were also used for resource allocation, promotion, and annual performance review (14 instruments). All but two studies reported on internal consistency and/or reliability; other aspects of validity were examined less frequently.

Conclusions

No instrument covered all relevant aspects of clinical teaching comprehensively. Validation of the instruments was often limited to assessment of internal consistency and reliability. Available instruments for assessing clinical teachers should be used carefully, especially for consequential decisions. There is a need for more valid comprehensive instruments.
Appendix
Available only for authorised users
Literature
1.
Leach DC. Changing education to improve patient care. Qual Health Care. 2001;10(Suppl 2):ii54–8.PubMed
2.
Leach DC, Philibert I. High-quality learning for high-quality health care: getting it right. JAMA. 2006;296(9):1132–4.CrossRefPubMed
3.
Kilminster S, Cottrell D, Grant J, Jolly B. AMEE Guide No. 27: effective educational and clinical supervision. Med Teach. 2007;29(1):2–19.CrossRefPubMed
4.
Prideaux D, Alexander H, Bower A, et al. Clinical teaching: maintaining an educational role for doctors in the new health care environment. Med Educ. 2000;34(10):820–6.CrossRefPubMed
5.
Boor K, Teunissen PW, Scherpbier AJ, van der Vleuten CP, van de Lande J, Scheele F. Residents' perceptions of the ideal clinical teacher-A qualitative study. Eur J Obstet Gynecol Reprod Biol. 2008 May 1.
6.
Irby DM, Ramsey PG, Gillmore GM, Schaad D. Characteristics of effective clinical teachers of ambulatory care medicine. Acad Med. 1991;66(1):54–5.CrossRefPubMed
7.
Irby DM. Teaching and learning in ambulatory care settings: a thematic review of the literature. Acad Med. 1995;70(10):898–931.CrossRefPubMed
8.
9.
Ullian JA, Bland CJ, Simpson DE. An alternative approach to defining the role of the clinical teacher. Acad Med. 1994;69(10):832–8.CrossRefPubMed
10.
Paukert JL, Richards BF. How medical students and residents describe the roles and characteristics of their influential clinical teachers. Acad Med. 2000;75(8):843–5.CrossRefPubMed
11.
Harden RM, Crosby J. AMEE Guide No 20: the good teacher is more than a lecturer - the twelve roles of the teacher. Med Teach. 2000;22(4):334–47.CrossRef
12.
Hesketh EA. A framework for developing excellence as a clinical educator. Med Educ. 2001;35(6):555–64.CrossRefPubMed
13.
Ramani S, Leinster S. AMEE Guide no. 34: teaching in the clinical environment. Med Teach. 2008;30(4):347–64.CrossRefPubMed
14.
Bandiera G, Lee S, Tiberius R. Creating effective learning in today's emergency departments: how accomplished teachers get it done. Ann Emerg Med. 2005;45(3):253–61.CrossRefPubMed
15.
Bleakley A. Pre-registration house officers and ward-based learning: a 'new apprenticeship' model. Med Educ. 2002;36(1):9–15.CrossRefPubMed
16.
Chitsabesan P, Corbett S, Walker L, Spencer J, Barton JR. Describing clinical teachers' characteristics and behaviours using critical incidents and repertory grids. Med Educ. 2006;40(7):645–53.CrossRefPubMed
17.
Heidenreich C, Lye P, Simpson D, Lourich M. The search for effective and efficient ambulatory teaching methods through the literature. Pediatrics. 2000;105(1 Pt 3):231–7.PubMed
18.
Sutkin G, Wagner E, Harris I, Schiffer R. What makes a good clinical teacher in medicine? A review of the literature. Acad Med. 2008;83(5):452–66.CrossRefPubMed
19.
Cote L, Leclere H. How clinical teachers perceive the doctor-patient relationship and themselves as role models. Acad Med. 2000;75(11):1117–24.CrossRefPubMed
20.
Kenny NP, Mann KV, MacLeod H. Role modeling in physicians' professional formation: reconsidering an essential but untapped educational strategy. Acad Med. 2003;78(12):1203–10.CrossRefPubMed
21.
Wright SM, Kern DE, Kolodner K, Howard DM, Brancati FL. Attributes of excellent attending-physician role models. N Engl J Med. 1998;339(27):1986–93.CrossRefPubMed
22.
Wright SM, Carrese JA. Excellence in role modelling: insight and perspectives from the pros. CMAJ. 2002;167(6):638–43.PubMed
23.
Althouse LA, Stritter FT, Steiner BD. Attitudes and approaches of influential role models in clinical education. Adv Health Sci Educ Theory Pract. 1999;4(2):111–22.CrossRefPubMed
24.
Kilminster SM, Jolly BC. Effective supervision in clinical practice settings: a literature review. Med Educ. 2000;34(10):827–40.CrossRefPubMed
25.
Snell L, Tallett S, Haist S, et al. A review of the evaluation of clinical teaching: new perspectives and challenges. Med Educ. 2000;34(10):862–70.CrossRefPubMed
26.
Bolhuis S. Professional development between teachers' practical knowledge and external demands: plea for a broad socail-constructivist and critical approach. In: Oser FK, Achtenwagen F, Renold U, eds. Competence Oriented Teacher Training. Old Research Demands and New Pathways. Rotterdam: Sense Publishers; 2006:237–49.
27.
Cheetham G, Chivers G. How professionals learn: an investigation of informal learning amongst people working in professions. J Eur Ind Train. 2001;25(5):248–92.
28.
Eraut M. Informal learning in the workplace. Stud Contin Educ. 2004;26(2):247–73.CrossRef
29.
Fluit C, Bolhuis S. Teaching and Learning. Patient-centered Acute Care Training (PACT). 1 ed. European Society of Intensive Care Medicine; 2007.
30.
Teunissen PW, Scheele F, Scherpbier AJ, et al. How residents learn: qualitative evidence for the pivotal role of clinical activities. Med Educ. 2007;41(8):763–70.CrossRefPubMed
31.
Frank JR, Danoff D. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29(7):642–7.CrossRefPubMed
32.
Leach DC. Evaluation of competency: an ACGME perspective. Accreditation council for graduate medical education. Am J Phys Med Rehabil. 2000;79(5):487–9.CrossRefPubMed
33.
Smith CA, Varkey AB, Evans AT, Reilly BM. Evaluating the performance of inpatient attending physicians: a new instrument for today's teaching hospitals. J Gen Intern Med. 2004;19(7):766–71.CrossRefPubMed
34.
Beckman TJ, Cook DA, Mandrekar JN. What is the validity evidence for assessments of clinical teaching? J Gen Intern Med. 2005;20(12):1159–64.CrossRefPubMed
35.
Boor K. The Clinical Learning Climate. Amsterdam: Vrije Universiteit Amsterdam; 2009.
36.
Downing SM. Validity: on meaningful interpretation of assessment data. Med Educ. 2003;37(9):830–7.CrossRefPubMed
37.
Downing SM. Reliability: on the reproducibility of assessment data. Med Educ. 2004;38(9):1006–12.CrossRefPubMed
38.
Silber C, Novielli K, Paskin D, et al. Use of critical incidents to develop a rating form for resident evaluation of faculty teaching. Med Educ. 2006;40(12):1201–8.CrossRefPubMed
39.
Afonso NM, Cardozo LJ, Mascarenhas OA, Aranha AN, Shah C. Are anonymous evaluations a better assessment of faculty teaching performance? A comparative analysis of open and anonymous evaluation processes. Fam Med. 2005;37(1):43–7.PubMed
40.
Beckman TJ, Lee MC, Rohren CH, Pankratz VS. Evaluating an instrument for the peer review of inpatient teaching. Med Teach. 2003;25(2):131–5.CrossRefPubMed
41.
Beckman TJ, Lee MC, Mandrekar JN. A comparison of clinical teaching evaluations by resident and peer physicians. Med Teach. 2004;26(4):321–5.CrossRefPubMed
42.
Beckman TJ, Mandrekar JN. The interpersonal, cognitive and efficiency domains of clinical teaching: construct validity of a multi-dimensional scale. Med Educ. 2005;39(12):1221–9.CrossRefPubMed
43.
Beckman TJ, Cook DA, Mandrekar JN. Factor instability of clinical teaching assessment scores among general internists and cardiologists. Med Educ. 2006;40(12):1209–16.CrossRefPubMed
44.
Bergen M, Stratos G, Berman J, Skeff KM. Comparison of clinical teaching by residents and attending physicians in inpatient and lecture settings. Teach Learn Med. 1993;5:149–57.CrossRef
45.
Bierer SB, Fishleder AJ, Dannefer E, Farrow N, Hull AL. Psychometric properties of an instrument designed to measure the educational quality of graduate training programs. Eval Health Prof. 2004;27(4):410–24.CrossRefPubMed
46.
Bierer SB, Hull AL. Examination of a clinical teaching effectiveness instrument used for summative faculty assessment. Eval Health Prof. 2007;30(4):339–61.CrossRefPubMed
47.
Bruijn M, Busari JO, Wolf BH. Quality of clinical supervision as perceived by specialist registrars in a university and district teaching hospital. Med Educ. 2006;40(10):1002–8.CrossRefPubMed
48.
Busari JO, Weggelaar NM, Knottnerus AC, Greidanus PM, Scherpbier AJ. How medical residents perceive the quality of supervision provided by attending doctors in the clinical setting. Med Educ. 2005;39(7):696–703.CrossRefPubMed
49.
Busari JO, Koot BG. Quality of clinical supervision as perceived by attending doctors in university and district teaching hospitals. Med Educ. 2007;41(10):957–64.CrossRefPubMed
50.
51.
Copeland HL, Hewson MG. Developing and testing an instrument to measure the effectiveness of clinical teaching in an academic medical center. Acad Med. 2000;75(2):161–6.CrossRefPubMed
52.
Cox SS, Swanson MS. Identification of teaching excellence in operating room and clinic settings. Am J Surg. 2002;183(3):251–5.CrossRefPubMed
53.
de Oliveira Filho GR, Dal Mago AJ, Garcia JH, Goldschmidt R. An instrument designed for faculty supervision evaluation by anesthesia residents and its psychometric properties. Anesth Analg. 2008;107(4):1316–22.CrossRefPubMed
54.
Dolmans DH, Wolfhagen HA, Gerver WJ, de Grave W, Scherpbier AJ. Providing physicians with feedback on how they supervise students during patient contacts. Med Teach. 2004;26(5):409–14.CrossRefPubMed
55.
Donnelly MB, Woolliscroft JO. Evaluation of clinical instructors by third-year medical students. Acad Med. 1989;64(3):159–64.CrossRefPubMed
56.
Donner-Banzhoff N, Merle H, Baum E, Basler HD. Feedback for general practice trainers: developing and testing a standardised instrument using the importance-quality-score method. Med Educ. 2003;37(9):772–7.CrossRefPubMed
57.
Guyatt G, Nishikawa J, Willan A, et al. A measurement process for evaluating clinical teachers in internal medicine. Can Med Assoc J. 1993;149(8):1097–102.
58.
Hayward R. Why the culture of medicine has to change. BMJ. 2007;335(7623):775.CrossRef
59.
Hekelman F, Vanek E, Kelly K, Alemagno S. Characteristics of family physicians' clinical teaching behaviors in the ambulatory setting: a descriptive study. Teach Learn Med. 1993;5(1):18–23.CrossRef
60.
Hekelman F, Snyder C, Clint W, Alemagno S, Hull A, et al. Humanistic teaching attributes of primary care physicians. Teach Learn Med. 1995;7(1):29–36.CrossRef
61.
Hewson MG, Jensen NM. An inventory to improve clinical teaching in the general internal medicine clinic. Med Educ. 1990;24(6):518–27.CrossRefPubMed
62.
Irby DM, Rakestraw P. Evaluating clinical teaching in medicine. J Med Educ. 1981;56:181–6.PubMed
63.
Irby DM, Gillmore GM, Ramsey PG. Factors affecting ratings of clinical teachers by medical students and residents. J Med Educ. 1987;62(1):1–7.PubMed
64.
James PA, Osborne JW. A measure of medical instructional quality in ambulatory settings: the MedIQ. Fam Med. 1999;31(4):263–9.PubMed
65.
James PA, Kreiter CD, Shipengrover J, Crosson J. Identifying the attributes of instructional quality in ambulatory teaching sites: a validation study of the MedEd IQ. Fam Med. 2002;34(4):268–73.PubMed
66.
Lewis BS, Pace WD. Qualitative and quantitative methods for the assessment of clinical preceptors. Fam Med. 1990;22(5):356–60.PubMed
67.
Litzelman DK. Factorial validation of a widely disseminated educational framework for evaluating clinical teachers. Acad Med. 1998;73(6):688–95.CrossRefPubMed
68.
Litzelman DK, Stratos GA, Marriott DJ, Lazaridis EN, Skeff KM. Beneficial and harmful effects of augmented feedback on physicians' clinical-teaching performances. Acad Med. 1998;73(3):324–32.CrossRefPubMed
69.
Litzelman DK, Westmoreland GR, Skeff KM, Stratos GA. Factorial validation of an educational framework using residents' evaluations of clinician-educators. Acad Med. 1999;74(10 Suppl):S25–7.CrossRefPubMed
70.
Love DW, Heller LE, Parker PF. The use of student evaluations in examining clinical teaching in pharmacy. Drug Intell Clin Pharm. 1982;16(10):759–64.PubMed
71.
Marriott DJ, Litzelman DK. Students' global assessments of clinical teachers: a reliable and valid measure of teaching effectiveness. Acad Med. 1998;73(10 Suppl):S72–4.CrossRefPubMed
72.
McLeod PJ. Faculty perspectives of a valid and reliable clinical tutor evaluation program. Eval Health Prof. 1991;14(3):333–42.CrossRef
73.
Mourad O, Redelmeier DA. Clinical teaching and clinical outcomes: teaching capability and its association with patient outcomes. Med Educ. 2006;40(7):637–44.CrossRefPubMed
74.
Mullan P, Sullivan D, Dielman T. What are raters rating? Predicting medical student, pediatric resident, and faculty ratings of clinical teachers. Teach Learn Med. 1993;5(4):221–6.CrossRef
75.
Ramsbottom-Lucier MT, Gillmore GM, Irby DM, Ramsey PG. Evaluation of clinical teaching by general internal medicine faculty in outpatient and inpatient settings. Acad Med. 1994;69(2):152–4.CrossRefPubMed
76.
Ramsey PG, Gillmore GM, Irby DM. Evaluating clinical teaching in the medicine clerkship: relationship of instructor experience and training setting to ratings of teaching effectiveness. J Gen Intern Med. 1988;3(4):351–5.CrossRefPubMed
77.
Risucci DA, Lutsky L, Rosati RJ, Tortolani AJ. Reliability and accuracy of resident evaluations of surgical faculty. Eval Health Prof. 1992;15(3):313–24.CrossRefPubMed
78.
Schum TR, Yindra KJ. Relationship between systematic feedback to faculty and ratings of clinical teaching. Acad Med. 1996;71(10):1100–2.CrossRefPubMed
79.
Schum T, Koss R, Yindra K, Nelson D. Students' and residents' ratings of teaching effectiveness in a department of pediatrics. Teach Learn Med. 1993;5(3):128–32.CrossRef
80.
Shellenberger S, Mahan JM. A factor analytic study of teaching in off-campus general practice clerkships. Med Educ. 1982;16(3):151–5.CrossRefPubMed
81.
Solomon DJ, Speer AJ, Rosebraugh CJ, DiPette DJ. The reliability of medical student ratings of clinical teaching. Eval Health Prof. 1997;20(3):343–52.CrossRefPubMed
82.
Spickard A III, Corbett EC Jr, Schorling JB. Improving residents' teaching skills and attitudes toward teaching. J Gen Intern Med. 1996;11(8):475–80.CrossRefPubMed
83.
Stalmeijer RE, Dolmans DH, Wolfhagen IH, Scherpbier AJ. Cognitive apprenticeship in clinical practice: can it stimulate learning in the opinion of students? Adv Health Sci Educ Theory Pract. 2008 September 17.
84.
Stalmeijer RE, Dolmans DH, Wolfhagen IH, Muijtjens AM, Scherpbier AJ. The development of an instrument for evaluating clinical teachers: involving stakeholders to determine content validity. Med Teach. 2008;30(8):e272–7.CrossRefPubMed
85.
Steiner IP, Franc-Law J, Kelly KD, Rowe BH. Faculty evaluation by residents in an emergency medicine program: a new evaluation instrument. Acad Emerg Med. 2000;7(9):1015–21.CrossRefPubMed
86.
Steiner IP, Yoon PW, Kelly KD, et al. The influence of residents training level on their evaluation of clinical teaching faculty. Teach Learn Med. 2005;17(1):42–8.CrossRefPubMed
87.
Tortolani AJ, Risucci DA, Rosati RJ. Resident evaluation of surgical faculty. J Surg Res. 1991;51(3):186–91.CrossRefPubMed
88.
van der Hem-Stokroos HH, van der Vleuten CPM, Daelmans HEM, Haarman HJTM, Scherpbier AJJA. Reliability of the clinical teaching effectiveness instrument. Med Educ. 2005;39(9):904–10.CrossRefPubMed
89.
Williams BC. Validation of a global measure of faculty's clinical teaching performance. Acad Med. 2002;77(2):177–80.CrossRefPubMed
90.
Zuberi RW, Bordage G, Norman GR. Validation of the SETOC instrument – Student evaluation of teaching in outpatient clinics. Adv Health Sci Educ Theory Pract. 2007;12(1):55–69.CrossRefPubMed
91.
Norcini JJ. Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005;39(9):880–9.CrossRefPubMed
92.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9 Suppl):S63–7.CrossRefPubMed
93.
Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29(9):855–71.CrossRefPubMed
94.
Scheele F, Teunissen P, van Luijk S, et al. Introducing competency-based postgraduate medical education in the Netherlands. Med Teach. 2008;30(3):248–53.CrossRefPubMed
95.
ten Cate O. Trust, competence, and the supervisor's role in postgraduate training. BMJ. 2006;333(7571):748–51.CrossRefPubMed
96.
ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–7.CrossRefPubMed
97.
Spencer J. ABC of learning and teaching in medicine: learning and teaching in the clinical environment. BMJ. 2003;326(7389):591–4.CrossRefPubMed
98.
McLeod PJ, James CA, Abrahamowicz M. Clinical tutor evaluation: a 5-year study by students on an in-patient service and residents in an ambulatory care clinic. Med Educ. 1993;27(1):48–54.CrossRefPubMed
99.
Downing SM, Haladyna TM. Validity threats: overcoming interference with proposed interpretations of assessment data. Med Educ. 2004;38(3):327–33.CrossRefPubMed
100.
Auewarakul C, Downing SM, Jaturatamrong U, Praditsuwan R. Sources of validity evidence for an internal medicine student evaluation system: an evaluative study of assessment methods. Med Educ. 2005;39(3):276–83.CrossRefPubMed
101.
Jahangiri L, Mucciolo TW, Choi M, Spielman AI. Assessment of teaching effectiveness in U.S. Dental schools and the value of triangulation. J Dent Educ. 2008;72(6):707–18.PubMed
102.
Van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ Theory Pract. 1996;1(1):41–67.CrossRef
Metadata
Title
Assessing the Quality of Clinical Teachers
A Systematic Review of Content and Quality of Questionnaires for Assessing Clinical Teachers
Authors
Cornelia R. M. G. Fluit, MD, MEdSci
Sanneke Bolhuis, PhD
Richard Grol, PhD
Roland Laan, MD, PhD
Michel Wensing, PhD
Publication date
01-12-2010
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue 12/2010
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-010-1458-y

Other articles of this Issue 12/2010

Journal of General Internal Medicine 12/2010 Go to the issue

Letters

Training Residents in Outpatient HIV Care

Editorials

From the Editor's Desk: Our Paper Anniversary

Original Research

Exploring the Meaning of Respect in Medical Student Education: an Analysis of Student Narratives

Original Research

Between-Visit Workload in Primary Care

Erratum

Erratum to: Having a Say: Agency and End-of-Life Decision-making in The Chaneysville Incident

Original Research

Massachusetts Health Reform and Disparities in Coverage, Access and Health Status

ACC 2024 Congress Coverage

Heart Failure Video

Year in Review: Heart failure and cardiomyopathies

Watch now

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.

Semaglutide benefits people with type 2 diabetes and obesity-related heart failure

16-04-2024 Type 2 Diabetes News

Incentivised to exercise

11-04-2024 Lifestyle Modifications News

New intervention for STEMI-related cardiogenic shock

10-04-2024 Myocardial Infarction News

» View more highlights on the ACC 2024 congress hub page

Image Credits