Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Surgical Endoscopy
Published in: Surgical Endoscopy 1/2011

Open Access 01-01-2011

Measuring learning gain during a one-day introductory bronchoscopy course

Authors: Henri G. Colt, Mohsen Davoudi, Septimiu Murgu, Nazanin Zamanian Rohani

Published in: Surgical Endoscopy | Issue 1/2011

Login to get access

Abstract

Background

Rigorous assessment of medical knowledge and technical skill inspires learning, reinforces confidence, and reassures the public. Identifying curricular effectiveness using objective measures of learning is therefore crucial for competency-oriented program development in a learner-centric educational environment. The aim of this study was to determine whether various measures of learning, including class-average normalized gain, can be used to assess the effectiveness of a one-day introductory bronchoscopy course curriculum.

Methods

We conducted a quasi-experimental one-group pre-test/post-test study at the University of California, Irvine. The group comprised 24 first-year pulmonary and critical care trainees from eight training institutions in southern California. Class-average normalized gain, single-student normalized gain, absolute gain, and relative gain were used as objective measures of cognitive knowledge and bronchoscopy technical skill learning. A class-average normalized gain of 30% was used to determine curricular effectiveness. Perceived educational value using Likert-scale surveys and post-course questionnaires was determined during and 3 months after course participation.

Results

Mean test scores of cognitive knowledge improved significantly from 48 to 66% (p = 0.043). Absolute gain for the class was 18%, relative gain was 37%, class average normalized gain 〈g〉 was 34%, and the average of the single-student normalized gains g(ave) was 29%. Mean test scores of technical skill improved significantly from 43 to 77% (p = 0.017). Absolute gain was 34%, relative gain was 78%, class average normalized gain 〈g〉 was 60%, and the average of the single-student normalized gains g(ave) was 59%. Statistically significant improvements in absolute gain were noted in all five elements of technical skill (p < 0.05). Likert-scale surveys, questionnaires, and surveys demonstrated strong perceived educational value.

Conclusion

The effectiveness of a one-day introductory bronchoscopy curriculum was demonstrated using a pre-test/post-test model with calculation of normalized gain and related metrics.
Appendix
Available only for authorised users
Literature
1.
Silvestri GA (2008) The evolution of bronchoscopy training. Respiration 76(1):92–101CrossRef
2.
Haponik EF, Russell GB, Beamis JF, Britt EJ, Kvale P, Mathur P, Metha A (2000) Bronchoscopy training: current fellows’ experiences and some concerns for the future. Chest 118(3):572–573CrossRef
3.
Wahidi MM, Silvestri GA, Coakley RD, Ferguson JS, Shepherd RW, Moses L, Conforti J, Que L, Anstrom KJ, McGuire F, Colt H, Downie GH (2009) A prospective multi-center study of competency metrics and educational interventions in the learning of bronchoscopy among starting pulmonary fellows. Chest 137(5):1040–1049CrossRefPubMed
4.
Reznick RK, MacRae H (2006) Teaching surgical skills—changes in the wind. N Engl J Med 355:2664–2669CrossRefPubMed
5.
Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C (2002) Shifting paradigms: from Flexner to competencies. Acad Med 77(5):361–367CrossRefPubMed
6.
Norman G (2009) The American College of Chest Physicians evidence-based educational guidelines for continuing medical education interventions: a critical review of evidence-based educational guidelines. Chest 135(3):834–837CrossRefPubMed
7.
Schijven MP, Schout BM, Dolmans VE, Hendrikx AJ, Broeders IA, Borel Rinkes IH (2008) Perceptions of surgical specialists in general surgery, orthopaedic surgery, urology and gynaecology on teaching endoscopic surgery in The Netherlands. Surg Endosc 22(2):472–482CrossRefPubMed
8.
Cronbach LJ, Furby L (1970) How should we measure “change” or should we? Psychol Bull 74:68–80CrossRef
9.
10.
11.
12.
Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin, New York
13.
Hake RR (1998) Interactive-engagement vs traditional methods: a six-thousand-student survey of mechanics test data for introductory physics courses. Am J Phys 66:64–74CrossRef
14.
Prather EE, Rudolph AL, Brissenden G, Schlingman WM (2009) A national study assessing the teaching and learning of introductory astronomy. Part I. The effect of interactive instruction. Am J Phys 77(4):320–330CrossRef
15.
16.
Hake RR (2008) Design-based research in physics education research: a review. In: Kelly AE, Lesh RA, Baek JY (eds) A handbook of design research methods in education: innovations in science, technology, engineering, and mathematics learning and teaching. Routledge, New York
17.
Hovland CI, Lumsdaine AA, Sheffield FD (1965) A baseline for measurement of percentage change. In: Hovland CI, Lumsdaine AA, Sheffield FD (eds), Experiments on mass communication. New York: Wiley (first published in 1949). Reprinted as pages 77–82 in Lazarsfeld PF, Rosenberg M (eds) (1955) The language of social research: a reader in the methodology of social research. Free Press, New York
18.
19.
Confrey J, Stohl V (2004) On evaluating curricular effectiveness: judging the quality of k-12 mathematics evaluations. National Academies Press, Washington, pp 36–37
20.
McGaghie WC, Siddall VJ, Mazmanian PE, Myers J (2009) Lessons for continuing medical education from simulation research in undergraduate and graduate medical education. Chest 135:62S–68SCrossRefPubMed
21.
22.
Harden RM, Crosby JR (2000) The good teacher is more than a lecturer: the twelve roles of the teacher. Med Teach 22:334–347CrossRef
23.
Quadrelli S, Galíndez F, Davoudi M, Colt HG (2009) Reliability of a 25-item low-stakes multiple choice assessment of bronchoscopic knowledge. Chest 135(2):315–321CrossRefPubMed
24.
Davoudi M, Osann K, Colt HG (2008) Validation of two instruments to assess technical bronchoscopic skill using virtual reality simulation. Respiration 76(1):92–101CrossRefPubMed
25.
Campbell D, Stanley J (1963) Experimental and quasi-experimental designs for research. Rand-McNally, Chicago
26.
Prather EE, Rudolph AL, Brissenden G (2009) Teaching and learning astronomy in the 21st century. Phys Today 62(10):41–47CrossRef
27.
Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65 Suppl:S63-S67
28.
Anderson LW, Krathwohl D (eds) (2001) A taxonomy for learning, teaching and assessing: a revision of bloom’s taxonomy of educational objectives. Addison Wesley Longman, Upper Saddle River
29.
Dreyfus HL, Dreyfus SE (1992) Mind over machine: the power of human intuition and expertise in the age of the computer. Free Press, New York
30.
Thomson O’Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J (2001) Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev (2):CD003030
31.
Lynch DC, Whitley TW, Willis SE (2000) A rationale for using synthetic designs in medical education research. Adv Health Sci Educ 5:93–103CrossRef
32.
Wieman C, Perkins K (2005) Transforming physics education. Phys Today 58(11):36–41CrossRef
33.
McGowan MA, Davis G (2005) Individual gain and engagement with teaching goals. In: McDougall D (ed), Proceedings of the 26th Annual Conference of the International Group for the Psychology of Mathematics Education, North American Chapter. OISE, Toronto
34.
Willingham DB, Dumas JA (1997) Long-term retention of a motor skill: implicit sequence knowledge is not retained after a one-year delay. Psychol Res 60:113–119CrossRef
35.
Marinopoulos SS, Baumann MH (2009) Methods and definitions of terms: effectiveness of continuing medical education: American College of Chest Physicians evidence-based educational guidelines. Chest 135:17S–28SCrossRefPubMed
36.
Bordage G, Carlin B, Mazmanian PE (2009) Continuing medical education effect on physician knowledge: effectiveness of continuing medical education: American College of Chest Physicians evidence-based educational guidelines. Chest 135:29S–36SCrossRefPubMed
37.
Sweet RM, McDougall EM (2008) Simulation and computer-animated devices: the new minimally invasive skills training paradigm. Urol Clin North Am 35(3):519–531CrossRefPubMed
38.
Wang EE, Quinones J, Fitch MT, Dooley-Hash S, Griswold-Theodorson S, Medzon R, Korley F, Laack T, Robinett A, Clay L (2008) Developing technical expertise in emergency medicine—the role of simulation in procedural skill acquisition. Acad Emerg Med 15(11):1046–1057CrossRefPubMed
39.
Cooke M, Irby DM, Sullivan W, Ludmerer KM (2006) American medical education 100 years after the Flexner report. N Engl J Med 355:1339–1344CrossRefPubMed
40.
41.
Chin MW, Forbes GM (2008) Should simulator use become mandatory in endoscopy training? J Gastroenterol Hepatol 23:996–997CrossRefPubMed
42.
Kruidering-Hall M, O’Sullivan PS, Chou CL (2009) Teaching feedback to first-year medical students: long-term skill retention and accuracy of student self-assessment. J Gen Intern Med 24(6):721–726CrossRefPubMed
43.
Christensen C, Horn MB, Johnson CW, Horn MB (2008) Disrupting class: how disruptive innovation will change the way the world learns. McGraw Hill, New York, pp 110–111
44.
Michelson JD, Manning L (2008) Competency assessment in simulation-based procedural education. Am J Surg 196:609–615CrossRefPubMed
45.
Metadata
Title
Measuring learning gain during a one-day introductory bronchoscopy course
Authors
Henri G. Colt
Mohsen Davoudi
Septimiu Murgu
Nazanin Zamanian Rohani
Publication date
01-01-2011
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 1/2011
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-010-1161-4

Other articles of this Issue 1/2011

Surgical Endoscopy 1/2011 Go to the issue

New Technology

Durability of the self-approximating translumenal access technique (STAT) for potential use in natural orifice translumenal surgery (NOTES)

OriginalPaper

Wound morbidity in mini-invasive thyroidectomy

OriginalPaper

A collaborative approach reduces the learning curve and improves outcomes in laparoscopic nephrectomy

OriginalPaper

Current analysis of endoloops in appendiceal stump closure

OriginalPaper

European consensus on a competency-based virtual reality training program for basic endoscopic surgical psychomotor skills

OriginalPaper

Laparoscopic inguinal herniorrhaphy in babies weighing 5 kg or less