Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2007

Open Access 01-12-2007 | Research article

Evidence based practice in postgraduate healthcare education: A systematic review

Authors: Gemma Flores-Mateo, Josep M Argimon

Published in: BMC Health Services Research | Issue 1/2007

Login to get access

Abstract

Background

Training in Evidence-Based Practice (EBP) has been widely implemented throughout medical school and residency curricula. The aim of this study is to systematically review studies that assessed the effectiveness of EBP teaching to improve knowledge, skills, attitudes and behavior of postgraduate healthcare workers, and to describe instruments available to evaluate EBP teaching.

Methods

The design is a systematic review of randomized, non-randomized, and before-after studies. The data sources were MEDLINE, Cochrane Library, EMBASE, CINAHL and ERIC between 1966 and 2006. Main outcomes were knowledge, skills, attitudes and behavior towards EBP. Standardized effect sizes (E-S) were calculated. The E-S was categorized as small (E-S < 0.2), small to moderate (E-S between 0.2 and 0.5), moderate to large (E-S between 0.51 and 0.79), large (E-S > 0.79). Reliability and validity of instruments for evaluating education were assessed. Studies excluded were those that were not original, performed in medical students, focused on prescribing practices, specific health problems, theoretical reviews of different components of EBP, continuing medical education, and testing the effectiveness of implementing guidelines.

Results

Twenty-four studies met our inclusion criteria. There were 15 outcomes within the 10 studies for which E-S could be calculated. The E-S ranged from 0.27 (95%CI: -0.05 to 0.59) to 1.32 (95%CI: 1.11 to 1.53). Studies assessing skills, behavior and/or attitudes had a "small to moderate" E-S. Only 1 of the 2 studies assessing knowledge had E-S of 0.57 (95 CI: 0.32 to 0.82) and 2 of the 4 studies that assessed total test score outcomes had "large" E-S. There were 22 instruments used, but only 10 had 2 or more types of validity or reliability evidence.

Conclusion

Small improvements in knowledge, skills, attitudes or behavior are noted when measured alone. A large improvement in skills and knowledge in EBP is noted when measured together in a total test score. Very few studies used validated measures tests.
Appendix
Available only for authorised users
Literature
1.
Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.PubMedCrossRef
2.
Brown LC, Johnson JA, Majumdar SR, Tsuyuki RT, McAlister FA: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171: 1189-1192.PubMedPubMedCentralCrossRef
3.
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.PubMedCrossRef
4.
Leape LL, Weissman JS, Schneider EC, Piana RN, Gatsonis C, Epstein AM: Adherence to practice guidelines: the role of specialty society guidelines. Am Heart J. 2003, 145: 19-26. 10.1067/mhj.2003.35.PubMedCrossRef
5.
Avezum A, Cavalcanti AB, Sousa AG, Farsky PS, Knobel M: [Adjuvant therapy in acute myocardial infarction: evidence based recommendations]. Rev Assoc Med Bras. 2000, 46: 363-368. 10.1590/S0104-42302000000400038.PubMedCrossRef
6.
Barzansky B, Etzel SI: Educational programs in US medical schools, 2004-2005. JAMA. 2005, 294: 1068-1074. 10.1001/jama.294.9.1068.PubMedCrossRef
7.
Medicine I: Health Professions Education: A bridge to quality. Edited by: Press NA. 2003, Washington DC
8.
Hatala R, Guyatt G: Evaluating the teaching of evidence-based medicine. JAMA. 2002, 288: 1110-1112. 10.1001/jama.288.9.1110.PubMedCrossRef
9.
10.
Coomarasamy A, Khan KS: What is the evidence that postgraduate teaching in evidence based medicine changes anything? A systematic review. BMJ. 2004, 329: 1017-10.1136/bmj.329.7473.1017.PubMedPubMedCentralCrossRef
11.
Norman GR, Shannon SI: Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: a critical appraisal. CMAJ. 1998, 158: 177-181.PubMedPubMedCentral
12.
Green ML: Graduate medical education training in clinical epidemiology, critical appraisal, and evidence-based medicine: a critical review of curricula. Acad Med. 1999, 74: 686-694. 10.1097/00001888-199906000-00017.PubMedCrossRef
13.
Taylor S, Muncer S: Redressing the power and effect of significance. A new approach to an old problem: teaching statistics to nursing students. Nurse Educ Today. 2000, 20: 358-364. 10.1054/nedt.2000.0429.PubMedCrossRef
14.
Reed D, Price EG, Windish DM, Wright SM, Gozu A, Hsu EB, Beach MC, Kern D, Bass EB: Challenges in systematic reviews of educational intervention studies. Ann Intern Med. 2005, 142: 1080-1089.PubMedCrossRef
15.
Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houston TK, Kaatz S, Whelan C, Green M: Instruments for evaluating education in evidence-based practice: a systematic review. JAMA. 2006, 296: 1116-1127. 10.1001/jama.296.9.1116.PubMedCrossRef
16.
Rosenthal: Meta-analytic procedures for combining studies with multiple effect sizes. Psychological Bulletin. 1986, 99: 400-406. 10.1037/0033-2909.99.3.400.CrossRef
17.
18.
Taylor RS, Reeves BC, Ewings PE, Taylor RJ: Critical appraisal skills training for health care professionals: a randomized controlled trial [ISRCTN46272378]. BMC Med Educ. 2004, 4: 30-10.1186/1472-6920-4-30.PubMedPubMedCentralCrossRef
19.
Cheng GY: Educational workshop improved information-seeking skills, knowledge, attitudes and the search outcome of hospital clinicians: a randomised controlled trial. Health Info Libr J. 2003, 20 Suppl 1:22-33.: 22-33. 10.1046/j.1365-2532.20.s1.5.x.CrossRef
20.
Forsetlund L, Bradley P, Forsen L, Nordheim L, Jamtvedt G, Bjorndal A: Randomised controlled trial of a theoretically grounded tailored intervention to diffuse evidence-based public health practice [ISRCTN23257060]. BMC Med Educ. 2003, 3: 2-10.1186/1472-6920-3-2.PubMedPubMedCentralCrossRef
21.
Linzer M, Brown JT, Frazier LM, DeLong ER, Siegel WC: Impact of a medical journal club on house-staff reading habits, knowledge, and critical appraisal skills. A randomized control trial. JAMA. 1988, 260: 2537-2541. 10.1001/jama.260.17.2537.PubMedCrossRef
22.
Macrae HM, Regehr G, McKenzie M, Henteleff H, Taylor M, Barkun J, Fitzgerald GW, Hill A, Richard C, Webber EM, McLeod RS: Teaching practicing surgeons critical appraisal skills with an Internet-based journal club: A randomized, controlled trial. Surgery. 2004, 136: 641-646. 10.1016/j.surg.2004.02.003.PubMedCrossRef
23.
Schilling K, Wiecha J, Polineni D, Khalil S: An interactive web-based curriculum on evidence-based medicine: design and effectiveness. Fam Med. 2006, 38: 126-132.PubMed
24.
Stevermer JJ, Chambliss ML, Hoekzema GS: Distilling the literature: a randomized, controlled trial testing an intervention to improve selection of medical articles for reading. Acad Med. 1999, 74: 70-72. 10.1097/00001888-199901000-00021.PubMedCrossRef
25.
Cabell CH, Schardt C, Sanders L, Corey GR, Keitz SA: Resident utilization of information technology. J Gen Intern Med. 2001, 16: 838-844. 10.1046/j.1525-1497.2001.10239.x.PubMedPubMedCentralCrossRef
26.
Smith CA, Ganschow PS, Reilly BM, Evans AT, McNutt RA, Osei A, Saquib M, Surabhi S, Yadav S: Teaching residents evidence-based medicine skills: a controlled trial of effectiveness and assessment of durability. J Gen Intern Med. 2000, 15: 710-715. 10.1046/j.1525-1497.2000.91026.x.PubMedPubMedCentralCrossRef
27.
Villanueva EV, Burrows EA, Fennessy PA, Rajendran M, Anderson JN: Improving question formulation for use in evidence appraisal in a tertiary care setting: a randomised controlled trial [ISRCTN66375463]. BMC Med Inform Decis Mak. 2001, 1: 4-10.1186/1472-6947-1-4.PubMedPubMedCentralCrossRef
28.
Haynes RB, Johnston ME, McKibbon KA, Walker CJ, Willan AR: A program to enhance clinical use of MEDLINE. A randomized controlled trial. Online J Curr Clin Trials. 1993, Doc No 56: 4005.
29.
Green ML, Ellis PJ: Impact of an evidence-based medicine curriculum based on adult learning theory. J Gen Intern Med. 1997, 12: 742-750. 10.1046/j.1525-1497.1997.07159.x.PubMedPubMedCentralCrossRef
30.
FU: Is a journal club effective for teaching critical appraisal skills?. Academic Psychiatry. 1999, 23: 205-209.CrossRef
31.
Bazarian JJ, Davis CO, Spillane LL, Blumstein H, Schneider SM: Teaching emergency medicine residents evidence-based critical appraisal skills: a controlled trial. Ann Emerg Med. 1999, 34: 148-154. 10.1016/S0196-0644(99)70222-2.PubMedCrossRef
32.
Ross R, Verdieck A: Introducing an evidence-based medicine curriculum into a family practice residency--is it effective?. Acad Med. 2003, 78: 412-417. 10.1097/00001888-200304000-00019.PubMedCrossRef
33.
Akl EA, Izuchukwu IS, El Dika S, Fritsche L, Kunz R, Schunemann HJ: Integrating an evidence-based medicine rotation into an internal medicine residency program. Acad Med. 2004, 79: 897-904. 10.1097/00001888-200409000-00018.PubMedCrossRef
34.
Ibbotson T, Grimshaw J, Grant A: Evaluation of a programme of workshops for promoting the teaching of critical appraisal skills. Med Educ. 1998, 32: 486-491. 10.1046/j.1365-2923.1998.00256.x.PubMedCrossRef
35.
Kellum JA, Rieker JP, Power M, Powner DJ: Teaching critical appraisal during critical care fellowship training: a foundation for evidence-based critical care medicine. Crit Care Med. 2000, 28: 3067-3070. 10.1097/00003246-200008000-00065.PubMedCrossRef
36.
Fritsche L, Greenhalgh T, Falck-Ytter Y, Neumayer HH, Kunz R: Do short courses in evidence based medicine improve knowledge and skills? Validation of Berlin questionnaire and before and after study of courses in evidence based medicine. BMJ. 2002, 325: 1338-1341. 10.1136/bmj.325.7376.1338.PubMedPubMedCentralCrossRef
37.
38.
McCluskey A, Lovarini M: Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after study. BMC Med Educ. 2005, 5: 40-10.1186/1472-6920-5-40.PubMedPubMedCentralCrossRef
39.
Straus SE, Ball C, Balcombe N, Sheldon J, McAlister FA: Teaching evidence-based medicine skills can change practice in a community hospital. J Gen Intern Med. 2005, 20: 340-343. 10.1111/j.1525-1497.2005.04045.x.PubMedPubMedCentralCrossRef
40.
Dinkevich E, Markinson A, Ahsan S, Lawrence B: Effect of a brief intervention on evidence-based medicine skills of pediatric residents. BMC Med Educ. 2006, 6: 1-10.1186/1472-6920-6-1.PubMedPubMedCentralCrossRef
41.
Lucas BP, Evans AT, Reilly BM, Khodakov YV, Perumal K, Rohr LG, Akamah JA, Alausa TM, Smith CA, Smith JP: The impact of evidence on physicians' inpatient treatment decisions. J Gen Intern Med. 2004, 19: 402-409. 10.1111/j.1525-1497.2004.30306.x.PubMedPubMedCentralCrossRef
42.
Smith AD, South PK, Levander OA: Effect of gold(I) compounds on the virulence of an amyocarditic strain of coxsackievirus B3. Biol Trace Elem Res. 2001, 84: 67-80. 10.1385/BTER:84:1-3:067.PubMedCrossRef
43.
Ramos KD, Schafer S, Tracz SM: Validation of the Fresno test of competence in evidence based medicine. BMJ. 2003, 326: 319-321. 10.1136/bmj.326.7384.319.PubMedPubMedCentralCrossRef
44.
Kinzie MB: Instructional design strategies for health behavior change. Patient Educ Couns. 2005, 56: 3-15. 10.1016/j.pec.2004.02.005.PubMedCrossRef
45.
Straus SE, Green ML, Bell DS, Badgett R, Davis D, Gerrity M, Ortiz E, Shaneyfelt TM, Whelan C, Mangrulkar R: Evaluating the teaching of evidence based medicine: conceptual framework. BMJ. 2004, 329: 1029-1032. 10.1136/bmj.329.7473.1029.PubMedPubMedCentralCrossRef
46.
Boon H, Stewart M: Patient-physician communication assessment instruments: 1986 to 1996 in review. Patient Educ Couns. 1998, 35: 161-176. 10.1016/S0738-3991(98)00063-9.PubMedCrossRef
47.
Egger M, Juni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7: 1-76.PubMedCrossRef
Metadata
Title
Evidence based practice in postgraduate healthcare education: A systematic review
Authors
Gemma Flores-Mateo
Josep M Argimon
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2007
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-7-119

Other articles of this Issue 1/2007

BMC Health Services Research 1/2007 Go to the issue

Research article

Payer leverage and hospital compliance with a benchmark: a population-based observational study

Study protocol

A Pragmatic Randomised, Controlled Trial of Intensive Care follow up programmes in improving Longer-term outcomes from critical illness. The PRACTICAL study

Research article

Using a multi-method, user centred, prospective hazard analysis to assess care quality and patient safety in a care pathway

Research article

Widening access to cardiovascular healthcare: community screening among ethnic minorities in inner-city Britain – the Healthy Hearts Project

Research article

Patients' understanding of genetic susceptibility testing in mainstream medicine: qualitative study on thrombophilia

Research article

Understanding the effects of a decentralized budget on physicians' compliance with guidelines for statin prescription – a multilevel methodological approach