Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Systematic Reviews
Published in: Systematic Reviews 1/2012

Open Access 01-12-2012 | Systematic review update

Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior

Authors: Amy Cheung, Michelle Weir, Alain Mayhew, Nicole Kozloff, Kaitlyn Brown, Jeremy Grimshaw

Published in: Systematic Reviews | Issue 1/2012

Login to get access

Abstract

Objective

The purpose of this project was to conduct an overview of existing systematic reviews to evaluate the effectiveness of reminders in changing professional behavior in clinical settings.

Materials and methods

Relevant systematic reviews of reminder interventions were identified through searches in MEDLINE, EMBASE, DARE and the Cochrane Library in conjunction with a larger project examining professional behavioral change interventions. Reviews were appraised using AMSTAR, a validated tool for assessing the quality of systematic reviews. As most reviews only reported vote counting, conclusions about effectiveness for each review were based on a count of positive studies. If available, we also report effect sizes. Conclusions were based on the findings from higher quality and current systematic reviews.

Results

Thirty-five reviews were eligible for inclusion in this overview. Ten reviews examined the effectiveness of reminders generally, 5 reviews focused on specific health care settings, 14 reviews concentrated on specific behaviors and 6 reviews addressed specific patient populations. The quality of the reviews was variable (median = 3, range = 1 to 8). Seven reviews had AMSTAR scores >5 and were considered in detail. Five of these seven reviews demonstrated positive effects of reminders in changing provider behavior. Few reviews used quantitative pooling methods; in one high quality and current review, the overall observed effects were moderate with an absolute median improvement in performance of 4.2% (IQR: 0.5% to 6.6%).

Discussion

The results support that modest improvements can occur with the use of reminders. The effect size is consistent with other interventions that have been used to improve professional behavior.

Conclusion

Reminders appear effective in improving different clinical behaviors across a range of settings.
Appendix
Available only for authorised users
Literature
1.
MacDonald CJ: Protocol-based computer reminders, the quality of care and the non-perfectibility of man. N Engl J Med. 1976, 24: 1351-1355.CrossRef
2.
Haynes RB, Walker CJ: Computer-aided quality assurance. A critical appraisal. Arch Intern Med. 1987, 7: 1297-1301.CrossRef
3.
Weir CR, Staggers N, Phansalkar S: The state of the evidence for computerized provider order entry: a systematic review and analysis of the quality of the literature. Int J Med Inform. 2009, 78: 365-374. 10.1016/j.ijmedinf.2008.12.001.CrossRefPubMed
4.
Becker LA Oxman AD:Chapter 22: Overviews of reviews. Cochrane Handbook for Systematic Reviews of Interventions Version 501 . Edited by: Higgins JPT, Green S. 2008, Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available fromhttp://​www.​cochrane-handbook.​org,
5.
Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD: Getting research findings into practice. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998, 317 (7156): 465-468. 10.1136/bmj.317.7156.465.CrossRefPubMedPubMedCentral
6.
Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O’Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39 (Suppl 2): II2-II45.PubMed
7.
Weir MC, Ryan R, Mayhew A, Worswick J, Santesso N, Lowe D, Leslie B, Stevens A, Hill S, Grimshaw JM: The Rx for Change database: a first-in-class tool for optimal prescribing and medicines use. Implementation Sci. 2010, 5: 89-10.1186/1748-5908-5-89.CrossRef
8.
Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM: External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007, 2: e1350-10.1371/journal.pone.0001350.CrossRefPubMedPubMedCentral
9.
Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M: AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009, 62: 1013-1020. 10.1016/j.jclinepi.2008.10.009.CrossRefPubMed
10.
Bushman BJ, Wang MC:Vote counting procedures in meta-analysis. Handbook of Research Synthesis. Edited by: Hedges LV Cooper H, Valentine JC. 1994, New York: Russell Sage Foundation, 207-220. 2,
11.
Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M: Analysis of cluster randomized trials in primary care: a practical approach. Fam Pract. 2000, 17: 192-196. 10.1093/fampra/17.2.192.CrossRefPubMed
12.
Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: iii-iv. 1–72CrossRefPubMed
13.
Sullivan F, Mitchell E: Has general practitioner computing made a difference to patient care? A systematic review of published reports. BMJ. 1995, 311: 848-852. 10.1136/bmj.311.7009.848.CrossRefPubMedPubMedCentral
14.
Johnston ME, Langton KB, Haynes RB, Mathieu A: Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994, 120: 135-142.CrossRefPubMed
15.
Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998, 280: 1339-1346. 10.1001/jama.280.15.1339.CrossRefPubMed
16.
Walton RT, Harvey E, Dovey S, Freemantle N: Computerised advice on drug dosage to improve prescribing practice. Cochrane Database Syst Rev. 2001, 1: CD002894-PubMed
17.
Ammenwerth E, Schnell-Inderst P, Machan C, Siebert U: The effect of electronic prescribing on medication errors and adverse drug events: a systematic review. J Am Med Inform Assoc. 2008, 15: 585-600. 10.1197/jamia.M2667.CrossRefPubMedPubMedCentral
18.
Bywood PT, Lunnay B, Roche AM: Strategies for facilitating change in alcohol and other drugs (AOD) professional practice: a systematic review of the effectiveness of reminders and feedback. Drug Alcohol Rev. 2008, 27: 548-558. 10.1080/09595230802245535.CrossRefPubMed
19.
Durieux P, Trinquart L, Colombet I, Nies J, Walton R, Rajeswaran A, Rege Walther M, Harvey E, Burnand B: Computerized advice on drug dosage to improve prescribing practice. Cochrane Database Syst Rev. 2008, 3: CD002894-PubMed
20.
Kastner M, Straus SE: Clinical decision support tools for osteoporosis disease management: a systematic review of randomized controlled trials. J Gen Intern Med. 2008, 23: 2095-2105. 10.1007/s11606-008-0812-9.CrossRefPubMedPubMedCentral
21.
Kaushal R, Shojania KG, Bates DW: Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Int Med. 2003, 163: 1409-1416. 10.1001/archinte.163.12.1409.CrossRef
22.
Randell R, Mitchell N, Dowding D, Cullum N, Thompson C: Effects of computerized decision support systems on nursing performance and patient outcomes: a systematic review. J Health Serv Res Policy. 2007, 12: 242-249. 10.1258/135581907782101543.CrossRefPubMed
23.
Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J: The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009, 3: CD001096-PubMed
24.
Balas EA, Austin SM, Mitchell JA, Ewigman BG, Bopp KD, Brown GD: The clinical value of computerized information services. A review of 98 randomized clinical trials. Arch Fam Med. 1996, 5: 271-278. 10.1001/archfami.5.5.271.CrossRefPubMed
25.
Buntinx F, Winkens R, Grol R, Knottnerus JA: Influencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A review. Fam Pract. 1993, 10: 219-228. 10.1093/fampra/10.2.219.CrossRefPubMed
26.
Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, Morton SC, Shekelle PG: Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006, 144: 742-752.CrossRefPubMed
27.
Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB: Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005, 293: 1223-1238. 10.1001/jama.293.10.1223.CrossRefPubMed
28.
Kawamoto K, Houlihan CA, Balas EA, Lobach DF: Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005, 330: 765-10.1136/bmj.38398.500764.8F.CrossRefPubMedPubMedCentral
29.
Mitchell E, Sullivan F: A descriptive feast but an evaluative famine: systematic review of published articles on primary care computing during 1980–97. BMJ. 2001, 322: 279-282. 10.1136/bmj.322.7281.279.CrossRefPubMedPubMedCentral
30.
Nies J, Colombet I, Degoulet P, Durieux P: Determinants of success for computerized clinical decision support systems integrated in CPOE systems: a systematic review. AMIA Annu Symp Proc. 2006, 594-598.
31.
Shiffman RN, Liaw Y, Brandt CA, Corb GJ: Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc. 1999, 6: 104-114. 10.1136/jamia.1999.0060104.CrossRefPubMedPubMedCentral
32.
Sintchenko V, Magrabi F, Tipper S: Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: a systematic review. Med Inform Internet Med. 2007, 32: 225-240. 10.1080/14639230701447701.CrossRefPubMed
33.
Bryan C, Boren SA: The use and effectiveness of electronic clinical decision support tools in the ambulatory/primary care setting: a systematic review of the literature. Inform Prim Care. 2008, 16 (2): 79-91.PubMed
34.
Colombet I, Chatellier G, Jaulent MC, Degoulet P: Decision aids for triage of patients with chest pain: a systematic review of field evaluation studies. AMIA Annu Symp Proc. 1999, 721-725.
35.
Georgiou A, Williamson M, Westbrook JI, Ray S: The impact of computerised physician order entry systems on pathology services: a systematic review. Int J Med Inform. 2007, 76: 514-529. 10.1016/j.ijmedinf.2006.02.004.CrossRefPubMed
36.
Jerant AF, Hill DB: Does the use of electronic medical records improve surrogate patient outcomes in outpatient settings?. J Fam Pract. 2000, 49: 349-357.PubMed
37.
Shea S, DuMouchel W, Bahamonde L: A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc. 1996, 3: 399-409. 10.1136/jamia.1996.97084513.CrossRefPubMedPubMedCentral
38.
Austin SM, Balas EA, Mitchell JA, Ewigman BG: Effect of physician reminders on preventive care: meta-analysis of randomized clinical trials. Proc Annu Symp Comput Appl Med Care. 1994, 121-124.
39.
Bennett JW, Glasziou PP: Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials. Med J Aust. 2003, 178: 217-222.PubMed
40.
Dexheimer JW, Talbot TR, Sanders DL, Rosenbloom ST, Aronsky D: Prompting clinicians about preventive care measures: a systematic review of randomized controlled trials. J Am Med Inform Assoc. 2008, 15: 311-320. 10.1197/jamia.M2555.CrossRefPubMedPubMedCentral
41.
Eslami S, Abu-Hanna A, de Keizer NF: Evaluation of outpatient computerized physician medication order entry systems: a systematic review. J Am Med Inform Assoc. 2007, 14: 400-406. 10.1197/jamia.M2238.CrossRefPubMedPubMedCentral
42.
Jimbo M, Nease DE, Ruffin MT, Rana GK: Information technology and cancer prevention. CA Cancer J Clin. 2006, 56: 26-36. 10.3322/canjclin.56.1.26. quiz 48–29CrossRefPubMed
43.
Pearson SA, Moxey A, Robertson J, Hains I, Williamson M, Reeve J, Newby D: Do computerised clinical decision support systems for prescribing change practice? A systematic review of the literature (1990–2007). BMC Health Serv Res. 2009, 9: 154-10.1186/1472-6963-9-154.CrossRefPubMedPubMedCentral
44.
Reckmann MH, Westbrook JI, Koh Y, Lo C, Day RO: Does computerized provider order entry reduce prescribing errors for hospital inpatients? A systematic review. J Am Med Inform Assoc. 2009, 16: 613-623. 10.1197/jamia.M3050.CrossRefPubMedPubMedCentral
45.
Schedlbauer A, Prasad V, Mulvaney C, Phansalkar S, Stanton W, Bates DW, Avery AJ: What evidence supports the use of computerized alerts and prompts to improve clinicians’ prescribing behavior?. J Am Med Inform Assoc. 2009, 16: 531-538. 10.1197/jamia.M2910.CrossRefPubMedPubMedCentral
46.
Yourman L, Concato J, Agostini JV: Use of computer decision support interventions to improve medication prescribing in older adults: a systematic review. Am J Geriatr Pharmacother. 2008, 6: 119-129. 10.1016/j.amjopharm.2008.06.001.CrossRefPubMed
47.
Chatellier G, Colombet I, Degoulet P: An overview of the effect of computer-assisted management of anticoagulant therapy on the quality of anticoagulation. Int J Med Inform. 1998, 49: 311-320. 10.1016/S1386-5056(98)00087-2.CrossRefPubMed
48.
Fitzmaurice DA, Hobbs FD, Delaney BC, Wilson S, McManus R: Review of computerized decision support systems for oral anticoagulation management. Br J Haematol. 1998, 102: 907-909. 10.1046/j.1365-2141.1998.00858.x.CrossRefPubMed
49.
Montgomery AA, Fahey T: A systematic review of the use of computers in the management of hypertension. J Epidemiol Community Health. 1998, 52 (8): 520-525. 10.1136/jech.52.8.520.CrossRefPubMedPubMedCentral
50.
van Rosse F, Maat B, Rademaker CM, van Vught AJ, Egberts AC, Bollen CW: The effect of computerized physician order entry on medication prescription errors and clinical outcome in pediatric and intensive care: a systematic review. Pediatrics. 2009, 123: 1184-1190. 10.1542/peds.2008-1494.CrossRefPubMed
51.
Heselmans A, Van de Velde S, Donceel P, Aertgeerts B, Ramaekers D: Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review. Implement Sci. 2009, 4: 82-10.1186/1748-5908-4-82.CrossRefPubMedPubMedCentral
52.
Damiani G, Pinnarelli L, Colosimo SC, Almiento R, Sicuro L, Galasso R, Sommella L, Ricciardi W: The effectiveness of computerized clinical guidelines in the process of care: a systematic review. BMC Health Serv Res. 2010, 10: 2-10.1186/1472-6963-10-2.CrossRefPubMedPubMedCentral
53.
Bright TJ, Wong A, Dhurjati R, Bristow E, Bastian L, Coeytaux RR, Samsa G, Hasselblad V, Williams JW, Musty MD, Wing L, Kendrick AS, Sanders GD, Lobach D: Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012, 157: 29-43.CrossRefPubMed
54.
Holt TA, Thorogood M, Griffiths F: Changing clinical practice through patient specific reminders available at the time of the clinical encounter: systematic review and meta-analysis. J Gen Intern Med. 2012, 27: 974-984. 10.1007/s11606-012-2025-5.CrossRefPubMedPubMedCentral
55.
Weir M, Mayhew A, Fergusson D, Grimshaw J:17th Cochrane Colloquium. An exploratory analysis of lumping and splitting in systematic reviews. 2009, Singapore,
56.
Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AS, Patchen Dellinger EP, Herbosa T, Joseph S, Kibatala PL, Lapitan MCM, Merry AF, Moorthy K, Reznick RK, Taylor B, Gawande AA, Safe Surgery Saves Lives Study Group: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360 (5): 491-499. 10.1056/NEJMsa0810119.CrossRefPubMed
Metadata
Title
Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior
Authors
Amy Cheung
Michelle Weir
Alain Mayhew
Nicole Kozloff
Kaitlyn Brown
Jeremy Grimshaw
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2012
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-1-36

Other articles of this Issue 1/2012

Systematic Reviews 1/2012 Go to the issue

Methodology

A framework for production of systematic review based briefings to support evidence-informed decision-making

Commentary

Prospective systematic review registration: perspective from the Guidelines International Network (G-I-N)

Protocol

Male participation in prevention programmes of mother to child transmission of HIV: a protocol for a systematic review to identify barriers, facilitators and reported interventions

Commentary

A Web-based archive of systematic review data

Protocol

Do randomized clinical trials with inadequate blinding report enhanced placebo effects for intervention groups and nocebo effects for placebo groups? A protocol for a meta-epidemiological study of PDE-5 inhibitors

Protocol

Study protocol: systematic review of the burden of heart failure in low- and middle-income countries