Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Printed educational messages aimed at family practitioners fail to increase retinal screening among their patients with diabetes: a pragmatic cluster randomized controlled trial [ISRCTN72772651]

Authors: Merrick Zwarenstein, Susan K Shiller, Ruth Croxford, Jeremy M Grimshaw, Diane Kelsall, J Michael Paterson, Andreas Laupacis, Peter C Austin, Karen Tu, Lingsong Yun, Janet E Hux

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Evidence of the effectiveness of printed educational messages in narrowing the gap between guideline recommendations and practice is contradictory. Failure to screen for retinopathy exposes primary care patients with diabetes to risk of eye complications. Screening is initiated by referral from family practitioners but adherence to guidelines is suboptimal. We aimed to evaluate the ability of printed educational messages aimed at family doctors to increase retinal screening of primary care patients with diabetes.

Methods

Design: Pragmatic 2×3 factorial cluster trial randomized by physician practice, involving 5,048 general practitioners (with 179,833 patients with diabetes). Setting: Ontario family practitioners. Interventions: Reminders (that retinal screening helps prevent diabetes-related vision loss and is covered by provincial health insurance for patients with diabetes) with prompts to encourage screening were mailed to each physician in conjunction with a widely-read professional newsletter. Alternative printed materials formats were an ‘outsert’ (short, directive message stapled to the outside of the newsletter), and/or a two-page, evidence-based article (‘insert’) and a pre-printed sticky note reminder for patients. Main outcome measure: A successful outcome was an eye examination (which includes retinal screening) provided to a patient with diabetes, not screened in the previous 12 months, within 90 days after visiting a family practitioner. Analysis accounted for clustering of doctors within practice groups.

Results

No intervention effect was detected (eye exam rates were 31.6% for patients of control physicians, 31.3% for the insert, 32.8% for the outsert, 32.3% for those who received both, and 31.2% for those who received both plus the patient reminder with the largest 95% confidence interval around any effect extending from −1.3% to 1.1%).

Conclusions

This large trial conclusively failed to demonstrate any impact of printed educational messages on screening uptake. Despite their low cost, printed educational messages should not be routinely used in attempting to close evidence-practice gaps relating to diabetic retinopathy screening.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Hollaway R, Benesch C, Rush S: Stroke prevention: narrowing the evidence practice gap. Neurol. 2000, 54: 1899-1906. 10.1212/WNL.54.10.1899.CrossRef Hollaway R, Benesch C, Rush S: Stroke prevention: narrowing the evidence practice gap. Neurol. 2000, 54: 1899-1906. 10.1212/WNL.54.10.1899.CrossRef
2.
go back to reference McGlynn E, Asch S, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr E: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed McGlynn E, Asch S, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr E: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed
3.
go back to reference Beck C, Lauzon C, Eisenberg M, Huynh T, Dion D, Roux R, Racine N, Carignan S, Diodati J, Charbonneau F, Lévesque C, Pouliot JJ, Pilote LL: Discharge prescriptions following admission for acute myocardial infarction at tertiary care and community hospitals in Quebec. Can J Cardiol. 2001, 17 (1): 33-40.PubMed Beck C, Lauzon C, Eisenberg M, Huynh T, Dion D, Roux R, Racine N, Carignan S, Diodati J, Charbonneau F, Lévesque C, Pouliot JJ, Pilote LL: Discharge prescriptions following admission for acute myocardial infarction at tertiary care and community hospitals in Quebec. Can J Cardiol. 2001, 17 (1): 33-40.PubMed
4.
go back to reference Lomas J: Words without action? The production, dissemination and impact of consensus recommendations. Ann Rev Pub Health. 1991, 12: 41-65. 10.1146/annurev.pu.12.050191.000353.CrossRef Lomas J: Words without action? The production, dissemination and impact of consensus recommendations. Ann Rev Pub Health. 1991, 12: 41-65. 10.1146/annurev.pu.12.050191.000353.CrossRef
5.
go back to reference Freemantle N, Harvey E, Wolf F, Grimshaw J, Grilli R, Bero L: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000, 2: CD000172-PubMed Freemantle N, Harvey E, Wolf F, Grimshaw J, Grilli R, Bero L: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000, 2: CD000172-PubMed
6.
go back to reference Farmer AP, Legare F, Turcot L, Grimshaw JM, Harvey E, McGowan JL, Wolf F: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008, 3: 004398- Farmer AP, Legare F, Turcot L, Grimshaw JM, Harvey E, McGowan JL, Wolf F: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008, 3: 004398-
7.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8: 1-72.CrossRef
8.
go back to reference Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, Makosso-Kallyth S, Wolf FM, Farmer AP, Gagnon M-P: Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 10: CD004398-PubMed Giguère A, Légaré F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, Makosso-Kallyth S, Wolf FM, Farmer AP, Gagnon M-P: Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 10: CD004398-PubMed
9.
go back to reference Woolf S, Johnson R: The break-even point: when medical advances are less important than improving the fidelity with which they are delivered. Ann Fam Med. 2005, 3: 545-552. 10.1370/afm.406.CrossRefPubMedPubMedCentral Woolf S, Johnson R: The break-even point: when medical advances are less important than improving the fidelity with which they are delivered. Ann Fam Med. 2005, 3: 545-552. 10.1370/afm.406.CrossRefPubMedPubMedCentral
10.
go back to reference Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutic trials. J Chron Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRefPubMed Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutic trials. J Chron Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.CrossRefPubMed
11.
go back to reference Buhrmann R, Assaud D, Hux J, Tang M, Sykora K: Diabetes and the eye. Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux J, Booth G, Slaughter P, Laupacis A. 2003, Toronto, Canada: Institute for Clinical Evaluative Sciences Buhrmann R, Assaud D, Hux J, Tang M, Sykora K: Diabetes and the eye. Diabetes in Ontario: An ICES Practice Atlas. Edited by: Hux J, Booth G, Slaughter P, Laupacis A. 2003, Toronto, Canada: Institute for Clinical Evaluative Sciences
12.
13.
go back to reference Meltzer S, Leiter L, Daneman D, Gerstein H, Lau D, Ludwig S, Yale J, Zinman B, Lillie D: 1998 clinical practice guidelines for the management of diabetes in Canada. CMAJ. 1998, 159 (Suppl 8): S1-S29.PubMed Meltzer S, Leiter L, Daneman D, Gerstein H, Lau D, Ludwig S, Yale J, Zinman B, Lillie D: 1998 clinical practice guidelines for the management of diabetes in Canada. CMAJ. 1998, 159 (Suppl 8): S1-S29.PubMed
14.
go back to reference Preliminary report on effects of photocoagulation therapy: The Diabetic Retinopathy Study Research Group. Am J Ophthalmol. 1976, 81 (4): 383-396.CrossRef Preliminary report on effects of photocoagulation therapy: The Diabetic Retinopathy Study Research Group. Am J Ophthalmol. 1976, 81 (4): 383-396.CrossRef
15.
go back to reference Zwarenstein M, Hux JE, Kelsall D, Paterson M, Grimshaw JM, Davis D, Laupacis A, Evans M, Austin PC, Slaughter PM, Shiller SK, Croxford R, Tu K: The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario Canada. Implement Sci. 2007, 2: 37-10.1186/1748-5908-2-37.CrossRefPubMedPubMedCentral Zwarenstein M, Hux JE, Kelsall D, Paterson M, Grimshaw JM, Davis D, Laupacis A, Evans M, Austin PC, Slaughter PM, Shiller SK, Croxford R, Tu K: The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario Canada. Implement Sci. 2007, 2: 37-10.1186/1748-5908-2-37.CrossRefPubMedPubMedCentral
17.
go back to reference Hux J, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25: 512-516. 10.2337/diacare.25.3.512.CrossRefPubMed Hux J, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002, 25: 512-516. 10.2337/diacare.25.3.512.CrossRefPubMed
18.
go back to reference Campbell M, Fayers P, Grimshaw J: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed Campbell M, Fayers P, Grimshaw J: Determinants of the intracluster correlation coefficient in cluster randomized trials: the case of implementation research. Clin Trials. 2005, 2 (2): 99-107. 10.1191/1740774505cn071oa.CrossRefPubMed
19.
go back to reference Grimshaw JM, Presseau J, Tetroe J, Eccles MP, Francis JJ, Godin G, Graham ID, Hux JE, Johnston M, Légaré F, Lemyre L, Robinson N, Zwarenstein M: Looking inside the black box: Results of a theory-based process evaluation exploring the results of a randomised controlled trial of printed educational messages to increase primary care physicians’ diabetic retinopathy referrals. Implement Sci. Grimshaw JM, Presseau J, Tetroe J, Eccles MP, Francis JJ, Godin G, Graham ID, Hux JE, Johnston M, Légaré F, Lemyre L, Robinson N, Zwarenstein M: Looking inside the black box: Results of a theory-based process evaluation exploring the results of a randomised controlled trial of printed educational messages to increase primary care physicians’ diabetic retinopathy referrals. Implement Sci.
Metadata
Title
Printed educational messages aimed at family practitioners fail to increase retinal screening among their patients with diabetes: a pragmatic cluster randomized controlled trial [ISRCTN72772651]
Authors
Merrick Zwarenstein
Susan K Shiller
Ruth Croxford
Jeremy M Grimshaw
Diane Kelsall
J Michael Paterson
Andreas Laupacis
Peter C Austin
Karen Tu
Lingsong Yun
Janet E Hux
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-87

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue