Skip to main content
Top
Published in: BMC Primary Care 1/2021

Open Access 01-12-2021 | Research article

Printed educational materials directed at Ontario family physicians do not improve adherence to guideline recommendations for diabetes management: a pragmatic, factorial, cluster randomized controlled trial [ISRCTN72772651]

Authors: Alison H. Howie, Neil Klar, Danielle M. Nash, Jennifer N. Reid, Merrick Zwarenstein

Published in: BMC Primary Care | Issue 1/2021

Login to get access

Abstract

Background

Printed educational materials (PEMs) have long been used to inform clinicians on evidence-based practices. However, the evidence for their effects on patient care and outcomes is unclear. In Ontario, despite widely available clinical practice guidelines recommending antihypertensives and cholesterol-lowering agents for patients with diabetes, prescriptions remain low. We aimed to determine whether PEMs can influence physicians to intensify prescribing of these medications.

Methods

A pragmatic, 2 × 2 factorial, cluster randomized controlled trial was designed to ascertain the effect of two PEM formats on physician prescribing: a postcard-sized message (“outsert”) or a longer narrative article (“insert”). Ontario family physician practices (clusters) were randomly allocated to receive the insert, outsert, both or neither. Physicians were eligible if they were in active practice and their patients were included if they were over 65 years with a diabetes diagnosis; both were unaware of the trial. Administrative databases at ICES (formerly the Institute for Clinical Evaluative Sciences) were used to link patients to their physician and to analyse prescribing patterns at baseline and 1 year following PEM mailout. The primary outcome was intensification defined as the addition of a new antihypertensive or cholesterol-lowering agent, or dose increase of a current drug, measured at the patient level. Analyses were by intention-to-treat and accounted for the clustering of patients to physicians.

Results

We randomly assigned 4231 practices (39% of Ontario family physicians) with a total population of 185,526 patients (20% of patients with diabetes in Ontario primary care) to receive the insert, outsert, both, and neither; among these, 4118 practices were analysed (n = 1025, n = 1037, n = 1031, n = 1025, respectively). No significant treatment effect was found for the outsert (odds ratio (OR) 1.01, 95% confidence interval (CI) 0.98 to 1.04) or the insert (OR 0.99, 95% CI 0.96 to 1.02). Percent of intensification in the four arms was similar (approximately 46%). Adjustment for physician characteristics (e.g., age, sex, practice location) had no impact on these findings.

Conclusions

PEMs have no effect on physician’s adherence to recommendations for the management of diabetes-related complications in Ontario. Further research should investigate the effect of other strategies to narrow this evidence-to-practice gap.

Trial registration

ISRCTN72772651. Retrospectively registered 21 July 2005.
Appendix
Available only for authorised users
Literature
1.
go back to reference Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104:510–20.CrossRef Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: understanding time lags in translational research. J R Soc Med. 2011;104:510–20.CrossRef
2.
go back to reference Grimshaw J, Eccles M, Lavis J, Hill S, Squires J. Knowledge translation of research findings. Implement Sci. 2012;7:50.CrossRef Grimshaw J, Eccles M, Lavis J, Hill S, Squires J. Knowledge translation of research findings. Implement Sci. 2012;7:50.CrossRef
3.
go back to reference Lau R, Stevenson F, Ong B, et al. Addressing the evidence to practice gap for complex interventions in primary care: a systematic review of reviews protocol. BMJ Open. 2014;4:e005548.CrossRef Lau R, Stevenson F, Ong B, et al. Addressing the evidence to practice gap for complex interventions in primary care: a systematic review of reviews protocol. BMJ Open. 2014;4:e005548.CrossRef
4.
go back to reference Zwarenstein M, Hux JE, Kelsall D, et al. The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario, Canada. Implement Sci. 2007;2:37.CrossRef Zwarenstein M, Hux JE, Kelsall D, et al. The Ontario printed educational message (OPEM) trial to narrow the evidence-practice gap with respect to prescribing practices of general and family physicians: a cluster randomized controlled trial, targeting the care of individuals with diabetes and hypertension in Ontario, Canada. Implement Sci. 2007;2:37.CrossRef
5.
go back to reference Leon B, Maddox TM. Diabetes and cardiovascular disease: epidemiology, biological mechanisms, treatment recommendations and future research. World J Diabetes. 2015;6:1246.CrossRef Leon B, Maddox TM. Diabetes and cardiovascular disease: epidemiology, biological mechanisms, treatment recommendations and future research. World J Diabetes. 2015;6:1246.CrossRef
6.
go back to reference UK Prospective Diabetes Study Group. Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. BMJ. 1998;317:703–13.CrossRef UK Prospective Diabetes Study Group. Tight blood pressure control and risk of macrovascular and microvascular complications in type 2 diabetes: UKPDS 38. BMJ. 1998;317:703–13.CrossRef
7.
go back to reference Heart Protection Study Collaborative Group. MRC/BHF heart protection study of cholesterol-lowering with simvastatin in 5963 people with diabetes: a randomised placebo-controlled trial. Lancet. 2003;361:2005–16.CrossRef Heart Protection Study Collaborative Group. MRC/BHF heart protection study of cholesterol-lowering with simvastatin in 5963 people with diabetes: a randomised placebo-controlled trial. Lancet. 2003;361:2005–16.CrossRef
8.
go back to reference Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2003 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2003;27(suppl 2):S1–S152. Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2003 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2003;27(suppl 2):S1–S152.
9.
go back to reference Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008;32(suppl 1):S1–S201. Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008;32(suppl 1):S1–S201.
10.
go back to reference Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2013 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2013;37(suppl 1):S1–S212. Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2013 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2013;37(suppl 1):S1–S212.
11.
go back to reference Diabetes Canada. Diabetes Canada 2018 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2018;42:S1–S325.CrossRef Diabetes Canada. Diabetes Canada 2018 clinical practice guidelines for the prevention and Management of Diabetes in Canada. Can J Diabetes. 2018;42:S1–S325.CrossRef
12.
go back to reference Giguère A, Légaré F, Grimshaw J. Printed educational materials: effects on professional practice and healthcare outcomes (review). Cochrane Database Syst Rev. 2012;10:CD004398.PubMed Giguère A, Légaré F, Grimshaw J. Printed educational materials: effects on professional practice and healthcare outcomes (review). Cochrane Database Syst Rev. 2012;10:CD004398.PubMed
13.
go back to reference Bero L, Grilli R, Grimshaw J, Harvey E, Oxman A, Thomson M. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317:465.CrossRef Bero L, Grilli R, Grimshaw J, Harvey E, Oxman A, Thomson M. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317:465.CrossRef
14.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1–72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1–72.CrossRef
15.
go back to reference Farmer A, Légaré F, Turcot L, et al. Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008;3:CD004398. Farmer A, Légaré F, Turcot L, et al. Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008;3:CD004398.
16.
go back to reference Grudniewicz A, Kealy R, Rodseth R, Hamid J, Rudoler D, Straus S. What is the effectiveness of printed educational materials on primary care physician knowledge, behaviour, and patient outcomes: a systematic review and meta-analyses. Implement Sci. 2015;10:164.CrossRef Grudniewicz A, Kealy R, Rodseth R, Hamid J, Rudoler D, Straus S. What is the effectiveness of printed educational materials on primary care physician knowledge, behaviour, and patient outcomes: a systematic review and meta-analyses. Implement Sci. 2015;10:164.CrossRef
17.
go back to reference Giguère A, Zomahoun HTV, Carmichael PH, et al. Printed educational materials: effects on professional practice and healthcare outcomes (review). Cochrane Database Syst Rev. 2020;8:CD004398.PubMed Giguère A, Zomahoun HTV, Carmichael PH, et al. Printed educational materials: effects on professional practice and healthcare outcomes (review). Cochrane Database Syst Rev. 2020;8:CD004398.PubMed
18.
go back to reference Zwarenstein M, Shiller SK, Croxford R, et al. Printed educational messages aimed at family practitioners fail to increase retinal screening among their patients with diabetes: a pragmatic cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2014;9:87.CrossRef Zwarenstein M, Shiller SK, Croxford R, et al. Printed educational messages aimed at family practitioners fail to increase retinal screening among their patients with diabetes: a pragmatic cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2014;9:87.CrossRef
19.
go back to reference Zwarenstein M, Grimshaw JM, Presseau J, et al. Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2016;11:124.CrossRef Zwarenstein M, Grimshaw JM, Presseau J, et al. Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2016;11:124.CrossRef
20.
go back to reference Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967;20:637–48.CrossRef Schwartz D, Lellouch J. Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967;20:637–48.CrossRef
23.
go back to reference Levy AR, O’Brien BJ, Sellors C, Grootendorst P, Willison D. Coding accuracy of administrative drug claims in the Ontario drug benefit database. Can J Clin Pharmacol. 2003;10:67–71.PubMed Levy AR, O’Brien BJ, Sellors C, Grootendorst P, Willison D. Coding accuracy of administrative drug claims in the Ontario drug benefit database. Can J Clin Pharmacol. 2003;10:67–71.PubMed
24.
go back to reference Hux JE, Flintoft V, Ivis F, Bica A. Determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;25:512–6.CrossRef Hux JE, Flintoft V, Ivis F, Bica A. Determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;25:512–6.CrossRef
25.
go back to reference Chan BTB, Schultz SE. Supply and utilization of general practitioner and family physician Services in Ontario. ICES investigative report. Toronto: Institute for Clinical Evaluative Sciences; 2005. Chan BTB, Schultz SE. Supply and utilization of general practitioner and family physician Services in Ontario. ICES investigative report. Toronto: Institute for Clinical Evaluative Sciences; 2005.
26.
go back to reference Fu A, Sheehan J. Treatment intensification for patients with type 2 diabetes and poor glycaemic control. Diabetes Obes Metab. 2016;18:892–8.CrossRef Fu A, Sheehan J. Treatment intensification for patients with type 2 diabetes and poor glycaemic control. Diabetes Obes Metab. 2016;18:892–8.CrossRef
27.
go back to reference Desai U, Kirson N, Kim J, et al. Time to treatment intensification after Monotherapy failure and its association with subsequent glycemic control among 93,515 patients with type 2 diabetes. Diabetes Care. 2018;41:2096–104.CrossRef Desai U, Kirson N, Kim J, et al. Time to treatment intensification after Monotherapy failure and its association with subsequent glycemic control among 93,515 patients with type 2 diabetes. Diabetes Care. 2018;41:2096–104.CrossRef
28.
go back to reference Arnold R, Yang S, Gold E, Farahbakhshian S, Sheehan J. Assessment of the relationship between diabetes treatment intensification and quality measure performance using electronic medical records. PLoS One. 2018;13:e0199011.CrossRef Arnold R, Yang S, Gold E, Farahbakhshian S, Sheehan J. Assessment of the relationship between diabetes treatment intensification and quality measure performance using electronic medical records. PLoS One. 2018;13:e0199011.CrossRef
29.
go back to reference Canivell S, Mata-Cases M, Real J, et al. Glycaemic control after treatment intensification in patients with type 2 diabetes uncontrolled on two or more non-insulin antidiabetic drugs in a real-world setting. Diabetes Obes Metab. 2019;21:1373–80.CrossRef Canivell S, Mata-Cases M, Real J, et al. Glycaemic control after treatment intensification in patients with type 2 diabetes uncontrolled on two or more non-insulin antidiabetic drugs in a real-world setting. Diabetes Obes Metab. 2019;21:1373–80.CrossRef
30.
go back to reference Campbell MK, Piaggio G, Elbourne DR, Altman DG, for the CONSORT Group. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRef Campbell MK, Piaggio G, Elbourne DR, Altman DG, for the CONSORT Group. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.CrossRef
31.
go back to reference Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.CrossRef Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.CrossRef
32.
go back to reference Shah BR, Bhattacharyya O, Yu CHY, Mamdani MM, Parsons JA, et al. Effect of an educational toolkit on quality of care: a pragmatic cluster randomized trial. PLoS Med. 2014;11(2):e1001588.CrossRef Shah BR, Bhattacharyya O, Yu CHY, Mamdani MM, Parsons JA, et al. Effect of an educational toolkit on quality of care: a pragmatic cluster randomized trial. PLoS Med. 2014;11(2):e1001588.CrossRef
33.
go back to reference Rushmer R, Davies HTO. Unlearning in health care. Qual Saf Health Care. 2004;13:10–5.CrossRef Rushmer R, Davies HTO. Unlearning in health care. Qual Saf Health Care. 2004;13:10–5.CrossRef
34.
go back to reference Gupta DM, Boland RJ, Aron DC. The physician’s experience of changing clinical practice: a struggle to unlearn. Implement Sci. 2017;12:28.CrossRef Gupta DM, Boland RJ, Aron DC. The physician’s experience of changing clinical practice: a struggle to unlearn. Implement Sci. 2017;12:28.CrossRef
35.
go back to reference Parsons JA, Yu CHY, Baker NA, Mamdani MM, Bhattacharyya O, et al. Practice Doesn’t always make perfect: a qualitative study explaining why a trial of an educational toolkit did not improve quality of care. PLoS One. 2016;11(12):e0167878.CrossRef Parsons JA, Yu CHY, Baker NA, Mamdani MM, Bhattacharyya O, et al. Practice Doesn’t always make perfect: a qualitative study explaining why a trial of an educational toolkit did not improve quality of care. PLoS One. 2016;11(12):e0167878.CrossRef
36.
go back to reference Loudon K, Treweek S, Sullivan F, et al. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.CrossRef Loudon K, Treweek S, Sullivan F, et al. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350:h2147.CrossRef
37.
go back to reference Zwarenstein M, Grimshaw JM, Presseau J, et al. Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2016;11:124. Zwarenstein M, Grimshaw JM, Presseau J, et al. Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651]. Implement Sci. 2016;11:124.
38.
go back to reference Alper BS, Stevermer JJ, White DS, Ewigman BG. Answering family physicians' clinical questions using electronic medical databases. J Fam Pract. 2001;50(11):960–5.PubMed Alper BS, Stevermer JJ, White DS, Ewigman BG. Answering family physicians' clinical questions using electronic medical databases. J Fam Pract. 2001;50(11):960–5.PubMed
39.
go back to reference Davies K. The information-seeking behaviour of doctors: a review of the evidence. Health Inf Libr J. 2007;24:78–94.CrossRef Davies K. The information-seeking behaviour of doctors: a review of the evidence. Health Inf Libr J. 2007;24:78–94.CrossRef
40.
go back to reference Bamimore MA, Devlin RA, Zaric GS, Garg AX, Sarma S. Quality of diabetes Care in Blended fee-for-service and blended capitation payment systems. Can J Diabetes. 2021;45:261–8.CrossRef Bamimore MA, Devlin RA, Zaric GS, Garg AX, Sarma S. Quality of diabetes Care in Blended fee-for-service and blended capitation payment systems. Can J Diabetes. 2021;45:261–8.CrossRef
41.
go back to reference Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;3:CD001096. Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;3:CD001096.
42.
go back to reference Tuti T, Nzinga J, Njoroge M, et al. A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implement Sci. 2017;12:61.CrossRef Tuti T, Nzinga J, Njoroge M, et al. A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory. Implement Sci. 2017;12:61.CrossRef
Metadata
Title
Printed educational materials directed at Ontario family physicians do not improve adherence to guideline recommendations for diabetes management: a pragmatic, factorial, cluster randomized controlled trial [ISRCTN72772651]
Authors
Alison H. Howie
Neil Klar
Danielle M. Nash
Jennifer N. Reid
Merrick Zwarenstein
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2021
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/s12875-021-01592-9

Other articles of this Issue 1/2021

BMC Primary Care 1/2021 Go to the issue