Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Study protocol

Testing feedback message framing and comparators to address prescribing of high-risk medications in nursing homes: protocol for a pragmatic, factorial, cluster-randomized trial

Authors: Noah M. Ivers, Laura Desveaux, Justin Presseau, Catherine Reis, Holly O. Witteman, Monica K. Taljaard, Nicola McCleary, Kednapa Thavorn, Jeremy M. Grimshaw

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

Audit and feedback (AF) interventions that leverage routine administrative data offer a scalable and relatively low-cost method to improve processes of care. AF interventions are usually designed to highlight discrepancies between desired and actual performance and to encourage recipients to act to address such discrepancies. Comparing to a regional average is a common approach, but more recipients would have a discrepancy if compared to a higher-than-average level of performance. In addition, how recipients perceive and respond to discrepancies may depend on how the feedback itself is framed. We aim to evaluate the effectiveness of different comparators and framing in feedback on high-risk prescribing in nursing homes.

Methods

This is a pragmatic, 2 × 2 factorial, cluster-randomized controlled trial testing variations in the comparator and framing on the effectiveness of quarterly AF in changing high-risk prescribing in nursing homes in Ontario, Canada. We grouped homes that share physicians into clusters and randomized these clusters into the four experimental conditions. Outcomes will be assessed after 6 months; all primary analyses will be by intention-to-treat. The primary outcome (monthly number of high-risk medications received by each patient) will be analysed using a general linear mixed effects regression model. We will present both four-arm and factorial analyses. With 160 clusters and an average of 350 beds per cluster, assuming no interaction and similar effects for each intervention, we anticipate 90% power to detect an absolute mean difference of 0.3 high-risk medications prescribed. A mixed-methods process evaluation will explore potential mechanisms underlying the observed effects, exploring targeted constructs including intention, self-efficacy, outcome expectations, descriptive norms, and goal prioritization. An economic analysis will examine cost-effectiveness analysis from the perspective of the publicly funded health care system.

Discussion

This protocol describes the rationale and methodology of a trial testing manipulations of theory-informed components of an audit and feedback intervention to determine how to improve an existing intervention and provide generalizable insights for implementation science.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, Grimshaw JM. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14.CrossRefPubMedPubMedCentral Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, Grimshaw JM. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:14.CrossRefPubMedPubMedCentral
2.
go back to reference Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness. Ann Intern Med. 2016;164:435–41.CrossRefPubMed Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness. Ann Intern Med. 2016;164:435–41.CrossRefPubMed
3.
go back to reference Weissman NW, Allison JJ, Kiefe CI, Farmer RM, Weaver MT, Williams OD, Child IG, Pemberton JH, Brown KC, Baker CS. Achievable benchmarks of care: the ABCs of benchmarking. J Eval Clin Pract. 1999;5:269–81.CrossRefPubMed Weissman NW, Allison JJ, Kiefe CI, Farmer RM, Weaver MT, Williams OD, Child IG, Pemberton JH, Brown KC, Baker CS. Achievable benchmarks of care: the ABCs of benchmarking. J Eval Clin Pract. 1999;5:269–81.CrossRefPubMed
4.
go back to reference Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001;285:2871–9.CrossRefPubMed Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001;285:2871–9.CrossRefPubMed
5.
go back to reference Curran J, Vachon B, Brehaut JC, Sales A, Grimshaw J. Developing a framework for replication of research in implementation science. In BioMed Central. 2014;14 Suppl 2:19. Curran J, Vachon B, Brehaut JC, Sales A, Grimshaw J. Developing a framework for replication of research in implementation science. In BioMed Central. 2014;14 Suppl 2:19.
6.
go back to reference Kluger AN, DeNisi AS. The effects of feedback interventions on performance: a historical review, a metaanalysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254–84.CrossRef Kluger AN, DeNisi AS. The effects of feedback interventions on performance: a historical review, a metaanalysis, and a preliminary feedback intervention theory. Psychol Bull. 1996;119:254–84.CrossRef
7.
go back to reference Llewellyn-Thomas HA, McGreal MJ, Thiel EC. Cancer patients’ decision making and trial-entry preferences: the effects of “framing” information about short-term toxicity and long-term survival. Med Decis Making. 1995;15:4–12.CrossRefPubMed Llewellyn-Thomas HA, McGreal MJ, Thiel EC. Cancer patients’ decision making and trial-entry preferences: the effects of “framing” information about short-term toxicity and long-term survival. Med Decis Making. 1995;15:4–12.CrossRefPubMed
8.
go back to reference LeBoeuf RA, Shafir E. Deep thoughts and shallow frames: on the susceptibility to framing effects. J Behav Decis Mak. 2003;16:77–92.CrossRef LeBoeuf RA, Shafir E. Deep thoughts and shallow frames: on the susceptibility to framing effects. J Behav Decis Mak. 2003;16:77–92.CrossRef
9.
go back to reference Marteau TM. Framing of information: its influence upon decisions of doctors and patients. Br J Soc Psychol. 1989;28(Pt 1):89–94.CrossRefPubMed Marteau TM. Framing of information: its influence upon decisions of doctors and patients. Br J Soc Psychol. 1989;28(Pt 1):89–94.CrossRefPubMed
10.
go back to reference Siminoff LA, Fetting JH. Effects of outcome framing on treatment decisions in the real world: impact of framing on adjuvant breast cancer decisions. Med Decis Making. 1989;9:262–71.CrossRefPubMed Siminoff LA, Fetting JH. Effects of outcome framing on treatment decisions in the real world: impact of framing on adjuvant breast cancer decisions. Med Decis Making. 1989;9:262–71.CrossRefPubMed
11.
go back to reference Tversky A, Kahneman D. The framing of decisions and the psychology of choice. Science. 1981;211:453–8.CrossRefPubMed Tversky A, Kahneman D. The framing of decisions and the psychology of choice. Science. 1981;211:453–8.CrossRefPubMed
12.
go back to reference Bui TC, Krieger HA, Blumenthal-Barby JS. Framing Effects on Physicians’ Judgment and Decision Making. Psychol Rep. 2015;117:508–22.CrossRefPubMed Bui TC, Krieger HA, Blumenthal-Barby JS. Framing Effects on Physicians’ Judgment and Decision Making. Psychol Rep. 2015;117:508–22.CrossRefPubMed
13.
go back to reference Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O’Brien MA, French SD, Young J, Odgaard-Jensen J. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29:1534–41.CrossRefPubMedPubMedCentral Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O’Brien MA, French SD, Young J, Odgaard-Jensen J. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29:1534–41.CrossRefPubMedPubMedCentral
14.
go back to reference Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388:547–8.CrossRefPubMed Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388:547–8.CrossRefPubMed
15.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.CrossRefPubMed Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.CrossRefPubMed
17.
go back to reference Locke EA, Latham GP. A theory of goal setting & task performance. Englewood Cliffs: Prentice Hall; 1990. Locke EA, Latham GP. A theory of goal setting & task performance. Englewood Cliffs: Prentice Hall; 1990.
18.
go back to reference Bandura A. Social cognitive theory of self-regulation. Organ Behav Hum Decis Process. 1991;50:248–87.CrossRef Bandura A. Social cognitive theory of self-regulation. Organ Behav Hum Decis Process. 1991;50:248–87.CrossRef
19.
go back to reference Van-Dijk D, Kluger AN. Feedback Sign Effect on Motivation: Is it Moderated by Regulatory Focus? Appl Psychol. 2004;53:113–35.CrossRef Van-Dijk D, Kluger AN. Feedback Sign Effect on Motivation: Is it Moderated by Regulatory Focus? Appl Psychol. 2004;53:113–35.CrossRef
20.
go back to reference Presseau J, Sniehotta FF, Francis JJ, Campbell NC. Multiple goals and time constraints: perceived impact on physicians’ performance of evidence-based behaviours. Implement Sci. 2009;4:77.CrossRefPubMedPubMedCentral Presseau J, Sniehotta FF, Francis JJ, Campbell NC. Multiple goals and time constraints: perceived impact on physicians’ performance of evidence-based behaviours. Implement Sci. 2009;4:77.CrossRefPubMedPubMedCentral
21.
go back to reference Presseau J, Francis JJ, Campbell NC, Sniehotta FF. Goal conflict, goal facilitation, and health professionals’ provision of physical activity advice in primary care: an exploratory prospective study. Implement Sci. 2011;6:73.CrossRefPubMedPubMedCentral Presseau J, Francis JJ, Campbell NC, Sniehotta FF. Goal conflict, goal facilitation, and health professionals’ provision of physical activity advice in primary care: an exploratory prospective study. Implement Sci. 2011;6:73.CrossRefPubMedPubMedCentral
22.
go back to reference Presseau J, Johnston M, Francis JJ, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw JM, Elovainio M, Hunter M, Eccles MP. Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2014;37:607–20.CrossRefPubMed Presseau J, Johnston M, Francis JJ, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw JM, Elovainio M, Hunter M, Eccles MP. Theory-based predictors of multiple clinician behaviors in the management of diabetes. J Behav Med. 2014;37:607–20.CrossRefPubMed
23.
go back to reference Gong J, Zhang Y, Yang Z, Huang Y, Feng J, Zhang W. The framing effect in medical decision-making: a review of the literature. Psychol Health Med. 2013;18:645–53.CrossRefPubMed Gong J, Zhang Y, Yang Z, Huang Y, Feng J, Zhang W. The framing effect in medical decision-making: a review of the literature. Psychol Health Med. 2013;18:645–53.CrossRefPubMed
25.
go back to reference McGettigan P, Sly K, O’Connell D, Hill S, Henry D. The effects of information framing on the practices of physicians. J Gen Intern Med. 1999;14:633–42.CrossRefPubMedPubMedCentral McGettigan P, Sly K, O’Connell D, Hill S, Henry D. The effects of information framing on the practices of physicians. J Gen Intern Med. 1999;14:633–42.CrossRefPubMedPubMedCentral
26.
go back to reference Kahneman D, Tversky A. Prospect Theory: An Analysis of Decision under Risk. Econometrica. 1979;47:263–91.CrossRef Kahneman D, Tversky A. Prospect Theory: An Analysis of Decision under Risk. Econometrica. 1979;47:263–91.CrossRef
27.
go back to reference Moulton LH. Covariate-based constrained randomization of group-randomized trials. Clin Trials. 2004;1:297–305.CrossRefPubMed Moulton LH. Covariate-based constrained randomization of group-randomized trials. Clin Trials. 2004;1:297–305.CrossRefPubMed
28.
go back to reference Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999;54:M546–553.CrossRefPubMed Morris JN, Fries BE, Morris SA. Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999;54:M546–553.CrossRefPubMed
29.
go back to reference Kessner DM, Kalk CE, Singer J. Assessing health quality--the case for tracers. N Engl J Med. 1973;288:189–94.CrossRefPubMed Kessner DM, Kalk CE, Singer J. Assessing health quality--the case for tracers. N Engl J Med. 1973;288:189–94.CrossRefPubMed
31.
go back to reference Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med. 2016;35:4718–28.CrossRefPubMed Hooper R, Teerenstra S, de Hoop E, Eldridge S. Sample size calculation for stepped wedge and other longitudinal cluster randomised trials. Stat Med. 2016;35:4718–28.CrossRefPubMed
32.
go back to reference Shepard DS. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, editors. Cost-effectiveness in Health and Medicine. New York: Oxford University Press; 1996. The Journal of Mental Health Policy and Economics 1999, 2:91-92. Shepard DS. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, editors. Cost-effectiveness in Health and Medicine. New York: Oxford University Press; 1996. The Journal of Mental Health Policy and Economics 1999, 2:91-92.
33.
go back to reference Wodchis WP, Bushmeneva K, Nikitovic M, McKillop I: Guidelines on Person-Level Costing Using Administrative Databases in Ontario. ((HSPRN) HSPRN ed., vol. 1; 2013. Wodchis WP, Bushmeneva K, Nikitovic M, McKillop I: Guidelines on Person-Level Costing Using Administrative Databases in Ontario. ((HSPRN) HSPRN ed., vol. 1; 2013.
34.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.CrossRefPubMedPubMedCentral
35.
go back to reference Presseau J, Hawthorne G, Sniehotta FF, Steen N, Francis JJ, Johnston M, Mackintosh J, Grimshaw JM, Kaner E, Elovainio M, et al. Improving Diabetes care through Examining, Advising, and prescribing (IDEA): protocol for a theory-based cluster randomised controlled trial of a multiple behaviour change intervention aimed at primary healthcare professionals. Implement Sci. 2014;9:61.CrossRefPubMedPubMedCentral Presseau J, Hawthorne G, Sniehotta FF, Steen N, Francis JJ, Johnston M, Mackintosh J, Grimshaw JM, Kaner E, Elovainio M, et al. Improving Diabetes care through Examining, Advising, and prescribing (IDEA): protocol for a theory-based cluster randomised controlled trial of a multiple behaviour change intervention aimed at primary healthcare professionals. Implement Sci. 2014;9:61.CrossRefPubMedPubMedCentral
36.
go back to reference Kluger AN, Van Dijk D. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010;44:1166–74.CrossRefPubMed Kluger AN, Van Dijk D. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010;44:1166–74.CrossRefPubMed
37.
go back to reference Higgins ET. Regulatory Fit. In: Shah JY, Gardner WL, editors. Handbook of Motivation Science. New York: The Guilford Press; 2008. Higgins ET. Regulatory Fit. In: Shah JY, Gardner WL, editors. Handbook of Motivation Science. New York: The Guilford Press; 2008.
38.
go back to reference Nieroda M, Keeling K, Keeling D. Healthcare Self-Management Tools: Promotion or Prevention Regulatory Focus? A Scale (PR-PV) Development and Validation. J Mark Theory Pract. 2015;23:57–74.CrossRef Nieroda M, Keeling K, Keeling D. Healthcare Self-Management Tools: Promotion or Prevention Regulatory Focus? A Scale (PR-PV) Development and Validation. J Mark Theory Pract. 2015;23:57–74.CrossRef
40.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009; (3):MR000008. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix LM, Pratap S: Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev 2009; (3):MR000008.
41.
go back to reference Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.CrossRefPubMedPubMedCentral Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.CrossRefPubMedPubMedCentral
42.
43.
go back to reference Lawton R, Heyhoe J, Louch G, Ingleson E, Glidewell L, Willis TA, McEachan RR, Foy R, programme A. Using the Theoretical Domains Framework (TDF) to understand adherence to multiple evidence-based indicators in primary care: a qualitative study. Implement Sci. 2016;11:113.CrossRefPubMedPubMedCentral Lawton R, Heyhoe J, Louch G, Ingleson E, Glidewell L, Willis TA, McEachan RR, Foy R, programme A. Using the Theoretical Domains Framework (TDF) to understand adherence to multiple evidence-based indicators in primary care: a qualitative study. Implement Sci. 2016;11:113.CrossRefPubMedPubMedCentral
44.
go back to reference TCPS 2. the latest edition of Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. 2014. http://www.pre.ethics.gc.ca/eng/policy-politique/initiatives/tcps2-eptc2/Default/. TCPS 2. the latest edition of Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. 2014. http://​www.​pre.​ethics.​gc.​ca/​eng/​policy-politique/​initiatives/​tcps2-eptc2/​Default/​.​
45.
go back to reference Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, Taljaard M, Ottawa Ethics of Cluster Randomized Trials Consensus G. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9:e1001346.CrossRefPubMedPubMedCentral Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, Taljaard M, Ottawa Ethics of Cluster Randomized Trials Consensus G. The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials. PLoS Med. 2012;9:e1001346.CrossRefPubMedPubMedCentral
46.
go back to reference Hippocrates: Oath of Hippocrates. In Harvard Classics, vol. 38. Boston: P.F. Collier and Son; 1910. Hippocrates: Oath of Hippocrates. In Harvard Classics, vol. 38. Boston: P.F. Collier and Son; 1910.
47.
48.
go back to reference Bloom BS. Effects of continuing medical education on improving physician clinical care and patient health: a review of systematic reviews. Int J Technol Assess Health Care. 2005;21:380–5.CrossRefPubMed Bloom BS. Effects of continuing medical education on improving physician clinical care and patient health: a review of systematic reviews. Int J Technol Assess Health Care. 2005;21:380–5.CrossRefPubMed
Metadata
Title
Testing feedback message framing and comparators to address prescribing of high-risk medications in nursing homes: protocol for a pragmatic, factorial, cluster-randomized trial
Authors
Noah M. Ivers
Laura Desveaux
Justin Presseau
Catherine Reis
Holly O. Witteman
Monica K. Taljaard
Nicola McCleary
Kednapa Thavorn
Jeremy M. Grimshaw
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0615-7

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue