Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2021

Open Access 01-12-2021 | Research article

Informing the research agenda for optimizing audit and feedback interventions: results of a prioritization exercise

Authors: Heather L. Colquhoun, Kelly Carroll, Kevin W. Eva, Jeremy M. Grimshaw, Noah Ivers, Susan Michie, Jamie C. Brehaut

Published in: BMC Medical Research Methodology | Issue 1/2021

Login to get access

Abstract

Background

Audit and feedback (A&F) interventions are one of the most common approaches for implementing evidence-based practices. A key barrier to more effective A&F interventions is the lack of a theory-guided approach to the accumulation of evidence. Recent interviews with theory experts identified 313 theory-informed hypotheses, spread across 30 themes, about how to create more effective A&F interventions. In the current survey, we sought to elicit from stakeholders which hypotheses were most likely to advance the field if studied further.

Methods

From the list of 313, three members of the research team identified 216 that were clear and distinguishable enough for prioritization. A web-based survey was then sent to 211 A&F intervention stakeholders asking them to choose up to 50 ‘priority’ hypotheses following the header “A&F interventions will be more effective if…”. Analyses included frequencies of endorsement of the individual hypotheses and themes into which they were grouped.

Results

68 of the 211 invited participants responded to the survey. Seven hypotheses were chosen by > 50% of respondents, including A&F interventions will be more effective… “if feedback is provided by a trusted source”; “if recipients are involved in the design/development of the feedback intervention”; “if recommendations related to the feedback are based on good quality evidence”; “if the behaviour is under the control of the recipient”; “if it addresses barriers and facilitators (drivers) to behaviour change”; “if it suggests clear action plans”; and “if target/goal/optimal rates are clear and explicit”. The most endorsed theme was Recipient Priorities (four hypotheses were chosen 92 times as a ‘priority’ hypotheses).

Conclusions

This work determined a set of hypotheses thought by respondents to be to be most likely to advance the field through future A&F intervention research. This work can inform a coordinated research agenda that may more efficiently lead to more effective A&F interventions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.
2.
go back to reference Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O'Brien MA, French SD, Young J, Odgaard-Jensen J. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29(11):1534–41.CrossRef Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O'Brien MA, French SD, Young J, Odgaard-Jensen J. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29(11):1534–41.CrossRef
3.
go back to reference Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Chalifoux M, Eva KW. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implementation Sci. 2013;8:66.CrossRef Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Chalifoux M, Eva KW. A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implementation Sci. 2013;8:66.CrossRef
4.
go back to reference Colquhoun HL, Carroll K, Eva KW, Grimshaw JM, Ivers N, Michie S, Sales A, Brehaut JC. Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses. Implement Sci. 2017;12(1):117.CrossRef Colquhoun HL, Carroll K, Eva KW, Grimshaw JM, Ivers N, Michie S, Sales A, Brehaut JC. Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses. Implement Sci. 2017;12(1):117.CrossRef
5.
go back to reference Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164:435.CrossRef Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, Ivers N, Grimshaw JM. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164:435.CrossRef
6.
go back to reference Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet E-surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34.CrossRef Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet E-surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34.CrossRef
7.
go back to reference Grimshaw J, Ivers N, Linklater S, Foy R, Francis JJ, Gude WT, Hysong SJ. Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback. BMJ Qual Saf. 2019;28(5):416–23.CrossRef Grimshaw J, Ivers N, Linklater S, Foy R, Francis JJ, Gude WT, Hysong SJ. Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback. BMJ Qual Saf. 2019;28(5):416–23.CrossRef
8.
go back to reference Newman K, Van Eerd D, Powell BJ, Urquhart R, Cornelissen E, Chan V, Lal S. Identifying priorities in knowledge translation from the perspective of trainees: results from an online survey. Implement Sci. 2015;10(1):92.CrossRef Newman K, Van Eerd D, Powell BJ, Urquhart R, Cornelissen E, Chan V, Lal S. Identifying priorities in knowledge translation from the perspective of trainees: results from an online survey. Implement Sci. 2015;10(1):92.CrossRef
9.
go back to reference Rankin NM, McGregor D, Butow PN, White K, Phillips JL, Young JM, Pearson SA, York S, Shaw T. Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science. BMC Med Res Methodol. 2016;16(1):110.CrossRef Rankin NM, McGregor D, Butow PN, White K, Phillips JL, Young JM, Pearson SA, York S, Shaw T. Adapting the nominal group technique for priority setting of evidence-practice gaps in implementation science. BMC Med Res Methodol. 2016;16(1):110.CrossRef
10.
go back to reference Boivin A, Lehoux P, Lacombe R, Burgers J, Grol R. Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9(1):24.CrossRef Boivin A, Lehoux P, Lacombe R, Burgers J, Grol R. Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9(1):24.CrossRef
Metadata
Title
Informing the research agenda for optimizing audit and feedback interventions: results of a prioritization exercise
Authors
Heather L. Colquhoun
Kelly Carroll
Kevin W. Eva
Jeremy M. Grimshaw
Noah Ivers
Susan Michie
Jamie C. Brehaut
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2021
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01195-5

Other articles of this Issue 1/2021

BMC Medical Research Methodology 1/2021 Go to the issue