Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Debate

No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention

Authors: Noah M Ivers, Anne Sales, Heather Colquhoun, Susan Michie, Robbie Foy, Jill J Francis, Jeremy M Grimshaw

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’

Discussion

Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature.

Summary

We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.
Appendix
Available only for authorised users
Literature
1.
Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296 (9): 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed
2.
Audet AM, Doty MM, Shamasdin J, Schoenbaum SC: Measure, learn, and improve: physicians’ involvement in quality improvement. Health Aff (Millwood). 2005, 24 (3): 843-853. 10.1377/hlthaff.24.3.843.CrossRef
3.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 6: CD000259
4.
Glasziou P, Meats E, Heneghan C, Shepperd S: What is missing from descriptions of treatment in trials and reviews?. BMJ. 2008, 336 (7659): 1472-1474. 10.1136/bmj.39590.732037.47.CrossRefPubMedPubMedCentral
5.
Sales A, Smith J, Curran G, Kochevar L: Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006, 21 (Suppl 2): 43-49.
6.
Colquhoun HL, Brehaut JC, Sales A, Ivers N, Grimshaw J, Michie S, Carroll K, Chalifoux M, Eva KW: A systematic review of the use of theory in randomized controlled trials of audit and feedback. Implement Sci. 2013, 8 (1): 66-10.1186/1748-5908-8-66.CrossRefPubMedPubMedCentral
7.
Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005, 5: 50-10.1186/1472-6963-5-50.CrossRefPubMedPubMedCentral
8.
Shute V: Focus on formative feedback. Rev of Educational Research. 2008, 78: 153-189. 10.3102/0034654307313795.CrossRef
9.
Ilgen DR, Fisher CD, Taylor MS: Consequences of individual feedback on behavior in organizations. J Appl Psychol. 1979, 64 (4): 349-371.CrossRef
10.
Kluger AN, DeNisi A: The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychol Bull. 1996, 119 (2): 254-284.CrossRef
11.
Locke EA, Latham GP: Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol. 2002, 57 (9): 705-717.CrossRefPubMed
12.
Brehaut JC, Eva KW: Building theories of knowledge translation interventions: use the entire menu of constructs. Implement Sci. 2012, 7: 114-5908-7-114-CrossRef
13.
Carver CS, Scheier MF: Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982, 92 (1): 111-135.CrossRefPubMed
14.
Gardner B, Whittington C, McAteer J, Eccles MP, Michie S: Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback. Soc Sci Med. 2010, 70 (10): 1618-1625. 10.1016/j.socscimed.2010.01.039.CrossRefPubMed
15.
Hysong SJ, Best RG, Pugh JA: Audit and feedback and clinical practice guideline adherence: Making feedback actionable. Implement Sci. 2006, 1: 9-10.1186/1748-5908-1-9.CrossRefPubMedPubMedCentral
16.
van der Veer SN, de Keizer NF, Ravelli AC, Tenkink S, Jager KJ: Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010, 79 (5): 305-323. 10.1016/j.ijmedinf.2010.01.011.CrossRefPubMed
17.
Hysong SJ: Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009, 47 (3): 356-363. 10.1097/MLR.0b013e3181893f6b.CrossRefPubMedPubMedCentral
18.
Li T, Vedula SS, Scherer R, Dickersin K: What comparative effectiveness research is needed? A framework for using guidelines and systematic reviews to identify evidence gaps and research priorities. Ann Intern Med. 2012, 156 (5): 367-377. 10.7326/0003-4819-156-5-201203060-00009.CrossRefPubMedPubMedCentral
19.
Eccles MP, Armstrong D, Baker R, Cleary K, Davies H, Davies S, Glasziou P, Ilott I, Kinmonth AL, Leng G, Logan S, Marteau T, Michie S, Rogers H, Rycroft-Malone J, Sibbald B: An implementation research agenda. Implement Sci. 2009, 4: 18-5908-4-18-
20.
Kluger AN, Van Dijk D: Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010, 44 (12): 1166-1174. 10.1111/j.1365-2923.2010.03849.x.CrossRefPubMed
21.
Rogers E: Diffusion of innovations. 1995, New York: Free Press
22.
Flodgren G, Parmelli E, Doumit G, Gattellari M, O’Brien MA, Grimshaw J, Eccles MP: Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2011, 8 (8): CD000125-PubMed
23.
Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50 (2): 179-211. 10.1016/0749-5978(91)90020-T.CrossRef
24.
Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW: Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001, 285 (22): 2871-2879. 10.1001/jama.285.22.2871.CrossRefPubMed
25.
Weissman NW, Allison JJ, Kiefe CI, Farmer RM, Weaver MT, Williams OD, Child IG, Pemberton JH, Brown KC, Baker CS: Achievable benchmarks of care: the ABCs of benchmarking. J Eval Clin Pract. 1999, 5 (3): 269-281. 10.1046/j.1365-2753.1999.00203.x.CrossRefPubMed
26.
Foy R, MacLennan G, Grimshaw J, Penney G, Campbell M, Grol R: Attributes of clinical recommendations that influence change in practice following audit and feedback. J Clin Epidemiol. 2002, 55 (7): 717-722. 10.1016/S0895-4356(02)00403-1.CrossRefPubMed
27.
Doran GT: There’s a S.M.A.R.T. way to write management’s goals and objectives. AMA Forum. Management review. 1981, 70 (11): 35-36.
28.
Presseau J, Sniehotta FF, Francis JJ, Campbell NC: Multiple goals and time constraints: perceived impact on physicians’ performance of evidence-based behaviours. Implement Sci. 2009, 4: 77-5908-4-77-CrossRef
29.
Cane J, O’Connor D, Michie S: Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012, 7: 37-5908-7-37-CrossRef
30.
Ashford SJ, Cummings LL: Feedback as an individual resource: Personal strategies of creating information. Organ Behav Hum Perform. 1983, 32 (3): 370-398. 10.1016/0030-5073(83)90156-3.CrossRef
31.
Bandura A, Cervone D: Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. J Pers Soc Psychol. 1983, 45 (5): 1017-1028.CrossRef
32.
Johnson RE, Chang CH, Lord RG: Moving from cognition to behavior: What the research says. Psychol Bull. 2006, 132 (3): 381-415.CrossRefPubMed
33.
Hysong SJ, Simpson K, Pietz K, SoRelle R, Broussard Smitham K, Petersen LA: Financial incentives and physician commitment to guideline-recommended hypertension management. Am J Manag Care. 2012, 18 (10): e378-e391.PubMedPubMedCentral
34.
Presseau J, Francis JJ, Campbell NC, Sniehotta FF: Goal conflict, goal facilitation, and health professionals’ provision of physical activity advice in primary care: An exploratory prospective study. Implement Sci. 2011, 6: 73-10.1186/1748-5908-6-73.CrossRefPubMedPubMedCentral
35.
Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, Robertson N: Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010, 3: CD005470
36.
Bonetti D, Johnston M, Pitts NB, Deery C, Ricketts I, Tilley C, Clarkson JE: Knowledge may not be the best target for strategies to influence evidence-based practice: using psychological models to understand RCT effects. Int J Behav Med. 2009, 16 (3): 287-293. 10.1007/s12529-008-9017-1.CrossRefPubMed
37.
Ivers N, Barnsley J, Upshur R, Shah B, Tu K, Grimshaw J, Zwarenstein M: My job is one patient at a time’: perceived discordance between population-level quality targets and patient-centered care inhibits quality improvement. Canadian Family Physician. 2013, in press
38.
Grilli R, Lomas J: Evaluating the message: the relationship between compliance rate and the subject of a practice guideline. Med Care. 1994, 32 (3): 202-213. 10.1097/00005650-199403000-00002.CrossRefPubMed
39.
Grol R, Dalhuijsen J, Thomas S, Veld C, Rutten G, Mokkink H: Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. BMJ. 1998, 317 (7162): 858-861.CrossRefPubMedPubMedCentral
40.
Shekelle PG, Kravitz RL, Beart J, Marger M, Wang M, Lee M: Are nonspecific practice guidelines potentially harmful? A randomized comparison of the effect of nonspecific versus specific guidelines on physician decision making. Health Serv Res. 2000, 34 (7): 1429-1448.PubMedPubMedCentral
41.
Glynn RJ, Brookhart MA, Stedman M, Avorn J, Solomon DH: Design of cluster-randomized trials of quality improvement interventions aimed at medical care providers. Med Care. 2007, 45 (10 Supl 2): 38-43.CrossRef
42.
Godin G, Belanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-10.1186/1748-5908-3-36.CrossRefPubMedPubMedCentral
43.
Ivers N, Tu K, Francis J, Barnsley J, Shah B, Upshur R, Moineddin R, Grimshaw J, Zwarenstein M: Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implement Sci. 2013, 8: 42-10.1186/1748-5908-8-42.CrossRef
44.
Collins LM, Chakraborty B, Murphy SA, Strecher V: Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions. Clin Trials. 2009, 6 (1): 5-15. 10.1177/1740774508100973.CrossRefPubMedPubMedCentral
45.
Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ: Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011, 89 (2): 167-205. 10.1111/j.1468-0009.2011.00625.x.CrossRefPubMedPubMedCentral
Metadata
Title
No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention
Authors
Noah M Ivers
Anne Sales
Heather Colquhoun
Susan Michie
Robbie Foy
Jill J Francis
Jeremy M Grimshaw
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-14

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue

Research

Did a quality improvement collaborative make stroke care better? A cluster randomized trial

Methodology

Patients-people-place: developing a framework for researching organizational culture during health service redesign and change

Study protocol

Optimizing polypharmacy among elderly hospital patients with chronic diseases—study protocol of the cluster randomized controlled POLITE-RCT trial

Short report

Quality improvement collaboratives and the wisdom of crowds: spread explained by perceived success at group level

Research

Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians’ diabetic retinopathy referrals [Trial registration number ISRCTN72772651]

Research

Data for improvement and clinical excellence: report of an interrupted time series trial of feedback in long-term care