Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2010

Open Access 01-12-2010 | Study protocol

Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care

Authors: Noah M Ivers, Karen Tu, Jill Francis, Jan Barnsley, Baiju Shah, Ross Upshur, Alex Kiss, Jeremy M Grimshaw, Merrick Zwarenstein

Published in: Implementation Science | Issue 1/2010

Login to get access

Abstract

Background

Audit and feedback to physicians is commonly used alone or as part of multifaceted interventions. While it can play an important role in quality improvement, the optimal design of audit and feedback is unknown. This study explores how feedback can be improved to increase acceptability and usability in primary care. The trial seeks to determine whether a theory-informed worksheet appended to feedback reports can help family physicians improve quality of care for their patients with diabetes and/or ischemic heart disease.

Methods

Two-arm cluster trial was conducted with participating primary care practices allocated using minimization to simple feedback or enhanced feedback group. The simple feedback group receives performance feedback reports every six months for two years regarding the proportion of their patients with diabetes and/or ischemic heart disease who are meeting quality targets. The enhanced feedback group receives these same reports as well as a theory-informed worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Participants are family physicians from across Ontario who use electronic medical records; data for rostered patients are used to produce the feedback reports and for analysis.

Outcomes

The primary disease outcomes are the blood pressure (BP), and low-density lipoprotein cholesterol (LDL) levels. The primary process measure is a composite score indicating the number of recommended activities (e.g., tests and prescriptions) conducted by the family physicians for their patients with diabetes and/or ischemic heart disease within the appropriate timeframe. Secondary outcomes are the proportion of patients whose results meet targets for glucose, LDL, and BP as well as the percent of patients receiving relevant prescriptions. A qualitative process evaluation using semi-structured interviews will explore perceived barriers to behaviour change in response to feedback reports and preferences with regard to feedback design.

Analysis

Intention-to-treat approach will be used to analyze the trial. Analysis will be performed on patient-level variables using generalized estimating equation models to adjust for covariates and account for the clustered nature of the data. The trial is powered to show small, but clinically important differences of 7 mmHG in systolic BP and 0.32 mmol/L in LDL.

Trial Registration

ClinicalTrials.gov NCT00996645
Appendix
Available only for authorised users
Literature
1.
Haffner SM, Lehto S, Ronnemaa T, Pyorala K, Laakso M: Mortality from coronary heart disease in subjects with type 2 diabetes and in nondiabetic subjects with and without prior myocardial infarction. N Engl J Med. 1998, 339 (4): 229-234. 10.1056/NEJM199807233390404.CrossRefPubMed
2.
3.
Narayan KM, Benjamin E, Gregg EW, Norris SL, Engelgau MM: Diabetes translation research: where are we and where do we want to be?. Ann Intern Med. 2004, 140 (11): 958-963.CrossRefPubMed
4.
Davis D, Davis N: Educational Interventions. Knowledge Translation in Health Care - Moving from Evidence to Practice. Edited by: Straus S, Tetroe J, Graham ID. 2009, UK: Wiley-Blackwell, 116.
5.
Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296 (4): 427-440. 10.1001/jama.296.4.427.CrossRefPubMed
6.
Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995, 153 (10): 1423-1431.PubMedPubMedCentral
7.
Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296 (9): 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed
8.
Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2 (2): CD000259.PubMed
9.
Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005, 5: 50-10.1186/1472-6963-5-50.CrossRefPubMedPubMedCentral
10.
Hysong SJ: Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009, 47 (3): 356-363. 10.1097/MLR.0b013e3181893f6b.CrossRefPubMedPubMedCentral
11.
Gardner B, Whittington C, McAteer J, Eccles MP, Michie S: Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback. Soc Sci Med. 2010, 70 (10): 1618-1625. 10.1016/j.socscimed.2010.01.039.CrossRefPubMed
12.
Kluger AN, DeNisi A: The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychol Bull. 1996, 119 (2): 254-284. 10.1037/0033-2909.119.2.254.CrossRef
13.
Carver CS, Scheier MF: Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull. 1982, 92 (1): 111-135. 10.1037/0033-2909.92.1.111.CrossRefPubMed
14.
Locke EA, Latham GP: Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. Am Psychol. 2002, 57 (9): 705-717. 10.1037/0003-066X.57.9.705.CrossRefPubMed
15.
Gollwitzer PM: Implementation Intentions. Am Psychol. 1999, 54 (7): 493-503. 10.1037/0003-066X.54.7.493.CrossRef
16.
Locke EA: A theory of goal setting & task performance. 1990, Englewood Cliffs, N.J.: Prentice Hall
17.
Bandura A: Self-efficacy. Encyclopedia of human behavior. Edited by: Ramachandran VS. 1994, Toronto: Academic Press, 71-81.
18.
Ajzen I, Manstead ASR: Changing health-related behaviors: An approach based on the theory of planned behavior. The scope of social psychology: Theory and applications. Edited by: van den Bos K, Hewstone M, de Wit J, Schut H, Stroebe M. 2007, New York: Psychology Press, 43-63.
19.
Gollwitzer PM, Fujita K, Oettingen G: Planning and the Implementation of Goals. Handbook of self-regulation: research, theory, and applications. Edited by: Baumeister RF, Vohs KD. 2004, New York: Guilford Press, 211-228.
20.
Kirschner K, Braspenning J, Maassen I, Bonte A, Burgers J, Grol R: Improving access to primary care: the impact of a quality-improvement strategy. Qual Saf Health Care. 2010, 19 (3): 248-251. 10.1136/qshc.2008.031526.CrossRefPubMed
21.
O'Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard-Jensen J, Kristoffersen DT, Forsetlund L, Bainbridge D, Freemantle N, Davis DA, Haynes RB, Harvey EL: Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007, 4 (4): CD000409.PubMed
22.
Davies P, Walker AE, Grimshaw JM: A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci. 2010, 5: 14-10.1186/1748-5908-5-14.CrossRefPubMedPubMedCentral
23.
Dawson L, Zarin DA, Emanuel EJ, Friedman LM, Chaudhari B, Goodman SN: Considering usual medical care in clinical trial design. PLoS Med. 2009, 6 (9): e1000111-10.1371/journal.pmed.1000111.CrossRefPubMedPubMedCentral
24.
25.
Tu K, Klein-Geltink J, Mitiku TF, Mihai C, Martin J: De-identification of primary care electronic medical records free-text data in Ontario, Canada. BMC Med Inform Decis Mak. 2010, 10: 35-10.1186/1472-6947-10-35.CrossRefPubMedPubMedCentral
26.
Tu K, Manuel D, Lam K, Kavanagh D, Mitiku TF, Guo H: Diabetics can be identified in an electronic medical record using laboratory tests and prescriptions. J Clin Epidemiol. 2010,
27.
Ivers NM, Pylypenko B, Tu K: Identifying Ischemic Heart Disease in an Electronic Medical Record. Journal of Primary Care and Community Health,
28.
29.
Jackson GL, Weinberger M: A decade with the chronic care model: some progress and opportunity for more. Med Care. 2009, 47 (9): 929-931. 10.1097/MLR.0b013e3181b63537.CrossRefPubMed
30.
31.
Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW: Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001, 285 (22): 2871-2879. 10.1001/jama.285.22.2871.CrossRefPubMed
32.
Sniehotta FF: Towards a theory of intentional behaviour change: plans, planning, and self-regulation. Br J Health Psychol. 2009, 14 (Pt 2): 261-273. 10.1348/135910708X389042.CrossRefPubMed
33.
Luszczynska A, Haynes C: Changing nutrition, physical activity and body weight among student nurses and midwives: effects of a planning intervention and self-efficacy beliefs. J Health Psychol. 2009, 14 (8): 1075-1084. 10.1177/1359105309342290.CrossRefPubMed
34.
35.
Shershneva MB, Wang MF, Lindeman GC, Savoy JN, Olson CA: Commitment to Practice Change: An Evaluator's Perspective. Eval Health Prof. 2010, 33 (3): 256-75. 10.1177/0163278710363960.CrossRefPubMedPubMedCentral
36.
Wakefield JG: Commitment to change: exploring its role in changing physician behavior through continuing education. J Contin Educ Health Prof. 2004, 24 (4): 197-204. 10.1002/chp.1340240403.CrossRefPubMed
37.
Mazmanian PE, Johnson RE, Zhang A, Boothby J, Yeatts EJ: Effects of a signature on rates of change: a randomized controlled trial involving continuing education and the commitment-to-change model. Acad Med. 2001, 76 (6): 642-646. 10.1097/00001888-200106000-00018.CrossRefPubMed
38.
Overton GK, MacVicar R: Requesting a commitment to change: conditions that produce behavioral or attitudinal commitment. J Contin Educ Health Prof. 2008, 28 (2): 60-66. 10.1002/chp.158.CrossRefPubMed
39.
40.
41.
Scott NW, McPherson GC, Ramsay CR, Campbell MK: The method of minimization for allocation to clinical trials. a review. Control Clin Trials. 2002, 23 (6): 662-674. 10.1016/S0197-2456(02)00242-8.CrossRefPubMed
42.
43.
Bhattacharyya OK, Estey EA, Cheng AY, Canadian Diabetes Association 2008: Update on the Canadian Diabetes Association 2008 clinical practice guidelines. Can Fam Physician. 2009, 55 (1): 39-43.PubMedPubMedCentral
44.
Genest J, McPherson R, Frohlich J, Anderson T, Campbell N, Carpentier A, Couture P, Dufour R, Fodor G, Francis GA, Grover S, Gupta M, Hegele RA, Lau DC, Leiter L, Lewis GF, Lonn E, Mancini GB, Ng D, Pearson GJ, Sniderman A, Stone JA, Ur E: 2009 Canadian Cardiovascular Society/Canadian guidelines for the diagnosis and treatment of dyslipidemia and prevention of cardiovascular disease in the adult - 2009 recommendations. Can J Cardiol. 2009, 25 (10): 567-579.CrossRefPubMedPubMedCentral
45.
Cooper A, Skinner J, Nherera L, Feder G, Ritchie G, Kathoria M, Turnbull N, Shaw G, MacDermott K, Minhas R, Packham C, Squires H, Thomson D, Timmis A, Walsh J, Williams H, White A: Clinical Guidelines and Evidence Review for Post Myocardial Infarction: Secondary prevention in primary and secondary care for patients following a myocardial infarction. Anonymous London: National Collaborating Centre for Primary Care and Royal College of General Practitioners. 2007, [Anonymous]
46.
47.
Holbrook A, Thabane L, Keshavjee K, Dolovich L, Bernstein B, Chan D, Troyan S, Foster G, Gerstein H, COMPETE II Investigators: Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. CMAJ. 2009, 181 (1-2): 37-44.CrossRefPubMedPubMedCentral
48.
Canadian Hypertension Education Program, Campbell N, Kwong MM: 2010 Canadian Hypertension Education Program recommendations: An annual update. Can Fam Physician. 2010, 56 (7): 649-653.
49.
Law MR, Morris JK, Wald NJ: Use of blood pressure lowering drugs in the prevention of cardiovascular disease: meta-analysis of 147 randomised trials in the context of expectations from prospective epidemiological studies. BMJ. 2009, 338: b1665-10.1136/bmj.b1665.CrossRefPubMedPubMedCentral
50.
Donner A, Klar N: Design and Analysis of Cluster Randomization Trials in Health Research. 2000, New York: Oxford University Press
51.
Littenberg B, MacLean CD: Intra-cluster correlation coefficients in adults with diabetes in primary care practices: the Vermont Diabetes Information System field survey. BMC Med Res Methodol. 2006, 6: 20-10.1186/1471-2288-6-20.CrossRefPubMedPubMedCentral
52.
Kizer JR, Madias C, Wilner B, Vaughan CJ, Mushlin AI, Trushin P, Gotto AM, Pasternak RC: Relation of different measures of low-density lipoprotein cholesterol to risk of coronary artery disease and death in a meta-regression analysis of large-scale trials of statin therapy. Am J Cardiol. 2010, 105 (9): 1289-1296. 10.1016/j.amjcard.2009.12.051.CrossRefPubMedPubMedCentral
53.
Hysong SJ, Best RG, Pugh JA: Audit and feedback and clinical practice guideline adherence: Making feedback actionable. Implement Sci. 2006, 1: 9-10.1186/1748-5908-1-9.CrossRefPubMedPubMedCentral
54.
Levy P, Williams J: The Social Context of Performance Appraisal: A Review and Framework for the Future. Journal of Management. 2004, 30 (6): 881-905.
55.
Rowan MS, Hogg W, Martin C, Vilis E: Family physicians' reactions to performance assessment feedback. Can Fam Physician. 2006, 52 (12): 1570-1571.PubMedPubMedCentral
56.
McAlearney AS, Chisolm DJ, Schweikhart S, Medow MA, Kelleher K: The story behind the story: physician skepticism about relying on clinical information technologies to reduce medical errors. Int J Med Inform. 2007, 76 (11-12): 836-842. 10.1016/j.ijmedinf.2006.09.021.CrossRefPubMed
57.
58.
Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A, 'Psychological Theory' Group: Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005, 14 (1): 26-33. 10.1136/qshc.2004.011155.CrossRefPubMedPubMedCentral
59.
Sandelowski M: Combining qualitative and quantitative sampling, data collection, and analysis techniques in mixed-method studies. Res Nurs Health. 2000, 23 (3): 246-255. 10.1002/1098-240X(200006)23:3<246::AID-NUR9>3.0.CO;2-H.CrossRefPubMed
60.
Doroodchi H, Abdolrasulnia M, Foster JA, Foster E, Turakhia MP, Skelding KA, Sagar K, Casebeer LL: Knowledge and attitudes of primary care physicians in the management of patients at risk for cardiovascular events. BMC Fam Pract. 2008, 9: 42-10.1186/1471-2296-9-42.CrossRefPubMedPubMedCentral
61.
Berthold HK, Gouni-Berthold I, Bestehorn KP, Bohm M, Krone W: Physician gender is associated with the quality of type 2 diabetes care. J Intern Med. 2008, 264 (4): 340-50. 10.1111/j.1365-2796.2008.01967.x.CrossRefPubMed
62.
Kuzel AJ: Sampling in Qualitative Inquiry. Doing Qualitative Research. Research Methods for Primary Care. Edited by: Crabtree B, Miller W. 1992, California: Sage Publications, 3: 41.
63.
Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analyzing qualitative data. Edited by: Bryman A, Burgess RG. 1994, London: Routledge, 173-194. full_text.CrossRef
64.
65.
Jones NE, Suurdt J, Ouelette-Kuntz H, Heyland DK: Implementation of the Canadian Clinical Practice Guidelines for Nutrition Support: a multiple case study of barriers and enablers. Nutr Clin Pract. 2007, 22 (4): 449-457. 10.1177/0115426507022004449.CrossRefPubMed
66.
Wolf ZR: Exploring the audit trail for qualitative investigations. Nurse Educ. 2003, 28 (4): 175-178. 10.1097/00006223-200307000-00008.CrossRefPubMed
67.
Barbour RS: Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?. BMJ. 2001, 322 (7294): 1115-1117. 10.1136/bmj.322.7294.1115.CrossRefPubMedPubMedCentral
68.
Kuper A, Lingard L, Levinson W: Critically appraising qualitative research. BMJ. 2008, 337: a1035-10.1136/bmj.a1035.CrossRefPubMed
69.
van der Veer SN, de Keizer NF, Ravelli AC, Tenkink S, Jager KJ: Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010, 79 (5): 305-323. 10.1016/j.ijmedinf.2010.01.011.CrossRefPubMed
70.
Thiru K, Hassey A, Sullivan F: Systematic review of scope and quality of electronic patient record data in primary care. BMJ. 2003, 326 (7398): 1070-10.1136/bmj.326.7398.1070.CrossRefPubMedPubMedCentral
Metadata
Title
Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care
Authors
Noah M Ivers
Karen Tu
Jill Francis
Jan Barnsley
Baiju Shah
Ross Upshur
Alex Kiss
Jeremy M Grimshaw
Merrick Zwarenstein
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2010
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-5-98

Other articles of this Issue 1/2010

Implementation Science 1/2010 Go to the issue

Research article

Statistical considerations in a systematic review of proxy measures of clinical behaviour

Research article

Determinants of the intention of elementary school nurses to adopt a redefined role in health promotion at school

Research article

Using intervention mapping to develop and adapt a secondary stroke prevention program in Veterans Health Administration medical centers

Research article

A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations

Study protocol

Multi-level analysis of electronic health record adoption by health care professionals: A study protocol

Systematic Review

A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework