Skip to main content
Top
Published in: Implementation Science 1/2012

Open Access 01-12-2012 | Study protocol

Improving quality of care through improved audit and feedback

Authors: Sylvia J Hysong, Cayla R Teal, Myrna J Khan, Paul Haidet

Published in: Implementation Science | Issue 1/2012

Login to get access

Abstract

Background

The Department of Veterans Affairs (VA) has led the industry in measuring facility performance as a critical element in improving quality of care, investing substantial resources to develop and maintain valid and cost-effective measures. The External Peer Review Program (EPRP) of the VA is the official data source for monitoring facility performance, used to prioritize the quality areas needing most attention. Facility performance measurement has significantly improved preventive and chronic care, as well as overall quality; however, much variability still exists in levels of performance across measures and facilities. Audit and feedback (A&F), an important component of effective performance measurement, can help reduce this variability and improve overall performance. Previous research suggests that VA Medical Centers (VAMCs) with high EPRP performance scores tend to use EPRP data as a feedback source. However, the manner in which EPRP data are used as a feedback source by individual providers as well as service line, facility, and network leadership is not well understood. An in-depth understanding of mental models, strategies, and specific feedback process characteristics adopted by high-performing facilities is thus urgently needed.
This research compares how leaders of high, low, and moderately performing VAMCs use clinical performance data from the EPRP as a feedback tool to maintain and improve quality of care.

Methods

We will conduct a qualitative, grounded theory analysis of up to 64 interviews using a novel method of sampling primary care, facility, and Veterans Integrated Service Network (VISN) leadership at high-, moderate-, and low-performing facilities. We will analyze interviews for evidence of cross-facility differences in perceptions of performance data usefulness and strategies for disseminating performance data evaluating performance, with particular attention to timeliness, individualization, and punitiveness of feedback delivery.

Discussion

Most research examining feedback to improve provider and facility performance lacks a detailed understanding of the elements of effective feedback. This research will highlight the elements most commonly used at high-performing facilities and identify additional features of their successful feedback strategies not previously identified. Armed with this information, practices can implement more effective A&F interventions to improve quality of care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Committee on Quality of Health Care in America: Crossing the quality chasm: a new health care system for the 21st century. 2001, National Academies Press, Washington Committee on Quality of Health Care in America: Crossing the quality chasm: a new health care system for the 21st century. 2001, National Academies Press, Washington
2.
go back to reference Committee on Quality of Health Care in America: Performance Measurement: Accelerating Improvement. 2006, National Academies Press, Washington DC Committee on Quality of Health Care in America: Performance Measurement: Accelerating Improvement. 2006, National Academies Press, Washington DC
3.
go back to reference Committee on Quality of Health Care in America: Rewarding Provider Performance: Aligning Incentives in Medicare. 2006, National Academies Press, Washington DC Committee on Quality of Health Care in America: Rewarding Provider Performance: Aligning Incentives in Medicare. 2006, National Academies Press, Washington DC
4.
go back to reference RAND Corporation: Quality Assessment Tools from RAND Health. Author . 2000. 6-29-2006. Ref Type: Electronic Citation RAND Corporation: Quality Assessment Tools from RAND Health. Author . 2000. 6-29-2006. Ref Type: Electronic Citation
5.
go back to reference Department of Veterans Affairs: Quality Assurance External Peer Review Program (EPRP). VHA Directive 2000–030 9-25-2000. 9-27-2006. Ref Type: Electronic Citation Department of Veterans Affairs: Quality Assurance External Peer Review Program (EPRP). VHA Directive 2000–030 9-25-2000. 9-27-2006. Ref Type: Electronic Citation
6.
go back to reference Asch SM, McGlynn EA, Hogan MM, Hayward RA, Shekelle P, Rubenstein L: Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample.[summary for patients in Ann Intern Med. 2004 Dec 21;141(12):I42; PMID: 15611486]. Ann Intern Med. 2004, 141: 938-945.CrossRefPubMed Asch SM, McGlynn EA, Hogan MM, Hayward RA, Shekelle P, Rubenstein L: Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample.[summary for patients in Ann Intern Med. 2004 Dec 21;141(12):I42; PMID: 15611486]. Ann Intern Med. 2004, 141: 938-945.CrossRefPubMed
7.
go back to reference Kerr EA, Asch S, Hamilton EG, McGlynn EA: Quality of Care for General Medical Conditions: A Review of the Literature and Quality Indicators. Quality of Care for General Medical Conditions: A Review of the Literature and Quality Indicators. Edited by: Kerr EA, Asch SM, Hamilton EG, McGlynn EA. 2000, RAND Corporation, , RAND Corporation. 9-27-2006. Ref Type: Electronic Citation. URL: http://www.rand.org/pubs/monograph_reports/MR1280/index.html Kerr EA, Asch S, Hamilton EG, McGlynn EA: Quality of Care for General Medical Conditions: A Review of the Literature and Quality Indicators. Quality of Care for General Medical Conditions: A Review of the Literature and Quality Indicators. Edited by: Kerr EA, Asch SM, Hamilton EG, McGlynn EA. 2000, RAND Corporation, , RAND Corporation. 9-27-2006. Ref Type: Electronic Citation. URL: http://​www.​rand.​org/​pubs/​monograph_​reports/​MR1280/​index.​html
8.
go back to reference Hysong SJ, Khan M, Petersen LA: Passive monitoring versus active assessment of clinical performance: impact on measured quality of care. Medical Care. 2011, 49: 883-890. 10.1097/MLR.0b013e318222a36c.CrossRefPubMed Hysong SJ, Khan M, Petersen LA: Passive monitoring versus active assessment of clinical performance: impact on measured quality of care. Medical Care. 2011, 49: 883-890. 10.1097/MLR.0b013e318222a36c.CrossRefPubMed
9.
go back to reference Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, CD000259-10.1002/14651858. 2 Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, CD000259-10.1002/14651858. 2
10.
go back to reference Hysong SJ: Meta-analysis: audit & feedback features impact effectiveness on care quality. Medical Care. 2009, 47: 356-363. 10.1097/MLR.0b013e3181893f6b.CrossRefPubMedPubMedCentral Hysong SJ: Meta-analysis: audit & feedback features impact effectiveness on care quality. Medical Care. 2009, 47: 356-363. 10.1097/MLR.0b013e3181893f6b.CrossRefPubMedPubMedCentral
11.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment (Winchester, England). 2004, 8: iii-iiv. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment (Winchester, England). 2004, 8: iii-iiv.
12.
go back to reference Meterko M, Young GJ, White B, Bokhour BG, Burgess JF, Berlowitz D: Provider attitudes toward pay-for-performance programs: development and validation of a measurement instrument. Health Serv Res. 2006, 41: 1959-1978. 10.1111/j.1475-6773.2006.00582.x.CrossRefPubMedPubMedCentral Meterko M, Young GJ, White B, Bokhour BG, Burgess JF, Berlowitz D: Provider attitudes toward pay-for-performance programs: development and validation of a measurement instrument. Health Serv Res. 2006, 41: 1959-1978. 10.1111/j.1475-6773.2006.00582.x.CrossRefPubMedPubMedCentral
13.
go back to reference Petersen LA, Woodard LD, Urech T, Daw C, Sookanan S: Does pay-for-performance improve the quality of health care?. Ann Intern Med. 2006, 145: 265-272.CrossRefPubMed Petersen LA, Woodard LD, Urech T, Daw C, Sookanan S: Does pay-for-performance improve the quality of health care?. Ann Intern Med. 2006, 145: 265-272.CrossRefPubMed
14.
go back to reference Davis DA, Mazmanian PE, Fordis M, Van HR, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296: 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed Davis DA, Mazmanian PE, Fordis M, Van HR, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. JAMA. 2006, 296: 1094-1102. 10.1001/jama.296.9.1094.CrossRefPubMed
15.
go back to reference Hysong SJ, Best RG, Pugh JA: Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implement Sci. 2006, 1 (9): 5-3-2006. Ref Type: Electronic Citation Hysong SJ, Best RG, Pugh JA: Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implement Sci. 2006, 1 (9): 5-3-2006. Ref Type: Electronic Citation
16.
go back to reference Hysong SJ, Pugh JA, Best RG: Clinical practice guideline implementation patterns in VHA outpatient clinics. Health Serv Res. 2007, 42: 84-103. 10.1111/j.1475-6773.2006.00610.x.CrossRefPubMedPubMedCentral Hysong SJ, Pugh JA, Best RG: Clinical practice guideline implementation patterns in VHA outpatient clinics. Health Serv Res. 2007, 42: 84-103. 10.1111/j.1475-6773.2006.00610.x.CrossRefPubMedPubMedCentral
17.
go back to reference Hysong SJ, Best RG, Pugh JA, Moore FI: Not of one mind: mental models of clinical practice guidelines in the VA. Health Serv Res. 2005, 40: 823-842.CrossRef Hysong SJ, Best RG, Pugh JA, Moore FI: Not of one mind: mental models of clinical practice guidelines in the VA. Health Serv Res. 2005, 40: 823-842.CrossRef
18.
go back to reference Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005, 5: 50-10.1186/1472-6963-5-50.CrossRefPubMedPubMedCentral Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R: What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005, 5: 50-10.1186/1472-6963-5-50.CrossRefPubMedPubMedCentral
19.
go back to reference Rogers EM: Diffusion of Innovations. 1995, Free Press, New York, 4 Rogers EM: Diffusion of Innovations. 1995, Free Press, New York, 4
20.
go back to reference Pinder CC: Valence-Instrumentality-Expectancy Theory. Motivation and work behavior. Edited by: Porter RMSL. 1977, McGraw-Hill, New York, 144-164. Pinder CC: Valence-Instrumentality-Expectancy Theory. Motivation and work behavior. Edited by: Porter RMSL. 1977, McGraw-Hill, New York, 144-164.
21.
go back to reference Locke EA, Latham GP: Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. Am Psychol. 2002, 57: 705-717.CrossRefPubMed Locke EA, Latham GP: Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. Am Psychol. 2002, 57: 705-717.CrossRefPubMed
22.
go back to reference Ramsey SD, Cheadle AD, Neighbor WE, Gore E, Temple P, Staiger T: Relative impact of patient and clinic factors on adherence to primary care preventive service guidelines: an exploratory study. Med Care. 2001, 39: 979-989. 10.1097/00005650-200109000-00008.CrossRefPubMed Ramsey SD, Cheadle AD, Neighbor WE, Gore E, Temple P, Staiger T: Relative impact of patient and clinic factors on adherence to primary care preventive service guidelines: an exploratory study. Med Care. 2001, 39: 979-989. 10.1097/00005650-200109000-00008.CrossRefPubMed
23.
go back to reference Sternthal B, Dholakia R, Leavitt C: The persuasive effect of source credibility: tests of cognitive response. J Consum Res. 1978, 4: 252-260. 10.1086/208704.CrossRef Sternthal B, Dholakia R, Leavitt C: The persuasive effect of source credibility: tests of cognitive response. J Consum Res. 1978, 4: 252-260. 10.1086/208704.CrossRef
24.
25.
go back to reference Vancouver JB, Tischner EC: The effect of feedback sign on task performance depends on self-concept discrepancies. J Appl Psychol. 2004, 89: 1092-1098.CrossRefPubMed Vancouver JB, Tischner EC: The effect of feedback sign on task performance depends on self-concept discrepancies. J Appl Psychol. 2004, 89: 1092-1098.CrossRefPubMed
26.
go back to reference Kluger AN, DeNisi A: The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996, 119: 254-284.CrossRef Kluger AN, DeNisi A: The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull. 1996, 119: 254-284.CrossRef
27.
go back to reference Ta S, Goldzweig C, Juzba M, Lee M, Wenger N, Yano EM: Addressing physician concerns about performance profiling: experience with a local veterans affairs quality evaluation program. Am J Med Qual. 2009, 24: 123-131.CrossRefPubMed Ta S, Goldzweig C, Juzba M, Lee M, Wenger N, Yano EM: Addressing physician concerns about performance profiling: experience with a local veterans affairs quality evaluation program. Am J Med Qual. 2009, 24: 123-131.CrossRefPubMed
28.
go back to reference Weeks WB, Yano EM, Rubenstein LV: Primary care practice management in rural and urban Veterans Health Administration settings. J Rural Heal. 2002, 18: 298-303. 10.1111/j.1748-0361.2002.tb00890.x.CrossRef Weeks WB, Yano EM, Rubenstein LV: Primary care practice management in rural and urban Veterans Health Administration settings. J Rural Heal. 2002, 18: 298-303. 10.1111/j.1748-0361.2002.tb00890.x.CrossRef
31.
go back to reference Jha AK, Perlin JB, Kizer KW, Dudley RA: Effect of the transformation of the Veterans Affairs health care system on the quality of care. New England Journal Of Medicine. 2003, 348: 2218-2227. 10.1056/NEJMsa021899.CrossRefPubMed Jha AK, Perlin JB, Kizer KW, Dudley RA: Effect of the transformation of the Veterans Affairs health care system on the quality of care. New England Journal Of Medicine. 2003, 348: 2218-2227. 10.1056/NEJMsa021899.CrossRefPubMed
32.
go back to reference Byrne MM, Daw CN, Nelson HA, Urech TH, Pietz K, Petersen LA: Method to develop health care peer groups for quality and financial comparisons across hospitals. Health Serv Res. 2009, 44: 577-592. 10.1111/j.1475-6773.2008.00916.x.CrossRefPubMedPubMedCentral Byrne MM, Daw CN, Nelson HA, Urech TH, Pietz K, Petersen LA: Method to develop health care peer groups for quality and financial comparisons across hospitals. Health Serv Res. 2009, 44: 577-592. 10.1111/j.1475-6773.2008.00916.x.CrossRefPubMedPubMedCentral
33.
go back to reference Salas E, Cannon-Bowers JA: Methods, tools, and strategies for team training. Training for a Rapidly Changing Workplace: Applications of Psychological Research. Edited by: Quiñones MA, Ehrenstein A. 1997, American Psychological Association, Washington, 249-279.CrossRef Salas E, Cannon-Bowers JA: Methods, tools, and strategies for team training. Training for a Rapidly Changing Workplace: Applications of Psychological Research. Edited by: Quiñones MA, Ehrenstein A. 1997, American Psychological Association, Washington, 249-279.CrossRef
34.
go back to reference Strauss AL, Corbin J: Basics of qualitative research : techniques and procedures for developing grounded theory. 1998, Sage Publications, Thousand Oaks, 2 Strauss AL, Corbin J: Basics of qualitative research : techniques and procedures for developing grounded theory. 1998, Sage Publications, Thousand Oaks, 2
36.
go back to reference Muhr T: User’s Manual for ATLAS.ti 5.0. [5]. 2004, ATLAS.ti Scientific Software Development GmbH, Berlin, Ref Type: Computer Program Muhr T: User’s Manual for ATLAS.ti 5.0. [5]. 2004, ATLAS.ti Scientific Software Development GmbH, Berlin, Ref Type: Computer Program
Metadata
Title
Improving quality of care through improved audit and feedback
Authors
Sylvia J Hysong
Cayla R Teal
Myrna J Khan
Paul Haidet
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2012
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-7-45

Other articles of this Issue 1/2012

Implementation Science 1/2012 Go to the issue