Skip to main content
Top
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Research

Understanding feedback report uptake: process evaluation findings from a 13-month feedback intervention in long-term care settings

Authors: Anne E Sales, Kimberly Fraser, Melba Andrea B Baylon, Hannah M O’Rourke, Gloria Gao, Tracey Bucknall, Suzanne Maisey

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Long-term care settings provide care to a large proportion of predominantly older, highly disabled adults across the United States and Canada. Managing and improving quality of care is challenging, in part because staffing is highly dependent on relatively non-professional health care aides and resources are limited. Feedback interventions in these settings are relatively rare, and there has been little published information about the process of feedback intervention. Our objectives were to describe the key components of uptake of the feedback reports, as well as other indicators of participant response to the intervention.

Methods

We conducted this project in nine long-term care units in four facilities in Edmonton, Canada. We used mixed methods, including observations during a 13-month feedback report intervention with nine post-feedback survey cycles, to conduct a process evaluation of a feedback report intervention in these units. We included all facility-based direct care providers (staff) in the feedback report distribution and survey administration. We conducted descriptive analyses of the data from observations and surveys, presenting this in tabular and graphic form. We constructed a short scale to measure uptake of the feedback reports. Our analysis evaluated feedback report uptake by provider type over the 13 months of the intervention.

Results

We received a total of 1,080 survey responses over the period of the intervention, which varied by type of provider, facility, and survey month. Total number of reports distributed ranged from 103 in cycle 12 to 229 in cycle 3, although the method of delivery varied widely across the period, from 12% to 65% delivered directly to individuals and 15% to 84% left for later distribution. The key elements of feedback uptake, including receiving, reading, understanding, discussing, and reporting a perception that the reports were useful, varied by survey cycle and provider type, as well as by facility. Uptake, as we measured it, was consistently high overall, but varied widely by provider type and time period.

Conclusions

We report detailed process data describing the aspects of uptake of a feedback report during an intensive, longitudinal feedback intervention in long-term care facilities. Uptake is a complex process for which we used multiple measures. We demonstrate the feasibility of conducting a complex longitudinal feedback intervention in relatively resource-poor long-term care facilities to a wider range of provider types than have been included in prior feedback interventions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bostick JE, Rantz MJ, Flesner MK, Riggs CJ. Systematic review of studies of staffing and quality in nursing homes. J Am Med Dir Assoc. 2006;7(6):366–76.PubMed Bostick JE, Rantz MJ, Flesner MK, Riggs CJ. Systematic review of studies of staffing and quality in nursing homes. J Am Med Dir Assoc. 2006;7(6):366–76.PubMed
2.
go back to reference Sales AE, Bostrom AM, Bucknall T, Draper K, Fraser K, Schalm C, et al. The use of data for process and quality improvement in long term care and home care: a systematic review of the literature. J Am Med Dir Assoc. 2012;13(2):103–13.PubMed Sales AE, Bostrom AM, Bucknall T, Draper K, Fraser K, Schalm C, et al. The use of data for process and quality improvement in long term care and home care: a systematic review of the literature. J Am Med Dir Assoc. 2012;13(2):103–13.PubMed
3.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.PubMed Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6:CD000259.PubMed
4.
go back to reference Grando VT, Rantz MJ, Maas M. Nursing home staff’s views on quality improvement interventions: a follow-up study. J Gerontol Nurs. 2007;33(1):40–7.PubMed Grando VT, Rantz MJ, Maas M. Nursing home staff’s views on quality improvement interventions: a follow-up study. J Gerontol Nurs. 2007;33(1):40–7.PubMed
5.
go back to reference Rantz MJ, Popejoy L, Petroski GF, Madsen RW, Mehr DR, Zwygart-Stauffacher M, et al. Randomized clinical trial of a quality improvement intervention in nursing homes. Gerontologist. 2001;41(4):525–38.PubMed Rantz MJ, Popejoy L, Petroski GF, Madsen RW, Mehr DR, Zwygart-Stauffacher M, et al. Randomized clinical trial of a quality improvement intervention in nursing homes. Gerontologist. 2001;41(4):525–38.PubMed
6.
go back to reference Sales AE, Schalm C, Baylon M, Fraser KD. Data for improvement and clinical excellence: report of an interrupted time series trial of feedback in long-term care. Implement Sci. 2014;9(1):161.PubMedPubMedCentral Sales AE, Schalm C, Baylon M, Fraser KD. Data for improvement and clinical excellence: report of an interrupted time series trial of feedback in long-term care. Implement Sci. 2014;9(1):161.PubMedPubMedCentral
7.
go back to reference Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, et al. Do self-reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28.PubMedPubMedCentral Eccles MP, Hrisos S, Francis J, Kaner EF, Dickinson HO, Beyer F, et al. Do self-reported intentions predict clinicians’ behaviour: a systematic review. Implement Sci. 2006;1:28.PubMedPubMedCentral
8.
go back to reference Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.PubMedPubMedCentral Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3:36.PubMedPubMedCentral
9.
go back to reference Rousseau N, McColl E, Newton J, Grimshaw J, Eccles M. Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ. 2003;326(7384):314.PubMedPubMedCentral Rousseau N, McColl E, Newton J, Grimshaw J, Eccles M. Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ. 2003;326(7384):314.PubMedPubMedCentral
10.
go back to reference Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12(1):40–6.PubMedPubMedCentral Hulscher ME, Laurant MG, Grol RP. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12(1):40–6.PubMedPubMedCentral
11.
go back to reference Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21 Suppl 2:S1–8.PubMedPubMedCentral Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21 Suppl 2:S1–8.PubMedPubMedCentral
12.
go back to reference Sales A, Helfrich C, Ho PM, Hedeen A, Plomondon ME, Li YF, et al. Implementing electronic clinical reminders for lipid management in patients with ischemic heart disease in the Veterans Health Administration: QUERI Series. Implement Sci. 2008;3:28.PubMedPubMedCentral Sales A, Helfrich C, Ho PM, Hedeen A, Plomondon ME, Li YF, et al. Implementing electronic clinical reminders for lipid management in patients with ischemic heart disease in the Veterans Health Administration: QUERI Series. Implement Sci. 2008;3:28.PubMedPubMedCentral
13.
go back to reference Hagedorn H, Hogan M, Smith JL, Bowman C, Curran GM, Espadas D, et al. Lessons learned about implementing research evidence into clinical practice. Experiences from VA QUERI. J Gen Intern Med. 2006;21 Suppl 2:S21–4.PubMedPubMedCentral Hagedorn H, Hogan M, Smith JL, Bowman C, Curran GM, Espadas D, et al. Lessons learned about implementing research evidence into clinical practice. Experiences from VA QUERI. J Gen Intern Med. 2006;21 Suppl 2:S21–4.PubMedPubMedCentral
14.
go back to reference Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.
15.
go back to reference Sales AE, Schalm C. Data for improvement and clinical excellence: protocol for an audit with feedback intervention in long-term care. Implement Sci. 2010;5:74.PubMedPubMedCentral Sales AE, Schalm C. Data for improvement and clinical excellence: protocol for an audit with feedback intervention in long-term care. Implement Sci. 2010;5:74.PubMedPubMedCentral
16.
go back to reference Sales AE, Estabrooks CA, Valente TW. The impact of social networks on knowledge transfer in long-term care facilities: protocol for a study. Implement Sci. 2010;5:49.PubMedPubMedCentral Sales AE, Estabrooks CA, Valente TW. The impact of social networks on knowledge transfer in long-term care facilities: protocol for a study. Implement Sci. 2010;5:49.PubMedPubMedCentral
17.
go back to reference Francis JJ, Eccles MP, Johnston M, Walker A, Grimshaw J, Foy R. Constructing questionnaires based on the theory of planned behaviour: a manual for health services researchers. 2004. Francis JJ, Eccles MP, Johnston M, Walker A, Grimshaw J, Foy R. Constructing questionnaires based on the theory of planned behaviour: a manual for health services researchers. 2004.
18.
go back to reference Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R. What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005;5:50.PubMedPubMedCentral Foy R, Eccles MP, Jamtvedt G, Young J, Grimshaw JM, Baker R. What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review. BMC Health Serv Res. 2005;5:50.PubMedPubMedCentral
19.
go back to reference Michie S, Abraham C. Advancing the science of behaviour change: a plea for scientific reporting. Addiction. 2008;103(9):1409–10.PubMed Michie S, Abraham C. Advancing the science of behaviour change: a plea for scientific reporting. Addiction. 2008;103(9):1409–10.PubMed
20.
go back to reference Tavender EJ, Bosch M, Gruen RL, Green SE, Knott J, Francis JJ, et al. Understanding practice: the factors that influence management of mild traumatic brain injury in the emergency department—a qualitative study using the Theoretical Domains Framework. Implement Sci. 2014;9:8.PubMedPubMedCentral Tavender EJ, Bosch M, Gruen RL, Green SE, Knott J, Francis JJ, et al. Understanding practice: the factors that influence management of mild traumatic brain injury in the emergency department—a qualitative study using the Theoretical Domains Framework. Implement Sci. 2014;9:8.PubMedPubMedCentral
21.
go back to reference Jamtvedt G, Young JM, Kristofferson DT, O’Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2006, 2(2). Jamtvedt G, Young JM, Kristofferson DT, O’Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2006, 2(2).
22.
go back to reference Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009;47(3):356–63.PubMedPubMedCentral Hysong SJ. Meta-analysis: audit and feedback features impact effectiveness on care quality. Med Care. 2009;47(3):356–63.PubMedPubMedCentral
23.
go back to reference Sales AE, Sharp ND, Li YF, Greiner GT, Lowy E, Mitchell P, et al. Nurse staffing and patient outcomes in Veterans Affairs hospitals. J Nurs Adm. 2005;35(10):459–66.PubMed Sales AE, Sharp ND, Li YF, Greiner GT, Lowy E, Mitchell P, et al. Nurse staffing and patient outcomes in Veterans Affairs hospitals. J Nurs Adm. 2005;35(10):459–66.PubMed
24.
go back to reference Kluger AN, Van Dijk D. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010;44(12):1166–74.PubMed Kluger AN, Van Dijk D. Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010;44(12):1166–74.PubMed
25.
go back to reference DeNisi AS, Kluger AN. Feedback effectiveness: can 360-degree appraisals be improved? Acad Manag Exec. 2000;14(1):129–38. DeNisi AS, Kluger AN. Feedback effectiveness: can 360-degree appraisals be improved? Acad Manag Exec. 2000;14(1):129–38.
26.
go back to reference Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:9–14. 14-5908. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9:9–14. 14-5908.
27.
go back to reference Cott C. “We decide, you carry it out”: a social network analysis of multidisciplinary long-term care teams. Soc Sci Med. 1997;45(9):1411–21.PubMed Cott C. “We decide, you carry it out”: a social network analysis of multidisciplinary long-term care teams. Soc Sci Med. 1997;45(9):1411–21.PubMed
28.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80. Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.
29.
go back to reference Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care. 2006;15(6):433–6.PubMedPubMedCentral Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD. Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback. Qual Saf Health Care. 2006;15(6):433–6.PubMedPubMedCentral
Metadata
Title
Understanding feedback report uptake: process evaluation findings from a 13-month feedback intervention in long-term care settings
Authors
Anne E Sales
Kimberly Fraser
Melba Andrea B Baylon
Hannah M O’Rourke
Gloria Gao
Tracey Bucknall
Suzanne Maisey
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-015-0208-2

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue