Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Data for improvement and clinical excellence: report of an interrupted time series trial of feedback in long-term care

Authors: Anne E Sales, Corinne Schalm, Melba Andrea B Baylon, Kimberly D Fraser

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

There is considerable evidence about the effectiveness of audit coupled with feedback for provider behavior change, although few feedback interventions have been conducted in long-term care settings. The primary purpose of the Data for Improvement and Clinical Excellence-Long-Term Care (DICE-LTC) project was to assess the effects of a feedback intervention delivered to all direct care providers on resident outcomes. Our objective in this report is to assess the effect of feedback reporting on rates of pain assessment, depression screening, and falls over time.

Methods

The intervention consisted of monthly feedback reports delivered to all direct care providers, facility and unit administrators, and support staff, delivered over 13 months in nine LTC units across four facilities. Data for feedback reports came from the Resident Assessment Instrument Minimum Data Set (RAI) version 2.0, a standardized instrument mandated in LTC facilities throughout Alberta. The primary evaluation used an interrupted time series design with a comparison group (units not included in the feedback intervention) and a comparison condition (pressure ulcers). We used segmented regression analysis to assess the effect of the feedback intervention.

Results

The primary outcome of the study, falls, showed little change over the period of the intervention, except for a small increase in the rate of falls during the intervention period. The only outcome that improved during the intervention period was the proportion of residents with high pain scores, which decreased at the beginning of the intervention. The proportion of residents with high depression scores appeared to worsen during the intervention.

Conclusions

Maintaining all nine units in the study for its 13-month duration was a positive outcome. The feedback reports, without any other intervention included, did not achieve the desired reduction in proportion of falls and elevated depression scores. The survey on intention to change pain assessment practice which was conducted shortly after most of the feedback distribution cycles may have acted as a co-intervention supporting a reduction in pain scores. The processing and delivery of feedback reports could be accomplished at relatively low cost because the data are mandated and could be added to other intervention approaches to support implementation of evidence-based practices.
Appendix
Available only for authorised users
Literature
1.
go back to reference Getting on with Better Health Care. 2005, Alberta Health and Wellness, Edmonton Getting on with Better Health Care. 2005, Alberta Health and Wellness, Edmonton
2.
go back to reference Duffy A: The assessment and management of falls in residential care settings. Br J Nurs. 2013, 22 (5): 259-263. 10.12968/bjon.2013.22.5.259.CrossRefPubMed Duffy A: The assessment and management of falls in residential care settings. Br J Nurs. 2013, 22 (5): 259-263. 10.12968/bjon.2013.22.5.259.CrossRefPubMed
3.
go back to reference Farless LB, Ritchie CS: Challenges of pain management in long-term care. Ann Longterm Care. 2012, 20 (5): 32-38. Farless LB, Ritchie CS: Challenges of pain management in long-term care. Ann Longterm Care. 2012, 20 (5): 32-38.
4.
go back to reference MacLaurin A, McConnell H: Utilizing quality improvement methods to prevent falls and injury from falls: enhancing resident safety in long-term care. J Saf Res. 2011, 42 (6): 525-535. 10.1016/j.jsr.2011.10.005.CrossRef MacLaurin A, McConnell H: Utilizing quality improvement methods to prevent falls and injury from falls: enhancing resident safety in long-term care. J Saf Res. 2011, 42 (6): 525-535. 10.1016/j.jsr.2011.10.005.CrossRef
5.
go back to reference Gordon AL, Logan PA, Jones RG, Forrester-Paton C, Mamo JP, Gladman JRF: A systematic mapping review of randomized controlled trials (RCTs) in care homes. BMC Geriatr. 2012, 12: 31-10.1186/1471-2318-12-31.CrossRefPubMedPubMedCentral Gordon AL, Logan PA, Jones RG, Forrester-Paton C, Mamo JP, Gladman JRF: A systematic mapping review of randomized controlled trials (RCTs) in care homes. BMC Geriatr. 2012, 12: 31-10.1186/1471-2318-12-31.CrossRefPubMedPubMedCentral
6.
go back to reference Sales AE, Bostrom AM, Bucknall T, Draper K, Fraser K, Schalm C, Warren S: The use of data for process and quality improvement in long term care and home care: a systematic review of the literature. J Am Med Dir Assoc. 2012, 13 (2): 103-113. 10.1016/j.jamda.2011.01.004.CrossRefPubMed Sales AE, Bostrom AM, Bucknall T, Draper K, Fraser K, Schalm C, Warren S: The use of data for process and quality improvement in long term care and home care: a systematic review of the literature. J Am Med Dir Assoc. 2012, 13 (2): 103-113. 10.1016/j.jamda.2011.01.004.CrossRefPubMed
7.
go back to reference Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39 (8 Suppl 2): 2-45. Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39 (8 Suppl 2): 2-45.
8.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. iii-ivCrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72. iii-ivCrossRef
9.
go back to reference Grimshaw J, Eccles M, Tetroe J: Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004, 24 (Suppl 1): S31-7. 10.1002/chp.1340240506.CrossRefPubMed Grimshaw J, Eccles M, Tetroe J: Implementing clinical guidelines: current evidence and future implications. J Contin Educ Health Prof. 2004, 24 (Suppl 1): S31-7. 10.1002/chp.1340240506.CrossRefPubMed
10.
go back to reference Shojania KG, Grimshaw J: Still no magic bullets: pursuing more rigorous research in quality improvement. Am J Med. 2004, 116 (11): 778-780. 10.1016/j.amjmed.2004.03.003.CrossRefPubMed Shojania KG, Grimshaw J: Still no magic bullets: pursuing more rigorous research in quality improvement. Am J Med. 2004, 116 (11): 778-780. 10.1016/j.amjmed.2004.03.003.CrossRefPubMed
11.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 6: Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD: Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 6:
12.
go back to reference Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2 (2): Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2 (2):
13.
go back to reference Rantz MJ, Popejoy L, Petroski GF, Madsen RW, Mehr DR, Zwygart-Stauffacher M, Hicks LL, Grando V, Wipke-Tevis DD, Bostick J, Porter R, Conn VS, Maas M: Randomized clinical trial of a quality improvement intervention in nursing homes. Gerontologist. 2001, 41 (4): 525-538. 10.1093/geront/41.4.525.CrossRefPubMed Rantz MJ, Popejoy L, Petroski GF, Madsen RW, Mehr DR, Zwygart-Stauffacher M, Hicks LL, Grando V, Wipke-Tevis DD, Bostick J, Porter R, Conn VS, Maas M: Randomized clinical trial of a quality improvement intervention in nursing homes. Gerontologist. 2001, 41 (4): 525-538. 10.1093/geront/41.4.525.CrossRefPubMed
14.
go back to reference Hirdes JP: Addressing the health needs of frail elderly people: Ontario's experience with an integrated health information system. Age Ageing. 2006, 35 (4): 329-331. 10.1093/ageing/afl036.CrossRefPubMed Hirdes JP: Addressing the health needs of frail elderly people: Ontario's experience with an integrated health information system. Age Ageing. 2006, 35 (4): 329-331. 10.1093/ageing/afl036.CrossRefPubMed
17.
go back to reference Carpenter GI, Hirdes JP, Ribbe MW, Ikegami N, Challis D, Steel K, Bernabei R, Fries B: Targeting and quality of nursing home care. A five-nation study. Aging (Milano). 1999, 11 (2): 83-89. Carpenter GI, Hirdes JP, Ribbe MW, Ikegami N, Challis D, Steel K, Bernabei R, Fries B: Targeting and quality of nursing home care. A five-nation study. Aging (Milano). 1999, 11 (2): 83-89.
18.
go back to reference Kluger AN, DeNisi A: Feedback interventions: toward the understanding of a double-edged sword. Curr Dir Psychol Sci. 1998, 7 (3): 67-72. 10.1111/1467-8721.ep10772989.CrossRef Kluger AN, DeNisi A: Feedback interventions: toward the understanding of a double-edged sword. Curr Dir Psychol Sci. 1998, 7 (3): 67-72. 10.1111/1467-8721.ep10772989.CrossRef
19.
go back to reference Kluger AN, Van Dijk D: Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010, 44 (12): 1166-1174. 10.1111/j.1365-2923.2010.03849.x.CrossRefPubMed Kluger AN, Van Dijk D: Feedback, the various tasks of the doctor, and the feedforward alternative. Med Educ. 2010, 44 (12): 1166-1174. 10.1111/j.1365-2923.2010.03849.x.CrossRefPubMed
20.
go back to reference Gardner B, Whittington C, McAteer J, Eccles MP, Michie S: Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback. Soc Sci Med. 2010, 70 (10): 1618-1625. 10.1016/j.socscimed.2010.01.039.CrossRefPubMed Gardner B, Whittington C, McAteer J, Eccles MP, Michie S: Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback. Soc Sci Med. 2010, 70 (10): 1618-1625. 10.1016/j.socscimed.2010.01.039.CrossRefPubMed
21.
go back to reference Slamet D: Business case for RAI 2.0 implementation: a jurisdictional review of outcomes observed from RAI v2.0 implementation. 2005, Fraser Health Region, Vancouver, B.C Slamet D: Business case for RAI 2.0 implementation: a jurisdictional review of outcomes observed from RAI v2.0 implementation. 2005, Fraser Health Region, Vancouver, B.C
22.
go back to reference Sales AE, Schalm C: Data for improvement and clinical excellence: protocol for an audit with feedback intervention in long-term care. Implement Sci. 2010, 5: 74-10.1186/1748-5908-5-74.CrossRefPubMedPubMedCentral Sales AE, Schalm C: Data for improvement and clinical excellence: protocol for an audit with feedback intervention in long-term care. Implement Sci. 2010, 5: 74-10.1186/1748-5908-5-74.CrossRefPubMedPubMedCentral
23.
go back to reference Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL: Pain in US nursing homes: validating a pain scale for the minimum data set. Gerontologist. 2001, 41 (2): 173-179. 10.1093/geront/41.2.173.CrossRefPubMed Fries BE, Simon SE, Morris JN, Flodstrom C, Bookstein FL: Pain in US nursing homes: validating a pain scale for the minimum data set. Gerontologist. 2001, 41 (2): 173-179. 10.1093/geront/41.2.173.CrossRefPubMed
24.
go back to reference Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C: Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing. 2000, 29 (2): 165-172. 10.1093/ageing/29.2.165.CrossRefPubMed Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C: Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing. 2000, 29 (2): 165-172. 10.1093/ageing/29.2.165.CrossRefPubMed
25.
go back to reference Lagarde M: How to do (or not to do)…assessing the impact of a policy change with routine longitudinal data. Health Policy Plan. 2012, 27 (1): 76-83. 10.1093/heapol/czr004.CrossRefPubMed Lagarde M: How to do (or not to do)…assessing the impact of a policy change with routine longitudinal data. Health Policy Plan. 2012, 27 (1): 76-83. 10.1093/heapol/czr004.CrossRefPubMed
26.
go back to reference Thornton DL: A note on the efficiency of the Cochrane-Orcutt estimator of the AR(1) regression model. J Econ. 1987, 36 (3): 369-376. 10.1016/0304-4076(87)90008-X.CrossRef Thornton DL: A note on the efficiency of the Cochrane-Orcutt estimator of the AR(1) regression model. J Econ. 1987, 36 (3): 369-376. 10.1016/0304-4076(87)90008-X.CrossRef
27.
go back to reference Magee L: Efficiency of iterative estimators in the regression model with AR(1) disturbances. J Econ. 1985, 29 (3): 275-287. 10.1016/0304-4076(85)90156-3.CrossRef Magee L: Efficiency of iterative estimators in the regression model with AR(1) disturbances. J Econ. 1985, 29 (3): 275-287. 10.1016/0304-4076(85)90156-3.CrossRef
28.
go back to reference Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-36. 10.1186/1748-5908-3-36.CrossRefPubMedPubMedCentral Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J: Healthcare professionals' intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008, 3: 36-36. 10.1186/1748-5908-3-36.CrossRefPubMedPubMedCentral
29.
go back to reference Godin G, Sheeran P, Conner M, Germain M: Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychology. 2008, 27 (2): 179-184. 10.1037/0278-6133.27.2.179.CrossRefPubMed Godin G, Sheeran P, Conner M, Germain M: Asking questions changes behavior: mere measurement effects on frequency of blood donation. Health Psychology. 2008, 27 (2): 179-184. 10.1037/0278-6133.27.2.179.CrossRefPubMed
30.
go back to reference Wood C, Conner M, Sandberg T, Godin G, Sheeran P: Why does asking questions change health behaviours? The mediating role of attitude accessibility. Psychol Health. 2014, 29 (4): 390-404. 10.1080/08870446.2013.858343.CrossRefPubMed Wood C, Conner M, Sandberg T, Godin G, Sheeran P: Why does asking questions change health behaviours? The mediating role of attitude accessibility. Psychol Health. 2014, 29 (4): 390-404. 10.1080/08870446.2013.858343.CrossRefPubMed
31.
go back to reference Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP: A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011, 26 (11): 1479-1498. 10.1080/08870446.2010.540664.CrossRefPubMed Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP: A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011, 26 (11): 1479-1498. 10.1080/08870446.2010.540664.CrossRefPubMed
32.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57 (4): 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M: From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008, 57 (4): 660-680. 10.1111/j.1464-0597.2008.00341.x.CrossRef
Metadata
Title
Data for improvement and clinical excellence: report of an interrupted time series trial of feedback in long-term care
Authors
Anne E Sales
Corinne Schalm
Melba Andrea B Baylon
Kimberly D Fraser
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-014-0161-5

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue