Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Implementation fidelity of a nurse-led falls prevention program in acute hospitals during the 6-PACK trial

Authors: Renata T. Morello, Anna L. Barker, Darshini R. Ayton, Fiona Landgren, Jeannette Kamar, Keith D. Hill, Caroline A. Brand, Catherine Sherrington, Rory Wolfe, Sheral Rifat, Johannes Stoelwinder

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

When tested in a randomized controlled trial (RCT) of 31,411 patients, the nurse-led 6-PACK falls prevention program did not reduce falls. Poor implementation fidelity (i.e., program not implemented as intended) may explain this result. Despite repeated calls for the examination of implementation fidelity as an essential component of evaluating interventions designed to improve the delivery of care, it has been neglected in prior falls prevention studies. This study examined implementation fidelity of the 6-PACK program during a large multi-site RCT.

Methods

Based on the 6-PACK implementation framework and intervention description, implementation fidelity was examined by quantifying adherence to program components and organizational support. Adherence indicators were: 1) falls-risk tool completion; and for patients classified as high-risk, provision of 2) a ‘Falls alert’ sign; and 3) at least one additional 6-PACK intervention. Organizational support indicators were: 1) provision of resources (executive sponsorship, site clinical leaders and equipment); 2) implementation activities (modification of patient care plans; training; implementation tailoring; audits, reminders and feedback; and provision of data); and 3) program acceptability. Data were collected from daily bedside observation, medical records, resource utilization diaries and nurse surveys.

Results

All seven intervention components were delivered on the 12 intervention wards. Program adherence data were collected from 103,398 observations and medical record audits. The falls-risk tool was completed each day for 75% of patients. Of the 38% of patients classified as high-risk, 79% had a ‘Falls alert’ sign and 63% were provided with at least one additional 6-PACK intervention, as recommended. All hospitals provided the recommended resources and undertook the nine outlined program implementation activities. Most of the nurses surveyed considered program components important for falls prevention.

Conclusions

While implementation fidelity was variable across wards, overall it was found to be acceptable during the RCT. Implementation failure is unlikely to be a key factor for the observed lack of program effectiveness in the 6-PACK trial.

Trial registration

The 6-PACK cluster RCT is registered with the Australian New Zealand Clinical Trials Registry, number ACTRN12611000332​921 (29 March 2011).
Appendix
Available only for authorised users
Literature
1.
go back to reference Morello RT, Barker AL, Watts JJ, Haines T, Zavarsek SS, Hill KD, et al. The extra resource burden of in-hospital falls: a cost of falls study. Med J Aust. 2015;203(9):367.CrossRefPubMed Morello RT, Barker AL, Watts JJ, Haines T, Zavarsek SS, Hill KD, et al. The extra resource burden of in-hospital falls: a cost of falls study. Med J Aust. 2015;203(9):367.CrossRefPubMed
3.
go back to reference Hitcho EB, Krauss MJ, Birge S, Claiborne Dunagan W, Fischer I, Johnson S, et al. Characteristics and circumstances of falls in a hospital setting: a prospective analysis. J Gen Intern Med. 2004;19(7):732–9. Pubmed Central PMCID: 1492485.CrossRefPubMedPubMedCentral Hitcho EB, Krauss MJ, Birge S, Claiborne Dunagan W, Fischer I, Johnson S, et al. Characteristics and circumstances of falls in a hospital setting: a prospective analysis. J Gen Intern Med. 2004;19(7):732–9. Pubmed Central PMCID: 1492485.CrossRefPubMedPubMedCentral
4.
go back to reference Hill K, Vu M, Walsh W. Falls in the acute hospital setting – impact on resource utilisation. Aust Health Rev. 2007;31(3):471–7.CrossRefPubMed Hill K, Vu M, Walsh W. Falls in the acute hospital setting – impact on resource utilisation. Aust Health Rev. 2007;31(3):471–7.CrossRefPubMed
5.
go back to reference Australian Commission on Safety and Quality in Health Care. Preventing falls and harm from falls in older people: best practice guidelines for Australian hospitals. Sydney: Australian Commission on Safety and Quality in Healthcare; 2009. Australian Commission on Safety and Quality in Health Care. Preventing falls and harm from falls in older people: best practice guidelines for Australian hospitals. Sydney: Australian Commission on Safety and Quality in Healthcare; 2009.
8.
go back to reference Center for Performance Sciences. Acute care implementation manual. Maryland: Centre for Performance Sciences; 2006. Center for Performance Sciences. Acute care implementation manual. Maryland: Centre for Performance Sciences; 2006.
9.
go back to reference The Australian Council on Healthcare Standards. National safety and quality health service standards program. NSW: The Australian Council on Healthcare Standards; 2012. The Australian Council on Healthcare Standards. National safety and quality health service standards program. NSW: The Australian Council on Healthcare Standards; 2012.
10.
go back to reference Canadian Institute for Health Information. Canadian hospital reporting project technical notes – clinical indicators. Ottawa: CIHI; 2013. Canadian Institute for Health Information. Canadian hospital reporting project technical notes – clinical indicators. Ottawa: CIHI; 2013.
11.
go back to reference Cameron ID, Murray GR, Gillespie LD, Robertson MC, Hill KD, Cumming RG, et al. Interventions for preventing falls in older people in nursing care facilities and hospitals. Cochrane Database Syst Rev. 2010;1:CD005465. Cameron ID, Murray GR, Gillespie LD, Robertson MC, Hill KD, Cumming RG, et al. Interventions for preventing falls in older people in nursing care facilities and hospitals. Cochrane Database Syst Rev. 2010;1:CD005465.
12.
go back to reference DiBardino D, Cohen ER, Didwania A. Meta-analysis: multidisciplinary fall prevention strategies in the acute care inpatient population. J Hosp Med. 2012;7(6):497–503.CrossRefPubMed DiBardino D, Cohen ER, Didwania A. Meta-analysis: multidisciplinary fall prevention strategies in the acute care inpatient population. J Hosp Med. 2012;7(6):497–503.CrossRefPubMed
13.
go back to reference Evans D, Hodgkinson B, Lambert L, Wood J. Falls risk factors in the hospital setting: a systematic review. Int J Nurs Pract. 2001;7(1):38–45. Epub 2002/01/29. Eng.CrossRefPubMed Evans D, Hodgkinson B, Lambert L, Wood J. Falls risk factors in the hospital setting: a systematic review. Int J Nurs Pract. 2001;7(1):38–45. Epub 2002/01/29. Eng.CrossRefPubMed
14.
go back to reference Coussement J, De Paepe L, Schwendimann R, Denhaerynck K, Dejaeger E, Milisen K. Interventions for preventing falls in acute- and chronic-care hospitals: a systematic review and meta-analysis. J Am Geriatr Soc. 2008;56(1):29–36.CrossRefPubMed Coussement J, De Paepe L, Schwendimann R, Denhaerynck K, Dejaeger E, Milisen K. Interventions for preventing falls in acute- and chronic-care hospitals: a systematic review and meta-analysis. J Am Geriatr Soc. 2008;56(1):29–36.CrossRefPubMed
15.
go back to reference Miake-Lye IM, Hempel S, Ganz DA, Shekelle PG. Inpatient fall prevention programs as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158(5 Pt 2):390–6.CrossRefPubMed Miake-Lye IM, Hempel S, Ganz DA, Shekelle PG. Inpatient fall prevention programs as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158(5 Pt 2):390–6.CrossRefPubMed
16.
go back to reference Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRefPubMed Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.CrossRefPubMed
17.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655. Pubmed Central PMCID: 2769032.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new medical research council guidance. BMJ. 2008;337:a1655. Pubmed Central PMCID: 2769032.CrossRefPubMedPubMedCentral
18.
go back to reference Hempel S, Newberry S, Wang Z, Booth M, Shanman R, Johnsen B, et al. Hospital fall prevention: a systematic review of implementation, components, adherence, and effectiveness. J Am Geriatr Soc. 2013;61(4):483–94. Pubmed Central PMCID: 3670303.CrossRefPubMedPubMedCentral Hempel S, Newberry S, Wang Z, Booth M, Shanman R, Johnsen B, et al. Hospital fall prevention: a systematic review of implementation, components, adherence, and effectiveness. J Am Geriatr Soc. 2013;61(4):483–94. Pubmed Central PMCID: 3670303.CrossRefPubMedPubMedCentral
19.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334(7591):455–9. Pubmed Central PMCID: 1808182.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334(7591):455–9. Pubmed Central PMCID: 1808182.CrossRefPubMedPubMedCentral
20.
go back to reference Dempsey J. Falls prevention revisited: a call for a new approach. J Clin Nurs. 2004;13(4):479–85.CrossRefPubMed Dempsey J. Falls prevention revisited: a call for a new approach. J Clin Nurs. 2004;13(4):479–85.CrossRefPubMed
21.
go back to reference Bakarich A, McMillan V, Prosser R. The effect of a nursing intervention on the incidence of older patient falls. Aust J Adv Nurs. 1997;15(1):26–31.PubMed Bakarich A, McMillan V, Prosser R. The effect of a nursing intervention on the incidence of older patient falls. Aust J Adv Nurs. 1997;15(1):26–31.PubMed
22.
go back to reference Schwendimann R, Buhler H, De Geest S, Milisen K. Falls and consequent injuries in hospitalized patients: effects of an interdisciplinary falls prevention program. BMC Health Serv Res. 2006;6:69. Pubmed Central PMCID: 1534028.CrossRefPubMedPubMedCentral Schwendimann R, Buhler H, De Geest S, Milisen K. Falls and consequent injuries in hospitalized patients: effects of an interdisciplinary falls prevention program. BMC Health Serv Res. 2006;6:69. Pubmed Central PMCID: 1534028.CrossRefPubMedPubMedCentral
23.
go back to reference Williams TA, King G, Hill AM, Rajagopal M, Barnes T, Basu A, et al. Evaluation of a falls prevention programme in an acute tertiary care hospital. J Clin Nurs. 2007;16(2):316–24.CrossRefPubMed Williams TA, King G, Hill AM, Rajagopal M, Barnes T, Basu A, et al. Evaluation of a falls prevention programme in an acute tertiary care hospital. J Clin Nurs. 2007;16(2):316–24.CrossRefPubMed
24.
go back to reference Cumming RG, Sherrington C, Lord SR, Simpson JM, Vogler C, Cameron ID, et al. Cluster randomised trial of a targeted multifactorial intervention to prevent falls among older people in hospital. BMJ. 2008;336(7647):758–60. Pubmed Central PMCID: 2287238.CrossRefPubMedPubMedCentral Cumming RG, Sherrington C, Lord SR, Simpson JM, Vogler C, Cameron ID, et al. Cluster randomised trial of a targeted multifactorial intervention to prevent falls among older people in hospital. BMJ. 2008;336(7647):758–60. Pubmed Central PMCID: 2287238.CrossRefPubMedPubMedCentral
25.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6. Pubmed Central PMCID: 1370978.CrossRefPubMedPubMedCentral Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6. Pubmed Central PMCID: 1370978.CrossRefPubMedPubMedCentral
26.
go back to reference Mihalic SF, Fagan AA, Argamaso S. Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity. Implement Sci. 2008;3:5. Pubmed Central PMCID: 2265741.CrossRefPubMedPubMedCentral Mihalic SF, Fagan AA, Argamaso S. Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity. Implement Sci. 2008;3:5. Pubmed Central PMCID: 2265741.CrossRefPubMedPubMedCentral
27.
go back to reference Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40. Pubmed Central PMCID: 2213686.CrossRefPubMedPubMedCentral Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40. Pubmed Central PMCID: 2213686.CrossRefPubMedPubMedCentral
28.
go back to reference Barker A, Kamar J, Graco M, Lawlor V, Hill K. Adding value to the STRATIFY falls risk assessment in acute hospitals. J Adv Nurs. 2011;67(2):450–7.CrossRefPubMed Barker A, Kamar J, Graco M, Lawlor V, Hill K. Adding value to the STRATIFY falls risk assessment in acute hospitals. J Adv Nurs. 2011;67(2):450–7.CrossRefPubMed
29.
go back to reference Barker A, Brand C, Haines T, Hill K, Brauer S, Jolley D, et al. The 6-PACK programme to decrease fall-related injuries in acute hospitals: protocol for a cluster randomised controlled trial. Inj Prev. 2011;17(4):e5.CrossRefPubMed Barker A, Brand C, Haines T, Hill K, Brauer S, Jolley D, et al. The 6-PACK programme to decrease fall-related injuries in acute hospitals: protocol for a cluster randomised controlled trial. Inj Prev. 2011;17(4):e5.CrossRefPubMed
30.
go back to reference Hendrich A, Chow MP, Skierczynski BA, Lu Z. A 36-hospital time and motion study: how do medical-surgical nurses spend their time? Perm J. 2008;12(3):25–34. Pubmed Central PMCID: 3037121.CrossRefPubMedPubMedCentral Hendrich A, Chow MP, Skierczynski BA, Lu Z. A 36-hospital time and motion study: how do medical-surgical nurses spend their time? Perm J. 2008;12(3):25–34. Pubmed Central PMCID: 3037121.CrossRefPubMedPubMedCentral
31.
go back to reference Barker AL, Morello RT, Wolfe R, Brand CA, Haines TP, Hill KD, et al. 6-PACK programme to decrease fall injuries in acute hospitals: cluster randomised controlled trial. BMJ. 2016;352:h6781. Pubmed Central PMCID: 4727091.CrossRefPubMedPubMedCentral Barker AL, Morello RT, Wolfe R, Brand CA, Haines TP, Hill KD, et al. 6-PACK programme to decrease fall injuries in acute hospitals: cluster randomised controlled trial. BMJ. 2016;352:h6781. Pubmed Central PMCID: 4727091.CrossRefPubMedPubMedCentral
33.
go back to reference Ayton DR. Barker AL. Morello RT. Brand CA. Talevski J. Landgren FS. et al. Barriers and enablers to implementation of the 6-PACK falls prevention program: a pre-implmentation study in acute hospitals participating in a cluster randomised controlled trial. PLOS one. 2017. https://doi.org/10.1371/journal.pone.0171932. Ayton DR. Barker AL. Morello RT. Brand CA. Talevski J. Landgren FS. et al. Barriers and enablers to implementation of the 6-PACK falls prevention program: a pre-implmentation study in acute hospitals participating in a cluster randomised controlled trial. PLOS one. 2017. https://​doi.​org/​10.​1371/​journal.​pone.​0171932.
34.
go back to reference Centre of Research Excellence in Patient Safety. An evaluation of the preventing falls and harm from falls in older people best practice guidelines for Australian hospitals. Melbourne: Monash University; 2012. Centre of Research Excellence in Patient Safety. An evaluation of the preventing falls and harm from falls in older people best practice guidelines for Australian hospitals. Melbourne: Monash University; 2012.
35.
go back to reference Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2. Pubmed Central PMCID: 3892708.CrossRefPubMed Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2. Pubmed Central PMCID: 3892708.CrossRefPubMed
36.
go back to reference Hasson H, Gilbert-Ouimet M, Baril-Gingras G, Brisson C, Vezina M, Bourbonnais R, et al. Implementation of an organizational-level intervention on the psychosocial environment of work: comparison of managers’ and employees’ views. J Occup Environ Med. 2012;54(1):85–91.CrossRefPubMed Hasson H, Gilbert-Ouimet M, Baril-Gingras G, Brisson C, Vezina M, Bourbonnais R, et al. Implementation of an organizational-level intervention on the psychosocial environment of work: comparison of managers’ and employees’ views. J Occup Environ Med. 2012;54(1):85–91.CrossRefPubMed
Metadata
Title
Implementation fidelity of a nurse-led falls prevention program in acute hospitals during the 6-PACK trial
Authors
Renata T. Morello
Anna L. Barker
Darshini R. Ayton
Fiona Landgren
Jeannette Kamar
Keith D. Hill
Caroline A. Brand
Catherine Sherrington
Rory Wolfe
Sheral Rifat
Johannes Stoelwinder
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2315-z

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue