Skip to main content
Top
Published in: Implementation Science 1/2019

Open Access 01-12-2019 | Care | Research

Evaluating the implementation of the PACE Steps to Success Programme in long-term care facilities in seven countries according to the RE-AIM framework

Authors: Mariska Oosterveld-Vlug, Bregje Onwuteaka-Philipsen, Maud ten Koppel, Hein van Hout, Tinne Smets, Lara Pivodic, Marc Tanghe, Nele Van Den Noortgate, Jo Hockley, Sheila Payne, Danni Collingridge Moore, Violetta Kijowska, Katarzyna Szczerbińska, Marika Kylänen, Suvi Leppäaho, Claudia Mercuri, Paola Rossi, Martina Mercuri, Giovanni Gambassi, Catherine Bassal, Emilie Morgan de Paula, Yvonne Engels, Luc Deliens, Lieve Van den Block, H. Roeline Pasman, on behalf of the PACE trial group

Published in: Implementation Science | Issue 1/2019

Login to get access

Abstract

Background

The PACE ‘Steps to Success’ programme is a complex educational and development intervention for staff to improve palliative care in long-term care facilities (LTCFs). In a cluster randomized controlled trial, this programme has been implemented in 37 LTCFs in 7 European countries. Alongside an effectiveness study, a process evaluation study was conducted. This paper reports on the results of this process evaluation, of which the aim was to provide a more detailed understanding of the implementation of the PACE Programme across and within countries.

Methods

The process evaluation followed the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework and involved various measures and tools, including diaries for country trainers, evaluation questionnaires for care staff, attendance lists and interviews (online and face-to-face, individual and in groups) with country trainers, managers, PACE coordinators and other staff members. Based on key elements of the PACE Programme, a priori criteria for a high, medium and low level of the RE-AIM components Reach, Adoption, Implementation and intention to Maintenance were defined. Qualitative data on factors affecting each RE-AIM component gathered in the online discussion groups and interviews were analysed according to the principles of thematic analysis.

Results

The performance of the PACE Programme on the RE-AIM components was highly variable within and across countries, with a high or medium score for in total 28 (out of 37) LTCFs on Reach, for 26 LTCFs on Adoption, for 35 LTCFs on Implementation and for 34 LTCFs on intention to Maintenance. The factors affecting performance on the different RE-AIM components could be classified into three major categories: (1) the PACE Programme itself and its way of delivery, (2) people working with the PACE Programme and (3) contextual factors. Several country-specific challenges in implementing the PACE Programme were identified.

Conclusions

The implementation of the PACE Programme was feasible but leaves room for improvement. Our analysis helps to better understand the optimal levels of training and facilitation and provides recommendations to improve implementation in the LTC setting. The results of the process evaluation will be used to further adapt and improve the PACE Programme prior to its further dissemination.

Trial registration

The PACE study was registered at www.​isrctn.​com—ISRCTN14741671 (FP7-HEALTH-2013-INNOVATION-1 603111) July 30, 2015.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pivodic L, Smets T, Van den Noortgate N, Onwuteaka-Philipsen BD, Engels Y, Szczerbińska K, et al. Quality of dying and quality of end-of-life care of nursing home residents in six countries: an epidemiological study. Palliat Med. 2018;32:1584–95.CrossRef Pivodic L, Smets T, Van den Noortgate N, Onwuteaka-Philipsen BD, Engels Y, Szczerbińska K, et al. Quality of dying and quality of end-of-life care of nursing home residents in six countries: an epidemiological study. Palliat Med. 2018;32:1584–95.CrossRef
2.
go back to reference Hall S, Petkova H, Tsouros AD, Costantini M, Higginson I. Palliative care for older people: better practices. Denmark: World Health Organization; 2011. Hall S, Petkova H, Tsouros AD, Costantini M, Higginson I. Palliative care for older people: better practices. Denmark: World Health Organization; 2011.
3.
go back to reference Van den Block L, Albers G, Pereira S, Pasman R, Onwuteaka-Philipsen B, Deliens L. Palliative care for older people: a public health perspective. UK: Oxford University Press; 2015.CrossRef Van den Block L, Albers G, Pereira S, Pasman R, Onwuteaka-Philipsen B, Deliens L. Palliative care for older people: a public health perspective. UK: Oxford University Press; 2015.CrossRef
4.
go back to reference Vandervoort A, Van den Block L, van der Steen JT, Volicer L, Vander Stichele R, Houttekier D, Deliens L. Nursing home residents dying with dementia in Flanders, Belgium: a nationwide postmortem study on clinical characteristics and quality of dying. J Am Med Dir Assoc. 2013;14:485–92.CrossRef Vandervoort A, Van den Block L, van der Steen JT, Volicer L, Vander Stichele R, Houttekier D, Deliens L. Nursing home residents dying with dementia in Flanders, Belgium: a nationwide postmortem study on clinical characteristics and quality of dying. J Am Med Dir Assoc. 2013;14:485–92.CrossRef
5.
go back to reference Gozalo P, Teno JM, Mitchell SL, Skinner J, Bynum J, Tyler D, Mor V. End-of-life transitions among nursing home residents with cognitive issues. N Engl J Med. 2011;365:1212–21.CrossRef Gozalo P, Teno JM, Mitchell SL, Skinner J, Bynum J, Tyler D, Mor V. End-of-life transitions among nursing home residents with cognitive issues. N Engl J Med. 2011;365:1212–21.CrossRef
6.
go back to reference Mitchell SL, Mor V, Gozalo PL, Servadio JL, Teno JM. Tube feeding in US nursing home residents with advanced dementia, 2000-2014. JAMA. 2016;316:769–70.CrossRef Mitchell SL, Mor V, Gozalo PL, Servadio JL, Teno JM. Tube feeding in US nursing home residents with advanced dementia, 2000-2014. JAMA. 2016;316:769–70.CrossRef
7.
go back to reference Nolan M, Davies S, Brown J, Wilkinson A, Warnes T, McKee K, et al. The role of education and training in achieving change in care homes: a literature review. J Res Nurs. 2008;13:411–33.CrossRef Nolan M, Davies S, Brown J, Wilkinson A, Warnes T, McKee K, et al. The role of education and training in achieving change in care homes: a literature review. J Res Nurs. 2008;13:411–33.CrossRef
8.
go back to reference Smets T, Onwuteaka-Philipsen BD, Miranda R, Pivodic L, Tanghe M, van Hout H, et al. PACE trial group. Integrating palliative care in long-term care facilities across Europe (PACE): protocol of a cluster randomized controlled trial of the ‘PACE Steps to Success’ intervention in seven countries. BMC Palliat Care. 2018;17:47.CrossRef Smets T, Onwuteaka-Philipsen BD, Miranda R, Pivodic L, Tanghe M, van Hout H, et al. PACE trial group. Integrating palliative care in long-term care facilities across Europe (PACE): protocol of a cluster randomized controlled trial of the ‘PACE Steps to Success’ intervention in seven countries. BMC Palliat Care. 2018;17:47.CrossRef
9.
go back to reference Hockley J, Froggatt K, Van den Block L, Onwuteaka-Philipsen B, Kylänen M, Szczerbińska K, et al. on behalf of PACE. A framework for cross-cultural development and implementation of complex interventions to improve palliative care in nursing homes: the PACE Steps to Success programme. BMC Health Serv Res. 2019;19:745. Hockley J, Froggatt K, Van den Block L, Onwuteaka-Philipsen B, Kylänen M, Szczerbińska K, et al. on behalf of PACE. A framework for cross-cultural development and implementation of complex interventions to improve palliative care in nursing homes: the PACE Steps to Success programme. BMC Health Serv Res. 2019;19:745.
11.
go back to reference O’Brien M, Kirton J, Knighting K, Roe B, Jack B. Improving end of life care in care homes; an evaluation of the six steps to success programme. BMC Palliat Care. 2016;15:53.CrossRef O’Brien M, Kirton J, Knighting K, Roe B, Jack B. Improving end of life care in care homes; an evaluation of the six steps to success programme. BMC Palliat Care. 2016;15:53.CrossRef
13.
go back to reference Watson J, Hockley J, Murray S. Evaluating effectiveness of the GSFCJ and LCP in care homes. End Life Care J. 2010;4:42–9. Watson J, Hockley J, Murray S. Evaluating effectiveness of the GSFCJ and LCP in care homes. End Life Care J. 2010;4:42–9.
15.
go back to reference Van den Block L, Honinx E, Pivodic L, Miranda R, Onwuteaka-Philipsen BD, Van Hout H, et al. on behalf of the PACE trial group. Effectiveness of a palliative care programme for nursing homes in seven countries: the PACE cluster-randomised controlled trial. JAMA Intern Med. 2019:1-10 [Epub ahead of print].. Van den Block L, Honinx E, Pivodic L, Miranda R, Onwuteaka-Philipsen BD, Van Hout H, et al. on behalf of the PACE trial group. Effectiveness of a palliative care programme for nursing homes in seven countries: the PACE cluster-randomised controlled trial. JAMA Intern Med. 2019:1-10 [Epub ahead of print]..
16.
go back to reference Thompson S, Bott M, Boyle D, Gajewski B, Tilden VP. A measure of palliative care in nursing homes. J Pain Symptom Manag. 2011;41:57–67.CrossRef Thompson S, Bott M, Boyle D, Gajewski B, Tilden VP. A measure of palliative care in nursing homes. J Pain Symptom Manag. 2011;41:57–67.CrossRef
17.
go back to reference Kiely DK, Volicer L, Teno J, Jones RN, Prigerson HG, Mitchell SL. The validity and reliability of scales for the evaluation of end-of-life care in advanced dementia. Alzheimer Dis Assoc Disord. 2006;20:176–81.CrossRef Kiely DK, Volicer L, Teno J, Jones RN, Prigerson HG, Mitchell SL. The validity and reliability of scales for the evaluation of end-of-life care in advanced dementia. Alzheimer Dis Assoc Disord. 2006;20:176–81.CrossRef
18.
go back to reference Munn JC, Zimmerman S, Hanson LC, Williams CS, Sloane PD, et al. Measuring the quality of dying in long-term care. J Am Geriatr Soc. 2007;55:1371–9.CrossRef Munn JC, Zimmerman S, Hanson LC, Williams CS, Sloane PD, et al. Measuring the quality of dying in long-term care. J Am Geriatr Soc. 2007;55:1371–9.CrossRef
19.
go back to reference Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRef Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15.CrossRef
20.
go back to reference Campbell M, Fitzpatrick R, Halnes A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.CrossRef Campbell M, Fitzpatrick R, Halnes A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.CrossRef
21.
go back to reference Hawe P, Shiell A, Riley T. Complex interventions. How “out of control” can a randomized controlled trial be? BMJ. 2004;328:1561–3.CrossRef Hawe P, Shiell A, Riley T. Complex interventions. How “out of control” can a randomized controlled trial be? BMJ. 2004;328:1561–3.CrossRef
22.
go back to reference Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluations in randomized controlled trials of complex interventions. BMJ. 2006;332:413–6.CrossRef Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluations in randomized controlled trials of complex interventions. BMJ. 2006;332:413–6.CrossRef
23.
go back to reference Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions. Medical Research Council guidance. BMJ. 2015;350:h1258.PubMed Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions. Medical Research Council guidance. BMJ. 2015;350:h1258.PubMed
24.
go back to reference Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.CrossRef Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.CrossRef
25.
go back to reference Zwaanswijk M, van Dulmen S. Advantages of asynchronous online focus groups and face-to-face focus groups as perceived by child, adolescent and adult participants: a survey study. BMC Res Notes. 2014;7:756.CrossRef Zwaanswijk M, van Dulmen S. Advantages of asynchronous online focus groups and face-to-face focus groups as perceived by child, adolescent and adult participants: a survey study. BMC Res Notes. 2014;7:756.CrossRef
26.
go back to reference Boyatzis RE. Transforming qualitative information: thematic analysis and code development. Thousand Oaks, California: Sage; 1998. Boyatzis RE. Transforming qualitative information: thematic analysis and code development. Thousand Oaks, California: Sage; 1998.
27.
go back to reference Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRef Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.CrossRef
28.
go back to reference Rycroft-Malone J, Seers K, Eldh AC, Cox K, Crichton N, Harvey G, et al. A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomized controlled international trial: an exemplar. Implement Sci. 2018;13:138.CrossRef Rycroft-Malone J, Seers K, Eldh AC, Cox K, Crichton N, Harvey G, et al. A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomized controlled international trial: an exemplar. Implement Sci. 2018;13:138.CrossRef
29.
go back to reference Low LF, Fletcher J, Goodenough B, Jeon YH, Etherton-Beer C, MacAndrew M, Beattie E. A systematic review of interventions to change staff care practices in order to improve resident outcomes in nursing homes. PLoS One. 2015;10:e0140711.CrossRef Low LF, Fletcher J, Goodenough B, Jeon YH, Etherton-Beer C, MacAndrew M, Beattie E. A systematic review of interventions to change staff care practices in order to improve resident outcomes in nursing homes. PLoS One. 2015;10:e0140711.CrossRef
30.
go back to reference Harvey G, McCormack B, Kitson A, Lynch E, Titchen A. Designing and implementing two facilitation interventions within the ‘Facilitating Implementation of Research Evidence (FIRE)’ study: a qualitative analysis from an external facilitators’ perspective. Implement Sci. 2018;13:141.CrossRef Harvey G, McCormack B, Kitson A, Lynch E, Titchen A. Designing and implementing two facilitation interventions within the ‘Facilitating Implementation of Research Evidence (FIRE)’ study: a qualitative analysis from an external facilitators’ perspective. Implement Sci. 2018;13:141.CrossRef
31.
go back to reference Froggatt K, Edwards M, Morbey H, Payne S. Mapping palliative care systems in long term care facilities in Europe: European Association of Palliative Care EAPC; 2015. Froggatt K, Edwards M, Morbey H, Payne S. Mapping palliative care systems in long term care facilities in Europe: European Association of Palliative Care EAPC; 2015.
32.
go back to reference Froggatt K, Payne S, Morbey H, Edwards M, Finne-Soveri H, Gambassi G, et al. Palliative care development in European care homes and nursing homes: application of a typology of implementation. J Am Med Dir Assoc. 2017;18:550.e7–e14.CrossRef Froggatt K, Payne S, Morbey H, Edwards M, Finne-Soveri H, Gambassi G, et al. Palliative care development in European care homes and nursing homes: application of a typology of implementation. J Am Med Dir Assoc. 2017;18:550.e7–e14.CrossRef
33.
go back to reference Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers S, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.CrossRef Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers S, Titchen A. Evaluating the successful implementation of evidence into practice using the PARIHS framework: theoretical and practical challenges. Implement Sci. 2008;3:1.CrossRef
34.
go back to reference Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8:28.CrossRef Rycroft-Malone J, Seers K, Chandler J, Hawkes CA, Crichton N, Allen C, et al. The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework. Implement Sci. 2013;8:28.CrossRef
35.
go back to reference Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.CrossRef Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33.CrossRef
36.
go back to reference Raad voor Volksgezondheid en Samenleving. Zonder context geen bewijs. Over de illusie van evidence-based practice in de zorg. [No evidence without context. About the illusion of evidence-based practice in health care]. Den Haag; 2017. Raad voor Volksgezondheid en Samenleving. Zonder context geen bewijs. Over de illusie van evidence-based practice in de zorg. [No evidence without context. About the illusion of evidence-based practice in health care]. Den Haag; 2017.
37.
go back to reference Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.CrossRef Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117.CrossRef
38.
go back to reference Masterson-Algar P, Burton CR, Rycroft-Malone J, Sackley C, Walker MF. Towards a programme theory for fidelity in the evaluation of complex evaluations. J Eval Clin Pract. 2014;20:445–52.CrossRef Masterson-Algar P, Burton CR, Rycroft-Malone J, Sackley C, Walker MF. Towards a programme theory for fidelity in the evaluation of complex evaluations. J Eval Clin Pract. 2014;20:445–52.CrossRef
39.
go back to reference Anstey S, Powell T, Coles B, Hale R, Gould D. Education and training to enhance end-of-life care for nursing home staff: a systematic literature review. BMJ Support Palliat Care. 2016;6:353–61.CrossRef Anstey S, Powell T, Coles B, Hale R, Gould D. Education and training to enhance end-of-life care for nursing home staff: a systematic literature review. BMJ Support Palliat Care. 2016;6:353–61.CrossRef
Metadata
Title
Evaluating the implementation of the PACE Steps to Success Programme in long-term care facilities in seven countries according to the RE-AIM framework
Authors
Mariska Oosterveld-Vlug
Bregje Onwuteaka-Philipsen
Maud ten Koppel
Hein van Hout
Tinne Smets
Lara Pivodic
Marc Tanghe
Nele Van Den Noortgate
Jo Hockley
Sheila Payne
Danni Collingridge Moore
Violetta Kijowska
Katarzyna Szczerbińska
Marika Kylänen
Suvi Leppäaho
Claudia Mercuri
Paola Rossi
Martina Mercuri
Giovanni Gambassi
Catherine Bassal
Emilie Morgan de Paula
Yvonne Engels
Luc Deliens
Lieve Van den Block
H. Roeline Pasman
on behalf of the PACE trial group
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
Implementation Science / Issue 1/2019
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-019-0953-8

Other articles of this Issue 1/2019

Implementation Science 1/2019 Go to the issue