Skip to main content
Top
Published in: BMC Health Services Research 1/2020

Open Access 01-12-2020 | Stroke | Research article

Evaluation and facilitation of intervention fidelity in community exercise programs through an adaptation of the TIDier framework

Authors: Marie-Louise Bird, William B. Mortenson, Janice J. Eng

Published in: BMC Health Services Research | Issue 1/2020

Login to get access

Abstract

Background

Despite high quality evidence supporting multiple physical and cognitive benefits of community-based exercise for people after stroke, there is little understanding on how to facilitate uptake of these research findings to real-world programs. A common barrier is a lack of standardised training for community fitness instructors, which hampers the ability to train more instructors to deliver the program as it was designed. Scaling up program delivery, while maintaining program fidelity, is complex. The objective of this research is to explore novel use of the Template for Intervention Description and Replication (TIDier) framework to evaluate and support implementation fidelity of a community exercise program.

Methods

We embedded intervention fidelity evaluation into an inaugural training program for fitness instructors who were to deliver the Fitness and Mobility Exercise Program for stroke, which has established efficacy. The training program consisted of a face-to-face workshop followed by 3 worksite ‘audit and feedback coaching cycles’ provided over 3 iterations of the 12-week program offered over 1 year. A modified TIDIER checklist (with 2 additional criteria) was used within the training workshop to clarify the key ‘active ingredients’ that were required for program fidelity, and secondly as a basis for the audit and feedback process enabling the quantitative measurement of fidelity. Data were collected from audits of observed classes and from a survey provided by fitness instructors who implemented the program.

Results

We demonstrated the feasibility of the TIDier checklist to capture 14 essential items for implementation evaluation of a complex exercise intervention for people with chronic health conditions over 3 iterations of the program. Based on the audit tool, program fidelity was high and improved over time. Three content areas for workplace coaching (intensity monitoring, space, and educational tips) were identified from the audit tool and were addressed.

Conclusion

Training of staff to deliver exercises to high need populations utilising workshops and workplace coaching that used the TIDier framework for training, onsite audit and feedback resulted in a high level of fidelity to the program principles. A novel checklist based on the TIDier framework was useful for embedding implementation fidelity in complex community-based interventions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Poltawski L, Abraham C, Forster A, Goodwin VA, Kilbride C, et al. Synthesising practice guidelines for the development of community-based exercise programmes after stroke. Imp Sci. 2013;8(1):115. Poltawski L, Abraham C, Forster A, Goodwin VA, Kilbride C, et al. Synthesising practice guidelines for the development of community-based exercise programmes after stroke. Imp Sci. 2013;8(1):115.
2.
go back to reference Merali S, Cameron JI, Barclay R, Salbach NM. Characterising community exercise programmes delivered by fitness instructors for people with neurological conditions: a scoping review. Health Soc Care Community. 2016;24(6):e101–16.PubMedCrossRef Merali S, Cameron JI, Barclay R, Salbach NM. Characterising community exercise programmes delivered by fitness instructors for people with neurological conditions: a scoping review. Health Soc Care Community. 2016;24(6):e101–16.PubMedCrossRef
3.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334(7591):455–9.PubMedPubMedCentralCrossRef Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334(7591):455–9.PubMedPubMedCentralCrossRef
4.
go back to reference Council, M.R. A framework for development and evaluation of RCTs for complex interventions to improve health London, Medical Research Council; 2000. Council, M.R. A framework for development and evaluation of RCTs for complex interventions to improve health London, Medical Research Council; 2000.
5.
go back to reference Gearing RE, El-Bassel N, Ghesquiere A, Baldwin S, Gillies J, et al. Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. Clin Psychol Rev. 2011;31(1):79–88.PubMedCrossRef Gearing RE, El-Bassel N, Ghesquiere A, Baldwin S, Gillies J, et al. Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. Clin Psychol Rev. 2011;31(1):79–88.PubMedCrossRef
6.
go back to reference May C, Finch T, Mair F, Ballini L, Dowrick C, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res. 2007;7(1):148.PubMedPubMedCentralCrossRef May C, Finch T, Mair F, Ballini L, Dowrick C, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res. 2007;7(1):148.PubMedPubMedCentralCrossRef
7.
go back to reference Perrin KM, Burke SG, O'Connor D, Walby G, Shippey C, et al. Factors contributing to intervention fidelity in a multi-site chronic disease self-management program. Imp Sci. 2006;1(1):26. Perrin KM, Burke SG, O'Connor D, Walby G, Shippey C, et al. Factors contributing to intervention fidelity in a multi-site chronic disease self-management program. Imp Sci. 2006;1(1):26.
8.
go back to reference Hoffmann TC, Walker MF. ‘TIDieR-ing up’the reporting of interventions in stroke research: the importance of knowing what is in the ‘black box. IntJ Stroke. 2015;10(5):657–8.CrossRef Hoffmann TC, Walker MF. ‘TIDieR-ing up’the reporting of interventions in stroke research: the importance of knowing what is in the ‘black box. IntJ Stroke. 2015;10(5):657–8.CrossRef
9.
go back to reference Salbach NM, Howe J-A, Baldry D, Merali S, Munce SE. Considerations for expanding community exercise programs incorporating a healthcare-recreation partnership for people with balance and mobility limitations: a mixed methods evaluation. BMC Res Notes. 2018;11(1):214.PubMedPubMedCentralCrossRef Salbach NM, Howe J-A, Baldry D, Merali S, Munce SE. Considerations for expanding community exercise programs incorporating a healthcare-recreation partnership for people with balance and mobility limitations: a mixed methods evaluation. BMC Res Notes. 2018;11(1):214.PubMedPubMedCentralCrossRef
10.
go back to reference Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Ser R. 2017;44(2):177–94.CrossRef Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Ser R. 2017;44(2):177–94.CrossRef
11.
go back to reference Marigold DS, Eng JJ, Dawson AS, Inglis JT, Harris JE, et al. Exercise leads to faster postural reflexes, improved balance and mobility, and fewer falls in older persons with chronic stroke. J Am Geriatr Soc. 2005;53(3):416–23.PubMedPubMedCentralCrossRef Marigold DS, Eng JJ, Dawson AS, Inglis JT, Harris JE, et al. Exercise leads to faster postural reflexes, improved balance and mobility, and fewer falls in older persons with chronic stroke. J Am Geriatr Soc. 2005;53(3):416–23.PubMedPubMedCentralCrossRef
12.
go back to reference Pang MY, Eng JJ, Dawson AS, McKay HA, Harris JE. A community-based fitness and mobility exercise program for older adults with chronic stroke: a randomized, controlled trial. J Am Geriatr Soc. 2005;53(10):1667–74.PubMedPubMedCentralCrossRef Pang MY, Eng JJ, Dawson AS, McKay HA, Harris JE. A community-based fitness and mobility exercise program for older adults with chronic stroke: a randomized, controlled trial. J Am Geriatr Soc. 2005;53(10):1667–74.PubMedPubMedCentralCrossRef
13.
go back to reference Mayo NE, Anderson S, Barclay R, Cameron JI, Desrosiers J, et al. Getting on with the rest of your life following stroke: a randomized trial of a complex intervention aimed at enhancing life participation post stroke. Clin Rehabil. 2015;29(12):1198–211.PubMedCrossRef Mayo NE, Anderson S, Barclay R, Cameron JI, Desrosiers J, et al. Getting on with the rest of your life following stroke: a randomized trial of a complex intervention aimed at enhancing life participation post stroke. Clin Rehabil. 2015;29(12):1198–211.PubMedCrossRef
14.
go back to reference Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.PubMedCrossRef Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.PubMedCrossRef
15.
go back to reference Eysenbach G. Improving the quality of Web surveys: the checklist for Reporting Results of Internet E-Surveys (CHERRIES). JMIR. 2004;6(3):e34.PubMed Eysenbach G. Improving the quality of Web surveys: the checklist for Reporting Results of Internet E-Surveys (CHERRIES). JMIR. 2004;6(3):e34.PubMed
16.
go back to reference Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.PubMedCrossRef Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.PubMedCrossRef
18.
go back to reference Moore GF, Evans RE, Hawkins J, Littlecott HJ, Turley R. All interventions are complex, but some are more complex than others: using iCAT_SR to assess complexity. Cochrane DB Syst Rev. 2017;7:ED000122. Moore GF, Evans RE, Hawkins J, Littlecott HJ, Turley R. All interventions are complex, but some are more complex than others: using iCAT_SR to assess complexity. Cochrane DB Syst Rev. 2017;7:ED000122.
19.
go back to reference French B, Thomas LH, Coupe J, McMahon NE, Connell L, et al. Repetitive task training for improving functional ability after stroke. Cochrane DB Syst Rev. 2016;11:CD006073. French B, Thomas LH, Coupe J, McMahon NE, Connell L, et al. Repetitive task training for improving functional ability after stroke. Cochrane DB Syst Rev. 2016;11:CD006073.
20.
go back to reference Haynes A, Brennan S, Redman S, Williamson A, Gallego G, et al. Figuring out fidelity: a worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Imp Sci. 2015;11(1):23. Haynes A, Brennan S, Redman S, Williamson A, Gallego G, et al. Figuring out fidelity: a worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Imp Sci. 2015;11(1):23.
21.
go back to reference Cotterill S, Knowles S, Martindale A-M, Elvey R, Howard S, et al. Getting messier with TIDieR: embracing context and complexity in intervention reporting. BMC Med Res Methodol. 2018;18(1):12.PubMedPubMedCentralCrossRef Cotterill S, Knowles S, Martindale A-M, Elvey R, Howard S, et al. Getting messier with TIDieR: embracing context and complexity in intervention reporting. BMC Med Res Methodol. 2018;18(1):12.PubMedPubMedCentralCrossRef
22.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane DB Syst Rev. 2012;6:CD000259. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane DB Syst Rev. 2012;6:CD000259.
Metadata
Title
Evaluation and facilitation of intervention fidelity in community exercise programs through an adaptation of the TIDier framework
Authors
Marie-Louise Bird
William B. Mortenson
Janice J. Eng
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2020
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-020-4919-y

Other articles of this Issue 1/2020

BMC Health Services Research 1/2020 Go to the issue