Skip to main content
Top
Published in: BMC Public Health 1/2017

Open Access 01-12-2017 | Research article

Assessment of fidelity in individual level behaviour change interventions promoting physical activity among adults: a systematic review

Authors: Jeffrey D. Lambert, Colin J. Greaves, Paul Farrand, Rosina Cross, Anne M. Haase, Adrian H. Taylor

Published in: BMC Public Health | Issue 1/2017

Login to get access

Abstract

Background

Behaviour change interventions that promote physical activity have major implications for health and well-being. Measuring intervention fidelity is crucial in determining the extent to which an intervention is delivered as intended, therefore increasing scientific confidence about effectiveness. However, we lack a clear overview of how well intervention fidelity is typically assessed in physical activity trials.

Methods

A systematic literature search was conducted to identify peer - reviewed physical activity promotion trials that explicitly measured intervention fidelity. Methods used to assess intervention fidelity were categorised, narratively synthesised and critiqued using assessment criteria from NIH Behaviour Change Consortium (BCC) Treatment Fidelity Framework (design, training, delivery, receipt and enactment).

Results

Twenty eight articles reporting of twenty one studies used a wide variety of approaches to measure intervention fidelity. Delivery was the most common domain of intervention fidelity measured. Approaches used to measure fidelity across all domains varied from researcher coding of observational data (using checklists or scales) to participant self-report measures. There was considerable heterogeneity of methodological approaches to data collection with respect to instruments used, attention to psychometric properties, rater-selection, observational method and sampling strategies.

Conclusions

In the field of physical activity interventions, fidelity measurement is highly heterogeneous both conceptually and methodologically. Clearer articulation of the core domains of intervention fidelity, along with appropriate measurement approaches for each domain are needed to improve the methodological quality of fidelity assessment in physical activity interventions. Recommendations are provided on how this situation can be improved.
Appendix
Available only for authorised users
Literature
2.
go back to reference Cooney GM, Dwan K, Greig CA, Lawlor DA, Rimer J, Waugh FR, et al. Exercise for depression. Cochrane Database Syst Rev. 2013;12(9):CD004366. Cooney GM, Dwan K, Greig CA, Lawlor DA, Rimer J, Waugh FR, et al. Exercise for depression. Cochrane Database Syst Rev. 2013;12(9):CD004366.
3.
go back to reference Shaw K, Gennat H, O’Rourke P, Del Mar C. Exercise for overweight or obesity. Cochrane Database Syst Rev. 2006;4 Shaw K, Gennat H, O’Rourke P, Del Mar C. Exercise for overweight or obesity. Cochrane Database Syst Rev. 2006;4
7.
go back to reference Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, et al. Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions. BMC Public Health. 2011;11(1):119.CrossRefPubMedPubMedCentral Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, et al. Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions. BMC Public Health. 2011;11(1):119.CrossRefPubMedPubMedCentral
8.
go back to reference Orrow G, Kinmonth A-L, Sanderson S, Sutton S. Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ. 2012;344:e1389.CrossRefPubMedPubMedCentral Orrow G, Kinmonth A-L, Sanderson S, Sutton S. Effectiveness of physical activity promotion based in primary care: systematic review and meta-analysis of randomised controlled trials. BMJ. 2012;344:e1389.CrossRefPubMedPubMedCentral
9.
go back to reference Mars T, Ellard D, Carnes D, Homer K, Underwood M, Taylor SJC. Fidelity in complex behaviour change interventions: a standardised approach to evaluate intervention integrity. BMJ Open. 2013;3(11):e003555.CrossRefPubMedPubMedCentral Mars T, Ellard D, Carnes D, Homer K, Underwood M, Taylor SJC. Fidelity in complex behaviour change interventions: a standardised approach to evaluate intervention integrity. BMJ Open. 2013;3(11):e003555.CrossRefPubMedPubMedCentral
10.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral
11.
go back to reference Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443.CrossRefPubMed Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23(5):443.CrossRefPubMed
15.
go back to reference Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2.CrossRefPubMed Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2.CrossRefPubMed
17.
go back to reference Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ. NIH Public Access. 2012;38(1):32–43. Schoenwald SK, Garland AF, Chapman JE, Frazier SL, Sheidow AJ. NIH Public Access. 2012;38(1):32–43.
18.
go back to reference Schoenwald SK, Garland AF. A Review of Treatment Adherence Measurement Methods. Psychol Assess. 2013;25(1):146–56.CrossRefPubMed Schoenwald SK, Garland AF. A Review of Treatment Adherence Measurement Methods. Psychol Assess. 2013;25(1):146–56.CrossRefPubMed
20.
go back to reference Schinckus L, Van den Broucke S, Housiaux M. Assessment of implementation fidelity in diabetes self-management education programs: A systematic review. Patient Educ Couns. 2014;96(1):13–21.CrossRefPubMed Schinckus L, Van den Broucke S, Housiaux M. Assessment of implementation fidelity in diabetes self-management education programs: A systematic review. Patient Educ Couns. 2014;96(1):13–21.CrossRefPubMed
21.
go back to reference Toomey E, Currie-Murphy L, Matthews J, Hurley DA. Implementation fidelity of physiotherapist-delivered group education and exercise interventions to promote self-management in people with osteoarthritis and chronic low back pain: a rapid review part II. Man Ther [Internet]. 2015;20(2):287–94. Available from: https://www.ncbi.nlm.nih.gov/pubmed/25466294.CrossRef Toomey E, Currie-Murphy L, Matthews J, Hurley DA. Implementation fidelity of physiotherapist-delivered group education and exercise interventions to promote self-management in people with osteoarthritis and chronic low back pain: a rapid review part II. Man Ther [Internet]. 2015;20(2):287–94. Available from: https://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​25466294.CrossRef
23.
go back to reference Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.CrossRefPubMed Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.CrossRefPubMed
27.
go back to reference Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: Issues and research recommendations. Clin Psychol Sci Pract. 2005;12(4):365–83.CrossRef Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: Issues and research recommendations. Clin Psychol Sci Pract. 2005;12(4):365–83.CrossRef
28.
go back to reference Richards J, Hillsdon M, Thorogood M, Foster C. Face-to-face interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;30(9):CD010392. Richards J, Hillsdon M, Thorogood M, Foster C. Face-to-face interventions for promoting physical activity. Cochrane Database Syst Rev. 2013;30(9):CD010392.
29.
go back to reference NICE. Behaviour change : individual approaches. 2014;(January):1–14. NICE. Behaviour change : individual approaches. 2014;(January):1–14.
30.
go back to reference Wongpakaran N, Wongpakaran T, Wedding D, Gwet KL. A comparison of Cohen ’ s Kappa and Gwet ’ s AC1 when calculating inter-rater reliability coefficients : a study conducted with personality disorder samples. BMC Med Res Methodol. 2013;13:61.CrossRefPubMedPubMedCentral Wongpakaran N, Wongpakaran T, Wedding D, Gwet KL. A comparison of Cohen ’ s Kappa and Gwet ’ s AC1 when calculating inter-rater reliability coefficients : a study conducted with personality disorder samples. BMC Med Res Methodol. 2013;13:61.CrossRefPubMedPubMedCentral
31.
go back to reference Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A Prod from ESRC methods Program Version. 2006;1 Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. A Prod from ESRC methods Program Version. 2006;1
32.
go back to reference Aittasalo M, Rinne M, Pasanen M, Kukkonen-Harjula K, Vasankari T. Promoting walking among office employees ― evaluation of a randomized controlled intervention with pedometers and e-mail messages. BMC Public Health. 2012;12(1):403. Available from: BMC Public Health. Aittasalo M, Rinne M, Pasanen M, Kukkonen-Harjula K, Vasankari T. Promoting walking among office employees ― evaluation of a randomized controlled intervention with pedometers and e-mail messages. BMC Public Health. 2012;12(1):403. Available from: BMC Public Health.
37.
go back to reference Goyder E, Hind D, Breckon J, Dimairo M, Minton J, Everson-Hock E, et al. A randomised controlled trial and cost-effectiveness evaluation of “booster” interventions to sustain increases in physical activity in middle-aged adults in deprived urban neighbourhoods. Health Technol Assess (Rockv). 2014;18(13):1–209. Goyder E, Hind D, Breckon J, Dimairo M, Minton J, Everson-Hock E, et al. A randomised controlled trial and cost-effectiveness evaluation of “booster” interventions to sustain increases in physical activity in middle-aged adults in deprived urban neighbourhoods. Health Technol Assess (Rockv). 2014;18(13):1–209.
40.
go back to reference Leslie E, Marshall AL, Owen N, Bauman A. Engagement and retention of participants in a physical activity website. Prev Med (Baltim). 2005;40(1):54–9.CrossRef Leslie E, Marshall AL, Owen N, Bauman A. Engagement and retention of participants in a physical activity website. Prev Med (Baltim). 2005;40(1):54–9.CrossRef
41.
go back to reference Levy SS, Cardinal BJ. Effects of a Self-determination Theory-based Mail-mediated Intervention on Adults’ Exercise Behavior. [Internet]. Baron Fox, Godin, Ingledew, Li, Marcus, Markland, Markland, Ryan, Ryan, Sallis D, editor. Vol. 18, American Journal of Health Promotion. Levy, Susan S.: Department of Exercise and Nutritional Sciences, San Diego State University, 5500 Campanile Dr, San Diego, CA, US, 92182–7251, slevy@mail.sdsu.edu: American Journal of Health Promotion; 2004. p. 345–349. Available from: https://www.ncbi.nlm.nih.gov/pubmed/15163133. Levy SS, Cardinal BJ. Effects of a Self-determination Theory-based Mail-mediated Intervention on Adults’ Exercise Behavior. [Internet]. Baron Fox, Godin, Ingledew, Li, Marcus, Markland, Markland, Ryan, Ryan, Sallis D, editor. Vol. 18, American Journal of Health Promotion. Levy, Susan S.: Department of Exercise and Nutritional Sciences, San Diego State University, 5500 Campanile Dr, San Diego, CA, US, 92182–7251, slevy@mail.sdsu.edu: American Journal of Health Promotion; 2004. p. 345–349. Available from: https://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​15163133.
45.
go back to reference Williams MA, Williamson EM, Heine PJ, Nichols V, Glover MJ, Dritsaki M, Adams J, Dosanjh S, Underwood M, Rahman A, McConkey C. Strengthening And stretching for Rheumatoid Arthritis of the Hand (SARAH). A randomised controlled trial and economic evaluation. Health Technol Assess. 2015;19(19):1–222. doi: 10.3310/hta19190. Williams MA, Williamson EM, Heine PJ, Nichols V, Glover MJ, Dritsaki M, Adams J, Dosanjh S, Underwood M, Rahman A, McConkey C. Strengthening And stretching for Rheumatoid Arthritis of the Hand (SARAH). A randomised controlled trial and economic evaluation. Health Technol Assess. 2015;19(19):1–222. doi: 10.​3310/​hta19190.
56.
go back to reference Moyers TB, Martin T, Manuel JK, Hendrickson SML, Miller WR. Assessing competence in the use of motivational interviewing. J Subst Abus Treat. 2005;28(1):19–26.CrossRef Moyers TB, Martin T, Manuel JK, Hendrickson SML, Miller WR. Assessing competence in the use of motivational interviewing. J Subst Abus Treat. 2005;28(1):19–26.CrossRef
57.
go back to reference Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed
59.
go back to reference Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman a. D, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011;343(oct18 2):d5928–d5928. Higgins JPT, Altman DG, Gotzsche PC, Juni P, Moher D, Oxman a. D, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. Bmj. 2011;343(oct18 2):d5928–d5928.
61.
go back to reference Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379.CrossRefPubMed Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379.CrossRefPubMed
64.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34.CrossRefPubMed Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009;62(10):e1–34.CrossRefPubMed
Metadata
Title
Assessment of fidelity in individual level behaviour change interventions promoting physical activity among adults: a systematic review
Authors
Jeffrey D. Lambert
Colin J. Greaves
Paul Farrand
Rosina Cross
Anne M. Haase
Adrian H. Taylor
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2017
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-017-4778-6

Other articles of this Issue 1/2017

BMC Public Health 1/2017 Go to the issue