Skip to main content
Top
Published in: Trials 1/2022

01-12-2022 | Stroke | Research

Treatment fidelity monitoring, reporting and findings in a complex aphasia intervention trial: a substudy of the Very Early Rehabilitation in SpEech (VERSE) trial

Authors: Erin Godecke, Emily Brogan, Natalie Ciccone, Miranda L. Rose, Elizabeth Armstrong, Anne Whitworth, Fiona Ellery, Audrey Holland, Sandy Middleton, Tapan Rai, Graeme J. Hankey, Dominique Cadilhac, Julie Bernhardt

Published in: Trials | Issue 1/2022

Login to get access

Abstract

Background

Treatment fidelity is inconsistently reported in aphasia research, contributing to uncertainty about the effectiveness of types of aphasia therapy following stroke. We outline the processes and outcomes of treatment fidelity monitoring in a pre-specified secondary analysis of the VERSE trial.

Methods

VERSE was a 3-arm, single-blinded RCT with a 12-week primary endpoint comparing Usual Care (UC) to two higher intensity treatments: Usual Care-Plus (UC-Plus) and VERSE, a prescribed intervention. Primary outcome results were previously reported. This secondary analysis focused on treatment fidelity. Video-recorded treatment sessions in the higher intensity study arms were evaluated for treatment adherence and treatment differentiation. Treatment components were evaluated using a pre-determined fidelity checklist. Primary outcome: prescribed amount of therapy time (minutes); secondary outcomes: (i) adherence to therapy protocol (%) and (ii) treatment differentiation between control and high intensity groups.

Results

Two hundred forty-six participants were randomised to Usual Care (n=81), Usual Care-Plus (n=82), and VERSE (n=83). One hundred thirty-five (82%) participants in higher intensity intervention arms received the minimum prescribed therapy minutes. From 10,805 (UC 7787; UC-Plus 1450; VERSE 1568) service events, 431 treatment protocol deviations were noted in 114 participants. Four hundred thirty-seven videos were evaluated. The VERSE therapists achieved over 84% adherence to key protocol elements. Higher stroke and aphasia severity, older age, and being in the UC-Plus group predicted more treatment deviations.

Conclusions

We found high levels of treatment adherence and differentiation between the intervention arms, providing greater confidence interpreting our results. The comprehensive systems for intervention fidelity monitoring and reporting in this trial make an important contribution to aphasia research and, we argue, should set a new standard for future aphasia studies.

Trial registration

Appendix
Available only for authorised users
Literature
1.
go back to reference Ang K, Hepgul N, Gao W, Higginson IJ. Strategies used in improving and assessing the level of reporting of implementation fidelity in randomised controlled trials of palliative care complex interventions: a systematic review. Palliat Med. 2018;32(2):500–16.CrossRef Ang K, Hepgul N, Gao W, Higginson IJ. Strategies used in improving and assessing the level of reporting of implementation fidelity in randomised controlled trials of palliative care complex interventions: a systematic review. Palliat Med. 2018;32(2):500–16.CrossRef
2.
go back to reference Gearing RE, El-Bassel N, Ghesquiere A, Baldwin S, Gillies J, Ngeow E. Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. Clin Psychol Rev. 2011;31(1):79–88.CrossRef Gearing RE, El-Bassel N, Ghesquiere A, Baldwin S, Gillies J, Ngeow E. Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation. Clin Psychol Rev. 2011;31(1):79–88.CrossRef
3.
go back to reference Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Br Med J. 2014;348:g1687.CrossRef Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Br Med J. 2014;348:g1687.CrossRef
5.
go back to reference Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004;23(5):443–51.CrossRef Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004;23(5):443–51.CrossRef
6.
go back to reference Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71(s1):S52–63.CrossRef Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71(s1):S52–63.CrossRef
7.
go back to reference Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: issues and research recommendations. Clin Psychol Sci Pract. 2005;12(4):365–83.CrossRef Perepletchikova F, Kazdin AE. Treatment integrity and therapeutic change: issues and research recommendations. Clin Psychol Sci Pract. 2005;12(4):365–83.CrossRef
8.
go back to reference O’Shea O, McCormack R, Bradley J, O’Neill B. Fidelity review: a scoping review of the methods used to evaluate treatment fidelity in behavioural change interventions. Phys Ther Rev. 2016;21(3-6):207–14.CrossRef O’Shea O, McCormack R, Bradley J, O’Neill B. Fidelity review: a scoping review of the methods used to evaluate treatment fidelity in behavioural change interventions. Phys Ther Rev. 2016;21(3-6):207–14.CrossRef
9.
go back to reference Dipper LT, Franklin S, de Aguiar V, Baumgaertner A, Brady M, Best W, et al. An umbrella review of aphasia intervention description in research: the AsPIRE project. Aphasiology. 2021;36(4):1–26. Dipper LT, Franklin S, de Aguiar V, Baumgaertner A, Brady M, Best W, et al. An umbrella review of aphasia intervention description in research: the AsPIRE project. Aphasiology. 2021;36(4):1–26.
10.
go back to reference Hinckley J, Douglas NF. Treatment fidelity: its importance and reported frequency in aphasia treatment studies. Am J Speech-Language Pathol. 2013;22(2):S279–S84. Hinckley J, Douglas NF. Treatment fidelity: its importance and reported frequency in aphasia treatment studies. Am J Speech-Language Pathol. 2013;22(2):S279–S84.
11.
go back to reference Brogan E, Ciccone N, Godecke E. Treatment fidelity in aphasia randomised controlled trials. Aphasiology. 2019;33(7):759–79.CrossRef Brogan E, Ciccone N, Godecke E. Treatment fidelity in aphasia randomised controlled trials. Aphasiology. 2019;33(7):759–79.CrossRef
12.
go back to reference Hickin J, Cruice M, Dipper L. A systematically conducted scoping review of the evidence and fidelity of treatments for verb deficits in aphasia: verb-in-isolation treatments. Am J Speech-Language Pathol. 2020;29(1s):530–59.CrossRef Hickin J, Cruice M, Dipper L. A systematically conducted scoping review of the evidence and fidelity of treatments for verb deficits in aphasia: verb-in-isolation treatments. Am J Speech-Language Pathol. 2020;29(1s):530–59.CrossRef
13.
go back to reference Conlon EL, Braun EJ, Babbitt EM, Cherney LR. Treatment fidelity procedures for an aphasia intervention within a randomized controlled trial: design, feasibility, and results. Am J Speech-Language Pathol. 2020;29(1S):412–24.CrossRef Conlon EL, Braun EJ, Babbitt EM, Cherney LR. Treatment fidelity procedures for an aphasia intervention within a randomized controlled trial: design, feasibility, and results. Am J Speech-Language Pathol. 2020;29(1S):412–24.CrossRef
14.
go back to reference Carragher M, Ryan B, Worrall L, Thomas S, Rose M, Simmons-Mackie N, et al. Fidelity protocol for the action success knowledge (ASK) trial: a psychosocial intervention administered by speech and language therapists to prevent depression in people with post-stroke aphasia. Br Med J Open. 2019;9(5):e023560. Carragher M, Ryan B, Worrall L, Thomas S, Rose M, Simmons-Mackie N, et al. Fidelity protocol for the action success knowledge (ASK) trial: a psychosocial intervention administered by speech and language therapists to prevent depression in people with post-stroke aphasia. Br Med J Open. 2019;9(5):e023560.
15.
go back to reference Behn N, Hilari K, Marshall J, Simpson A, Northcott S, Thomas S, et al. SUpporting well-being through PEeR-befriending (SUPERB) trial: an exploration of fidelity in peer-befriending for people with aphasia. Aphasiology. 2018;32(sup1):21–3.CrossRef Behn N, Hilari K, Marshall J, Simpson A, Northcott S, Thomas S, et al. SUpporting well-being through PEeR-befriending (SUPERB) trial: an exploration of fidelity in peer-befriending for people with aphasia. Aphasiology. 2018;32(sup1):21–3.CrossRef
16.
go back to reference Spell LA, Richardson JD, Basilakos A, Stark BC, Teklehaimanot A, Hillis AE, et al. Developing, implementing, and improving assessment and treatment fidelity in clinical aphasia research. Am J Speech-Language Pathol. 2020;29(1):286–98.CrossRef Spell LA, Richardson JD, Basilakos A, Stark BC, Teklehaimanot A, Hillis AE, et al. Developing, implementing, and improving assessment and treatment fidelity in clinical aphasia research. Am J Speech-Language Pathol. 2020;29(1):286–98.CrossRef
17.
go back to reference Godecke E, Armstrong E, Rai T, Ciccone N, Rose ML, Middleton S, et al. A randomized control trial of intensive aphasia therapy after acute stroke: the very early rehabilitation for SpEech (VERSE) study. Int J Stroke. 2020;0(0):1747493020961926. Godecke E, Armstrong E, Rai T, Ciccone N, Rose ML, Middleton S, et al. A randomized control trial of intensive aphasia therapy after acute stroke: the very early rehabilitation for SpEech (VERSE) study. Int J Stroke. 2020;0(0):1747493020961926.
18.
go back to reference McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67(3):267–77.CrossRef McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67(3):267–77.CrossRef
19.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRef Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.CrossRef
20.
go back to reference Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–60.CrossRef Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–60.CrossRef
21.
go back to reference Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef
22.
go back to reference Brogan E, Ciccone N, Godecke E. An exploration of aphasia therapy dosage in the first six months of stroke recovery. Neuropsychol Rehabil. 2020;34(10):1–35. Brogan E, Ciccone N, Godecke E. An exploration of aphasia therapy dosage in the first six months of stroke recovery. Neuropsychol Rehabil. 2020;34(10):1–35.
23.
go back to reference Brogan E, Godecke E, Ciccone N. Behind the therapy door: what is “usual care” aphasia therapy in acute stroke management? Aphasiology. 2020;6(10):1–23. Brogan E, Godecke E, Ciccone N. Behind the therapy door: what is “usual care” aphasia therapy in acute stroke management? Aphasiology. 2020;6(10):1–23.
24.
go back to reference Dalton E, Churilov L, Lannin NA, Corbett D, Hayward KS. Dose articulation in preclinical and clinical stroke recovery: refining a discovery research pipeline and presenting a scoping review protocol. Front Neurol. 2019;10(1148):1291–313. Dalton E, Churilov L, Lannin NA, Corbett D, Hayward KS. Dose articulation in preclinical and clinical stroke recovery: refining a discovery research pipeline and presenting a scoping review protocol. Front Neurol. 2019;10(1148):1291–313.
Metadata
Title
Treatment fidelity monitoring, reporting and findings in a complex aphasia intervention trial: a substudy of the Very Early Rehabilitation in SpEech (VERSE) trial
Authors
Erin Godecke
Emily Brogan
Natalie Ciccone
Miranda L. Rose
Elizabeth Armstrong
Anne Whitworth
Fiona Ellery
Audrey Holland
Sandy Middleton
Tapan Rai
Graeme J. Hankey
Dominique Cadilhac
Julie Bernhardt
Publication date
01-12-2022
Publisher
BioMed Central
Keywords
Stroke
Aphasia
Published in
Trials / Issue 1/2022
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-022-06433-3

Other articles of this Issue 1/2022

Trials 1/2022 Go to the issue