Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2017

Open Access 01-12-2017 | Research

Quality of intervention delivery in a cluster randomised controlled trial: a qualitative observational study with lessons for fidelity

Authors: Karen James, Alan Quirk, Sue Patterson, Geoff Brennan, Duncan Stewart

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

Understanding intervention fidelity is an essential part of the evaluation of complex interventions because fidelity not only affects the validity of trial findings, but also because studies of fidelity can be used to identify barriers and facilitators to successful implementation, and so provide important information about factors likely to impact the uptake of the intervention into clinical practice. Participant observation methods have been identified as being particularly valuable in studies of fidelity, yet are rarely used. This study aimed to use these methods to explore the quality of implementation of a complex intervention (Safewards) on mental health wards during a cluster randomised controlled trial. Specific aims were firstly to describe the different ways in which the intervention was implemented, and secondly to explore the contextual factors moderating the quality of intervention delivery, in order to inform ‘real world’ implementation of the intervention.

Methods

Safewards was implemented on 16 mental health wards in England. We used Research Assistants (RAs) trained in participant observation to record qualitative observational data on the quality of intervention delivery (n = 565 observations). At the end of the trial, two focus groups were conducted with RAs, which were used to develop the coding framework. Data were analysed using thematic analysis.

Results

There was substantial variation in intervention delivery between wards. We observed modifications to the intervention which were both fidelity consistent and inconsistent, and could enhance or dilute the intervention effects. We used these data to develop a typology which describes the different ways in which the intervention was delivered. This typology could be used as a tool to collect qualitative observational data about fidelity during trials. Moderators of Safewards implementation included systemic, interpersonal, and individual factors and patient responses to the intervention.

Conclusions

Our study demonstrates how, with appropriate training in participant observation, RAs can collect high-quality observational data about the quality of intervention delivery during a trial, giving a more complete picture of ‘fidelity’ than measurements of adherence alone.

Trial registration

ISRCTN registry; IRSCTN38001825. Registered 29 August 2012
Appendix
Available only for authorised users
Literature
1.
Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.CrossRefPubMed
2.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions. UK: Medical Research Council; 2011.
3.
Haynes A, Brennan S, Redman S, Williamson A, Gallego G, Butow P. Figuring out fidelity: A worked example of the methods used to identify, critique and revise the essential elements of a contextualised intervention in health policy agencies. Implement Sci. 2016;11:23.CrossRefPubMedPubMedCentral
4.
Mihalic S. The importance of implementation fidelity. Emot Behav Disord Youth. 2004;4(4):83–105.
5.
6.
McKleroy VS, Galbraith JS, Cummings B, Jones P. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Educ Prev. 2006;18:59–73.CrossRefPubMed
7.
Mowbray CT, Holter MC, Teague GB, Bybee D. Fidelity criteria: development, measurement, and validation. Am J Eval. 2003;24(3):315–40.CrossRef
8.
Stirman SW, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implement Sci. 2013;8:65.CrossRefPubMedPubMedCentral
9.
Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: A case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7:23.CrossRefPubMedPubMedCentral
10.
Lawton J, Jenkins N, Darbyshire JL, Holman RR, Farmer AJ, Hallowell N. Challenges of maintaining research protocol fidelity in a clinical care setting: a qualitative study of the experiences and views of patients and staff participating in a randomized controlled trial. Trials. 2011;12:108.CrossRefPubMedPubMedCentral
11.
Quirk A, MacNeil V, Dhital R, Whittlesea C, Norman I, McCambridge J. Qualitative process study of community pharmacist brief alcohol intervention effectiveness trial: Can research participation effects explain a null finding? Drug Alcohol Depend. 2016;161:36–41.CrossRefPubMed
12.
13.
Jones F, Gage H, Drummond A, Bhalla A, Grant R, Lennon S, … Liston M. Feasibility study of an integrated stroke self-management programme: a cluster-randomised controlled trial. BMJ Open. 2016;6(1):e008900.
14.
McEachan RR, Santorelli G, Bryant M, Sahota P, Farrar D, Small N, et al. The HAPPY (healthy and active parenting programmme for early years) feasibility randomised control trial: acceptability and feasibility of an intervention to reduce infant obesity. BMC Public Health. 2016;16(1):211.CrossRefPubMedPubMedCentral
15.
Bowers L, James K, Quirk A, Simpson A, SUGAR, Stewart D, Hodsall J. Reducing conflict and containment rates on acute psychiatric wards: the Safewards cluster randomised controlled trial. Int J Nurs Stud. 2015;52:1412–22.CrossRefPubMedPubMedCentral
16.
Bowers L, Simpson A, Alexander J. Patient-staff conflict: Results of a survey on acute psychiatric wards. Soc Psychiatry Psychiatr Epidemiol. 2003;38(7):402–8.CrossRefPubMed
17.
Bowers L. Safewards: a new model of conflict and containment on psychiatric wards. J Psychiatr Ment Health Nurs. 2014;21(6):499–508.CrossRefPubMed
18.
Mustafa F. The Safewards study lacks rigour despite its randomised design. Int J Nurs Stud. 2015;52:1906–7.CrossRefPubMed
19.
Bowers L. Response to Mustafa 2015: the Safewards study lacks rigour despite its randomised design. Int J Nurs Stud. 2015;53:405–6.CrossRefPubMed
20.
Bate P, Robert G, Fulop N, Øvretveit J, Dixon-Woods M. Perspectives on context. London: The Health Foundation; 2014.
21.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
22.
Price O, Burbery P, Leonard S, Doyle M. Evaluation of Safewards in forensic mental health: analysis of a multicomponent intervention intended to reduce levels of conflict and containment in inpatient mental health settings. Ment Health Pract. 2016;19(8):14–21.CrossRef
Metadata
Title
Quality of intervention delivery in a cluster randomised controlled trial: a qualitative observational study with lessons for fidelity
Authors
Karen James
Alan Quirk
Sue Patterson
Geoff Brennan
Duncan Stewart
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-2189-8

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue

Research

Resource implications of preparing individual participant data from a clinical trial to share with external researchers

Correction

Correction to Reduced nicotine content cigarettes in smokers of low socioeconomic status: study protocol for a randomized control trial

Study protocol

Effects of a brief, pedometer-based behavioral intervention for individuals with COPD during inpatient pulmonary rehabilitation on 6-week and 6-month objectively measured physical activity: study protocol for a randomized controlled trial

Study protocol

Developing and evaluating multimedia information resources to improve engagement of children, adolescents, and their parents with trials (TRECA study): Study protocol for a series of linked randomised controlled trials

Study protocol

Efficacy of vitamin D3 supplementation in reducing incidence of pulmonary tuberculosis and mortality among HIV-infected Tanzanian adults initiating antiretroviral therapy: study protocol for a randomized controlled trial

Study protocol

The effect of a mindfulness-based intervention in cognitive functions and psychological well-being applied as an early intervention in schizophrenia and high-risk mental state in a Chilean sample: study protocol for a randomized controlled trial