Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

"Did the trial kill the intervention?" experiences from the development, implementation and evaluation of a complex intervention

Authors: Lydia Bird, Antony Arthur, Karen Cox

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

The development, implementation and evaluation of any new health intervention is complex. This paper uses experiences from the design, implementation and evaluation of a rehabilitation programme to shed light on, and prompt discussion around, some of the complexities involved in such an undertaking.

Methods

Semi-structured interviews were conducted with 15 trial participants and five members of staff at the conclusion of a trial evaluating a rehabilitation programme aimed at promoting recovery after stem cell transplantation.

Results

This study identified a number of challenges relating to the development and evaluation of complex interventions. The difficulty of providing a standardised intervention that was acceptable to patients was highlighted in the participant interviews. Trial participants and some members of staff found the concept of equipoise and randomisation challenging and there was discord between the psychosocial nature of the intervention and the predominant bio-medical culture in which the research took place.

Conclusions

A lack of scientific evidence as to the efficacy of an intervention does not preclude staff and patients holding strong views about the benefits of an intervention. The evaluation of complex interventions should, where possible, facilitate not restrict that complexity. Within the local environment where the trial is conducted, acquiescence from those in positions of authority is insufficient; commitment to the trial is required.
Literature
2.
go back to reference Yoshioka A: Use of randomisation in the Medical Research Council's clinical trial of streptomycin in pulmonary tuberculosis in the 1940s. BMJ. 1998, 317 (7167): 1220-1223.CrossRefPubMedPubMedCentral Yoshioka A: Use of randomisation in the Medical Research Council's clinical trial of streptomycin in pulmonary tuberculosis in the 1940s. BMJ. 1998, 317 (7167): 1220-1223.CrossRefPubMedPubMedCentral
3.
go back to reference Medical Research Council: A framework for the development and evaluation of RCTs for complex interventions to improve health. London. 2000 Medical Research Council: A framework for the development and evaluation of RCTs for complex interventions to improve health. London. 2000
4.
go back to reference Medical Research Council: Developing and evaluating complex interventions: new guidance. London. 2008 Medical Research Council: Developing and evaluating complex interventions: new guidance. London. 2008
5.
go back to reference Schneider CM, Dennehy CA, Roozeboom M, Carter SD: A model program: exercise intervention for cancer rehabilitation. Integrative Cancer Therapies. 2002, 1 (1): 76-82.CrossRefPubMed Schneider CM, Dennehy CA, Roozeboom M, Carter SD: A model program: exercise intervention for cancer rehabilitation. Integrative Cancer Therapies. 2002, 1 (1): 76-82.CrossRefPubMed
6.
go back to reference Rees KTR, Singh S, Coats AJS, Ebrahim S: Exercise based rehabilitation for heart failure. Cochrane Database of Systematic Reviews. 2004, CD003331-3 Rees KTR, Singh S, Coats AJS, Ebrahim S: Exercise based rehabilitation for heart failure. Cochrane Database of Systematic Reviews. 2004, CD003331-3
7.
go back to reference van Weert E, Hoekstra-Weebers JEH, Grol BMF, Otter R, Arendzen JH, Postema K, van der Schans CP: Physical functioning and quality of life after cancer rehabilitation. International Journal of Rehabilitation Research. 2004, 27 (1): 27-35. 10.1097/00004356-200403000-00004.CrossRefPubMed van Weert E, Hoekstra-Weebers JEH, Grol BMF, Otter R, Arendzen JH, Postema K, van der Schans CP: Physical functioning and quality of life after cancer rehabilitation. International Journal of Rehabilitation Research. 2004, 27 (1): 27-35. 10.1097/00004356-200403000-00004.CrossRefPubMed
8.
go back to reference Bird L, Arthur A, Niblock T, Stone R, Watson L, Cox K: Rehabilitation programme after stem cell transplantation: randomized controlled trial. J Adv Nurs. 2010, 66 (3): 607-615. 10.1111/j.1365-2648.2009.05232.x.CrossRefPubMed Bird L, Arthur A, Niblock T, Stone R, Watson L, Cox K: Rehabilitation programme after stem cell transplantation: randomized controlled trial. J Adv Nurs. 2010, 66 (3): 607-615. 10.1111/j.1365-2648.2009.05232.x.CrossRefPubMed
9.
go back to reference Popay J: Qualitative research and evidence-based healthcare. Journal of the Royal Society of Medicine, Supplement. 1998, 91 (35): 32-37. Popay J: Qualitative research and evidence-based healthcare. Journal of the Royal Society of Medicine, Supplement. 1998, 91 (35): 32-37.
10.
go back to reference Heinonen H, Volin L, Zevon MA, Uutela A, Barrick C, Ruutu T: Stress among allogeneic bone marrow transplantation patients. Patient Education and Counseling. 2005, 56 (1): 62-71. 10.1016/j.pec.2003.12.007.CrossRefPubMed Heinonen H, Volin L, Zevon MA, Uutela A, Barrick C, Ruutu T: Stress among allogeneic bone marrow transplantation patients. Patient Education and Counseling. 2005, 56 (1): 62-71. 10.1016/j.pec.2003.12.007.CrossRefPubMed
11.
go back to reference Murtagh MJ, Thomson RG, May CR, Rapley T, Heaven BR, Graham RH, Kaner EF, Stobbart L, Eccles MP: Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool. Qual Saf Health Care. 2007, 16 (3): 224-229. 10.1136/qshc.2006.018499.CrossRefPubMedPubMedCentral Murtagh MJ, Thomson RG, May CR, Rapley T, Heaven BR, Graham RH, Kaner EF, Stobbart L, Eccles MP: Qualitative methods in a randomised controlled trial: the role of an integrated qualitative process evaluation in providing evidence to discontinue the intervention in one arm of a trial of a decision support tool. Qual Saf Health Care. 2007, 16 (3): 224-229. 10.1136/qshc.2006.018499.CrossRefPubMedPubMedCentral
12.
go back to reference Riley T, Hawe P, Shiell A: Contested ground: How should qualitative evidence inform the conduct of a community intervention trial?. Journal of Health Services Research and Policy. 2005, 10 (2): 103-110. 10.1258/1355819053559029.CrossRefPubMed Riley T, Hawe P, Shiell A: Contested ground: How should qualitative evidence inform the conduct of a community intervention trial?. Journal of Health Services Research and Policy. 2005, 10 (2): 103-110. 10.1258/1355819053559029.CrossRefPubMed
13.
go back to reference Rapley T, May C, Heaven B, Murtagh M, Graham R, Kaner EFS, Thomson R: Doctor-patient interaction in a randomised controlled trial of decision-support tools. Social Science and Medicine. 2006, 62 (9): 2267-2278. 10.1016/j.socscimed.2005.10.011.CrossRefPubMed Rapley T, May C, Heaven B, Murtagh M, Graham R, Kaner EFS, Thomson R: Doctor-patient interaction in a randomised controlled trial of decision-support tools. Social Science and Medicine. 2006, 62 (9): 2267-2278. 10.1016/j.socscimed.2005.10.011.CrossRefPubMed
14.
go back to reference Hawe P, Shiell A, Riley T: Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ. 2004, 328 (7455): 1561-1563. 10.1136/bmj.328.7455.1561.CrossRefPubMedPubMedCentral Hawe P, Shiell A, Riley T: Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ. 2004, 328 (7455): 1561-1563. 10.1136/bmj.328.7455.1561.CrossRefPubMedPubMedCentral
15.
go back to reference Featherstone K, Donovan JL: Random allocation or allocation at random? Patients' perspectives of participation in a randomised controlled trial. BMJ. 1998, 317 (7167): 1177-1180.CrossRefPubMedPubMedCentral Featherstone K, Donovan JL: Random allocation or allocation at random? Patients' perspectives of participation in a randomised controlled trial. BMJ. 1998, 317 (7167): 1177-1180.CrossRefPubMedPubMedCentral
16.
go back to reference Snowdon C, Garcia J, Elbourne D: Making sense of randomization; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997, 45 (9): 1337-1355. 10.1016/S0277-9536(97)00063-4.CrossRefPubMed Snowdon C, Garcia J, Elbourne D: Making sense of randomization; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997, 45 (9): 1337-1355. 10.1016/S0277-9536(97)00063-4.CrossRefPubMed
17.
go back to reference Edwards SJ, Lilford RJ, Hewison J: The ethics of randomised controlled trials from the perspectives of patients, the public, and healthcare professionals. BMJ. 1998, 317 (7167): 1209-1212.CrossRefPubMedPubMedCentral Edwards SJ, Lilford RJ, Hewison J: The ethics of randomised controlled trials from the perspectives of patients, the public, and healthcare professionals. BMJ. 1998, 317 (7167): 1209-1212.CrossRefPubMedPubMedCentral
18.
go back to reference Jenkins V, Leach L, Fallowfield L, Nicholls K, Newsham A: Describing randomisation: patients' and the public's preferences compared with clinicians' practice. Br J Cancer. 2002, 87 (8): 854-858. 10.1038/sj.bjc.6600527.CrossRefPubMedPubMedCentral Jenkins V, Leach L, Fallowfield L, Nicholls K, Newsham A: Describing randomisation: patients' and the public's preferences compared with clinicians' practice. Br J Cancer. 2002, 87 (8): 854-858. 10.1038/sj.bjc.6600527.CrossRefPubMedPubMedCentral
19.
go back to reference Alderson P, Madden M, Oakley A, Wilkins R: Women's views of breast cancer treatment and research. Report of a pilot project 1993. London. 1994 Alderson P, Madden M, Oakley A, Wilkins R: Women's views of breast cancer treatment and research. Report of a pilot project 1993. London. 1994
20.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. BMJ. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral
21.
go back to reference Oakley A: Who's afraid of the randomised controlled trial? Some dilemmas of the scientific method and 'good' research practice. Women's Health Counts. 1990, Robertts: Routledge Oakley A: Who's afraid of the randomised controlled trial? Some dilemmas of the scientific method and 'good' research practice. Women's Health Counts. 1990, Robertts: Routledge
22.
go back to reference Fox RC: Experiment Perilous, physicians and patients facing the unknown. 1998, London: Transaction Publishers Fox RC: Experiment Perilous, physicians and patients facing the unknown. 1998, London: Transaction Publishers
23.
go back to reference Davies C: Gender And The Professional Predicament In Nursing. 1995, Buckingham: Open University Press Davies C: Gender And The Professional Predicament In Nursing. 1995, Buckingham: Open University Press
24.
go back to reference Mackay L: Conflicts in Care, Medicine and Nursing. 1993, London: Chapman and Hall Mackay L: Conflicts in Care, Medicine and Nursing. 1993, London: Chapman and Hall
25.
Metadata
Title
"Did the trial kill the intervention?" experiences from the development, implementation and evaluation of a complex intervention
Authors
Lydia Bird
Antony Arthur
Karen Cox
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-24

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue