Skip to main content
Top
Published in: Trials 1/2007

Open Access 01-12-2007 | Research

Does it matter if clinicians recruiting for a trial don't understand what the trial is really about? Qualitative study of surgeons' experiences of participation in a pragmatic multi-centre RCT

Authors: Sue Ziebland, Katie Featherstone, Claire Snowdon, Karen Barker, Helen Frost, Jeremy Fairbank

Published in: Trials | Issue 1/2007

Login to get access

Abstract

Background

Qualitative methods are increasingly used to study the process of clinical trials and patients understanding of the rationale for trials, randomisation and reasons for taking part or refusing. Patients' understandings are inevitably influenced by the recruiting clinician's understanding of the trial, yet relatively little qualitative work has explored clinicians' perceptions and understandings of trials. This study interviewed surgeons shortly after the multi-centre, pragmatic RCT in which they had participated had been completed.

Methods

We used in-depth interviews with surgeons who participated in the Spine Stabilisation Trial (a pragmatic RCT) to explore their understanding of the trial purpose and how this understanding had influenced their recruitment procedures and interpretation of the results. A purposive sample of eleven participating surgeons was chosen from 8 of the 15 UK trial centres.

Results

Although the surgeons thought that the trial was addressing an important question there was little agreement about what this question was: although it was a trial of 'equivalent' treatments, some thought that it was a trial of surgery, others a trial of rehabilitation and others that it was exploring what to do with patients in whom all other treatment options had been unsuccessful. The surgeons we interviewed were not aware of the rationale for the pragmatic inclusion criteria and nearly all were completely baffled about the meaning of 'equipoise'. Misunderstandings about the entry criteria were an important source of confusion about the results and led to reluctance to apply the results to their own practice.

Conclusion

The study suggests several lessons for the conduct of future multi-centre trials. Recruiting surgeons (and other clinicians) may not be familiar with the rationale for pragmatic designs and may need to be regularly reminded about the purpose during the study. Reassurance may be necessary that a pragmatic design is not considered a design fault. We conclude that it does matter if clinicians do not understand the rationale for the trial if, as we have shown here, their perception of the trial aims and methods adversely affects who they recruit; if their views affect what the patients are told; and if they mistakenly view the results as unscientific, unreliable and ultimately irrelevant to their practice.
Literature
1.
go back to reference Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Quality improvement report: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. Commentary: presenting unbiased information to patients can be difficult. BMJ. 2002, 5;325 (7367): 766-70. 10.1136/bmj.325.7367.766.CrossRef Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Quality improvement report: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. Commentary: presenting unbiased information to patients can be difficult. BMJ. 2002, 5;325 (7367): 766-70. 10.1136/bmj.325.7367.766.CrossRef
2.
go back to reference Pollock AV: The rise and fall of the random controlled trial in surgery. Theor Surg. 1989, 4: 163-170. Pollock AV: The rise and fall of the random controlled trial in surgery. Theor Surg. 1989, 4: 163-170.
3.
4.
go back to reference Ko CY, Sack J, Chang JT, Fink A: Reporting randomized, controlled trials: where quality of reporting may be improved. Dis Colon Rectum. 2002, 45 (4): 443-7. 10.1007/s10350-004-6217-x.CrossRefPubMed Ko CY, Sack J, Chang JT, Fink A: Reporting randomized, controlled trials: where quality of reporting may be improved. Dis Colon Rectum. 2002, 45 (4): 443-7. 10.1007/s10350-004-6217-x.CrossRefPubMed
5.
go back to reference Solomon MJ, McLeod RS: Surgery and the randomised controlled trial: past, present and future. Med J Aust. 1998, 169 (7): 380-3.PubMed Solomon MJ, McLeod RS: Surgery and the randomised controlled trial: past, present and future. Med J Aust. 1998, 169 (7): 380-3.PubMed
6.
go back to reference Horton R: Surgical research or comic opera: questions but few answers. Lancet. 1996, 347: 984-985. 10.1016/S0140-6736(96)90137-3.CrossRefPubMed Horton R: Surgical research or comic opera: questions but few answers. Lancet. 1996, 347: 984-985. 10.1016/S0140-6736(96)90137-3.CrossRefPubMed
7.
go back to reference Solomon MJ, McLeod RS: Should we be performing more randomized controlled trials evaluating surgical operations?. Surgery. 1995, 118 (3): 459-67. 10.1016/S0039-6060(05)80359-9.CrossRefPubMed Solomon MJ, McLeod RS: Should we be performing more randomized controlled trials evaluating surgical operations?. Surgery. 1995, 118 (3): 459-67. 10.1016/S0039-6060(05)80359-9.CrossRefPubMed
8.
go back to reference Curry JI, Reeves B, Stringer MD: Randomized controlled trials in pediatric surgery: could we do better?. J Pediatr Surg. 2003, 38 (4): 556-9. 10.1053/jpsu.2003.50121.CrossRefPubMed Curry JI, Reeves B, Stringer MD: Randomized controlled trials in pediatric surgery: could we do better?. J Pediatr Surg. 2003, 38 (4): 556-9. 10.1053/jpsu.2003.50121.CrossRefPubMed
9.
go back to reference Anyanwu AC, Treasure T: Surgical research revisited: clinical trials in the cardiothoracic surgical literature. Eur J Cardiothorac Surg. 2004, 25 (3): 299-303. 10.1016/j.ejcts.2003.12.004.CrossRefPubMed Anyanwu AC, Treasure T: Surgical research revisited: clinical trials in the cardiothoracic surgical literature. Eur J Cardiothorac Surg. 2004, 25 (3): 299-303. 10.1016/j.ejcts.2003.12.004.CrossRefPubMed
11.
go back to reference Buchwald H: Surgical procedures and devices should be evaluated in the same way as medical therapy. Control Clin Trials. 1997, 18 (6): 478-87. 10.1016/S0197-2456(96)00114-6.CrossRefPubMed Buchwald H: Surgical procedures and devices should be evaluated in the same way as medical therapy. Control Clin Trials. 1997, 18 (6): 478-87. 10.1016/S0197-2456(96)00114-6.CrossRefPubMed
12.
go back to reference Ehrlich PF, Newman KD, Haase GM, Lobe TE, Wiener ES, Holcomb GW: Lessons learned from a failed multi-institutional randomized controlled study. J Pediatr Surg. 2002, 37 (3): 431-6. 10.1053/jpsu.2002.30853.CrossRefPubMed Ehrlich PF, Newman KD, Haase GM, Lobe TE, Wiener ES, Holcomb GW: Lessons learned from a failed multi-institutional randomized controlled study. J Pediatr Surg. 2002, 37 (3): 431-6. 10.1053/jpsu.2002.30853.CrossRefPubMed
13.
go back to reference McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D: Randomised trials in surgery: problems and possible solutions. BMJ. 2002, 324 (7351): 1448-51. 10.1136/bmj.324.7351.1448.CrossRefPubMedPubMedCentral McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D: Randomised trials in surgery: problems and possible solutions. BMJ. 2002, 324 (7351): 1448-51. 10.1136/bmj.324.7351.1448.CrossRefPubMedPubMedCentral
14.
go back to reference Reitsma AM, Moreno JD: thical regulations for innovative surgery: the last frontier?. J Am Coll Surg. 2002, 194 (6): 792-801. 10.1016/S1072-7515(02)01153-5.CrossRefPubMed Reitsma AM, Moreno JD: thical regulations for innovative surgery: the last frontier?. J Am Coll Surg. 2002, 194 (6): 792-801. 10.1016/S1072-7515(02)01153-5.CrossRefPubMed
15.
16.
go back to reference McLeod RS, Wright JG, Solomon MJ, Hu X, Walters BC, Lossing A: Randomized controlled trials in surgery: Issues and problems. Surgery. 1996, 119 (5): 483-6. 10.1016/S0039-6060(96)80254-6.CrossRefPubMed McLeod RS, Wright JG, Solomon MJ, Hu X, Walters BC, Lossing A: Randomized controlled trials in surgery: Issues and problems. Surgery. 1996, 119 (5): 483-6. 10.1016/S0039-6060(96)80254-6.CrossRefPubMed
17.
go back to reference Maddern GJ: Surgery and evidence-based medicine. Med J Aust. 1998, 5;169 (7): 348-9. Maddern GJ: Surgery and evidence-based medicine. Med J Aust. 1998, 5;169 (7): 348-9.
18.
go back to reference McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D: Randomised trials in surgery: problems and possible solutions. BMJ. 2002, 324 (7351): 1448-51. 10.1136/bmj.324.7351.1448.CrossRefPubMedPubMedCentral McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D: Randomised trials in surgery: problems and possible solutions. BMJ. 2002, 324 (7351): 1448-51. 10.1136/bmj.324.7351.1448.CrossRefPubMedPubMedCentral
19.
go back to reference Fallowfield L, Ratcliffe D, Souhami R: Clinicians' attitudes to clinical trials of cancer therapy. Eur J Cancer. 1997, 33 (13): 2221-9. 10.1016/S0959-8049(97)00253-0.CrossRefPubMed Fallowfield L, Ratcliffe D, Souhami R: Clinicians' attitudes to clinical trials of cancer therapy. Eur J Cancer. 1997, 33 (13): 2221-9. 10.1016/S0959-8049(97)00253-0.CrossRefPubMed
20.
go back to reference Martin RC, Polk HC, Jaques DP: Does additional surgical training increase participation in randomized controlled trials?. Am J Surg. 2003, 185 (3): 239-43. 10.1016/S0002-9610(02)01369-7.CrossRefPubMed Martin RC, Polk HC, Jaques DP: Does additional surgical training increase participation in randomized controlled trials?. Am J Surg. 2003, 185 (3): 239-43. 10.1016/S0002-9610(02)01369-7.CrossRefPubMed
21.
go back to reference Millat B, Fingerhut A, Flamant Y, Hay JM, Fagniez PL, Farah A, Duron JJ, Courchevel JM: Survey of the impact of randomised clinical trials on surgical practice in France. Eur J Surg. 1999, 165 (2): 87-94. 10.1080/110241599750007243.CrossRefPubMed Millat B, Fingerhut A, Flamant Y, Hay JM, Fagniez PL, Farah A, Duron JJ, Courchevel JM: Survey of the impact of randomised clinical trials on surgical practice in France. Eur J Surg. 1999, 165 (2): 87-94. 10.1080/110241599750007243.CrossRefPubMed
22.
go back to reference Fairbank J, Frost H, Wilson-MacDonald J, Yu LM, Barker K, Collins R: Spine Stabilisation Trial Group Randomised controlled trial to compare surgical stabilisation of the lumbar spine with an intensive rehabilitation programme for patients with chronic low back pain: the MRC spine stabilisation trial. BMJ. 2005, 330: 1233-1239. 10.1136/bmj.38441.620417.8F.CrossRefPubMedPubMedCentral Fairbank J, Frost H, Wilson-MacDonald J, Yu LM, Barker K, Collins R: Spine Stabilisation Trial Group Randomised controlled trial to compare surgical stabilisation of the lumbar spine with an intensive rehabilitation programme for patients with chronic low back pain: the MRC spine stabilisation trial. BMJ. 2005, 330: 1233-1239. 10.1136/bmj.38441.620417.8F.CrossRefPubMedPubMedCentral
23.
go back to reference Riviero-Arias O, Campbell H, Gray A, Fairbank J, Frost H, Wilson-MacDonald J: Surgical stabilisation of the lumbar spine compared with a programme of intensive rehabilitation for the management of patients with chronic low back pain: cost utility analysis based on a randomised controlled trial. BMJ. 2005, 330: 1239-1243. 10.1136/bmj.38441.429618.8F.CrossRef Riviero-Arias O, Campbell H, Gray A, Fairbank J, Frost H, Wilson-MacDonald J: Surgical stabilisation of the lumbar spine compared with a programme of intensive rehabilitation for the management of patients with chronic low back pain: cost utility analysis based on a randomised controlled trial. BMJ. 2005, 330: 1239-1243. 10.1136/bmj.38441.429618.8F.CrossRef
24.
25.
go back to reference Garcia J, Elbourne DR, Snowdon C: Equipoise: a case study of the views of clinicians involved in two neonatal trials. Clin Trials. 2004, 1 (2): 170-8. 10.1191/1740774504cn020xx.CrossRefPubMed Garcia J, Elbourne DR, Snowdon C: Equipoise: a case study of the views of clinicians involved in two neonatal trials. Clin Trials. 2004, 1 (2): 170-8. 10.1191/1740774504cn020xx.CrossRefPubMed
26.
go back to reference Schwartz D, Lelouch J: Explanatory and pragmatic attitudes in therapeutic trials. Journal of Chronic Disease. 1967, 20: 637-48. 10.1016/0021-9681(67)90041-0.CrossRef Schwartz D, Lelouch J: Explanatory and pragmatic attitudes in therapeutic trials. Journal of Chronic Disease. 1967, 20: 637-48. 10.1016/0021-9681(67)90041-0.CrossRef
27.
go back to reference Snowdon C, Elbourne D, Garcia J: Making sense of randomisation; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997, 45: 1337-55. 10.1016/S0277-9536(97)00063-4.CrossRefPubMed Snowdon C, Elbourne D, Garcia J: Making sense of randomisation; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med. 1997, 45: 1337-55. 10.1016/S0277-9536(97)00063-4.CrossRefPubMed
Metadata
Title
Does it matter if clinicians recruiting for a trial don't understand what the trial is really about? Qualitative study of surgeons' experiences of participation in a pragmatic multi-centre RCT
Authors
Sue Ziebland
Katie Featherstone
Claire Snowdon
Karen Barker
Helen Frost
Jeremy Fairbank
Publication date
01-12-2007
Publisher
BioMed Central
Published in
Trials / Issue 1/2007
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-8-4

Other articles of this Issue 1/2007

Trials 1/2007 Go to the issue