Skip to main content
Top
Published in: Trials 1/2011

Open Access 01-12-2011 | Research

Effects on patients of their healthcare practitioner's or institution's participation in clinical trials: a systematic review

Authors: Mike Clarke, Kirsty Loudon

Published in: Trials | Issue 1/2011

Login to get access

Abstract

Background

Systematic reviews have shown uncertainty about the size or direction of any 'trial effect' for patients in trials compared to those treated outside trials. We are not aware of any systematic review of whether there is a 'trial effect' related to being treated by healthcare practitioners or institutions that take part in research.

Methods

We searched the Cochrane Methodology Register and MEDLINE (most recently in January 2009) for studies in which patients were allocated to treatment in one or other setting, and cohort studies reporting the outcomes of patients from different settings. We independently assessed study quality, including the control of bias in the generation of the comparison groups, and extracted data.

Results

We retrieved and checked more than 15,000 records. Thirteen articles were eligible: five practitioner studies and eight institution studies. Meta-analyses were not possible because of heterogeneity. Two practitioner studies were judged to be 'controlled' or better. A Canadian study among nurses found that use of research evidence was higher for those who took part in research working groups and a Danish study on general practitioners found that trial doctors were more likely to prescribe in accordance with research evidence and guidelines. Five institution studies were 'controlled' but provided mixed results. A study of North American patients at hospitals that had taken part in trials for myocardial infarction found no statistically significant difference in treatment for patients in trial and non-trial hospitals. A Canadian study of myocardial infarction patients found that trial participants had better survival than patients in the same hospitals who were not in trials or those in non-trial hospitals. A study of general practices in Denmark did not detect differences in guideline adherence between trial and non-trial practices but found that trial practices were more likely to prescribe the trial sponsor's drugs. The other two 'controlled' studies of institutions found lower mortality in trial than non-trial hospitals.

Conclusions

The available findings from existing research suggest that there might be a 'trial effect' of better outcomes, greater adherence to guidelines and more use of evidence by practitioners and institutions that take part in trials. However, the consequences for patient health are uncertain and the most robust conclusion may be that there is no apparent evidence that patients treated by practitioners or in institutions that take part in trials do worse than those treated elsewhere.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vist GE, Bryant D, Somerville L, Birminghem T, Oxman AD: Outcomes of patients who participate in randomized controlled trials compared to similar patients receiving similar interventions who do not participate. Cochrane Database of Systematic Reviews. 2008, MR000009-3 Vist GE, Bryant D, Somerville L, Birminghem T, Oxman AD: Outcomes of patients who participate in randomized controlled trials compared to similar patients receiving similar interventions who do not participate. Cochrane Database of Systematic Reviews. 2008, MR000009-3
2.
go back to reference Clarke M, Oxman AD, Paulsen E, Higgins JPT, Green S, editors: Appendix A: Guide to the contents of a Cochrane Methodology protocol and review. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2009, The Cochrane Collaboration, Version 5.0.2 [updated September 2009]. (Accessed 28 November 2010), http://www.cochrane-handbook.org Clarke M, Oxman AD, Paulsen E, Higgins JPT, Green S, editors: Appendix A: Guide to the contents of a Cochrane Methodology protocol and review. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2009, The Cochrane Collaboration, Version 5.0.2 [updated September 2009]. (Accessed 28 November 2010), http://​www.​cochrane-handbook.​org
3.
go back to reference Braunholtz DA, Edwards SJL, Lilford RJ: Are randomized clinical trials good for us (in the short term)? Evidence for a 'trial effect'. Journal of Clinical Epidemiology. 2001, 54 (3): 217-24. 10.1016/S0895-4356(00)00305-X.CrossRefPubMed Braunholtz DA, Edwards SJL, Lilford RJ: Are randomized clinical trials good for us (in the short term)? Evidence for a 'trial effect'. Journal of Clinical Epidemiology. 2001, 54 (3): 217-24. 10.1016/S0895-4356(00)00305-X.CrossRefPubMed
4.
go back to reference Peppercorn JM, Weeks JC, Cook EF, Joffe S: Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review. Lancet. 2004, 363 (9405): 263-70. 10.1016/S0140-6736(03)15383-4.CrossRefPubMed Peppercorn JM, Weeks JC, Cook EF, Joffe S: Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review. Lancet. 2004, 363 (9405): 263-70. 10.1016/S0140-6736(03)15383-4.CrossRefPubMed
5.
go back to reference Anon: Chinese Journal of Evidence Based Medicine to be indexed in Cochrane Methodology Register. Chinese Journal of Evidence Based Medicine. 2004, 4: 833- Anon: Chinese Journal of Evidence Based Medicine to be indexed in Cochrane Methodology Register. Chinese Journal of Evidence Based Medicine. 2004, 4: 833-
6.
go back to reference Meineche-Schmidt V, Hvenegaard A, Juhl HH: Participation in a clinical trial influences the future management of patients with gastro-oesophageal reflux disease in general practice. Alimentary Pharmacology & Therapeutics. 2006, 24 (7): 1117-25.CrossRef Meineche-Schmidt V, Hvenegaard A, Juhl HH: Participation in a clinical trial influences the future management of patients with gastro-oesophageal reflux disease in general practice. Alimentary Pharmacology & Therapeutics. 2006, 24 (7): 1117-25.CrossRef
7.
go back to reference Tranmer JE, Lochaus-Gerlach J, Lam M: The effect of staff nurse participation in a clinical nursing research project on attitude towards, access to, support of and use of research in the acute care setting. Canadian Journal of Nursing Leadership. 2002, 15 (1): 18-26.CrossRefPubMed Tranmer JE, Lochaus-Gerlach J, Lam M: The effect of staff nurse participation in a clinical nursing research project on attitude towards, access to, support of and use of research in the acute care setting. Canadian Journal of Nursing Leadership. 2002, 15 (1): 18-26.CrossRefPubMed
8.
go back to reference Das D, Ishaq S, Harrison R, Kosuri K, Harper E, Decaestecker J, Sampliner R, Attwood S, Barr H, Watson P, Moayyedi P, Jankowski J: Management of Barrett's esophagus in the UK: overtreated and underbiopsied but improved by the introduction of a national randomized trial. American Journal of Gastroenterology. 2008, 103 (5): 1079-89. 10.1111/j.1572-0241.2008.01790.x.CrossRefPubMed Das D, Ishaq S, Harrison R, Kosuri K, Harper E, Decaestecker J, Sampliner R, Attwood S, Barr H, Watson P, Moayyedi P, Jankowski J: Management of Barrett's esophagus in the UK: overtreated and underbiopsied but improved by the introduction of a national randomized trial. American Journal of Gastroenterology. 2008, 103 (5): 1079-89. 10.1111/j.1572-0241.2008.01790.x.CrossRefPubMed
9.
go back to reference Kizer JR, Cannon CP, McCabe CH, Mueller HS, Schweiger MJ, Davis VG, Perritt R, Antman EM, for the TIMI investigators: Trends in the use of pharmacotherapies for acute myocardial infarction among physicians who design and/or implement randomized trials versus physicians in routine clinical practice: the MILIS-TIMI experience. American Heart Journal. 1999, 137 (1): 79-92. 10.1016/S0002-8703(99)70462-X.CrossRefPubMed Kizer JR, Cannon CP, McCabe CH, Mueller HS, Schweiger MJ, Davis VG, Perritt R, Antman EM, for the TIMI investigators: Trends in the use of pharmacotherapies for acute myocardial infarction among physicians who design and/or implement randomized trials versus physicians in routine clinical practice: the MILIS-TIMI experience. American Heart Journal. 1999, 137 (1): 79-92. 10.1016/S0002-8703(99)70462-X.CrossRefPubMed
10.
go back to reference Adler MW: Changes in local clinical practice following an experiment in medical care: evaluation of evaluation. Journal of Epidemiology and Community Health. 1978, 32 (2): 143-6. 10.1136/jech.32.2.143.CrossRefPubMedPubMedCentral Adler MW: Changes in local clinical practice following an experiment in medical care: evaluation of evaluation. Journal of Epidemiology and Community Health. 1978, 32 (2): 143-6. 10.1136/jech.32.2.143.CrossRefPubMedPubMedCentral
11.
go back to reference Majumdar SR, Chang WC, Armstrong PW: Do the investigative sites that take part in a positive clinical trial translate that evidence into practice?. American Journal of Medicine. 2002, 113 (2): 140-5. 10.1016/S0002-9343(02)01166-X.CrossRefPubMed Majumdar SR, Chang WC, Armstrong PW: Do the investigative sites that take part in a positive clinical trial translate that evidence into practice?. American Journal of Medicine. 2002, 113 (2): 140-5. 10.1016/S0002-9343(02)01166-X.CrossRefPubMed
12.
go back to reference Jha P, Deboer D, Sykora K, Naylor CD: Characteristics and mortality outcomes of thrombolysis trial participants and nonparticipants: a population-based comparison. Journal of the American College of Cardiology. 1996, 27 (6): 1335-42. 10.1016/0735-1097(96)00018-6.CrossRefPubMed Jha P, Deboer D, Sykora K, Naylor CD: Characteristics and mortality outcomes of thrombolysis trial participants and nonparticipants: a population-based comparison. Journal of the American College of Cardiology. 1996, 27 (6): 1335-42. 10.1016/0735-1097(96)00018-6.CrossRefPubMed
13.
go back to reference du Bois A, Rochon J, Lamparter C, Pfisterer J, for the AGO Organkommission OVAR: Pattern of care and impact of participation in clinical studies on the outcome in ovarian cancer. International Journal of Gynecological Cancer. 2005, 15 (2): 183-91. 10.1111/j.1525-1438.2005.15202.x.CrossRefPubMed du Bois A, Rochon J, Lamparter C, Pfisterer J, for the AGO Organkommission OVAR: Pattern of care and impact of participation in clinical studies on the outcome in ovarian cancer. International Journal of Gynecological Cancer. 2005, 15 (2): 183-91. 10.1111/j.1525-1438.2005.15202.x.CrossRefPubMed
14.
go back to reference Andersen M, Kragstrup J, Søndergaard J: How conducting a clinical trial affects physicians' guideline adherence and drug preferences. JAMA. 2006, 295 (23): 2759-64. 10.1001/jama.295.23.2759.CrossRefPubMed Andersen M, Kragstrup J, Søndergaard J: How conducting a clinical trial affects physicians' guideline adherence and drug preferences. JAMA. 2006, 295 (23): 2759-64. 10.1001/jama.295.23.2759.CrossRefPubMed
15.
go back to reference Majumdar SR, Roe MT, Peterson ED, Chen AY, Gibler WB, Armstrong PW: Better outcomes for patients treated at hospitals that participate in clinical trials. Archives of Internal Medicine. 2008, 168 (6): 657-62. 10.1001/archinternmed.2007.124.CrossRefPubMed Majumdar SR, Roe MT, Peterson ED, Chen AY, Gibler WB, Armstrong PW: Better outcomes for patients treated at hospitals that participate in clinical trials. Archives of Internal Medicine. 2008, 168 (6): 657-62. 10.1001/archinternmed.2007.124.CrossRefPubMed
16.
go back to reference Chen AY, Schrag N, Hao Y, Flanders WD, Kepner J, Stewart A, Ward E: Changes in treatment of advanced laryngeal cancer 1985-2001. Otolaryngology - Head and Neck Surgery. 2006, 135 (6): 831-7. 10.1016/j.otohns.2006.07.012.CrossRefPubMed Chen AY, Schrag N, Hao Y, Flanders WD, Kepner J, Stewart A, Ward E: Changes in treatment of advanced laryngeal cancer 1985-2001. Otolaryngology - Head and Neck Surgery. 2006, 135 (6): 831-7. 10.1016/j.otohns.2006.07.012.CrossRefPubMed
17.
go back to reference Clark WF, Garg AX, Blake PG, Rock GA, Heidenheim AP, Sackett DL: Effect of awareness of a randomized controlled trial on use of experimental therapy. JAMA. 2003, 290 (10): 1351-5. 10.1001/jama.290.10.1351.CrossRefPubMed Clark WF, Garg AX, Blake PG, Rock GA, Heidenheim AP, Sackett DL: Effect of awareness of a randomized controlled trial on use of experimental therapy. JAMA. 2003, 290 (10): 1351-5. 10.1001/jama.290.10.1351.CrossRefPubMed
18.
go back to reference Janni W, Kiechle M, Sommer H, Rack B, Gauger K, Heinrigs M, Steinfeld D, Augustin D, Simon W, Harbeck N, Friese K, ADEBAR Study Group: Study participation improves treatment strategies and individual patient care in participating centers. Anticancer Research. 2006, 26 (5B): 3661-7.PubMed Janni W, Kiechle M, Sommer H, Rack B, Gauger K, Heinrigs M, Steinfeld D, Augustin D, Simon W, Harbeck N, Friese K, ADEBAR Study Group: Study participation improves treatment strategies and individual patient care in participating centers. Anticancer Research. 2006, 26 (5B): 3661-7.PubMed
19.
go back to reference Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG: Evaluating non-randomised intervention studies. Health Technology Assessment. 2003, 7 (27): 1-186.CrossRef Deeks JJ, Dinnes J, D'Amico R, Sowden AJ, Sakarovitch C, Song F, Petticrew M, Altman DG: Evaluating non-randomised intervention studies. Health Technology Assessment. 2003, 7 (27): 1-186.CrossRef
20.
go back to reference Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K: Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database of Systematic Reviews. 2009, MR000006-1 Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K: Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database of Systematic Reviews. 2009, MR000006-1
21.
go back to reference Dwan K, Gamble C, Kolamunnage-Dona R, Mohammed S, Powell C, Williamson PR: Assessing the potential for outcome reporting bias in a review: a tutorial. Trials. 2010, 11: 52-10.1186/1745-6215-11-52.CrossRefPubMedPubMedCentral Dwan K, Gamble C, Kolamunnage-Dona R, Mohammed S, Powell C, Williamson PR: Assessing the potential for outcome reporting bias in a review: a tutorial. Trials. 2010, 11: 52-10.1186/1745-6215-11-52.CrossRefPubMedPubMedCentral
22.
go back to reference Clarke M, Hopewell S, Chalmers I: Clinical trials should begin and end with systematic reviews of relevant evidence: 12 years and waiting. Lancet. 2010, 376: 20-21. 10.1016/S0140-6736(10)61045-8.CrossRefPubMed Clarke M, Hopewell S, Chalmers I: Clinical trials should begin and end with systematic reviews of relevant evidence: 12 years and waiting. Lancet. 2010, 376: 20-21. 10.1016/S0140-6736(10)61045-8.CrossRefPubMed
Metadata
Title
Effects on patients of their healthcare practitioner's or institution's participation in clinical trials: a systematic review
Authors
Mike Clarke
Kirsty Loudon
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Trials / Issue 1/2011
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-12-16

Other articles of this Issue 1/2011

Trials 1/2011 Go to the issue