Skip to main content
Top
Published in: Trials 1/2020

01-12-2020 | Rheumatoid Arthritis | Review

Exclusion rates in randomized controlled trials of treatments for physical conditions: a systematic review

Authors: Jinzhang He, Daniel R. Morales, Bruce Guthrie

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

The generalisability of randomized controlled trials (RCTs) can be uncertain because the impact of exclusion criteria is rarely quantified. The aim of this study was to systematically review studies examining the percentage of clinical populations with a physical health condition who would be excluded by RCTs of treatments for that condition.

Methods

Medline and Embase were searched from inception to Feb 11th 2018. Two reviewers independently completed screening, full-text review, data extraction and risk-of-bias assessment. The primary outcome was the percentage of patients in the clinical population who would have been excluded from each examined trial. Subgroup analyses examined exclusion by population setting, publication date and funding source.

Results

Titles/abstracts (20,754) were screened, and 50 studies were included which reported exclusion rates from 305 trials of treatments in 31 physical conditions. Estimated rates of exclusion from trials varied from 0% to 100%, and the median exclusion rate was 77.1% of patients (interquartile range 55.5% to 89.0% exclusion). Median exclusion rates for trials in common chronic conditions were high, including hypertension 83.0%, type 2 diabetes 81.7%, chronic obstructive pulmonary disease 84.3%, and asthma 96.0%. The most commonly applied exclusion criteria related to age, co-morbidity and co-prescribing, whereas more implicit criteria relating to life expectancy or functional status were not typically examined. There was no evidence that exclusion varied by the nature of the clinical population in which exclusion was evaluated or trial funding source. There was no statistically significant change in exclusion rates in more recent compared with older trials.

Conclusions

The majority of trials of treatments for physical conditions examined excluded the majority of patients with the condition being treated. Almost a quarter of the trials studied excluded over 90% of patients, more than half of trials excluded at least three quarters of patients, and four out of five trials excluded at least half of patients. A limitation is that most studies applied only a subset of eligibility criteria, so exclusion rates are likely under-estimated. Exclusion from trials of older people and people with co-morbidity and co-prescribing is increasingly untenable given population aging and increasing multimorbidity.

Trial registration

PROSPERO registration CRD42016042282.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rothwell P. Factors that can affect the external validity of randomised controlled trials. PLoS Clin Trials. 2006;1(1):e9.CrossRef Rothwell P. Factors that can affect the external validity of randomised controlled trials. PLoS Clin Trials. 2006;1(1):e9.CrossRef
2.
go back to reference Rothwell PM. External validity of randomised controlled trials: to whom do the results of this trial apply? Lancet. 2005;365(9453):82–93.CrossRef Rothwell PM. External validity of randomised controlled trials: to whom do the results of this trial apply? Lancet. 2005;365(9453):82–93.CrossRef
3.
go back to reference Van Spall HGC, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297(11):1233–40.CrossRef Van Spall HGC, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA. 2007;297(11):1233–40.CrossRef
4.
go back to reference Masoudi FA, Havranek EP, Wolfe P, Gross CP, Rathore SS, Steiner JF, et al. Most hospitalized older persons do not meet the enrollment criteria for clinical trials in heart failure. Am Heart J. 2003;146(2):250–7.CrossRef Masoudi FA, Havranek EP, Wolfe P, Gross CP, Rathore SS, Steiner JF, et al. Most hospitalized older persons do not meet the enrollment criteria for clinical trials in heart failure. Am Heart J. 2003;146(2):250–7.CrossRef
5.
go back to reference Saunders C, Byrne CD, Guthrie B, Lindsay RS, McKnight JA, Philip S, et al. External validity of randomized controlled trials of glycaemic control and vascular disease: how representative are participants? Diabet Med. 2013;30(3):300–8.CrossRef Saunders C, Byrne CD, Guthrie B, Lindsay RS, McKnight JA, Philip S, et al. External validity of randomized controlled trials of glycaemic control and vascular disease: how representative are participants? Diabet Med. 2013;30(3):300–8.CrossRef
6.
go back to reference Townsley CA, Selby R, Siu LL. Systematic review of barriers to the recruitment of older patients with cancer onto clinical trials. J Clin Oncol. 2005;23(13):3112–24.CrossRef Townsley CA, Selby R, Siu LL. Systematic review of barriers to the recruitment of older patients with cancer onto clinical trials. J Clin Oncol. 2005;23(13):3112–24.CrossRef
7.
go back to reference Lee PY, Alexander KP, Hammill BG, Pasquali SK, Peterson ED. Representation of elderly persons and women in published randomized trials of acute coronary syndromes. JAMA. 2001;286(6):708–13.CrossRef Lee PY, Alexander KP, Hammill BG, Pasquali SK, Peterson ED. Representation of elderly persons and women in published randomized trials of acute coronary syndromes. JAMA. 2001;286(6):708–13.CrossRef
8.
go back to reference Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380:37–43.CrossRef Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380:37–43.CrossRef
9.
go back to reference Marengoni A, Angleman S, Melis R, Mangialasche F, Karp A, Garmen A, et al. Aging with multimorbidity: a systematic review of the literature. Ageing Res Rev. 2011;10(4):430–9.CrossRef Marengoni A, Angleman S, Melis R, Mangialasche F, Karp A, Garmen A, et al. Aging with multimorbidity: a systematic review of the literature. Ageing Res Rev. 2011;10(4):430–9.CrossRef
10.
go back to reference Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases. JAMA. 2005;294:716–24.CrossRef Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases. JAMA. 2005;294:716–24.CrossRef
11.
go back to reference Hughes L, McMurdo MET, Guthrie B. Guidelines for people not for diseases: the challenges of applying UK clinical guidelines to people with multimorbidity. Age Ageing. 2013;42(1):62–9.CrossRef Hughes L, McMurdo MET, Guthrie B. Guidelines for people not for diseases: the challenges of applying UK clinical guidelines to people with multimorbidity. Age Ageing. 2013;42(1):62–9.CrossRef
12.
go back to reference Halpina DMG. Lessons from the major studies in COPD: problems and pitfalls in translating research evidence into practice. Prim Care Respir J. 2010;19:170.CrossRef Halpina DMG. Lessons from the major studies in COPD: problems and pitfalls in translating research evidence into practice. Prim Care Respir J. 2010;19:170.CrossRef
13.
go back to reference Carey MP, Senn TE, Vanable PA, Coury-Doniger P, Urban MA. Do STD clinic patients who consent to sexual health research differ from those who decline? Findings from a randomized controlled trial with implications for the generalization of research results. Sex Transm Dis. 2008;35(1):73–7.CrossRef Carey MP, Senn TE, Vanable PA, Coury-Doniger P, Urban MA. Do STD clinic patients who consent to sexual health research differ from those who decline? Findings from a randomized controlled trial with implications for the generalization of research results. Sex Transm Dis. 2008;35(1):73–7.CrossRef
14.
go back to reference Fortin M, Dionne J, Pinho G, Gignac J, Almirall J, Lapointe L. Randomized controlled trials: do they have external validity for patients with multiple comorbidities? Ann Fam Med. 2006;4(2):104–8.CrossRef Fortin M, Dionne J, Pinho G, Gignac J, Almirall J, Lapointe L. Randomized controlled trials: do they have external validity for patients with multiple comorbidities? Ann Fam Med. 2006;4(2):104–8.CrossRef
15.
go back to reference Jones R, Jones R, McCowan C, Montgomery A, Fahey T. The external validity of published randomized controlled trials in primary care. BMC Fam Pract. 2009;10(1):5.CrossRef Jones R, Jones R, McCowan C, Montgomery A, Fahey T. The external validity of published randomized controlled trials in primary care. BMC Fam Pract. 2009;10(1):5.CrossRef
17.
go back to reference Miró Ò, Gil V, Muller C, Mebazaa A, Bueno H, Martin-Sanchez FJ, et al. How does a clinical trial fit into the real world? The RELAX-AHF study population into the EAHFE registry. Clin Res Cardiol. 2015;104(10):850–60.CrossRef Miró Ò, Gil V, Muller C, Mebazaa A, Bueno H, Martin-Sanchez FJ, et al. How does a clinical trial fit into the real world? The RELAX-AHF study population into the EAHFE registry. Clin Res Cardiol. 2015;104(10):850–60.CrossRef
18.
go back to reference Aaltonen KJ, Ylikyla S, Tuulikki Joensuu J, Isomaki P, Pirila L, Kauppi M, et al. Efficacy and effectiveness of tumour necrosis factor inhibitors in the treatment of rheumatoid arthritis in randomized controlled trials and routine clinical practice. Rheumatology (Oxford). 2017;56(5):725–35. Aaltonen KJ, Ylikyla S, Tuulikki Joensuu J, Isomaki P, Pirila L, Kauppi M, et al. Efficacy and effectiveness of tumour necrosis factor inhibitors in the treatment of rheumatoid arthritis in randomized controlled trials and routine clinical practice. Rheumatology (Oxford). 2017;56(5):725–35.
19.
go back to reference Vashisht P, Sayles H, Cannella AC, Mikuls TR, Michaud K. Generalizability of patients with rheumatoid arthritis in biologic agent clinical trials. Arthritis Care Res (Hoboken). 2016;68(10):1478–88.CrossRef Vashisht P, Sayles H, Cannella AC, Mikuls TR, Michaud K. Generalizability of patients with rheumatoid arthritis in biologic agent clinical trials. Arthritis Care Res (Hoboken). 2016;68(10):1478–88.CrossRef
20.
go back to reference Radner H, Dixon W, Hyrich K, Askling J. Consistency and utility of data items across European rheumatoid arthritis clinical cohorts and registers. Arthritis Care Res. 2015;67(9):1219–29.CrossRef Radner H, Dixon W, Hyrich K, Askling J. Consistency and utility of data items across European rheumatoid arthritis clinical cohorts and registers. Arthritis Care Res. 2015;67(9):1219–29.CrossRef
21.
go back to reference Zhang S, Liang F, Li W, Tannock IF. Comparison of eligibility criteria between protocols, registries, and publications of cancer clinical trials. J Natl Cancer Inst. 2016;108(11):djw129.CrossRef Zhang S, Liang F, Li W, Tannock IF. Comparison of eligibility criteria between protocols, registries, and publications of cancer clinical trials. J Natl Cancer Inst. 2016;108(11):djw129.CrossRef
22.
go back to reference Thake M, Lowry A. A systematic review of trends in the selective exclusion of older participant from randomised clinical trials. Arch Gerontol Geriatr. 2017;72:99–102.CrossRef Thake M, Lowry A. A systematic review of trends in the selective exclusion of older participant from randomised clinical trials. Arch Gerontol Geriatr. 2017;72:99–102.CrossRef
23.
go back to reference Broekhuizen K, Pothof A, De Craen AJM, Mooijaart SP. Characteristics of randomized controlled trials designed for elderly: a systematic review. PLoS One. 2015;10(5):e0126709.CrossRef Broekhuizen K, Pothof A, De Craen AJM, Mooijaart SP. Characteristics of randomized controlled trials designed for elderly: a systematic review. PLoS One. 2015;10(5):e0126709.CrossRef
24.
go back to reference Du Vaure CB, Dechartres A, Battin C, Ravaud P, Boutron I. Exclusion of patients with concomitant chronic conditions in ongoing randomised controlled trials targeting 10 common chronic conditions and registered at ClinicalTrials.gov: a systematic review of registration details. BMJ Open. 2016;6(9):e012265.CrossRef Du Vaure CB, Dechartres A, Battin C, Ravaud P, Boutron I. Exclusion of patients with concomitant chronic conditions in ongoing randomised controlled trials targeting 10 common chronic conditions and registered at ClinicalTrials.gov: a systematic review of registration details. BMJ Open. 2016;6(9):e012265.CrossRef
25.
go back to reference Schmidt AF, Groenwold RHH, Van Delden JJM, Van Der Does Y, Klungel OH, Roes KCB, et al. Justification of exclusion criteria was underreported in a review of cardiovascular trials. J Clin Epidemiol. 2014;67(6):635–44.CrossRef Schmidt AF, Groenwold RHH, Van Delden JJM, Van Der Does Y, Klungel OH, Roes KCB, et al. Justification of exclusion criteria was underreported in a review of cardiovascular trials. J Clin Epidemiol. 2014;67(6):635–44.CrossRef
26.
go back to reference Cruz-Jentoft AJ, Carpena-Ruiz M, Montero-Errasquín B, Sánchez-Castellano C, Sánchez-García E. Exclusion of older adults from ongoing clinical trials about type 2 diabetes mellitus. J Am Geriatr Soc. 2013;61(5):734–8.CrossRef Cruz-Jentoft AJ, Carpena-Ruiz M, Montero-Errasquín B, Sánchez-Castellano C, Sánchez-García E. Exclusion of older adults from ongoing clinical trials about type 2 diabetes mellitus. J Am Geriatr Soc. 2013;61(5):734–8.CrossRef
27.
go back to reference Oude Rengerink K, Kalkman S, Collier S, Ciaglia A, Worsley SD, Lightbourne A, et al. Series: pragmatic trials and real world evidence: paper 3. Patient selection challenges and consequences. J Clin Epidemiol. 2017;89:173–80.CrossRef Oude Rengerink K, Kalkman S, Collier S, Ciaglia A, Worsley SD, Lightbourne A, et al. Series: pragmatic trials and real world evidence: paper 3. Patient selection challenges and consequences. J Clin Epidemiol. 2017;89:173–80.CrossRef
28.
go back to reference Guthrie B, Thompson A, Dumbreck S, Flynn A, Alderson P, Nairn M, et al. Better guidelines for better care: accounting for multimorbidity in clinical guidelines (NIHR HS&DR 11/2003/27). Health Serv Deliv Res. 2017;5:16. Guthrie B, Thompson A, Dumbreck S, Flynn A, Alderson P, Nairn M, et al. Better guidelines for better care: accounting for multimorbidity in clinical guidelines (NIHR HS&DR 11/2003/27). Health Serv Deliv Res. 2017;5:16.
29.
go back to reference O’Hare AM, Hotchkiss JR, Kurella Tamura M, Larson EB, Hemmelgarn BR, Batten A, et al. Interpreting treatment effects from clinical trials in the context of real-world risk information: end-stage renal disease prevention in older adults. JAMA Intern Med. 2014;174(3):391–7.CrossRef O’Hare AM, Hotchkiss JR, Kurella Tamura M, Larson EB, Hemmelgarn BR, Batten A, et al. Interpreting treatment effects from clinical trials in the context of real-world risk information: end-stage renal disease prevention in older adults. JAMA Intern Med. 2014;174(3):391–7.CrossRef
30.
go back to reference Bourgeois FT, Shannon MW, Valim C, Mandl KD. Adverse drug events in the outpatient setting: an 11-year national analysis. Pharmacoepidemiol Drug Saf. 2010;19(9):901–10.CrossRef Bourgeois FT, Shannon MW, Valim C, Mandl KD. Adverse drug events in the outpatient setting: an 11-year national analysis. Pharmacoepidemiol Drug Saf. 2010;19(9):901–10.CrossRef
31.
go back to reference Li L, Geraghty OC, Mehta Z, Rothwell PM. Age-specific risks, severity, time course, and outcome of bleeding on long-term antiplatelet treatment after vascular events: a population-based cohort study. Lancet. 2017;390(10093):490–9.CrossRef Li L, Geraghty OC, Mehta Z, Rothwell PM. Age-specific risks, severity, time course, and outcome of bleeding on long-term antiplatelet treatment after vascular events: a population-based cohort study. Lancet. 2017;390(10093):490–9.CrossRef
32.
go back to reference Atkins D, Chang SM, Gartlehner G, Buckley DI, Whitlock EP, Berliner E, et al. Assessing applicability when comparing medical interventions: AHRQ and the effective health care program. J Clin Epidemiol. 2011;64(11):1198–207.CrossRef Atkins D, Chang SM, Gartlehner G, Buckley DI, Whitlock EP, Berliner E, et al. Assessing applicability when comparing medical interventions: AHRQ and the effective health care program. J Clin Epidemiol. 2011;64(11):1198–207.CrossRef
33.
go back to reference Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011;64(12):1303–10.CrossRef Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, et al. GRADE guidelines: 8. Rating the quality of evidence—indirectness. J Clin Epidemiol. 2011;64(12):1303–10.CrossRef
34.
go back to reference Ahmad N, Boutron I, Dechartres A, Durieux P, Ravaud P. Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. 2010;11(1):1–9.CrossRef Ahmad N, Boutron I, Dechartres A, Durieux P, Ravaud P. Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. 2010;11(1):1–9.CrossRef
35.
go back to reference Beaver JA, Ison G, Pazdur R. Reevaluating Eligibility Criteria — Balancing Patient Protection and Participation in Oncology Trials. N Engl J Med. 2017;376:1504–5.CrossRef Beaver JA, Ison G, Pazdur R. Reevaluating Eligibility Criteria — Balancing Patient Protection and Participation in Oncology Trials. N Engl J Med. 2017;376:1504–5.CrossRef
36.
go back to reference Guthrie B, Makubate B, Hernandez-Santiago V, Dreischulte T. The rising tide of polypharmacy and drug-drug interactions: population database analysis 1995-2010. BMC Med. 2015;13:74.CrossRef Guthrie B, Makubate B, Hernandez-Santiago V, Dreischulte T. The rising tide of polypharmacy and drug-drug interactions: population database analysis 1995-2010. BMC Med. 2015;13:74.CrossRef
37.
go back to reference Guthrie B, Boyd CM. Clinical guidelines in the context of aging and multimorbidity. Public Policy Aging Rep. 2018;28(4):143–9.CrossRef Guthrie B, Boyd CM. Clinical guidelines in the context of aging and multimorbidity. Public Policy Aging Rep. 2018;28(4):143–9.CrossRef
Metadata
Title
Exclusion rates in randomized controlled trials of treatments for physical conditions: a systematic review
Authors
Jinzhang He
Daniel R. Morales
Bruce Guthrie
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-4139-0

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue