Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2018

Open Access 01-12-2018 | Research

A study of target effect sizes in randomised controlled trials published in the Health Technology Assessment journal

Authors: Joanne C. Rothwell, Steven A. Julious, Cindy L. Cooper

Published in: Trials | Issue 1/2018

Login to get access

Abstract

Background

When designing a randomised controlled trial (RCT), an important consideration is the sample size required. This is calculated from several components; one of which is the target difference. This study aims to review the currently reported methods of elicitation of the target difference as well as to quantify the target differences used in Health Technology Assessment (HTA)-funded trials.

Methods

Trials were identified from the National Institute of Health Research Health Technology Assessment journal. A total of 177 RCTs published between 2006 and 2016 were assessed for eligibility. Eligibility was established by the design of the trial and the quality of data available. The trial designs were parallel-group, superiority RCTs with a continuous primary endpoint. Data were extracted and the standardised anticipated and observed effect size estimates were calculated. Exclusion criteria was based on trials not providing enough detail in the sample size calculation and results, and trials not being of parallel-group, superiority design.

Results

A total of 107 RCTs were included in the study from 102 reports. The most commonly reported method for effect size derivation was a review of evidence and use of previous research (52.3%). This was common across all clinical areas. The median standardised target effect size was 0.30 (interquartile range: 0.20–0.38), with the median standardised observed effect size 0.11 (IQR 0.05–0.29). The maximum anticipated and observed effect sizes were 0.76 and 1.18, respectively. Only two trials had anticipated target values above 0.60.

Conclusion

The most commonly reported method of elicitation of the target effect size is previous published research. The average target effect size was 0.3.
A clear distinction between the target difference and the minimum clinically important difference is recommended when designing a trial. Transparent explanation of target difference elicitation is advised, with multiple methods including a review of evidence and opinion-seeking advised as the more optimal methods for effect size quantification.
Appendix
Available only for authorised users
Literature
1.
2.
3.
4.
Cook JA, Hislop JM, Adewuyi TE, Harrild KA, Altman DG, Ramsay CR, et al. Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review. Health Technol Assess. 2014;18(28).
5.
Cook JA, Hislop J, Altman DG, Fayers PM, Briggs AH, Ramsay CR, Norrie JD, Harvey IM, Buckley B, Fergusson D, Ford I, Vale LD. Specifying the target difference in the primary outcome for a randomised controlled trial - guidance for researchers. Trials. 2015;16(12) https://​doi.​org/​10.​1186/​s13063-014-0526-8.
6.
Jaeschke R, Singer J, Guyatt GH. Measurement of health status: ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407–15.CrossRefPubMed
7.
Zhang Y, Zhang S, Thabane L, Furukawa TA, Johnston BC, Guyatt GH. Although not consistently superior, the absolute approach to framing the minimally important difference has advantages over the relative approach. J Clin Epidemiol. 2015;68(8):888–94.CrossRefPubMed
8.
DeRogatis L, Graziottin A, Bitzer J, Schmitt S, Koochaki PE. Clinically relevant changes in sexual desire, satisfying sexual activity and personal distress as measured by the PFSF, SAL & PDS in postmenopausal women with HSDD. J Sex Med. 2009;6:175–83.CrossRefPubMed
9.
Khanna D, Tseng CH, Furst DE, Clements PJ, Elashoff R, Roth M, et al. Minimally important differences in the Mahler’s transition Dyspnoea index in a large randomized controlled trial—results from the scleroderma lung study. Rheumatology. 2009;48(12):1537–40.CrossRefPubMedCentralPubMed
10.
Wyrwich KW, Nienaber NA, Tierney WM, Wolinsky FD. Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. Med Care. 1999;37(5):469–78.CrossRefPubMed
11.
Torgerson DJ, Ryan M, Ratcliffe J. Economics in sample size determination for clinical trials. QJM. 1995;88(7):517–21.PubMed
12.
Aarabi M, Skinner J, Price CE, Jackson PR. Patients’ acceptance of antihypertensive therapy to prevent cardiovascular disease: a comparison between south Asians and Caucasians in the United Kingdom. Eur J Cardiovasc Prev Rehabil. 2008;15(1):59–66.CrossRefPubMed
13.
Allison DB, Elobeid MA, Cope MB, Brock DW, Faith MS, Vander Veur S, et al. Sample size in obesity trials: patient perspective versus current practice. Med Decis Mak. 2010;30(1):68–75.CrossRef
14.
McAlister FA, O’Connor AM, Wells G, Grover SA, Laupacis A. When should hypertension be treated? The different perspectives of Canadian family physicians and patients. Can Med Assoc J. 2000;163(4):403–8.
15.
Hulley SB, Cummings SR, Browner WS, Grady DG, Newman TB. Designing clinical research. Baltimore: Lippincott Williams & Wilkins; 2013.
16.
Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, Goldsmith CH. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10(1):1.CrossRefPubMedCentralPubMed
17.
Julious SA. Sample sizes for clinical trials. London: CRC Press; 2009.
18.
Salter GC, Roman M, Bland MJ, MacPherson H. Acupuncture for chronic neck pain: a pilot for a randomised controlled trial. BMC Musculoskelet Disord. 2006;7(1):99.CrossRefPubMedCentralPubMed
19.
Thomas JR, Lochbaum MR, Landers DM, He C. Planning significant and meaningful research in exercise science: estimating sample size. Res Q Exerc Sport. 1997;68(1):33–43.CrossRefPubMed
20.
Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale: Lawrence Erlbaum Associates; 1988. p. 20–6.
21.
22.
Julious SA. Sample sizes for clinical trials. Boca Raton: CRC Press; 2010.
23.
Cook JA, Julious SA, Sones W, Hampson LV, Hewitt C, Berlin JA, Ashby D, Emsley R, Fergusson DA, Walters SJ, Wilson ECF, MacLennan G, Stallard N, Rothwell JC, Bland M, Brown L, Ramsay CR, Cook A, Armstrong D, Altman D, Vale LD. DELTA2 guidance on choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial. BMJ. 2018. [in press].
24.
Reeves BC, Pike K, Rogers CA, Brierley RC, Stokes E, Wordsworth S, Angelini GD. A multicentre randomised controlled trial of transfusion indication threshold reduction on transfusion rates, orbidity and health-care resource use following cardiac surgery (TITRe2). 2016
25.
Richards DA, Hill JJ, Gask L, Lovell K, Chew-Graham C, Bower P, Bland JM. Clinical effectiveness of collaborative care for depression in UK primary care (CADET): cluster randomised controlled trial. BMJ. 2013;347:f4913.CrossRefPubMedCentralPubMed
26.
Richards DA, Hughes-Morley A, Hayes RA, Araya R, Barkham M, Bland JM, Gilbody S. Collaborative Depression Trial (CADET): multi-centre randomised controlled trial of collaborative care for depression-study protocol. BMC Health Serv Res. 2009;9(1):188.CrossRefPubMedCentralPubMed
27.
Sully BG, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14(1):166.CrossRefPubMedCentralPubMed
Metadata
Title
A study of target effect sizes in randomised controlled trials published in the Health Technology Assessment journal
Authors
Joanne C. Rothwell
Steven A. Julious
Cindy L. Cooper
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Trials / Issue 1/2018
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-018-2886-y

Other articles of this Issue 1/2018

Trials 1/2018 Go to the issue

Study protocol

Effect of an exercise-based cardiac rehabilitation program “Baduanjin Eight-Silken-Movements with self-efficacy building” for heart failure (BESMILE-HF study): study protocol for a randomized controlled trial

Study protocol

Internet-based cognitive behavioural therapy (iCBT) for perinatal anxiety and depression versus treatment as usual: study protocol for two randomised controlled trials

Study protocol

Community-based intervention for management of diabetes in Nepal (COBIN-D trial): study protocol for a cluster-randomized controlled trial

Study protocol

Efficacy and safety of electroacupuncture for post stroke depression: study protocol for a randomized controlled trial

Study protocol

High flow nasal oxygen after bariatric surgery (OXYBAR), prophylactic post-operative high flow nasal oxygen versus conventional oxygen therapy in obese patients undergoing bariatric surgery: study protocol for a randomised controlled pilot trial

Research

Challenges recruiting to a proof-of-concept pharmaceutical trial for a rare disease: the trigeminal neuralgia experience