Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2019

Open Access 01-12-2019 | Methodology

Sample size estimation for randomised controlled trials with repeated assessment of patient-reported outcomes: what correlation between baseline and follow-up outcomes should we assume?

Authors: Stephen J. Walters, Richard M. Jacques, Inês Bonacho dos Anjos Henriques-Cadby, Jane Candlish, Nikki Totton, Mica Teo Shu Xian

Published in: Trials | Issue 1/2019

Login to get access

Abstract

Background

Patient-reported outcome measures (PROMs) are now frequently used in randomised controlled trials (RCTs) as primary endpoints. RCTs are longitudinal, and many have a baseline (PRE) assessment of the outcome and one or more post-randomisation assessments of outcome (POST). With such pre-test post-test RCT designs there are several ways of estimating the sample size and analysing the outcome data: analysis of post-randomisation treatment means (POST); analysis of mean changes from pre- to post-randomisation (CHANGE); analysis of covariance (ANCOVA).
Sample size estimation using the CHANGE and ANCOVA methods requires specification of the correlation between the baseline and follow-up measurements. Other parameters in the sample size estimation method being unchanged, an assumed correlation of 0.70 (between baseline and follow-up outcomes) means that we can halve the required sample size at the study design stage if we used an ANCOVA method compared to a comparison of POST treatment means method. So what correlation (between baseline and follow-up outcomes) should be assumed and used in the sample size calculation? The aim of this paper is to estimate the correlations between baseline and follow-up PROMs in RCTs.

Methods

The Pearson correlation coefficients between the baseline and repeated PROM assessments from 20 RCTs (with 7173 participants at baseline) were calculated and summarised.

Results

The 20 reviewed RCTs had sample sizes, at baseline, ranging from 49 to 2659 participants. The time points for the post-randomisation follow-up assessments ranged from 7 days to 24 months; 464 correlations, between baseline and follow-up, were estimated; the mean correlation was 0.50 (median 0.51; standard deviation 0.15; range − 0.13 to 0.91).

Conclusions

There is a general consistency in the correlations between the repeated PROMs, with the majority being in the range of 0.4 to 0.6. The implications are that we can reduce the sample size in an RCT by 25% if we use an ANCOVA model, with a correlation of 0.50, for the design and analysis. There is a decline in correlation amongst more distant pairs of time points.
Literature
1.
Frison L, Pocock SJ. Repeated measures in clinical trials: analysis using mean summary statistics and its implications for design. Stat Med. 1992;11(13):1685–704.PubMed
2.
Altman DG, Gardner MJ, Martin J. Statistics with confidence: confidence intervals and statistical guidelines. London: BMJ Books; 2000.
3.
Walters SJ. Sample size and power estimation for studies with health related quality of life outcomes: a comparison of four methods using the SF-36. Health Qual Life Outcomes. 2004;2:26.PubMedPubMedCentral
4.
Walters SJ. Quality of life outcomes in clinical trials and health-care evaluation:a practical guide to analysis and interpretation. Chichester: Wiley; 2009. p. 1–365.
5.
Machin D, Campbell MJ, Tan SB, Tan SH. Sample sizes for clinical, laboratory and epidemiology studies. 4th ed. Chichester: Wiley-Blackwell; 2018.
6.
Littlewood C, Bateman M, Brown K, Bury J, Mawson S, May S, et al. A self-managed single exercise programme versus usual physiotherapy treatment for rotator cuff tendinopathy: a randomised controlled trial (the SELF study). Clin Rehabil. 2016;30(7):686–96.PubMed
7.
Campbell MJ, Machin D, Walters SJ. Medical statistics: a textbook for the health sciences. 4th edition. Chichester: Wiley; 2007.
8.
Campbell MJ, Walters SJ. How to design, analyse and report cluster randomised trials in medicine and health related research. Chichester: Wiley-Blackwell; 2014.
9.
Morrell CJ, Walters SJ, Dixon S, Collins KA, Brereton LML, Peters J, et al. Cost effectiveness of community leg ulcer clinics: Randomised controlled trial. Br Med J. 1998;316(7143):1487–91.
10.
Jack DS, Prestele H, Bakshi R. Clinical Study Report. A double-blind, randomised, controlled study to compare methotrexate plus cyclosporine A/neoral vs. methotrexate plus placebo in subjects with early severe rheumatoid arthritis. Basel, Switzerland; 2000.
11.
Weatherley-Jones E, Nicholl JP, Thomas KJ, Parry GJ, McKendrick MW, Green ST, et al. A randomised, controlled, triple-blind trial of the efficacy of homeopathic treatment for chronic fatigue syndrome. J Psychosom Res. 2004;56(2):189–97.PubMed
12.
Thomas KJ, MacPherson H, Ratcliffe J, Thorpe L, Brazier J, Campbell M, et al. Longer term clinical and economic benefits of offering acupuncture care to patients with chronic low back pain. Health Technol Assess. 2005;9(32):1–109.
13.
Mitchell C, Walker J, Walters S, Morgan AB, Binns T, Mathers N. Costs and effectiveness of pre- and post-operative home physiotherapy for total knee replacement: randomized controlled trial. J Eval Clin Pract. 2005;11(3):283–92.PubMed
14.
Gariballa S, Forster S, Walters S, Powers H. A randomized, double-blind, placebo-controlled trial of nutritional supplementation during acute illness. Am J Med. 2006;119(8):693–9.PubMed
15.
Dixon S, Walters SJ, Turner L, Hancock BW. Quality of life and cost-effectiveness of interferon-alpha in malignant melanoma: results from randomised trial. Br J Cancer. 2006;94(4):492–8.PubMedPubMedCentral
16.
Morrell CJ, Slade P, Warner R, Paley G, Dixon S, Walters SJ, et al. Clinical effectiveness of health visitor training in psychologically informed approaches for depression in postnatal women: pragmatic cluster randomised trial in primary care. BMJ. 2009;338(7689):a3045.PubMedPubMedCentral
17.
Waterhouse JC, Walters SJ, Oluboyede Y, Lawson RA. A randomised 2 x 2 trial of community versus hospital pulmonary rehabilitation, followed by telephone or conventional follow-up. Health Technol Assess. 2010;14(6):i–v.PubMed
18.
Farndon LJ, Vernon W, Walters SJ, Dixon S, Bradburn M, Concannon M, et al. The effectiveness of salicylic acid plasters compared with ‘usual’ scalpel debridement of corns: a randomised controlled trial. J Foot Ankle Res. 2013;6(1):40.PubMedPubMedCentral
19.
Mountain GA, Hind D, Gossage-Worrall R, Walters SJ, Duncan R, Newbould L, et al. ‘Putting Life in Years’ (PLINY) telephone friendship groups research study: pilot randomised controlled trial. Trials. 2014;15(1):141.PubMedPubMedCentral
20.
Goodacre S, Cohen J, Bradburn M, Stevens J, Gray A, Benger J, et al. The 3Mg trial: a randomised controlled trial of intravenous or nebulised magnesium sulphate versus placebo in adults with acute severe asthma. Health Technol Assess. 2014;18(22):1–168.PubMedPubMedCentral
21.
Thomas SA, Coates E, das Nair R, Lincoln NB, Cooper C, Palmer R, et al. Behavioural Activation Therapy for Depression after Stroke (BEADS): a study protocol for a feasibility randomised controlled pilot trial of a psychological intervention for post-stroke depression. Pilot Feasibility Stud. 2016;2(1):45.PubMedPubMedCentral
22.
McDermott CJ, Bradburn MJ, Maguire C, Cooper CL, Baird WO, Baxter SK, et al. DiPALS: Diaphragm Pacing in patients with Amyotrophic Lateral Sclerosis – a randomised controlled trial. Health Technol Assess (Rockv). 2016;20(45):1–186.
23.
Mountain G, Windle G, Hind D, Walters S, Keertharuth A, Chatters R, et al. A preventative lifestyle intervention for older adults (lifestyle matters): a randomised controlled trial. Age Ageing. 2017;46(4):627–34.PubMedPubMedCentral
24.
Jha S, Walters SJ, Bortolami O, Dixon S, Alshreef A. Impact of pelvic floor muscle training on sexual function of women with urinary incontinence and a comparison of electrical stimulation versus standard treatment (IPSU trial): a randomised controlled trial. Physiother. 2018;104(1):91–7.
25.
Reddington M, Walters SJ, Cohen J, Baxter SK, Cole A. Does early intervention improve outcomes in the physiotherapy management of lumbar radicular syndrome? Results of the POLAR pilot randomised controlled trial. BMJ Open. 2018;8(7):e021631.PubMedPubMedCentral
26.
Cox M, O’Connor C, Biggs K, Hind D, Bortolami O, Franklin M, et al. The feasibility of early pulmonary rehabilitation and activity after COPD exacerbations: external pilot randomised controlled trial, qualitative case study and exploratory economic evaluation. Health Technol Assess . 2018;22(11):1–204.PubMed
27.
Holt RI, Hind D, Gossage-Worrall R, Bradburn MJ, Saxon D, McCrone P, et al. Structured lifestyle education to support weight loss for people with schizophrenia, schizoaffective disorder and first episode psychosis: the STEPWISE RCT. Health Technol Assess. 2018;22(65):1–160.PubMed
28.
Broadbent E, Petrie KJ, Main J, Weinman J. The Brief Illness Perception Questionnaire. J Psychosom Res. 2006;60(6):631–7.PubMed
29.
30.
Collin C, Wade DT, Davies S, Horne V. The Barthel ADL Index: a reliability study. Int Disabil Stud. 1988;10(2):61–3.PubMed
31.
Overall J, Gorham D. The Brief Psychiatric Rating Scale (BPRS). Psychol Rep. 1962;10:799–812.
32.
Evans C, Connell J, Barkham M, Margison F, McGrath G, Mellor-Clark J, et al. Towards a standardised brief outcome measure: psychometric properties and utility of the CORE-OM. Br J Psychiatry. 2002;180:51–60.PubMed
33.
Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.
34.
Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150:782–6.
35.
Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.PubMed
36.
EuroQol Group. EuroQol—a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.
37.
Schwarzer R, Jerusalem M. Generalized Self-Efficacy Scale. In: Weinman J, Wright S, Johnston M, editors. Measures in health psychology: a user’s portfolio. Windsor: NFER-NELSON; 1995. p. 35–7.
38.
Smets EM, Garssen B, Bonke B, De Haes JC. The Multidimensional Fatigue Inventory (MFI) psychometric qualities of an instrument to assess fatigue. J Psychosom Res. 1995;39(3):315–25.PubMed
39.
Fairbank JC, Pynsent PB. The Oswestry Disability Index. Spine (Phila Pa 1976). 2000;25(22):2940–52 discussion 2952.
40.
Tinkler L, Hicks S. Measuring subjective well-being. London: Office for National Statistics; 2011. p. 29.
41.
42.
Rogers RG, Kammerer-Doak D, Villarreal A, Coates K, Qualls C. A new instrument to measure sexual function in women with urinary incontinence or pelvic organ prolapse. Am J Obstet Gynecol. 2001;184(4):552–8.PubMed
43.
Ware JE, Snow KK, Kosinski M, Gandek B. SF-36 Health Survey Manual and Intepretation Guide. Boston: The Health Institute, New England Medical Center; 1993.
44.
Ware JE, Kosinski M, Keller SD. SF-36 Physical and Mental Health Summary Scales: a user’s manual. Boston: The Health Institute, New England Medical Center; 1994.
45.
Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92.PubMed
46.
Flemons WW, Reimer MA. Development of a disease-specific health-related quality of life questionnaire for sleep apnea. Am J Respir Crit Care Med. 1998;158(2):494–503.PubMed
47.
Roach KE, Budiman-Mak E, Songsiridej N, Lertratanakul Y. Development of a shoulder pain and disability index. Arthritis Care Res. 1991;4(4):143–9.PubMed
48.
Hawker GA, Mian S, Kendzerska T, French M. Measures of adult pain: Visual Analog Scale for Pain (VAS Pain), Numeric Rating Scale for Pain (NRS Pain), McGill Pain Questionnaire (MPQ), Short-Form McGill Pain Questionnaire (SF-MPQ), Chronic Pain Grade Scale (CPGS), Short Form-36 Bodily Pain Scale (SF). Arthritis Care Res (Hoboken). 2011;63(S11):S240–52.
49.
Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW. Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988;15(12):1833–40.PubMed
50.
Walters SJ, Dos Anjos Henriques-Cadby IB, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.PubMedPubMedCentral
51.
Clifton L, Clifton DA. The correlation between baseline score and post-intervention score, and its implications for statistical analysis. Trials. 2019;20(1):43.PubMedPubMedCentral
52.
Clifton L, Birks J, Clifton DA. Comparing different ways of calculating sample size for two independent means: a worked example. Contemp Clin Trials Commun. 2019;13:100309.PubMed
53.
Heeren T, D’Agostino R. Robustness of the two independent samples t-test when applied to ordinal scaled data. Stat Med. 1987;6(1):79–90.PubMed
54.
Sullivan LM, D’Agostino RB. Robustness and power of analysis of covariance applied to ordinal scaled data as arising in randomized controlled trials. Stat Med. 2003;22(8):1317–34.PubMed
55.
Walters SJ. Consultants’ forum: should post hoc sample size calculations be done? Pharm Stat. 2009;8(2):163–9.PubMed
56.
Walters SJ, Campbell MJ. The use of bootstrap methods for estimating sample size and analysing health-related quality of life outcomes. Stat Med. 2005;24(7):1075–102.PubMed
Metadata
Title
Sample size estimation for randomised controlled trials with repeated assessment of patient-reported outcomes: what correlation between baseline and follow-up outcomes should we assume?
Authors
Stephen J. Walters
Richard M. Jacques
Inês Bonacho dos Anjos Henriques-Cadby
Jane Candlish
Nikki Totton
Mica Teo Shu Xian
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Trials / Issue 1/2019
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-019-3671-2

Other articles of this Issue 1/2019

Trials 1/2019 Go to the issue

Methodology

The correlation between baseline score and post-intervention score, and its implications for statistical analysis

Study protocol

The effect of Baduanjin exercise on health-related physical fitness of college students: study protocol for a randomized controlled trial

Study protocol

The Back2School modular cognitive behavioral intervention for youths with problematic school absenteeism: study protocol for a randomized controlled trial

Study protocol

Online Social anxiety Cognitive therapy for Adolescents (OSCA): protocol for a randomised controlled trial

Correction

Correction to: Tamponade dressings versus no tamponade after hemorrhoidectomy: study protocol for a randomized controlled trial

Study protocol

Preformed pediatric zirconia crown versus preformed pediatric metal crown: study protocol for a randomized clinical trial