Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Trials
Published in: Trials 1/2019

Open Access 01-12-2019 | Care | Review

Statistical design and analysis in trials of proportionate interventions: a systematic review

Authors: Jane Candlish, M. Dawn Teare, Judith Cohen, Tracey Bywater

Published in: Trials | Issue 1/2019

Login to get access

Abstract

Background

In proportionate or adaptive interventions, the dose or intensity can be adjusted based on individual need at predefined decision stages during the delivery of the intervention. The development of such interventions may require an evaluation of the effectiveness of the individual stages in addition to the whole intervention. However, evaluating individual stages of an intervention has various challenges, particularly the statistical design and analysis. This review aimed to identify the use of trials of proportionate interventions and how they are being designed and analysed in current practice.

Methods

We searched MEDLINE, Web of Science and PsycINFO for articles published between 2010 and 2015 inclusive. We considered trials of proportionate interventions in all fields of research. For each trial, its aims, design and analysis were extracted. The data synthesis was conducted using summary statistics and a narrative format.

Results

Our review identified 44 proportionate intervention trials, comprising 28 trial results, 13 protocols and three secondary analyses. These were mostly described as stepped care (n=37) and mainly focussed on mental health research (n=30). The other studies were aimed at finding an optimal adaptive treatment strategy (n=7) in a variety of therapeutic areas. Further terminology used included adaptive intervention, staged intervention, sequentially multiple assignment trial or a two-phase design. The median number of decision stages in the interventions was two and only one study explicitly evaluated the effect of the individual stages.

Conclusions

Trials of proportionate staged interventions are being used predominantly within the mental health field. However, few studies consider the different stages of the interventions, either at the design or the analysis phase, and how they may interact with one another. There is a need for further guidance on the design, analyses and reporting across trials of proportionate interventions.

Trial registration

Prospero, CRD42016033781. Registered on 2 February 2016.
Appendix
Available only for authorised users
Literature
1.
Almirall D, Kasari C, McCaffrey DF, Nahum-Shani I. Developing optimized adaptive interventions in education. J Res Educ Eff. 2018; 11(1):27–34.PubMed
2.
Marmot MG, Allen J, Goldblatt P, Boyce T, McNeish D, Grady M, Geddes I, et al.Fair society, healthy lives: Strategic review of health inequalities in England post-2010. The Marmot Review. 2010.
3.
Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B, Fabiano GA, Waxmonsky JG, Yu J, Murphy SA. Experimental design and primary data analysis methods for comparing adaptive interventions. Psychol Methods. 2012; 17(4):457.PubMed
4.
5.
Lancaster G, Campbell M, Eldridge S, Farrin A, Marchant M, Muller S, Perera R, Peters T, Prevost A, Rait G. Trials in primary care: statistical issues in the design, conduct and evaluation of complex interventions. Stat Methods Med Res. 2010; 19(4):349–77.PubMed
6.
Collins LM, Murphy SA, Bierman KL. A conceptual framework for adaptive preventive interventions. Prev Sci. 2004; 5(3):185–96.PubMedPubMedCentral
7.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P, et al.Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009; 6(7):1000097.
8.
9.
10.
Paris J. Stepped care: an alternative to routine extended treatment for patients with borderline personality disorder. Psychiatr Serv. 2013; 64(10):1035–7.PubMed
11.
Jakicic JM, Tate DF, Lang W, Davis KK, Polzien K, Rickman AD, Erickson K, Neiberg RH, Finkelstein EA. Effect of a stepped-care intervention approach on weight loss in adults: a randomized clinical trial. JAMA. 2012; 307(24):2617–26.PubMedPubMedCentral
12.
Carels RA, Hoffmann DA, Hinman N, Burmeister JM, Koball A, Ashrafioun L, Oehlhof MW, Bannon E, Leroy M, Darby L. Step-down approach to behavioural weight loss treatment: a pilot of a randomised clinical trial. Psychol Health. 2013; 28(10):1121–34.PubMed
13.
Watson J, Crosby H, Dale V, Tober G, Wu Q, Lang J, McGovern R, Newbury-Birch D, Parrott S, Bland J, et al.AESOPS: a randomised controlled trial of the clinical effectiveness and cost-effectiveness of opportunistic screening and stepped care interventions for older hazardous alcohol users in primary care. Health Technology Assessment, No. 17.25. 2013.
14.
Borsari B, Magill M, Mastroleo NR, Hustad JTP, Tevyaw TOL, Barnett NP, Kahler CW, Eaton E, Monti PM. Mandated college students’ response to sequentially administered alcohol interventions in a randomized clinical trial using stepped care. J Consult Clin Psychol. 2016; 84(2):103–12.PubMed
15.
Lock J, Le Grange D, Agras WS, Fitzpatrick KK, Jo B, Accurso E, Forsberg S, Anderson K, Arnow K, Stainer M. Can adaptive treatment improve outcomes in family-based therapy for adolescents with anorexia nervosa? Feasibility and treatment effects of a multi-site treatment study. Behav Res Ther. 2015; 73:90–5.PubMedPubMedCentral
16.
Mitchell JE, Agras S, Crow S, Halmi K, Fairburn CG, Bryson S, Kraemer H. Stepped care and cognitive–behavioural therapy for bulimia nervosa: randomised trial. Br J Psychiatry. 2011; 198(5):391–7.PubMedPubMedCentral
17.
Lamb SE, Williams MA, Williamson EM, Gates S, Withers EJ, Mt-Isa S, Ashby D, Castelnuovo E, Underwood M, Cooke MW, Group MT. Managing Injuries of the Neck Trial (MINT): a randomised controlled trial of treatments for whiplash injuries. Health Technol Assess. 2012;16(49).
18.
Richter D, Mickel C, Acharya S, Brunel P, Militaru C. Aliskiren-based stepped-care treatment algorithm provides effective blood pressure control. Int J Clin Pract. 2011; 65(5):613–23.PubMed
19.
Hamall KM, Heard TR, Inder KJ, McGill KM, Kay-Lambkin F. The Child Illness and Resilience Program (CHiRP): a study protocol of a stepped care intervention to improve the resilience and wellbeing of families living with childhood chronic illness. BMC Psychol. 2014;2(1).
20.
Stam H, van der Wouden JC, van der Horst HE, Maarsingh OR. Impairment reduction in older dizzy people in primary care: study protocol for a cluster randomised controlled trial. Trials. 2015;16(313).
21.
Borsari B, Hustad JTP, Mastroleo NR, Tevyaw TO, Barnett NP, Kahler CW, Short EE, Monti PM. Addressing alcohol use and problems in mandated college students: a randomized clinical trial using stepped care. J Consult Clin Psychol. 2012; 80(6):1062–74.PubMedPubMedCentral
22.
Mitchell N, Hewitt C, Adamson J, Parrott S, Torgerson D, Ekers D, Holmes J, Lester H, McMillan D, Richards D, Spilsbury K, Godfrey C, Gilbody S. A randomised evaluation of CollAborative care and active surveillance for Screen-Positive EldeRs with sub-threshold depression (CASPER): study protocol for a randomized controlled trial. Trials. 2011;12.
23.
Tolin DF, Diefenbach GJ, Gilliam CM. Stepped care versus standard cognitive-behavioral therapy for obsessive–compulsive disorder: a preliminary study of efficacy and costs. Depression Anxiety. 2011; 28(4):314–23.PubMed
24.
Nordin K, Rissanen R, Ahlgren J, Burell G, Fjällskog ML, Börjesson S, Arving C. Design of the study: how can health care help female breast cancer patients reduce their stress symptoms? A randomized intervention study with stepped-care. BMC Cancer. 2012; 12(1):167.PubMedPubMedCentral
25.
Gilliam CM, Diefenbach GJ, Whiting SE, Tolin DF. Stepped care for obsessive–compulsive disorder: an open trial. Behav Res Ther. 2010; 48(11):1144–9.PubMedPubMedCentral
26.
van der Leeden AJ, van Widenfelt BM, van der Leeden R, Liber JM, Utens EM, Treffers PD. Stepped care cognitive behavioural therapy for children with anxiety disorders: a new treatment approach. Behav Cogn Psychother. 2011; 39(1):55–75.PubMed
27.
Krebber AMH, Leemans CR, de Bree R, van Straten A, Smit F, Smit EF, Becker A, Eeckhout GM, Beekman AT, Cuijpers P, et al.Stepped care targeting psychological distress in head and neck and lung cancer patients: a randomized clinical trial. BMC Cancer. 2012; 12(1):173.PubMedPubMedCentral
28.
Mattsson S, Alfonsson S, Carlsson M, Nygren P, Olsson E, Johansson B. U-CARE: internet-based stepped care with interactive support and cognitive behavioral therapy for reduction of anxiety and depressive symptoms in cancer: a clinical trial protocol. BMC Cancer. 2013; 13:414.PubMedPubMedCentral
29.
Oosterbaan DB, Verbraak MJ, Terluin B, Hoogendoorn AW, Peyrot WJ, Muntingh A, van Balkom AJ. Collaborative stepped care versus care as usual for common mental disorders: 8-month, cluster randomised controlled trial. Br J Psychiatry. 2013; 203(2):132–9.PubMed
30.
Rose JE, Behm FM. Adapting smoking cessation treatment according to initial response to precessation nicotine patch. Am J Psychiatry. 2013; 170(8):860–7.PubMedPubMedCentral
31.
Kasari C, Kaiser A, Goods K, Nietfeld J, Mathy P, Landa R, Murphy S, Almirall D. Communication interventions for minimally verbal children with autism: a sequential multiple assignment randomized trial. J Am Acad Child Adolesc Psychiatry. 2014; 53(6):635–46.PubMedPubMedCentral
32.
Weiss RD, Potter JS, Fiellin DA, Byrne M, Connery HS, Dickinson W, Gardin J, Griffin ML, Gourevitch MN, Haller DL, et al.Adjunctive counseling during brief and extended buprenorphine-naloxone treatment for prescription opioid dependence: a 2-phase randomized controlled trial. Arch Gen Psychiatr. 2011; 68(12):1238–46.PubMed
33.
Shortreed SM, Moodie EE. Estimating the optimal dynamic antipsychotic treatment regime: evidence from the sequential multiple-assignment randomized clinical antipsychotic trials of intervention and effectiveness schizophrenia study. J R Stat Soc Ser C Appl Stat. 2012; 61(4):577–99.PubMedPubMedCentral
34.
Wang L, Rotnitzky A, Lin X, Millikan RE, Thall PF. Evaluation of viable dynamic treatment regimes in a sequentially randomized trial of advanced prostate cancer. J Am Stat Assoc. 2012; 107(498):493–508.PubMedPubMedCentral
35.
Wu F, Laber EB, Lipkovich IA, Severus E. Who will benefit from antidepressants in the acute treatment of bipolar depression? A reanalysis of the STEP-BD study by Sachs et al. 2007, using Q-learning. Int J Bipolar Disord. 2015; 3(1):1–11.
36.
Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, Kirchner JE, Solberg LI, Main D, Bauer MS. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014; 9(132).
37.
Diggle P, Heagerty P, Liang KY, Zeger S. Analysis of Longitudinal Data. Oxford: Oxford University Press; 2002.
38.
Andersson G, Carlbring P, Draper C, O’Donohue W. Stepped Care and E-health: Practical Applications to Behavioral Disorders. New York: Springer; 2011.
39.
Richards DA, Bower P, Pagel C, Weaver A, Utley M, Cape J, Pilling S, Lovell K, Gilbody S, Leibowitz J, et al.Delivering stepped care: an analysis of implementation in routine practice. Implementation Sci. 2012; 7(1):1.
40.
41.
42.
43.
44.
45.
46.
Nahum-Shani I, Hekler EB, Spruijt-Metz D. Building health behavior models to guide the development of just-in-time adaptive interventions: a pragmatic framework. Health Psychol. 2015; 34(S):1209.PubMedCentral
47.
Klasnja P, Hekler EB, Shiffman S, Boruvka A, Almirall D, Tewari A, Murphy SA. Microrandomized trials: an experimental design for developing just-in-time adaptive interventions. Health Psychol. 2015; 34(S):1220.PubMedCentral
48.
NeCamp T, Kilbourne A, Almirall D. Comparing cluster-level dynamic treatment regimens using sequential, multiple assignment, randomized trials: regression estimation and sample size considerations. Stat Methods Med Res. 2017; 26(4):1572–89.PubMedPubMedCentral
49.
Lu X, Nahum-Shani I, Kasari C, Lynch KG, Oslin DW, Pelham WE, Fabiano G, Almirall D. Comparing dynamic treatment regimes using repeated-measures outcomes: modeling considerations in smart studies. Stat Med. 2016; 35(10):1595–615.PubMed
50.
Roberts C, Roberts SA. Design and analysis of clinical trials with clustering effects due to treatment. Clin Trials. 2005; 2(2):152–62.PubMed
51.
Baldwin SA, Bauer DJ, Stice E, Rohde P. Evaluating models for partially clustered designs. Psychol Methods. 2011; 16(2):149–165.
52.
Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010; 8(1):1.
53.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M, et al.Better reporting of interventions: template for intervention description and replication (TIDieR): checklist and guide. BMJ. 2014; 348:1687.
54.
Ell K, Katon W, Xie B, Lee PJ, Kapetanovic S, Guterman J, Chou CP. Collaborative care management of major depression among low-income, predominantly Hispanic subjects with diabetes: a randomized controlled trial. Diabetes Care. 2010; 33(4):706–13.PubMedPubMedCentral
55.
van’t Veer-Tazelaar P, Smit F, van Hout H, van Oppen P, van der Horst H, Beekman A, van Marwijk H. Cost-effectiveness of a stepped care intervention to prevent depression and anxiety in late life: randomised trial. Br J Psychiatry. 2010; 196(4):319–25.PubMed
56.
Braamse AMJ, van Meijel B, Visser O, van Oppen P, Boenink AD, Eeltink C, Cuijpers P, Huijgens PC, Beekman ATF, Dekker J. Distress and quality of life after autologous stem cell transplantation: a randomized clinical trial to evaluate the outcome of a web-based stepped care intervention. BMC Cancer. 2010;10(361).
57.
Patel V, Weiss HA, Chowdhary N, Naik S, Pednekar S, Chatterjee S, De Silva MJ, Bhat B, Araya R, King M, et al.Effectiveness of an intervention led by lay health counsellors for depressive and anxiety disorders in primary care in Goa, India (MANAS): a cluster randomised controlled trial. Lancet. 2010; 376(9758):2086–95.PubMedPubMedCentral
58.
Kay-Lambkin FJ, Baker AL, McKetin R, Lee N. Stepping through treatment: reflections on an adaptive treatment strategy among methamphetamine users with depression. Drug Alcohol Rev. 2010; 29(5):475–82.PubMed
59.
Seekles W, van Straten A, Beekman A, van Marwijk H, Cuijpers P. Stepped care treatment for depression and anxiety in primary care: a randomized controlled trial. Trials. 2011;12(171).
60.
Apil SR, Hoencamp E, Haffmans JPM, Spinhoven P. A stepped care relapse prevention program for depression in older people: a randomized controlled trial. Int J Geriatr Psychiatry. 2012; 27(6):583–91.PubMed
61.
Karp JF, Rollman BL, Reynolds CF, Morse JQ, Lotrich F, Mazumdar S, Morone N, Weiner DK. Addressing both depression and pain in late life: the methodology of the ADAPT study. Pain Med. 2012; 13(3):405–18.PubMedPubMedCentral
62.
Dozeman E, van Marwijk HW, van Schaik DJ, Smit F, Stek ML, van der Horst HE, Bohlmeijer ET, Beekman AT. Contradictory effects for prevention of depression and anxiety in residents in homes for the elderly: a pragmatic randomized controlled trial. Int Psychogeriatr. 2012; 24(08):1242–51.PubMed
63.
Pommer AM, Pouwer F, Denollet J, Pop VJ. Managing co-morbid depression and anxiety in primary care patients with asthma and/or chronic obstructive pulmonary disease: study protocol for a randomized controlled trial. Trials. 2012; 13(1):6.PubMedPubMedCentral
64.
Van Dijk SE, Pols AD, Adriaanse MC, Bosmans JE, Elders PJ, Van Marwijk HW, Van Tulder MW. Cost-effectiveness of a stepped-care intervention to prevent major depression in patients with type 2 diabetes mellitus and/or coronary heart disease and subthreshold depression: design of a cluster-randomized controlled trial. BMC Psychiatry. 2013;13(128).
65.
Arving C, Thormodsen I, Brekke G, Mella O, Berntsen S, Nordin K. Early rehabilitation of cancer patients: a randomized controlled intervention study. BMC Cancer. 2013;13.
66.
van der Aa HP, Van Rens GH, Comijs HC, Bosmans JE, Margrain TH, van Nispen RM. Stepped-care to prevent depression and anxiety in visually impaired older adults: design of a randomised controlled trial. BMC Psychiatry. 2013;13(209).
67.
Muntingh A, van der Feltz-Cornelis C, van Marwijk H, Spinhoven P, Assendelft W, de Waal M, Ader H, van Balkom A. Effectiveness of collaborative stepped care for anxiety disorders in primary care: a pragmatic cluster randomised controlled trial. Psychother Psychosom. 2014; 83(1):37–44.PubMed
68.
Gureje O, Oladeji BD, Araya R, Montgomery AA. A cluster randomized clinical trial of a stepped care intervention for depression in primary care (STEPCARE): study protocol. BMC Psychiatry. 2015; 15(1):1.
69.
Stoop C, Nefs G, Pommer A, Pop V, Pouwer F. Effectiveness of a stepped care intervention for anxiety and depression in people with diabetes, asthma or COPD in primary care: a randomized controlled trial. J Affect Disord. 2015; 184:269–76.PubMed
70.
Schuurhuizen CS, Braamse AM, Beekman AT, Bomhof-Roordink H, Bosmans JE, Cuijpers P, Hoogendoorn AW, Konings IR, van der Linden MH, Neefjes EC, et al.Screening and treatment of psychological distress in patients with metastatic colorectal cancer: study protocol of the TES trial. BMC Cancer. 2015;15(302).
71.
Haug T, Nordgreen T, Öst LG, Kvale G, Tangen T, Andersson G, Carlbring P, Heiervang ER, Havik OE. Stepped care versus face-to–face cognitive behavior therapy for panic disorder and social anxiety disorder: predictors and moderators of outcome. Behav Res Ther. 2015; 71:76–89.PubMed
72.
Salloum A, Wang W, Robst J, Murphy TK, Scheeringa MS, Cohen JA, Storch EA. Stepped care versus standard trauma-focused cognitive behavioral therapy for young children. J Child Psychol Psychiatry. 2015; 57(5):614–22.PubMedPubMedCentral
73.
Painter JT, Fortney JC, Gifford AL, Rimland D, Monson T, Rodriguez-Barradas MC, Pyne JM. Cost-effectiveness of collaborative care for depression in HIV clinics. J Acquir Immune Defic Syndr. 2015; 70(4):377–85.PubMedPubMedCentral
Metadata
Title
Statistical design and analysis in trials of proportionate interventions: a systematic review
Authors
Jane Candlish
M. Dawn Teare
Judith Cohen
Tracey Bywater
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
Trials / Issue 1/2019
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-019-3206-x

Other articles of this Issue 1/2019

Trials 1/2019 Go to the issue

Study protocol

A combination of multimodal physical exercises in real and virtual environments for individuals after chronic stroke: study protocol for a randomized controlled trial

Study protocol

Preformed pediatric zirconia crown versus preformed pediatric metal crown: study protocol for a randomized clinical trial

Study protocol

Antibiotic Review Kit for Hospitals (ARK-Hospital): study protocol for a stepped-wedge cluster-randomised controlled trial

Study protocol

An online intervention for improving stroke survivors’ health-related quality of life: study protocol for a randomised controlled trial

Study protocol

Rapid Access to Contrast-Enhanced spectral mammogRaphy in women recalled from breast cancer screening: the RACER trial study design

Research

Understanding the impact of a multispecialty electronic consultation service on family physician referral rates to specialists: a randomized controlled trial using health administrative data