Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Time-varying SMART design and data analysis methods for evaluating adaptive intervention effects

Authors: Tianjiao Dai, Sanjay Shete

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

In a standard two-stage SMART design, the intermediate response to the first-stage intervention is measured at a fixed time point for all participants. Subsequently, responders and non-responders are re-randomized and the final outcome of interest is measured at the end of the study. To reduce the side effects and costs associated with first-stage interventions in a SMART design, we proposed a novel time-varying SMART design in which individuals are re-randomized to the second-stage interventions as soon as a pre-fixed intermediate response is observed. With this strategy, the duration of the first-stage intervention will vary.

Methods

We developed a time-varying mixed effects model and a joint model that allows for modeling the outcomes of interest (intermediate and final) and the random durations of the first-stage interventions simultaneously. The joint model borrows strength from the survival sub-model in which the duration of the first-stage intervention (i.e., time to response to the first-stage intervention) is modeled. We performed a simulation study to evaluate the statistical properties of these models.

Results

Our simulation results showed that the two modeling approaches were both able to provide good estimations of the means of the final outcomes of all the embedded interventions in a SMART. However, the joint modeling approach was more accurate for estimating the coefficients of first-stage interventions and time of the intervention.

Conclusion

We conclude that the joint modeling approach provides more accurate parameter estimates and a higher estimated coverage probability than the single time-varying mixed effects model, and we recommend the joint model for analyzing data generated from time-varying SMART designs. In addition, we showed that the proposed time-varying SMART design is cost-efficient and equally effective in selecting the optimal embedded adaptive intervention as the standard SMART design.
Appendix
Available only for authorised users
Literature
1.
go back to reference Almirall D, Nahum-Shani I, Sherwood NE, Murphy SA. Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research. Transl Behav Med. 2014;4:260–74.CrossRefPubMedPubMedCentral Almirall D, Nahum-Shani I, Sherwood NE, Murphy SA. Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research. Transl Behav Med. 2014;4:260–74.CrossRefPubMedPubMedCentral
2.
go back to reference Dawson R, Lavori P.W. Placebo-free designs for evaluating new mental health treatments: the use of adaptive treatment strategies. Statistics in medicine. 2004;23:3249–3262. Dawson R, Lavori P.W. Placebo-free designs for evaluating new mental health treatments: the use of adaptive treatment strategies. Statistics in medicine. 2004;23:3249–3262.
3.
go back to reference Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24:1455–81.CrossRefPubMed Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24:1455–81.CrossRefPubMed
4.
5.
6.
go back to reference Lavori PW, Dawson R. Dynamic treatment regimes: practical design considerations. Clin Trials. 2004;1:9–20.CrossRefPubMed Lavori PW, Dawson R. Dynamic treatment regimes: practical design considerations. Clin Trials. 2004;1:9–20.CrossRefPubMed
7.
go back to reference Lavori PW, Dawson R, Rush AJ. Flexible treatment strategies in chronic disease: clinical and research implications. Biol Psychiatry. 2000;48:605–14.CrossRefPubMed Lavori PW, Dawson R, Rush AJ. Flexible treatment strategies in chronic disease: clinical and research implications. Biol Psychiatry. 2000;48:605–14.CrossRefPubMed
8.
go back to reference Heinrichs RW. Cognitive improvement in response to antipsychotic drugs: neurocognitive effects of antipsychotic medications in patients with chronic schizophrenia in the CATIE Trial. Arch Gen Psychiatry. 2007;64:631–2.CrossRefPubMed Heinrichs RW. Cognitive improvement in response to antipsychotic drugs: neurocognitive effects of antipsychotic medications in patients with chronic schizophrenia in the CATIE Trial. Arch Gen Psychiatry. 2007;64:631–2.CrossRefPubMed
9.
go back to reference Rush AJ, Trivedi M, Fava M. Depression, IV: STAR*D treatment trial for depression. Am J Psychiatry. 2003;160:237.CrossRefPubMed Rush AJ, Trivedi M, Fava M. Depression, IV: STAR*D treatment trial for depression. Am J Psychiatry. 2003;160:237.CrossRefPubMed
10.
go back to reference Lavori PW, Rush AJ, Wisniewski SR, Alpert J, Fava M, Kupfer DJ, et al. Strengthening clinical effectiveness trials: equipoise-stratified randomization. Biol Psychiatry. 2001;50:792–801.CrossRefPubMed Lavori PW, Rush AJ, Wisniewski SR, Alpert J, Fava M, Kupfer DJ, et al. Strengthening clinical effectiveness trials: equipoise-stratified randomization. Biol Psychiatry. 2001;50:792–801.CrossRefPubMed
11.
go back to reference Thall PF, Millikan RE, Sung HG. Evaluating multiple treatment courses in clinical trials. Stat Med. 2000;19:1011–28.CrossRefPubMed Thall PF, Millikan RE, Sung HG. Evaluating multiple treatment courses in clinical trials. Stat Med. 2000;19:1011–28.CrossRefPubMed
12.
go back to reference Collins LM, Murphy SA, Bierman KA. A conceptual framework for adaptive preventive interventions. Prevention Science. 2004;5:181-192. Collins LM, Murphy SA, Bierman KA. A conceptual framework for adaptive preventive interventions. Prevention Science. 2004;5:181-192.
13.
go back to reference Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B, Fabiano GA, et al. Q-learning: a data analysis method for constructing adaptive interventions. Psychol Methods. 2012;17:478–94.CrossRefPubMedPubMedCentral Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B, Fabiano GA, et al. Q-learning: a data analysis method for constructing adaptive interventions. Psychol Methods. 2012;17:478–94.CrossRefPubMedPubMedCentral
14.
go back to reference Kasari C, Kaiser A, Goods K, Nietfeld J, Mathy P, Landa R, et al. Communication interventions for minimally verbal children with autism: a sequential multiple assignment randomized trial. J Am Acad Child Adolesc Psychiatry. 2014;53:635–46.CrossRefPubMedPubMedCentral Kasari C, Kaiser A, Goods K, Nietfeld J, Mathy P, Landa R, et al. Communication interventions for minimally verbal children with autism: a sequential multiple assignment randomized trial. J Am Acad Child Adolesc Psychiatry. 2014;53:635–46.CrossRefPubMedPubMedCentral
15.
go back to reference Schulte PJ, Tsiatis AA, Laber EB, Davidian M. Q- and A-learning Methods for Estimating Optimal Dynamic Treatment Regimes. Stat Sci. 2014;29:640–61.CrossRefPubMed Schulte PJ, Tsiatis AA, Laber EB, Davidian M. Q- and A-learning Methods for Estimating Optimal Dynamic Treatment Regimes. Stat Sci. 2014;29:640–61.CrossRefPubMed
16.
go back to reference Zhao YQ, Zeng D, Laber EB, Kosorok MR. New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes. J Am Stat Assoc. 2015;110:583–98.CrossRefPubMedPubMedCentral Zhao YQ, Zeng D, Laber EB, Kosorok MR. New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes. J Am Stat Assoc. 2015;110:583–98.CrossRefPubMedPubMedCentral
17.
go back to reference Zhang B, Tsiatis AA, Laber EB, Davidian M. Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions. Biometrika. 2003;100:681–694. Zhang B, Tsiatis AA, Laber EB, Davidian M. Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions. Biometrika. 2003;100:681–694.
18.
go back to reference Lu X, Lynch KG, Oslin DW, Murphy S. Comparing treatment policies with assistance from the structural nested mean model. Biometrics. 2016;72(1):10-19. Lu X, Lynch KG, Oslin DW, Murphy S. Comparing treatment policies with assistance from the structural nested mean model. Biometrics. 2016;72(1):10-19.
19.
go back to reference Lu X, Nahum-Shani I, Kasari C, Lynch KG, Oslin DW, Pelham WE et al. Comparing dynamic treatment regimes using repeated-measures outcomes: modeling considerations in SMART studies. Statistics in Medicine. 2016;35(10):1595-1615. Lu X, Nahum-Shani I, Kasari C, Lynch KG, Oslin DW, Pelham WE et al. Comparing dynamic treatment regimes using repeated-measures outcomes: modeling considerations in SMART studies. Statistics in Medicine. 2016;35(10):1595-1615.
20.
go back to reference Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B, Fabiano GA, et al. Experimental design and primary data analysis methods for comparing adaptive interventions. Psychol Methods. 2012;17:457–77.CrossRefPubMed Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B, Fabiano GA, et al. Experimental design and primary data analysis methods for comparing adaptive interventions. Psychol Methods. 2012;17:457–77.CrossRefPubMed
21.
go back to reference Lei H, Nahum-Shani I, Lynch K, Oslin D, Murphy SA. A “SMART” design for building individualized treatment sequences. Annu Rev Clin Psychol. 2012;8:21–48.CrossRefPubMed Lei H, Nahum-Shani I, Lynch K, Oslin D, Murphy SA. A “SMART” design for building individualized treatment sequences. Annu Rev Clin Psychol. 2012;8:21–48.CrossRefPubMed
22.
go back to reference Pelham WE, Fabiano GA, Waxmonsky JG, Greiner AR, Gnagy EM, Pelham WE, et al. Treatment Sequencing for Childhood ADHD: A Multiple-Randomization Study of Adaptive Medication and Behavioral Interventions. Journal of Clinical Child and Adolescent Psychology. 45(4):396-415. doi:10.1080/15374416.2015.1105138. Pelham WE, Fabiano GA, Waxmonsky JG, Greiner AR, Gnagy EM, Pelham WE, et al. Treatment Sequencing for Childhood ADHD: A Multiple-Randomization Study of Adaptive Medication and Behavioral Interventions. Journal of Clinical Child and Adolescent Psychology. 45(4):396-415. doi:10.​1080/​15374416.​2015.​1105138.
23.
go back to reference Page TF, Pelham Iii WE, Fabiano GA, Greiner AR, Gnagy EM, Hart KC, et al. Comparative Cost Analysis of Sequential, Adaptive, Behavioral, Pharmacological, and Combined Treatments for Childhood ADHD. Journal of Clinical Child and Adolescent Psychology: the Official Journal For the Society of Clinical Child and Adolescent Psychology. American Psychological Association, Division 53. 1-12. PMID 26808137. doi:10.1080/15374416.2015.1055859. Page TF, Pelham Iii WE, Fabiano GA, Greiner AR, Gnagy EM, Hart KC, et al. Comparative Cost Analysis of Sequential, Adaptive, Behavioral, Pharmacological, and Combined Treatments for Childhood ADHD. Journal of Clinical Child and Adolescent Psychology: the Official Journal For the Society of Clinical Child and Adolescent Psychology. American Psychological Association, Division 53. 1-12. PMID 26808137. doi:10.​1080/​15374416.​2015.​1055859.
25.
go back to reference Ebbert JO, Wyatt KD, Hays JT, Klee EW, Hurt RD. Varenicline for smoking cessation: efficacy, safety, and treatment recommendations. Patient Prefer Adherence. 2010;4:355–62.CrossRefPubMedPubMedCentral Ebbert JO, Wyatt KD, Hays JT, Klee EW, Hurt RD. Varenicline for smoking cessation: efficacy, safety, and treatment recommendations. Patient Prefer Adherence. 2010;4:355–62.CrossRefPubMedPubMedCentral
26.
go back to reference Cinciripini PM, Robinson JD, Karam-Hage M, Minnix JA, Lam C, Versace F, et al. Effects of varenicline and bupropion sustained-release use plus intensive smoking cessation counseling on prolonged abstinence from smoking and on depression, negative affect, and other symptoms of nicotine withdrawal. JAMA Psychiatry. 2013;70:522–33.CrossRefPubMedPubMedCentral Cinciripini PM, Robinson JD, Karam-Hage M, Minnix JA, Lam C, Versace F, et al. Effects of varenicline and bupropion sustained-release use plus intensive smoking cessation counseling on prolonged abstinence from smoking and on depression, negative affect, and other symptoms of nicotine withdrawal. JAMA Psychiatry. 2013;70:522–33.CrossRefPubMedPubMedCentral
27.
go back to reference Tan X, Shiyko MP, Li R, Li Y, Dierker L. A time-varying effect model for intensive longitudinal data. Psychol Methods. 2012;17:61–77.CrossRefPubMed Tan X, Shiyko MP, Li R, Li Y, Dierker L. A time-varying effect model for intensive longitudinal data. Psychol Methods. 2012;17:61–77.CrossRefPubMed
28.
go back to reference Shiyko MP, Lanza ST, Tan X, Li R, Shiffman S. Using the time-varying effect model (TVEM) to examine dynamic associations between negative affect and self confidence on smoking urges: differences between successful quitters and relapsers. Prev Sci. 2012;13:288–99.CrossRefPubMedPubMedCentral Shiyko MP, Lanza ST, Tan X, Li R, Shiffman S. Using the time-varying effect model (TVEM) to examine dynamic associations between negative affect and self confidence on smoking urges: differences between successful quitters and relapsers. Prev Sci. 2012;13:288–99.CrossRefPubMedPubMedCentral
29.
go back to reference Henderson R, Diggle P, Dobson A. Joint modelling of longitudinal measurements and event time data. Biostatistics. 2000;1:465–80.CrossRefPubMed Henderson R, Diggle P, Dobson A. Joint modelling of longitudinal measurements and event time data. Biostatistics. 2000;1:465–80.CrossRefPubMed
30.
go back to reference Rizopoulos D. JM: An R Package for the Joint Modelling of Longitudinal and Time-to-Event Data. J Stat Softw. 2015;35:1–33. Rizopoulos D. JM: An R Package for the Joint Modelling of Longitudinal and Time-to-Event Data. J Stat Softw. 2015;35:1–33.
33.
go back to reference Taunk NK, Haffty BG, Chen S, Khan AJ, Nelson C, Pierce D, et al. Comparison of radiation-induced fatigue across 3 different radiotherapeutic methods for early stage breast cancer. Cancer. 2011;117:4116–24.CrossRefPubMed Taunk NK, Haffty BG, Chen S, Khan AJ, Nelson C, Pierce D, et al. Comparison of radiation-induced fatigue across 3 different radiotherapeutic methods for early stage breast cancer. Cancer. 2011;117:4116–24.CrossRefPubMed
34.
go back to reference Hombrink J, Voss AC, Frohlich D, Glatzel M, Krauss A, Glaser FH. Therapy trends in the prevention of radiation-induced diarrhea after pelvic and abdominal irradiation. Results of a tricenter study. Strahlenther Onkol. 1995;171:49–53.PubMed Hombrink J, Voss AC, Frohlich D, Glatzel M, Krauss A, Glaser FH. Therapy trends in the prevention of radiation-induced diarrhea after pelvic and abdominal irradiation. Results of a tricenter study. Strahlenther Onkol. 1995;171:49–53.PubMed
35.
go back to reference Harris K, Doyle M, Barnes EA, Sinclair E, Danjoux C, Barbera L, et al. Diarrhea as a radiation side effect “welcomed” by patients taking opioids. J Pain Symptom Manage. 2006;31:97–8.CrossRefPubMed Harris K, Doyle M, Barnes EA, Sinclair E, Danjoux C, Barbera L, et al. Diarrhea as a radiation side effect “welcomed” by patients taking opioids. J Pain Symptom Manage. 2006;31:97–8.CrossRefPubMed
36.
37.
go back to reference Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–60.CrossRefPubMed Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000;11:550–60.CrossRefPubMed
Metadata
Title
Time-varying SMART design and data analysis methods for evaluating adaptive intervention effects
Authors
Tianjiao Dai
Sanjay Shete
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0202-7

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue