Skip to main content
Top
Published in: Prevention Science 1/2019

01-01-2019

Standardized Effect Sizes for Preventive Mobile Health Interventions in Micro-randomized Trials

Authors: Brook Luers, Predrag Klasnja, Susan Murphy

Published in: Prevention Science | Issue 1/2019

Login to get access

Abstract

Mobile Health (mHealth) interventions are behavioral interventions that are accessible to individuals in their daily lives via a mobile device. Most mHealth interventions consist of multiple intervention components. Some of the components are “pull” components, which require individuals to access the component on their mobile device at moments when they decide they need help. Other intervention components are “push” components, which are initiated by the intervention, not the individual, and are delivered via notifications or text messages. Micro-randomized trials (MRTs) have been developed to provide data to assess the effects of push intervention components on subsequent emotions and behavior. In this paper, we review the micro-randomized trial design and provide an approach to computing a standardized effect size for these intervention components. This effect size can be used to compare different push intervention components that may be included in an mHealth intervention. In addition, a standardized effect size can be used to inform sample size calculations for future MRTs. Here, the standardized effect size is a function of time because the push notifications can occur repeatedly over time. We illustrate this methodology using data from an MRT involving HeartSteps, an mHealth intervention for physical activity as part of the secondary prevention of heart disease.
Appendix
Available only for authorised users
Literature
go back to reference Bowen, S., & Marlatt, A. (2009). Surfing the urge: Brief mindfulness-based intervention for college student smokers. Psychology of Addictive Behaviors, 23, 666.CrossRefPubMed Bowen, S., & Marlatt, A. (2009). Surfing the urge: Brief mindfulness-based intervention for college student smokers. Psychology of Addictive Behaviors, 23, 666.CrossRefPubMed
go back to reference Cleveland, W.S., & Devlin, S.J. (1988). Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83, 596–610.CrossRef Cleveland, W.S., & Devlin, S.J. (1988). Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83, 596–610.CrossRef
go back to reference Cohen, J. (1988). Statistical power analysis for the social sciences. Hillsdale: Erlbaum. Cohen, J. (1988). Statistical power analysis for the social sciences. Hillsdale: Erlbaum.
go back to reference Dempsey, W., Liao, P., Klasnja, P., Nahum-Shani, I., Murphy, S.A. (2015). Randomised trials for the fitbit generation. Significance, 12, 20–23.CrossRefPubMed Dempsey, W., Liao, P., Klasnja, P., Nahum-Shani, I., Murphy, S.A. (2015). Randomised trials for the fitbit generation. Significance, 12, 20–23.CrossRefPubMed
go back to reference Efron, B., & Tibshirani, R. (1994). An introduction to the bootstrap. Boca Raton: Taylor & Francis. Efron, B., & Tibshirani, R. (1994). An introduction to the bootstrap. Boca Raton: Taylor & Francis.
go back to reference Friedman, J., Hastie, T., Tibshirani, R. (2009). The elements of statistical learning. New York: Springer. Friedman, J., Hastie, T., Tibshirani, R. (2009). The elements of statistical learning. New York: Springer.
go back to reference Gollwitzer, P.M. (1999). Implementation intentions: Strong effects of simple plans. American Psychologist, 54, 493.CrossRef Gollwitzer, P.M. (1999). Implementation intentions: Strong effects of simple plans. American Psychologist, 54, 493.CrossRef
go back to reference Hovsepian, K., al’Absi, M., Ertin, E., Kamarck, T., Nakajima, M., Kumar, S. (2015). cstress: Towards a gold standard for continuous stress assessment in the mobile environmentt. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (pp. 493–504). Hovsepian, K., al’Absi, M., Ertin, E., Kamarck, T., Nakajima, M., Kumar, S. (2015). cstress: Towards a gold standard for continuous stress assessment in the mobile environmentt. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (pp. 493–504).
go back to reference Klasnja, P., Hekler, E.B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., Murphy, S.A. (2015). Microrandomized trials: An experimental design for developing just-in-time adaptive interventions. Health Psychology, 34, 1220.CrossRefPubMedCentral Klasnja, P., Hekler, E.B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., Murphy, S.A. (2015). Microrandomized trials: An experimental design for developing just-in-time adaptive interventions. Health Psychology, 34, 1220.CrossRefPubMedCentral
go back to reference Kumar, S., Abowd, G., Abraham, W.T., al’Absi, M., Chau, D.H., Ertin, E., Wetter, D. (2017). Center of excellence for mobile sensor data-to-knowledge (md2k). IEEE Pervasive Computing, 16, 18–22.CrossRefPubMedPubMedCentral Kumar, S., Abowd, G., Abraham, W.T., al’Absi, M., Chau, D.H., Ertin, E., Wetter, D. (2017). Center of excellence for mobile sensor data-to-knowledge (md2k). IEEE Pervasive Computing, 16, 18–22.CrossRefPubMedPubMedCentral
go back to reference Liao, P., Klasnja, P., Tewari, A., Murphy, S.A. (2016). Sample size calculations for micro-randomized trials in mHealth. Statistics in Medicine, 35, 1944–1971.CrossRefPubMed Liao, P., Klasnja, P., Tewari, A., Murphy, S.A. (2016). Sample size calculations for micro-randomized trials in mHealth. Statistics in Medicine, 35, 1944–1971.CrossRefPubMed
go back to reference Luszczynska, A. (2006). An implementation intentions intervention, the use of a planning strategy, and physical activity after myocardial infarction. Social Science & Medicine, 62, 900– 908.CrossRef Luszczynska, A. (2006). An implementation intentions intervention, the use of a planning strategy, and physical activity after myocardial infarction. Social Science & Medicine, 62, 900– 908.CrossRef
go back to reference Nahum-Shani, I., Smith, S.N., Spring, B.J., Collins, L.M., Witkiewitz, K., Tewari, A., Murphy, S.A. (2016). Just-in-time adaptive interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, 1–17. https://doi.org/10.1007/s12160-016-9830-8. Nahum-Shani, I., Smith, S.N., Spring, B.J., Collins, L.M., Witkiewitz, K., Tewari, A., Murphy, S.A. (2016). Just-in-time adaptive interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, 1–17. https://​doi.​org/​10.​1007/​s12160-016-9830-8.
go back to reference Olejnik, S., & Algina, J. (2000). Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241–286.CrossRefPubMed Olejnik, S., & Algina, J. (2000). Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241–286.CrossRefPubMed
go back to reference Seewald, N.J., Sun, J., Liao, P. (2016). MRT-SS Calculator: An R shiny application for sample size calculation in micro-randomized trials. arXiv:1609.00695. [February 18, 2017]. Seewald, N.J., Sun, J., Liao, P. (2016). MRT-SS Calculator: An R shiny application for sample size calculation in micro-randomized trials. arXiv:1609.​00695. [February 18, 2017].
go back to reference Smith, S.N., Lee, A., Kelly, H., Seewald, N., Boruvka, A., Murphy, S.A., Klasnja, P. (2017). Design lessons from a micro-randomized pilot study in mobile health. In J. M. Rehg, S. A. Murphyand, & S. Kumar (Eds.), Mobile health: Sensors, analytic methods, and applications. Switzerland: Springer International Publishing. In press. Smith, S.N., Lee, A., Kelly, H., Seewald, N., Boruvka, A., Murphy, S.A., Klasnja, P. (2017). Design lessons from a micro-randomized pilot study in mobile health. In J. M. Rehg, S. A. Murphyand, & S. Kumar (Eds.), Mobile health: Sensors, analytic methods, and applications. Switzerland: Springer International Publishing. In press.
go back to reference Wilkinson, L. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594.CrossRef Wilkinson, L. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594.CrossRef
go back to reference Witkiewitz, K., Desai, S.A., Bowen, S., Leigh, B.C., Kirouac, M., Larimer, M.E. (2014). Development and evaluation of a mobile intervention for heavy drinking and smoking among college students. Psychology of Addictive Behaviors, 28, 639.CrossRefPubMedPubMedCentral Witkiewitz, K., Desai, S.A., Bowen, S., Leigh, B.C., Kirouac, M., Larimer, M.E. (2014). Development and evaluation of a mobile intervention for heavy drinking and smoking among college students. Psychology of Addictive Behaviors, 28, 639.CrossRefPubMedPubMedCentral
Metadata
Title
Standardized Effect Sizes for Preventive Mobile Health Interventions in Micro-randomized Trials
Authors
Brook Luers
Predrag Klasnja
Susan Murphy
Publication date
01-01-2019
Publisher
Springer US
Published in
Prevention Science / Issue 1/2019
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-017-0862-5

Other articles of this Issue 1/2019

Prevention Science 1/2019 Go to the issue