Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Research article

Applying machine learning to predict future adherence to physical activity programs

Authors: Mo Zhou, Yoshimi Fukuoka, Ken Goldberg, Eric Vittinghoff, Anil Aswani

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

Identifying individuals who are unlikely to adhere to a physical exercise regime has potential to improve physical activity interventions. The aim of this paper is to develop and test adherence prediction models using objectively measured physical activity data in the Mobile Phone-Based Physical Activity Education program (mPED) trial. To the best of our knowledge, this is the first to apply Machine Learning methods to predict exercise relapse using accelerometer-recorded physical activity data.

Methods

We use logistic regression and support vector machine methods to design two versions of a Discontinuation Prediction Score (DiPS), which uses objectively measured past data (e.g., steps and goal achievement) to provide a numerical quantity indicating the likelihood of exercise relapse in the upcoming week. The respective prediction accuracy of these two versions of DiPS are compared, and then numerical simulation is performed to explore the potential of using DiPS to selectively allocate financial incentives to participants to encourage them to increase physical activity.

Results

we had access to a physical activity trial data that were continuously collected every 60 sec every day for 9 months in 210 participants. By using the first 15 weeks of data as training and test on weeks 16–30, we show that both versions of DiPS have a test AUC of 0.9 with high sensitivity and specificity in predicting the probability of exercise adherence. Simulation results assuming different intervention regimes suggest the potential benefit of using DiPS as a score to allocate resources in physical activity intervention programs in reducing costs over other allocation schemes.

Conclusions

DiPS is capable of making accurate and robust predictions for future weeks. The most predictive features are steps and physical activity intensity. Furthermore, the use of DiPS scores can be a promising approach to determine when or if to provide just-in-time messages and step goal adjustments to improve compliance. Further studies on the use of DiPS in the design of physical activity promotion programs are warranted.

Trial registration

ClinicalTrials.gov NCT01280812 Registered on January 21, 2011.
Literature
1.
go back to reference Gujral S, McAuley E, Oberlin LE, Kramer AF, Erickson KI. The role of brain structure in predicting adherence to a physical activity regimen. Psychosom Med. 2018;80(1):69.PubMedPubMedCentralCrossRef Gujral S, McAuley E, Oberlin LE, Kramer AF, Erickson KI. The role of brain structure in predicting adherence to a physical activity regimen. Psychosom Med. 2018;80(1):69.PubMedPubMedCentralCrossRef
2.
go back to reference Booth ML, Owen N, Bauman A, Clavisi O, Leslie E. Social–cognitive and perceived environment influences associated with physical activity in older Australians. Preventive medicine. 2000;31(1):15-22.PubMedCrossRef Booth ML, Owen N, Bauman A, Clavisi O, Leslie E. Social–cognitive and perceived environment influences associated with physical activity in older Australians. Preventive medicine. 2000;31(1):15-22.PubMedCrossRef
3.
go back to reference Harris TJ, Owen CG, Victor CR, Adams R, Cook DG. What factors are associated with physical activity in older people, assessed objectively by accelerometry? Br J Sports Med. 2009;43(6):442-50.PubMedCrossRef Harris TJ, Owen CG, Victor CR, Adams R, Cook DG. What factors are associated with physical activity in older people, assessed objectively by accelerometry? Br J Sports Med. 2009;43(6):442-50.PubMedCrossRef
4.
go back to reference Jefferis BJ, Sartini C, Lee IM, et al. Adherence to physical activity guidelines in older adults, using objectively measured physical activity in a population-based study. BMC Public Health. 2014;14(1):382.PubMedPubMedCentralCrossRef Jefferis BJ, Sartini C, Lee IM, et al. Adherence to physical activity guidelines in older adults, using objectively measured physical activity in a population-based study. BMC Public Health. 2014;14(1):382.PubMedPubMedCentralCrossRef
7.
go back to reference Fukuoka Y, Haskell W, Lin F, Vittinghoff E. Short- and long-term effects of a Mobile phone app in conjunction with brief in-person counseling on physical activity among physically inactive women: the mPED randomized clinical trial. JAMA Netw Open. 2019;2(5):e194281 PMID: 31125101.PubMedPubMedCentralCrossRef Fukuoka Y, Haskell W, Lin F, Vittinghoff E. Short- and long-term effects of a Mobile phone app in conjunction with brief in-person counseling on physical activity among physically inactive women: the mPED randomized clinical trial. JAMA Netw Open. 2019;2(5):e194281 PMID: 31125101.PubMedPubMedCentralCrossRef
8.
go back to reference Stetson BA, Rahn JM, Dubbert PM, et al. Prospective evaluation of the effects of stress on exercise adherence in community-residing women. Health Psychol. 1997;16:515–20.PubMedCrossRef Stetson BA, Rahn JM, Dubbert PM, et al. Prospective evaluation of the effects of stress on exercise adherence in community-residing women. Health Psychol. 1997;16:515–20.PubMedCrossRef
9.
go back to reference Marlatt GA, Gordon JR. Relapse prevention: maintenance strategies in addictive behavior change. New York: Guilford Press; 1985. Marlatt GA, Gordon JR. Relapse prevention: maintenance strategies in addictive behavior change. New York: Guilford Press; 1985.
10.
go back to reference Simkin LR, Gross AM. Assessment of coping with high-risk situations for exercise relapse among healthy women. Health Psychol. 1994;13(3):274.PubMedCrossRef Simkin LR, Gross AM. Assessment of coping with high-risk situations for exercise relapse among healthy women. Health Psychol. 1994;13(3):274.PubMedCrossRef
11.
go back to reference Marcus BH, Forsyth LH, Stone EJ, et al. Physical activity behavior change: issues in adoption and maintenance. Health Psychol. 2000;19(1S):32.PubMedCrossRef Marcus BH, Forsyth LH, Stone EJ, et al. Physical activity behavior change: issues in adoption and maintenance. Health Psychol. 2000;19(1S):32.PubMedCrossRef
12.
go back to reference McCaul KD, Glasgow RE, Schafer LC. Diabetes regimen behaviors: Predicting adherence. Med Care. 1987;25:868–81.PubMedCrossRef McCaul KD, Glasgow RE, Schafer LC. Diabetes regimen behaviors: Predicting adherence. Med Care. 1987;25:868–81.PubMedCrossRef
13.
go back to reference Stone VE, Jordan J, Tolson J, et al. Perspectives on adherence and simplicity for HIV-infected patients on antiretroviral therapy: self-report of the relative importance of multiple attributes of highly active antiretroviral therapy (HAART) regimens in predicting adherence. J Acquir Immune Defic Syndr. 2004;36(3):808–16.PubMedCrossRef Stone VE, Jordan J, Tolson J, et al. Perspectives on adherence and simplicity for HIV-infected patients on antiretroviral therapy: self-report of the relative importance of multiple attributes of highly active antiretroviral therapy (HAART) regimens in predicting adherence. J Acquir Immune Defic Syndr. 2004;36(3):808–16.PubMedCrossRef
14.
go back to reference Lin JH, Zhang SM, Manson JE. Predicting adherence to tamoxifen for breast cancer adjuvant therapy and prevention. Cancer Prev Res. 2011;4(9):1360–5.CrossRef Lin JH, Zhang SM, Manson JE. Predicting adherence to tamoxifen for breast cancer adjuvant therapy and prevention. Cancer Prev Res. 2011;4(9):1360–5.CrossRef
15.
go back to reference Mason JE, England DA, Denton BT, et al. Optimizing statin treatment decisions for diabetes patients in the presence of uncertain future adherence. Med Decis Mak. 2012;32(1):154–66.CrossRef Mason JE, England DA, Denton BT, et al. Optimizing statin treatment decisions for diabetes patients in the presence of uncertain future adherence. Med Decis Mak. 2012;32(1):154–66.CrossRef
16.
go back to reference Aswani A, Kaminsky P, Mintz Y, Flowers E, Fukuoka Y. Behavioral modeling in weight loss interventions. Eur J Oper Res. 2019;272(3):1058-72.PubMedCrossRef Aswani A, Kaminsky P, Mintz Y, Flowers E, Fukuoka Y. Behavioral modeling in weight loss interventions. Eur J Oper Res. 2019;272(3):1058-72.PubMedCrossRef
18.
go back to reference Schuna JM, Johnson WD, Tudor-Locke C. Adult self-reported and objectively monitored physical activity and sedentary behavior: NHANES 2005–2006. Int J Behav Nutr Phys Act. 2013;10(1):126.PubMedPubMedCentralCrossRef Schuna JM, Johnson WD, Tudor-Locke C. Adult self-reported and objectively monitored physical activity and sedentary behavior: NHANES 2005–2006. Int J Behav Nutr Phys Act. 2013;10(1):126.PubMedPubMedCentralCrossRef
19.
20.
go back to reference Case MA, Burwick HA, Volpp KG, et al. Accuracy of smartphone applications and wearable devices for tracking physical activity data. JAMA. 2015;313(6):625–6.PubMedCrossRef Case MA, Burwick HA, Volpp KG, et al. Accuracy of smartphone applications and wearable devices for tracking physical activity data. JAMA. 2015;313(6):625–6.PubMedCrossRef
21.
go back to reference Fujiki Y. iPhone as a physical activity measurement platform. InCHI'10 Extended Abstracts on Human Factors in Computing Systems. 2010. (pp. 4315-4320). ACM. Fujiki Y. iPhone as a physical activity measurement platform. InCHI'10 Extended Abstracts on Human Factors in Computing Systems. 2010. (pp. 4315-4320). ACM.
22.
go back to reference Hekler EB, Buman MP, Grieco L, et al. Validation of physical activity tracking via android smartphones compared to ActiGraph accelerometer: laboratory-based and free-living validation studies. JMIR Mhealth Uhealth. 2015;3(2):e36.PubMedPubMedCentralCrossRef Hekler EB, Buman MP, Grieco L, et al. Validation of physical activity tracking via android smartphones compared to ActiGraph accelerometer: laboratory-based and free-living validation studies. JMIR Mhealth Uhealth. 2015;3(2):e36.PubMedPubMedCentralCrossRef
23.
go back to reference Bauer S, de Niet J, Timman R, et al. Enhancement of care through self-monitoring and tailored feedback via text messaging and their use in the treatment of childhood overweight. Patient Educ Couns. 2010;79(3):315–9.PubMedCrossRef Bauer S, de Niet J, Timman R, et al. Enhancement of care through self-monitoring and tailored feedback via text messaging and their use in the treatment of childhood overweight. Patient Educ Couns. 2010;79(3):315–9.PubMedCrossRef
24.
go back to reference Beasley JM, Riley WT, Davis A, et al. Evaluation of a PDA-based dietary assessment and intervention program: a randomized controlled trial. J Am Coll Nutr. 2008;27(2):280–6.PubMedCrossRef Beasley JM, Riley WT, Davis A, et al. Evaluation of a PDA-based dietary assessment and intervention program: a randomized controlled trial. J Am Coll Nutr. 2008;27(2):280–6.PubMedCrossRef
25.
go back to reference Burke LE, Conroy MB, Sereika SM, et al. The effect of electronic self-monitoring on weight loss and dietary intake: a randomized behavioral weight loss trial. Obesity. 2011;19(2):338–44.PubMedCrossRef Burke LE, Conroy MB, Sereika SM, et al. The effect of electronic self-monitoring on weight loss and dietary intake: a randomized behavioral weight loss trial. Obesity. 2011;19(2):338–44.PubMedCrossRef
26.
go back to reference Fjeldsoe BS, Miller YD, Marshall AL. MobileMums: a randomized controlled trial of an SMS-based physical activity intervention. Ann Behav Med. 2010;39(2):101–11.PubMedCrossRef Fjeldsoe BS, Miller YD, Marshall AL. MobileMums: a randomized controlled trial of an SMS-based physical activity intervention. Ann Behav Med. 2010;39(2):101–11.PubMedCrossRef
27.
go back to reference Fukuoka Y, Gay CL, Joiner KL, et al. A novel diabetes prevention intervention using a mobile app: a randomized controlled trial with overweight adults at risk. Am J Prev Med. 2015;49(2):223–37.PubMedPubMedCentralCrossRef Fukuoka Y, Gay CL, Joiner KL, et al. A novel diabetes prevention intervention using a mobile app: a randomized controlled trial with overweight adults at risk. Am J Prev Med. 2015;49(2):223–37.PubMedPubMedCentralCrossRef
28.
go back to reference Fukuoka Y, Vittinghoff E, Jong SS, et al. Innovation to motivation-pilot study of a mobile phone intervention to increase physical activity among sedentary women. J Prev Med. 2010;51(3):287–9.CrossRef Fukuoka Y, Vittinghoff E, Jong SS, et al. Innovation to motivation-pilot study of a mobile phone intervention to increase physical activity among sedentary women. J Prev Med. 2010;51(3):287–9.CrossRef
29.
go back to reference Hurling R, Catt M, De Boni M, et al. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. JMIR. 2007;9(2):e7.PubMed Hurling R, Catt M, De Boni M, et al. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. JMIR. 2007;9(2):e7.PubMed
30.
go back to reference Joo NS, Kim BT. Mobile phone short message service messaging for behaviour modification in a community-based weight control programme in Korea. J Telemed Telecare. 2007;13(8):416–20.PubMedCrossRef Joo NS, Kim BT. Mobile phone short message service messaging for behaviour modification in a community-based weight control programme in Korea. J Telemed Telecare. 2007;13(8):416–20.PubMedCrossRef
31.
32.
go back to reference Patrick K, Raab F, Adams MA, et al. A text message–based intervention for weight loss: randomized controlled trial. JMIR. 2009;11(1):e1.PubMed Patrick K, Raab F, Adams MA, et al. A text message–based intervention for weight loss: randomized controlled trial. JMIR. 2009;11(1):e1.PubMed
33.
go back to reference Riley WT, Rivera DE, Atienza AA, et al. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med. 2011;1(1):53–71.PubMedPubMedCentralCrossRef Riley WT, Rivera DE, Atienza AA, et al. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med. 2011;1(1):53–71.PubMedPubMedCentralCrossRef
34.
go back to reference Fukuoka Y, Vittinghoff E, Hooper J. A weight loss intervention using a commercial mobile application in Latino Americans—Adelgaza trial. Transl Behav Med. 2018;8(5):714–23.PubMedPubMedCentralCrossRef Fukuoka Y, Vittinghoff E, Hooper J. A weight loss intervention using a commercial mobile application in Latino Americans—Adelgaza trial. Transl Behav Med. 2018;8(5):714–23.PubMedPubMedCentralCrossRef
35.
go back to reference Zhou M, Fukuoka Y, Mintz Y, et al. Evaluating machine learning based automated personalized daily step goals delivered through a Mobile phone app: a randomized controlled trial. JMIR Mhealth Uhealth. 2018;6:e28.PubMedPubMedCentralCrossRef Zhou M, Fukuoka Y, Mintz Y, et al. Evaluating machine learning based automated personalized daily step goals delivered through a Mobile phone app: a randomized controlled trial. JMIR Mhealth Uhealth. 2018;6:e28.PubMedPubMedCentralCrossRef
36.
go back to reference Kyriacos U, Jelsma J, Jordan S. Monitoring vital signs using early warning scoring systems: a review of the literature. J Nurs Manag. 2011;19(3):311–30.PubMedCrossRef Kyriacos U, Jelsma J, Jordan S. Monitoring vital signs using early warning scoring systems: a review of the literature. J Nurs Manag. 2011;19(3):311–30.PubMedCrossRef
37.
38.
go back to reference Paterson R, MacLeod D, Thetford D, Beattie A, Graham C, Lam S, et al. Prediction of in-hospital mortality and length of stay using an early warning scoring system: clinical audit. Clinical Medicine. 2006;6(3):281–4.PubMedPubMedCentralCrossRef Paterson R, MacLeod D, Thetford D, Beattie A, Graham C, Lam S, et al. Prediction of in-hospital mortality and length of stay using an early warning scoring system: clinical audit. Clinical Medicine. 2006;6(3):281–4.PubMedPubMedCentralCrossRef
39.
go back to reference Vorwerk C. MEWS: predicts hospital admission and mortality in emergency department patients. Emerg Med J. 2009;26(6):466.PubMedCrossRef Vorwerk C. MEWS: predicts hospital admission and mortality in emergency department patients. Emerg Med J. 2009;26(6):466.PubMedCrossRef
40.
go back to reference Williams B, Alberti G, Ball C, et al. National Early Warning Score (NEWS): standardising the assessment of acute-illness severity in the NHS. London: The Royal College of Physicians; 2012. Williams B, Alberti G, Ball C, et al. National Early Warning Score (NEWS): standardising the assessment of acute-illness severity in the NHS. London: The Royal College of Physicians; 2012.
41.
go back to reference Oshima Y, Kawaguchi K, Tanaka S, et al. Classifying household and locomotive activities using a triaxial accelerometer. Gait Posture. 2010;31(3):370–4.PubMedCrossRef Oshima Y, Kawaguchi K, Tanaka S, et al. Classifying household and locomotive activities using a triaxial accelerometer. Gait Posture. 2010;31(3):370–4.PubMedCrossRef
42.
go back to reference Ohkawara K, Oshima Y, Hikihara Y, Ishikawa-Takata K, Tabata I, Tanaka S. Real-time estimation of daily physical activity intensity by a triaxial accelerometer and a gravity-removal classification algorithm. Br J Nutr. 2011;105(11):1681–91.PubMedCrossRef Ohkawara K, Oshima Y, Hikihara Y, Ishikawa-Takata K, Tabata I, Tanaka S. Real-time estimation of daily physical activity intensity by a triaxial accelerometer and a gravity-removal classification algorithm. Br J Nutr. 2011;105(11):1681–91.PubMedCrossRef
43.
go back to reference Fukuoka Y, Zhou M, Vittinghoff E, Haskell W, Goldberg K, Aswani A. Objectively measured baseline physical activity patterns in women in the mPED trial: cluster analysis. JMIR Public Health Surveill. 2018;4(1):e10.PubMedPubMedCentralCrossRef Fukuoka Y, Zhou M, Vittinghoff E, Haskell W, Goldberg K, Aswani A. Objectively measured baseline physical activity patterns in women in the mPED trial: cluster analysis. JMIR Public Health Surveill. 2018;4(1):e10.PubMedPubMedCentralCrossRef
45.
go back to reference Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97. Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995;20(3):273–97.
46.
go back to reference Cadmus-Bertram L, Marcus BH, Patterson RE, Parker BA, Morey BL. Use of the Fitbit to measure adherence to a physical activity intervention among overweight or obese, postmenopausal women: self-monitoring trajectory during 16 weeks. JMIR MHealth UHealth. 2015;3(4):e96.PubMedPubMedCentralCrossRef Cadmus-Bertram L, Marcus BH, Patterson RE, Parker BA, Morey BL. Use of the Fitbit to measure adherence to a physical activity intervention among overweight or obese, postmenopausal women: self-monitoring trajectory during 16 weeks. JMIR MHealth UHealth. 2015;3(4):e96.PubMedPubMedCentralCrossRef
47.
go back to reference Rejeski WJ, Axtell R, Fielding R, Katula J, King AC, Manini TM, Marsh AP, Pahor M, Rego A, Tudor-Locke C, Newman M. Promoting physical activity for elders with compromised function: the lifestyle interventions and independence for elders (LIFE) study physical activity intervention. Clin Interv Aging. 2013;8:1119.PubMedPubMedCentralCrossRef Rejeski WJ, Axtell R, Fielding R, Katula J, King AC, Manini TM, Marsh AP, Pahor M, Rego A, Tudor-Locke C, Newman M. Promoting physical activity for elders with compromised function: the lifestyle interventions and independence for elders (LIFE) study physical activity intervention. Clin Interv Aging. 2013;8:1119.PubMedPubMedCentralCrossRef
48.
go back to reference Goodpaster BH, DeLany JP, Otto AD, Kuller L, Vockley J, South-Paul JE, Thomas SB, Brown J, McTigue K, Hames KC, Lang W. Effects of diet and physical activity interventions on weight loss and cardiometabolic risk factors in severely obese adults: a randomized trial. Jama. 2010;304(16):1795–802.PubMedPubMedCentralCrossRef Goodpaster BH, DeLany JP, Otto AD, Kuller L, Vockley J, South-Paul JE, Thomas SB, Brown J, McTigue K, Hames KC, Lang W. Effects of diet and physical activity interventions on weight loss and cardiometabolic risk factors in severely obese adults: a randomized trial. Jama. 2010;304(16):1795–802.PubMedPubMedCentralCrossRef
49.
go back to reference Zhou M, Mintz Y, Fukuoka Y, Goldberg K, Flowers E, Kaminsky P, Castillejo A, Aswani A. Personalizing Mobile Fitness Apps using Reinforcement Learning. In: In: Proceedings of the 23rd International on Intelligent User Interfaces: 2nd Workshop on Theory-Informed User Modeling for Tailoring and Personalizing Interfaces (HUMANIZE); 2018. Zhou M, Mintz Y, Fukuoka Y, Goldberg K, Flowers E, Kaminsky P, Castillejo A, Aswani A. Personalizing Mobile Fitness Apps using Reinforcement Learning. In: In: Proceedings of the 23rd International on Intelligent User Interfaces: 2nd Workshop on Theory-Informed User Modeling for Tailoring and Personalizing Interfaces (HUMANIZE); 2018.
50.
go back to reference Munson SA, Consolvo S. Exploring goal-setting, rewards, self-monitoring, and sharing to motivate physical activity. In2012 6th international conference on pervasive computing technologies for healthcare (PervasiveHealth) and workshops. 2012. (pp. 25-32). IEEE. Munson SA, Consolvo S. Exploring goal-setting, rewards, self-monitoring, and sharing to motivate physical activity. In2012 6th international conference on pervasive computing technologies for healthcare (PervasiveHealth) and workshops. 2012. (pp. 25-32). IEEE.
51.
go back to reference Konrad A, Bellotti V, Crenshaw N, Tucker S, Nelson L, Du H, Pirolli P, Whittaker S. Finding the adaptive sweet spot: Balancing compliance and achievement in automated stress reduction. InProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015. (pp. 3829-3838). ACM. Konrad A, Bellotti V, Crenshaw N, Tucker S, Nelson L, Du H, Pirolli P, Whittaker S. Finding the adaptive sweet spot: Balancing compliance and achievement in automated stress reduction. InProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2015. (pp. 3829-3838). ACM.
52.
go back to reference Adams MA, Sallis JF, Norman GJ, et al. An adaptive physical activity intervention for overweight adults: a randomized controlled trial. PLoS One. 2013;8(12):e82901.PubMedPubMedCentralCrossRef Adams MA, Sallis JF, Norman GJ, et al. An adaptive physical activity intervention for overweight adults: a randomized controlled trial. PLoS One. 2013;8(12):e82901.PubMedPubMedCentralCrossRef
53.
go back to reference Adams MA, Hurley JC, Todd M, et al. Adaptive goal setting and financial incentives: a 2×2 factorial randomized controlled trial to increase adults? Physical activity. BMC Public Health. 2017;17(1):286.PubMedPubMedCentralCrossRef Adams MA, Hurley JC, Todd M, et al. Adaptive goal setting and financial incentives: a 2×2 factorial randomized controlled trial to increase adults? Physical activity. BMC Public Health. 2017;17(1):286.PubMedPubMedCentralCrossRef
Metadata
Title
Applying machine learning to predict future adherence to physical activity programs
Authors
Mo Zhou
Yoshimi Fukuoka
Ken Goldberg
Eric Vittinghoff
Anil Aswani
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0890-0

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue