This paper is in the following e-collection/theme issue:

Wearables and MHealth Reviews (256)

Published on in Vol 6, No 11 (2018): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/10076, first published .
Key Elements of mHealth Interventions to Successfully Increase Physical Activity: Meta-Regression

Key Elements of mHealth Interventions to Successfully Increase Physical Activity: Meta-Regression

Key Elements of mHealth Interventions to Successfully Increase Physical Activity: Meta-Regression

Authors of this article:

Lisa V. Eckerstorfer1 Author Orcid Image ;   Norbert K. Tanzer1 Author Orcid Image ;   Claudia Vogrincic-Haselbacher1 Author Orcid Image ;   Gayannee Kedia1 Author Orcid Image ;   Hilmar Brohmer1 Author Orcid Image ;   Isabelle Dinslaken1 Author Orcid Image ;   Katja Corcoran1, 2 Author Orcid Image
Article Authors Cited by (45) Tweetations (27) Metrics

    Original Paper

    1Institute of Psychology, University of Graz, Graz, Austria

    2BioTechMed-Graz, Graz, Austria

    Corresponding Author:

    Lisa V Eckerstorfer, MSc

    Institute of Psychology

    University of Graz

    Universitaetsplatz 1

    Graz, 8010

    Austria

    Phone: 43 316 380 ext 8524

    Email: lisa.eckerstorfer@uni-graz.at


    Background: Mobile technology gives researchers unimagined opportunities to design new interventions to increase physical activity. Unfortunately, it is still unclear which elements are useful to initiate and maintain behavior change.

    Objective: In this meta-analysis, we investigated randomized controlled trials of physical activity interventions that were delivered via mobile phone. We analyzed which elements contributed to intervention success.

    Methods: After searching four databases and science networks for eligible studies, we entered 50 studies with N=5997 participants into a random-effects meta-analysis, controlling for baseline group differences. We also calculated meta-regressions with the most frequently used behavior change techniques (behavioral goals, general information, self-monitoring, information on where and when, and instructions on how to) as moderators.

    Results: We found a small overall effect of the Hedges g=0.29, (95% CI 0.20 to 0.37) which reduced to g=0.22 after correcting for publication bias. In the moderator analyses, behavioral goals and self-monitoring each led to more intervention success. Interventions that used neither behavioral goals nor self-monitoring had a negligible effect of g=0.01, whereas utilizing either technique increased effectiveness by Δg=0.31, but combining them did not provide additional benefits (Δg=0.36).

    Conclusions: Overall, mHealth interventions to increase physical activity have a small to moderate effect. However, including behavioral goals or self-monitoring can lead to greater intervention success. More research is needed to look at more behavior change techniques and their interactions. Reporting interventions in trial registrations and articles need to be structured and thorough to gain accurate insights. This can be achieved by basing the design or reporting of interventions on taxonomies of behavior change.

    JMIR Mhealth Uhealth 2018;6(11):e10076

    doi:10.2196/10076

    Keywords

    exercise; physical activity; mHealth; behavior change; meta-analysis; meta-regression 


    People spend much time with their mobile phones (on average 2 hours and 27 minutes per day using apps and the Web [1]) and too little time being physically active [2,3], even though physical activity is beneficial for both body [4-6] and mind [6,7]. Recently, researchers have been looking for ways to use mobile phones to increase physical activity. These mobile health (mHealth) interventions have only been possible in recent years with the upsurge of mobile communication devices [8-11].

    For researchers who strive to change health-related behavior, mHealth shows excellent promise for building life-changing interventions, but their efficacy is currently uncertain [12]. In the domain of physical activity, mHealth interventions yield small to moderate effects [13]. To date, researchers have not been able to pinpoint contextual elements that lead to greater intervention success in increasing physical activity [13-19]. Indeed, a wide range of interventions are implemented that often overlap with each other. However, it is still unclear which basic principles and strategies lead to efficient changes. Tomlinson and colleagues [20] pointed out that there should be a joint effort among researchers to find and refine strategies for successful mHealth interventions. Hence, we know that mHealth interventions have great potential, but we need to establish how to maximize their efficacy. This meta-analysis study aims to identify content-related elements that predict intervention efficacy. The resulting knowledge is crucial for creating new interventions and guidelines.

    One way to describe the content of interventions is to identify the behavior change techniques (BCTs) on which they rely. These are theory-based methods to change psychological determinants of behavior, such as agreeing on a behavioral contract or facilitating social comparison. Until now, it is unclear which BCTs contribute more to mHealth intervention success than others. This is mostly because until recently, only a limited number of studies have been available. Previous reviews and meta-analyses identified n=11 [15], n=19 [13], and n=18 [19] studies. These pools of studies only provide enough power to test two or three moderators in a meta-regression [21], so there was no feasible way to test the influence of each BCT—first, because there is a considerable number of BCTs and second, because some BCTs are seldom used or not used at all [13,22].

    In the present meta-analysis, we decided to use a taxonomy by Michie and colleagues [23], which—in contrast to more general taxonomies for behavior change [24]—focuses on BCTs for diet and physical activity interventions. This taxonomy contains 40 BCTs, all of which we coded, but we only tested the influence of the 5 most frequently used ones in order to retain sufficient statistical power. In our sample, these are (1) behavioral goals, (2) general information, (3) self-monitoring, (4) information on where and when, and (5) instructions on how to. One change we wanted to make in comparison to previous work is to control for group differences at baseline. Even though we only used randomized controlled trials (RCTs), we expected to find a high number of feasibility and pilot tests with small sample sizes, in which not all the advantages of randomization can unfold properly. Our main research question is which of the 5 most frequently used BCTs have the potential to increase the efficacy of mobile phone-delivered physical activity interventions?


    Searching for Studies

    To find suitable studies, we searched Google scholar and 4 databases: PubMed, PsycINFO, ScienceDirect, and the ISI Web of Knowledge using search terms related to physical activity, mHealth and study design. An example for a search syntax is ([randomized controlled trial OR RCT OR randomised controlled trial OR clinical trial] AND [mobile phone OR smartphone OR mobile app OR mHealth] AND [exercise OR physical fitness OR physical activity]). We did not restrict year of publication, but we did restrict language to English or German. Furthermore, we searched reference lists of published reviews on the topic [14,15,19] and posted invitations to research communities in health psychology, sports psychology, social psychology, and sports science to contribute relevant studies.

    Selecting Studies

    We did not restrict inclusion to specific populations. Instead, we accepted all studies that targeted physical activity—be it for healthy populations, sick populations, during pregnancy, or for children (Textbox 1). The general flow of study selection is presented in Figure 1.

    We identified a total of 2067 studies. After removing duplicates, we screened the remaining 1817 records for eligibility according to their title and abstract. We assessed the full text of 205 studies and from these, 50 met the inclusion criteria [25-74]. When we screened titles and abstracts, we excluded poorly fitting records hierarchically. First, we reviewed content fit, and then we checked whether the research was original. Following that, we assessed whether there was an intervention and whether the intervention was delivered via mobile phone—and so on. In the second screening, we checked those points again—but more thoroughly—and we also assessed more complex questions, such as the suitability of the control group or whether there was enough information to compute effect sizes of group differences at baseline and the end of the intervention.

    Study inclusion and exclusion criteria.

    Inclusion criteria

    • The intervention was automatically delivered via mobile phone by either an app or texting
    • The intervention targeted an increase in physical activity
    • There was a control group, which was more passive than the intervention group and did not have personal communications with medical staff or researchers instead of receiving the mHealth intervention
    • Allocation to experimental and control groups was randomized, though we accepted stratification (eg, by gender)
    • At least one of the outcomes measured actual physical activity (via electronic trackers or self-reported) or assessed objective indicators of physical fitness (eg, peak oxygen intake)

    Exclusion criteria

    • Study designs were nonexperimental (eg, observational studies, reports and comments, case studies)
    • The data necessary to calculate an effect size was not available
    Textbox 1. Study inclusion and exclusion criteria.
    ‎
    Figure 1. Flow diagram of the study selection process. RCT: randomized controlled trial; PA: physical activity; mHealth (mobile health).
    View this figure

    Outcome Measures and Effect Size

    In the present meta-analysis, we wanted to investigate how selected interventions influence physical activity; hence we focused on physical activity as outcomes. There are 2 main methods to measure physical activity: having people self-report their physical activity and electronically tracking people’s movement. Self-reported and tracked physical activity generally correlate poorly or moderately with each other, but with a range from r=–.71 to .96 [75]. To check whether the way in which physical activity was measured in our studies impacts our main results, we investigated the influence of physical activity measurement on intervention success by including the type of outcome (tracked versus self-reported versus both) as a moderator in our design.

    Since our pool of studies includes many pilot and feasibility tests, we decided to account for their small sample size by using the Hedges g to measure effect size. This is principally the same measurement as the Cohen d, but it uses a correction factor for small sample sizes [76]. The interpretation of the Hedges g follows the same rule of thumb that applies to the Cohen d:|g |=0.20 for a small effect, |g |=0.50 for a medium effect, and |g |=0.80 for a large effect.

    Review Procedure and Moderators

    The extracted studies were initially screened for eligibility and then articles were classified according to title and abstract. The categories are depicted in the list of “Records excluded” (Figure 1). The procedure was conducted hierarchically, first making sure the topic fitted, then checking the originality of the data (ie, if there was any data collected), implementation of an intervention, mHealth focus of that intervention, and so on. A consensus was reached through discussion. Information was then extracted from the articles and protocols into a Microsoft Excel spreadsheet. Of the 205 studies of which the full text was assessed for eligibility, 96 were coded twice to uphold the same rating standards. Again, a consensus was reached through discussion in several evaluation sessions.

    To estimate study quality, we used the Effective Public Health Practice Project (EPHPP) Quality Assessment Tool [77]. The EPHPP tool has 6 sections, which are aggregated to a final grade on a 3-point scale. Low study quality is a known issue in electronic interventions [78,79], but we did not exclude those studies. Instead, we checked whether the study quality moderates intervention efficacy, because a correspondence can be a sign of publication bias.

    Further, some of the studies we included did not (only) target physical activity, but health or weight, with an increase of physical activity being one of multiple intervention goals. We expected that mHealth interventions directly targeting physical activity rather than health or weight would be more efficient in increasing physical activity. Therefore, we assessed the studies’ main objective as a moderator of intervention success.

    Behavior Change Techniques

    To identify the factors of mHealth intervention success, we used a taxonomy of 40 BCTs to code intervention contents [23]. We coded only BCTs that were employed in the intervention group and not in the control group. If a BCT was used in both groups, we counted it as absent from the intervention. Since we only expected to collect a sample of studies large enough to test 5 moderators (ie, around 25 to 50 studies), we decided to test the five most frequently used BCTs as moderators. The BCTs we tested were (1) behavioral goals, (2) general information, (3) self-monitoring, (4) information on where and when, and (5) instructions on how to.

    Meta-Analysis and Meta-Regression

    To assure quality in our meta-analysis, we consulted with experts, and followed the recommendations in Borenstein and colleagues [76], and consulted a quality assessment tool for meta-analyses [80]. All statistical analyses in the present study were conducted in R, version 3.4.2 [81] with the additional packages robumeta [82], metafor [83], MAd [84], tidyverse [85], readxl [86], compute.es [87], stats [81], ggplot2 [88], yarrr [89], and wesanderson [90]. We calculated the effect size (Hedges g) for the difference between the intervention and control group before the intervention (baseline) and at the end of the scheduled intervention (postintervention) from means, standard deviations and group size, P-values or proportions. To assess whether there were meaningful physical activity group differences before the interventions were administered, we first performed a random-effects meta-analysis with baseline group differences. Then, we correlated baseline group differences with postintervention group differences. Since there was more heterogeneity at baseline than expected by chance alone and baseline group differences were not independent of intervention success, we used baseline group differences as a covariate in further analyses, essentially setting physical activity group differences before the intervention to zero. We also removed outliers at baseline and repeated the overall effect size analyses with this reduced pool of studies.

    For the meta-analysis with postintervention group differences and meta-regression we used robumeta, as recommended in a review of meta-analysis packages [91]. This package allows for dependent effect estimation (ie, combining multiple outcomes per study in a correlated or hierarchical fashion) [92]. We coded up to four outcomes per study and aggregated those with a correction for small sample sizes. Since we were not able to predict the correlation between outcomes, we performed sensitivity analyses. Varying the assumed correlation only led to negligible outcome changes in the second decimal place regarding the estimated coefficients and tau-squared (τ²). For our main analyses, we first ran a random effects null-model to determine overall intervention success. Then, we checked— separately for each moderator—whether study quality, the intervention’s main objective, physical activity tracking or any of the most frequently used BCTs were associated with greater intervention success. For each BCT, we compared interventions that used it with interventions that did not use it. In an exploratory fashion, we also investigated a combination of the two most efficient BCTs. We did not run any more moderator analyses to avoid exceeding the power of our pool of 50 studies.

    Publication Bias

    To evaluate a possible publication bias in the field, we created a funnel plot and performed the Egger asymmetry test [93] as recommended in [76]. We also performed a trim and fill analysis [94] and the Orwin Failsafe-N test to assess whether the effect might be an artifact of bias [95]. Due to a large proportion of feasibility and pilot trials with small sample sizes in our pool of studies, we decided against restricting the analysis to large samples.


    Selected Studies

    For our meta-analysis, we had a final pool of 50 studies with N=5997 people. The mean age of included samples was 40.6 (SD 16.7), and on average there were 62.7% women in each study (SD 29.2). We found that 40/50 (80%) studies were of good quality, 5 of the 50 (10%) were of moderate quality, and the remaining 10% (5/50) were of poor quality. Twenty-nine of the 50 (58%) studies targeted physical activity, 13/50 (26%) targeted health and 16% (8/50) targeted weight. Furthermore, 20 of the 50 (40%) studies used self-reported measures of physical activity, 17/50 (34%) tracked physical activity, and 13/50 (26%) studies used both methods. We coded a maximum of 4 outcomes per study (M=1.76), which led to 87 physical activity-related outcomes across the pool of 50 studies. Sample sizes and group differences at baseline as well as after the intervention are provided in Table 1. A table with more details regarding population, intervention, comparison, and outcomes can be found in Multimedia Appendix 1.

    Not all BCTs were used equally often. Therefore, some BCTs are featured in more than half of the studies whereas others are not featured at all. Information for each BCT of the taxonomy is available in Multimedia Appendix 1. We decided to test the five most frequently used BCTs as moderators. As shown in Table 2, there are 18 to 30 studies out of 48 using each of these 5 BCTs. Table 2 also indicates the number of studies in each element in which physical activity was measured as self-reports, electronically tracked, or if both methods were used simultaneously. We ran a chi-square test to determine whether using a certain BCT was confounded by how physical activity was measured. The test did not reveal a significant association between using BCTs and the way in which physical activity was measured (χ²8=13.6, P=.09). Overall—in 48/50 (96%) studies—235 BCTs were used, which led to a mean of 5 BCTs per study.

    Baseline Group Differences

    A random-effects meta-analysis with baseline group differences revealed that the estimated effect g=0.05 was not significantly different from zero (95% CI –0.03 to 0.13, P=.22), but there was considerable heterogeneity between the studies (Q (49)=93.79, P<.001) and 43.33% of this heterogeneity was due to true effect sizes rather than sampling variance (I²=43.33%). Overall, the variance of true effects was τ²=0.03 on a scale of the Hedges g.

    Correlating group differences at baseline with group differences postintervention showed a positive association of r=.44 (P<.001, see Figure 2). This means that when participants who received the intervention were more physically active at baseline than people in the control group, this advantage was also conveyed to group differences after the intervention. To consider this phenomenon, we took baseline differences into account in 2 separate ways. Firstly, we used baseline group differences as a covariate—setting group differences to zero. Secondly, we removed outcomes with group differences of |g |>0.50 at baseline and reran overall effect size analyses with this reduced pool of studies. In the reduced pool, there were 44 studies with 76 outcomes. We present a scatterplot of outcomes at baseline by outcomes postintervention (see Figure 2).

    Point Estimate

    We assumed a correlation of r=.80 between outcomes of the same study. We did not have the means to check whether this assumption was valid, so we also performed sensitivity analyses—varying the assumed correlation between 0 and 1—and we did not find meaningful changes in the results. A random effects model for group differences postintervention revealed an estimated effect size of g=0.33 (95% CI 0.22 to 0.44, P<.001). We show a forest plot of group differences after the intervention is presented (see Figure 3). However, including baseline differences as a covariate in the same analysis reduced the estimated effect size to g=0.29 (95% CI 0.20 to 0.37, P<.001) with a covariate slope estimate of g=0.63 (95% CI 0.11 to 1.14, P=.02), meaning that increasing baseline group differences by g=1.00 would lead to a greater intervention success of g=0.63. True means had a variance of τ²=0.06 on a scale of the Hedges g, and 61.15% of the observed heterogeneity was due to true differences between studies rather than chance, so we went ahead with the planned moderator analyses. Estimating the overall effect size with a reduced pool of outcomes instead of baseline group differences as covariate painted much the same picture (estimated effect size g=0.28, 95% CI 0.19 to 0.38, P<.001, I²=56.38%, τ²=0.05).

    Moderator Analyses

    All moderator analyses were conducted using baseline group differences as a covariate. They did not reveal a significant influence of study quality (Δg=0.03, 95% CI –0.15 to 0.22, P=.70). In terms of an intervention’s main objective, targeting weight rather than physical activity reduced the success of increasing physical activity, but there were no differences between health and physical activity or health and weight as the main objective (ΔgPA versus weight=–0.21, 95% CI –0.42 to –0.003, P=.047; Δghealth versus PA=0.13, 95% CI –0.09 to 0.36, P=.23; Δghealth vs weight=–0.08, 95% CI –0.29 to 0.14, P=.45). There was no difference between interventions in which people self-reported their physical activity and interventions whereby physical activity was tracked, and those interventions in which both methods were used simultaneously (Δgself-reported versus tracked=0.01, 95% CI –0.21 to 0.24, P=.90; Δgboth versus self-reported=–0.11, 95% CI –0.34 to 0.11, P=.31; Δgboth versus tracked=–0.12, 95% CI –0.36 to 0.11, P=.27).

    Table 1. Overview of included studies showing the Hedges g effect size of group differences.
    StudyNBaseline, gaPostintervention, g (95% CI)
    Abraham et al 2015 [25]320.410.00 (–0.68 to 0.68)
    Adams et al 2013 [26]20–0.770.44 (–0.41 to 1.29)
    Allen et al 2013 [27]23–0.02–0.11 (–0.89 to 0.67)
    Allman-Farinelli et al 2016 [28]248–0.120.28 (0.03 to 0.52)
    Cadmus-Bertram et al 2015 [29]51–0.100.13 (–0.31 to 0.57)
    Choi et al 2016 [30]290.110.58 (–0.15 to 1.31)
    Chow et al 2015 [31]710–0.130.24 (0.04 to 0.44)
    Cotten and Prapavessis 2016 [32]560.020.34 (–0.11 to 0.78)
    Cowdery et al 2015 [33]39–0.340.17 (–0.45 to 0.79)
    Direito et al 2015 [34]34–0.54–0.14 (–0.72 to 0.43)
    Eckerstorfer et al (unpublished data)95–0.160.02 (–0.37 to 0.41)
    Fassnacht et al 2015 [35]45–0.310.00 (–0.59 to 0.59)
    Fjeldsoe et al 2016 [36]216–0.090.09 (0.56 to 1.25)
    Fjeldsoe et al 2015 [73]2660.010.38 (0.09 to 0.68)
    Fjeldsoe et al 2010 [37]880.280.91 (–0.13 to 0.30)
    Frederix et al 2015 [38]139–0.170.44 (0.14 to 0.73)
    Fukuoka et al 2015 [39]610.060.57 (0.17 to 0.97)
    Garde et al 2015 [40]47–0.21–0.07 (–0.55 to 0.42)
    Gell and Wadsworth 2015 [41]870.010.30 (–0.14 to 0.74)
    Glynn et al 2014 [42]66–0.230.25 (–0.23 to 0.73)
    Hales et al 2016 [43]43–0.070.00 (–0.59 to 0.59)
    Hartman et al 2016 [44]500.390.43 (–0.08 to 0.93)
    Hebden et al 2014 [45]510.050.01 (–0.47 to 0.49)
    Hurling et al 2007 [46]770.170.36 (–0.08 to 0.80)
    Johnston et al 2016 [47]1510.070.07 (–0.23 to 0.36)
    Joseph et al 2015 [48]28–0.040.17 (–0.41 to 0.75)
    Kim and Glanz 2013 [49]410.491.14 (0.55 to 1.72)
    Kim et al 2015 [50]196–0.100.14 (–0.14 to 0.42)
    Kim et al 2016 [51]950.08–0.06 (–0.45 to 0.33)
    Kinnafick et al 2016 [52]65–0.12–0.13 (–0.55 to 0.29)
    Laing et al 2014 [53]211–0.120.23 (–0.05 to 0.51)
    Lubans et al 2016 [54]1570.300.14 (–0.16 to 0.43)
    Maddison et al 2015 [55]1430.050.25 (–0.02 to 0.52)
    Maher et al 2015 [56]980.050.54 (0.20 to 0.87)
    Martin et al 2015 [57]320.001.35 (0.73 to 1.97)
    Nguyen et al 2013 [58]841.301.88 (1.36 to 2.40)
    Pfaeffli et al 2015 [59]1230.630.55 (0.07 to 1.03)
    Poirier et al 2016 [60]217–0.150.32 (0.04 to 0.60)
    Prestwich et al 2010 [61]94–0.140.36 (0.02 to 0.69)
    Rubinstein et al 2016 [62]5530.030.05 (–0.15 to 0.25)
    Schwerdtfeger et al 2012 [63]43–0.040.56 (–0.03 to 1.15)
    Silveira et al 2013 [64]311.321.36 (0.70 to 2.02)
    Suggs et al 2013 [65]1580.171.18 (0.84 to 1.52)
    Tabak et al 2014 [66]290.541.05 (0.29 to 1.81)
    van der Weegen et al 2015 [67]117–0.250.43 (0.09 to 0.77)
    van Drongelen et al 2014 [68]3900.120.19 (0.02 to 0.35)
    Vorrink et al 2016 [69]157–0.08–0.08 (–0.42 to 0.26)
    Walsh et al 2016 [70]550.230.29 (–0.23 to 0.81)
    Wang et al 2016 [71]590.30–0.22 (–0.64 to 0.20)
    Zach et al 2016 [72]1000.490.30 (–0.09 to 0.69)

    aHedges g refers to the effect size of group differences, where larger values indicate more physical activity of the intervention group compared to the control group.

    Table 2. The number of studies using each tested behavior change technique overall and split for the way in which physical activity was measured.
    Behavior change techniqueNSelf-reported, n, (%)Tracked, n (%)Both, n (%)
    Behavioral goals3010 (33)8 (27)12 (40)
    Self-monitoring265 (19)8 (31)13 (50)
    General information249 (38)11 (46)4 (17)
    Information on where and when196 (32)11 (58)2 (11)
    Instructions on how to184 (22)8 (44)6 (33)
    ‎
    Figure 2. Scatterplot of group differences before and after the intervention for each outcome separately. Point size indicates the number of participants in each study. ES: effect size.
    View this figure
    ‎
    Figure 3. Forest plot for physical activity postintervention. The larger the values, the more active the intervention group was compared to the control group. Horizontal lines depict 95% CI and line thickness indicates each number's impact on the summary effect.
    View this figure

    Also, we analyzed the effect of the five most frequently used BCTs. Two studies could not be coded for BCTs because they used very diverse interventions and from the text, it was not clear which participants received which intervention components. Thus, we conducted the analyses with a pool of 48 studies, using 84 outcomes. The moderator analyses are visually presented (see Figure 4). Using the BCTs behavioral goals and self-monitoring led to greater intervention success, but the other 3 tested BCTs (ie, general information, information on where and when, and instructions on how to) were not associated with greater intervention success (behavioral goals: Δg=0.20, 95% CI 0.02 to 0.38, P=.03; general information: Δg=–0.16, 95% CI –0.33 to 0.01, P=.07; self-monitoring: Δg=0.17 95% CI 0.01 to 0.34, P=.04; information on where and when: Δg=0.11, 95% CI –0.07 to 0.30, P=.22; instructions on how to: Δg=0.01, 95% CI –0.17 to 0.19, P=.88). We decided to explore the BCTs behavioral goals and self-monitoring further by combining them in a single moderator model and checking for additive effects. This analysis revealed that if neither behavioral goals nor self-monitoring are used this is associated with a lower intervention efficacy compared with the use of either or both BCTs (Δgnone versus either=0.31, 95% CI 0.13 to 0.49, P=.002; Δgnone versus both=0.36, 95% CI 0.15 to 0.56, P=.002; Δgeither versus both=0.05, 95% CI –0.19 to 0.29, P=.67). More precisely, interventions using neither goals nor rewards have an estimated effect of g=0.01, while interventions in which goals and rewards are used simultaneously have an estimated effect of g=0.36.

    ‎
    Figure 4. Differences in intervention efficacy depending on the use of the 5 most common behavior change techniques (BCTs). In each panel, “no” means that the BCT was not used and “yes” means that the BCT was used. The “n” next to “yes” and “no” indicates the number of studies in each group. The black line shows the mean intervention efficacy with a 95% CI in white. The curved areas depict density of data points (ie, fine-grained vertical histograms) for all included studies. The last panel shows intervention efficacy depending on a combination of behavioral goals and self-monitoring (n(none)=9, n(either)=22, n(both)=17). These depictions are not controlled for baseline group differences.
    View this figure
    ‎
    Figure 5. Funnel plot to assess publication bias. Point size indicates the number of participants in each study. The dotted and dashed lines show a 95% and 99% credibility region respectively and the full lines represent a 95% CI for the summary effect.
    View this figure

    Publication Bias

    To assess possible publication bias visually, we drew a funnel plot (see Figure 5). On the right side, there were 6 studies outside the 95% credibility region and 2 of those 6 were outside the 99% credibility region. The trim and fill method also suggested that 7 studies are missing on the left side (SE 4.00). These studies might lead to an overestimation of the overall effect. Filling in these “missing” studies led to an adjusted estimated overall effect size of g=0.22, meaning that we overestimated by Δg=0.07. The Egger asymmetry test was not significant (z=1.53, P=.12). Due to its low power in small pools of studies, this nonsignificance does not rule out that no studies are missing. However, the Orwin Failsafe-N test suggests that to obtain a point estimate half the size of the original effect (ie, g=0.14), we would need 76 more studies with a nil effect. One hundred and thirty-three studies with a nil effect would be needed to reduce the effect to a negligible effect size of g=0.10. Overall, publication bias seems to be acceptably low.


    This meta-analysis aimed to identify which BCTs contribute to behavior change in mHealth interventions targeting physical activity. We found an association between heightened efficacy and behavioral goals and the same for self-monitoring. Using either of these techniques pushed the effect from g=0.01 to g=0.32, but we found no further significant benefit from combining them in an intervention (g=0.36). Overall, we found a small to moderate effect of interventions on physical activity, which agrees with another recent meta-analysis of mHealth physical activity interventions [13]. Furthermore, targeting physical activity directly instead of weight can lead to a greater increase of physical activity, but we did not find that the study quality or the tracked versus self-reported data contributed to the intervention efficacy. We also found that neglecting baseline group differences would lead to an overestimation of the efficacy of interventions in this pool of diverse RCTs with many small sample sizes.

    To our knowledge, this is the most comprehensive assessment of mHealth interventions to increase physical activity so far. Further, this is the first one to address baseline group differences as covariates and to analyze moderating effects of the most frequently used BCTs while retaining sufficient power. However, 34/50 (68%) of all included studies were published in the years 2015 and 2016. This confirms the rapid growth of the mHealth literature concerned with increasing physical activity. To facilitate sequential meta-analyses and to increase transparency, we are sharing the information we coded and the annotated R script in Multimedia Appendix 2.

    Limitations

    There are 2 caveats we would like to address. Firstly, we did not look at actual changes within groups over time because the correlation between baseline and postintervention, which is necessary for this analysis, was generally not reported. Instead, we assessed group differences at baseline and postintervention. Using this approach, an increase of physical activity in the intervention group compared to the control group led us to assume intervention success. However, we also assumed intervention success if physical activity in the control group decreased during the intervention while being stable in the intervention group. Of course, the effects we analyzed might also have been a combination of both (ie, an increase of physical activity in the intervention group and a decrease of physical activity in the control group). Secondly, 4 studies in our pool of 50 (8%) studies used clustered randomization methods (for example by school) [41,54,56,67]. We did not differentiate those studies from fully RCTs, because we did not expect an interaction between the intervention effect and the type of unit randomized (ie, person versus school) [95].

    Future Research

    When more studies are available, we will have the statistical power for more sophisticated moderator analyses like meta-CART [96]. Our results suggest that behavioral goals and self-monitoring are especially beneficial, but it remains unclear which other BCTs work well and what interactions there are. Many BCTs from the taxonomy were not used at all, or only very little, and it was hard to code BCTs based on the available information. For the field as a whole it would be beneficial to report intervention content in a more structured way—if possible, based on a BCT taxonomy [24,97] to counteract the current confusion [20], and make our findings more replicable. Furthermore, not all BCTs might work equally well in each context and for each person. However, to assess this question, more research is needed.

    In this meta-analysis, we only looked at BCTs, but of course, there is much more to think about when designing successful mHealth interventions. Intervention efficacy does not only depend on BCTs as intervention components, but also on the target population, the intervention design, and duration, as well as the intervention objectives. For example, participants who suffer from illness might be more motivated to use an mHealth intervention because they suffer more than healthy participants. Additionally, healthy participants might already be quite physically active and would therefore not gain a lot from an mHealth intervention targeting motivation to be physically active. Further, BCTs need to be carefully matched with intervention objectives. For example, when an intervention targets capability for physical activity, BCTs related to self-belief might have a greater impact on intervention success than behavioral goals and self-monitoring.

    Conclusion

    Despite a small to moderate overall success in increasing physical activity with mHealth interventions, setting behavioral goals or enabling self-monitoring, as well as a combination thereof, might be beneficial. With increasing technological possibilities, interventions will become ever more complex, and it is crucial to report their content thoroughly. However, let us not forget: BCTs are not everything. It is also important that people like and use the interventions. Elements of gamification and appealing visual presentation could be considered to address this issue.

    Acknowledgments

    This project was financed by the Austrian Science Fund (FWF) P 28393. The authors acknowledge the financial support from the University of Graz. Many thanks to Martin Aresin, Justus Baltzer and Robert Spörk for helping to code the studies. We would also like to thank Elizabeth Tipton for a fruitful discussion on how to handle baseline group differences.

    Conflicts of Interest

    None declared.

    Authors' Contributions

    The authors LVE, NKT, and KC conceived the presented idea. LVE developed the theory, supervised the data collection, performed the computations, and wrote the first draft of the manuscript. NKT verified the analytical methods. KC supervised the findings of this work. All authors discussed the results and contributed to the final manuscript.

    ‎

    Multimedia Appendix 1

    Description of included studies (population, country, duration, and outcomes).

    XLSX File (Microsoft Excel File), 63KB
    ‎

    Multimedia Appendix 2

    Data spreadsheet and annotated analysis script.

    ZIP File (Zip Archive), 103KB
    1. The Nielsen Company. http://www.nielsen.com/. 2017. Nielsen Total Audience Report - Q2 2017   URL: http://www.nielsen.com/us/en/insights/reports/2017/the-nielsen-total-audience-q2-2017.html [accessed 2017-12-30] [WebCite Cache]
    2. European Commission. https://data.europa.eu/. 2014. Special Eurobarometer 412: Sport and Physical Activity 2014   URL: https://data.europa.eu/euodp/data/dataset/S1116_80_2_412 [accessed 2017-12-31] [WebCite Cache]
    3. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U. Global physical activity levels: surveillance progress, pitfalls, and prospects. The Lancet 2012 Jul;380(9838):247-257. [CrossRef]
    4. Warburton DER, Nicol CW, Bredin SSD. Health benefits of physical activity: the evidence. CMAJ 2006 Mar 14;174(6):801-809 [FREE Full text] [CrossRef] [Medline]
    5. Patel AV, Hildebrand JS, Leach CR, Campbell PT, Doyle C, Shuval K, et al. Walking in Relation to Mortality in a Large Prospective Cohort of Older U.S. Adults. Am J Prev Med 2018 Jan;54(1):10-19. [CrossRef] [Medline]
    6. Penedo FJ, Dahn JR. Exercise and well-being: a review of mental and physical health benefits associated with physical activity. Current Opinion in Psychiatry 2005;18(2):189-193. [CrossRef]
    7. Fox KR. The influence of physical activity on mental well-being. PHN 2007 Jan 2;2(3a). [CrossRef]
    8. Statista. Number of smartphone users worldwide from 2014 to 2020 (in billions) 2017 WebCite original   URL: https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/ [accessed 2018-02-02] [WebCite Cache]
    9. Statista. Number of smartphone users in the United States from 2010 to 2022 (in millions) 2017 WebCite original   URL: https://www.statista.com/statistics/201182/forecast-of-smartphone-users-in-the-us/ [accessed 2018-02-02] [WebCite Cache]
    10. Statista. Number of mobile phone users worldwide from 2013 to 2019 (in billions) 2018 WebCite original   URL: https://www.statista.com/statistics/274774/forecast-of-mobile-phone-users-worldwide/ [accessed 2018-05-18] [WebCite Cache]
    11. Miller G. The Smartphone Psychology Manifesto. Perspect Psychol Sci 2012 May;7(3):221-237 [FREE Full text] [CrossRef] [Medline]
    12. Marcolino MS, Oliveira JAQ, D'Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The Impact of mHealth Interventions: Systematic Review of Systematic Reviews. JMIR Mhealth Uhealth 2018 Jan 17;6(1):e23 [FREE Full text] [CrossRef] [Medline]
    13. Direito A, Carraça E, Rawstorn J, Whittaker R, Maddison R. mHealth Technologies to Influence Physical Activity and Sedentary Behaviors: Behavior Change Techniques, Systematic Review and Meta-Analysis of Randomized Controlled Trials. Ann Behav Med 2017 Apr;51(2):226-239. [CrossRef] [Medline]
    14. Schoeppe S, Alley S, Van Lippevelde W, Bray NA, Williams SL, Duncan MJ, et al. Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour: a systematic review. Int J Behav Nutr Phys Act 2016 Dec 07;13(1):127 [FREE Full text] [CrossRef] [Medline]
    15. Fanning J, Mullen SP, McAuley E. Increasing physical activity with mobile devices: a meta-analysis. J Med Internet Res 2012;14(6):e161 [FREE Full text] [CrossRef] [Medline]
    16. Bort-Roig J, Gilson ND, Puig-Ribera A, Contreras RS, Trost SG. Measuring and influencing physical activity with smartphone technology: a systematic review. Sports Med 2014 May;44(5):671-686. [CrossRef] [Medline]
    17. Monroe CM, Thompson DL, Bassett DR, Fitzhugh EC, Raynor HA. Usability of Mobile Phones in Physical Activity–Related Research: A Systematic Review. American Journal of Health Education 2015 Jul 06;46(4):196-206. [CrossRef]
    18. Zhao J, Freeman B, Li M. Can Mobile Phone Apps Influence People's Health Behavior Change? An Evidence Review. J Med Internet Res 2016 Oct 31;18(11):e287 [FREE Full text] [CrossRef] [Medline]
    19. Stuckey MI, Carter SW, Knight E. The role of smartphones in encouraging physical activity in adults. Int J Gen Med 2017;10:293-303 [FREE Full text] [CrossRef] [Medline]
    20. Tomlinson M, Rotheram-Borus MJ, Swartz L, Tsai AC. Scaling up mHealth: where is the evidence? PLoS Med 2013;10(2):e1001382 [FREE Full text] [CrossRef] [Medline]
    21. van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med 2002 Feb 28;21(4):589-624. [Medline]
    22. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
    23. Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health 2011 Nov;26(11):1479-1498. [CrossRef] [Medline]
    24. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
    25. Abraham AA, Chow W, So H, Yip BH, Li AM, Kumta SM, et al. Lifestyle intervention using an internet-based curriculum with cell phone reminders for obese Chinese teens: a randomized controlled study. PLoS One 2015;10(5):e0125673 [FREE Full text] [CrossRef] [Medline]
    26. Adams MA, Sallis JF, Norman GJ, Hovell MF, Hekler EB, Perata E. An adaptive physical activity intervention for overweight adults: a randomized controlled trial. PLoS One 2013 Dec;8(12):e82901 [FREE Full text] [CrossRef] [Medline]
    27. Allen JK, Stephens J, Dennison Himmelfarb CR, Stewart KJ, Hauck S. Randomized controlled pilot study testing use of smartphone technology for obesity treatment. J Obes 2013;2013:151597 [FREE Full text] [CrossRef] [Medline]
    28. Allman-Farinelli M, Partridge SR, McGeechan K, Balestracci K, Hebden L, Wong A, et al. A Mobile Health Lifestyle Program for Prevention of Weight Gain in Young Adults (TXT2BFiT): Nine-Month Outcomes of a Randomized Controlled Trial. JMIR Mhealth Uhealth 2016 Jun 22;4(2):408-419 [FREE Full text] [CrossRef] [Medline]
    29. Cadmus-Bertram LA, Marcus BH, Patterson RE, Parker BA, Morey BL. Randomized Trial of a Fitbit-Based Physical Activity Intervention for Women. Am J Prev Med 2015 Sep;49(3):414-418 [FREE Full text] [CrossRef] [Medline]
    30. Choi J, Lee JH, Vittinghoff E, Fukuoka Y. mHealth Physical Activity Intervention: A Randomized Pilot Study in Physically Inactive Pregnant Women. Matern Child Health J 2016 May;20(5):1091-1101. [CrossRef] [Medline]
    31. Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of Lifestyle-Focused Text Messaging on Risk Factor Modification in Patients With Coronary Heart Disease: A Randomized Clinical Trial. JAMA 2015 Sep;314(12):1255-1263. [CrossRef] [Medline]
    32. Cotten E, Prapavessis H. Increasing Nonsedentary Behaviors in University Students Using Text Messages: Randomized Controlled Trial. JMIR Mhealth Uhealth 2016 Aug 19;4(3):e99 [FREE Full text] [CrossRef] [Medline]
    33. Cowdery J, Majeske P, Frank R, Brown D. Exergame Apps and Physical Activity: The Results of the ZOMBIE Trial. American Journal of Health Education 2015 Jul 06;46(4):216-222. [CrossRef]
    34. Direito A, Jiang Y, Whittaker R, Maddison R. Apps for IMproving FITness and Increasing Physical Activity Among Young People: The AIMFIT Pragmatic Randomized Controlled Trial. J Med Internet Res 2015 Aug 27;17(8):e210 [FREE Full text] [CrossRef] [Medline]
    35. Fassnacht DB, Ali K, Silva C, Gonçalves S, Machado PPP. Use of text messaging services to promote health behaviors in children. J Nutr Educ Behav 2015;47(1):75-80. [CrossRef] [Medline]
    36. Fjeldsoe BS, Goode AD, Phongsavan P, Bauman A, Maher G, Winkler E, et al. Evaluating the Maintenance of Lifestyle Changes in a Randomized Controlled Trial of the 'Get Healthy, Stay Healthy' Program. JMIR Mhealth Uhealth 2016;4(2) [FREE Full text] [CrossRef] [Medline]
    37. Fjeldsoe BS, Miller YD, Marshall AL. MobileMums: a randomized controlled trial of an SMS-based physical activity intervention. Ann Behav Med 2010 May;39(2):101-111. [CrossRef] [Medline]
    38. Frederix I, Hansen D, Coninx K, Vandervoort P, Vandijck D, Hens N, et al. Medium-Term Effectiveness of a Comprehensive Internet-Based and Patient-Specific Telerehabilitation Program With Text Messaging Support for Cardiac Patients: Randomized Controlled Trial. J Med Internet Res 2015;17(7) [FREE Full text] [CrossRef] [Medline]
    39. Fukuoka Y, Gay CL, Joiner KL, Vittinghoff E. A Novel Diabetes Prevention Intervention Using a Mobile App: A Randomized Controlled Trial With Overweight Adults at Risk. Am J Prev Med 2015 Aug;49(2):223-237 [FREE Full text] [CrossRef] [Medline]
    40. Garde A, Umedaly A, Abulnaga SM, Robertson L, Junker A, Chanoine JP, et al. Assessment of a Mobile Game to Promote Physical Activity Among Children. Games Health J 2015 Apr 01;4(2):149-158. [CrossRef] [Medline]
    41. Gell NM, Wadsworth DD. The Use of Text Messaging to Promote Physical Activity in Working Women: A Randomized Controlled Trial. J Phys Act Health 2015 Jun;12(6):756-763. [CrossRef] [Medline]
    42. Glynn LG, Hayes PS, Casey M, Glynn F, Alvarez-Iglesias A, Newell J, et al. Effectiveness of a smartphone application to promote physical activity in primary care: the SMART MOVE randomised controlled trial. Br J Gen Pract 2014 Jul;64(624):e384-e391 [FREE Full text] [CrossRef] [Medline]
    43. Hales S, Turner-McGrievy GM, Wilcox S, Fahim A, Davis RE, Huhns M, et al. Social networks for improving healthy weight loss behaviors for overweight and obese adults: A randomized clinical trial of the social pounds off digitally (Social POD) mobile app. Int J Med Inform 2016 Dec;94:81-90. [CrossRef] [Medline]
    44. Hartman SJ, Nelson SH, Cadmus-Bertram LA, Patterson RE, Parker BA, Pierce JP. Technology- and Phone-Based Weight Loss Intervention: Pilot RCT in Women at Elevated Breast Cancer Risk. Am J Prev Med 2016 Nov;51(5):714-721 [FREE Full text] [CrossRef] [Medline]
    45. Hebden L, Cook A, van der Ploeg HP, King L, Bauman A, Allman-Farinelli M. A mobile health intervention for weight management among young adults: a pilot randomised controlled trial. J Hum Nutr Diet 2013 Aug 29;27(4):322-332. [CrossRef]
    46. Hurling R, Catt M, Boni MD, Fairley BW, Hurst T, Murray P, et al. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. J Med Internet Res 2007;9(2):e7 [FREE Full text] [CrossRef] [Medline]
    47. Johnston N, Bodegard J, Jerström S, Åkesson J, Brorsson H, Alfredsson J, et al. Effects of interactive patient smartphone support app on drug adherence and lifestyle changes in myocardial infarction patients: A randomized study. Am Heart J 2016 Aug;178:85-94 [FREE Full text] [CrossRef] [Medline]
    48. Joseph RP, Keller C, Adams MA, Ainsworth BE. Print versus a culturally-relevant Facebook and text message delivered intervention to promote physical activity in African American women: a randomized pilot trial. BMC Womens Health 2015;15:30 [FREE Full text] [CrossRef] [Medline]
    49. Kim BH, Glanz K. Text messaging to motivate walking in older African Americans: a randomized controlled trial. Am J Prev Med 2013 Jan;44(1):71-75. [CrossRef] [Medline]
    50. Kim J, Oh S, Steinhubl S, Kim S, Bae WK, Han JS, et al. Effectiveness of 6 months of tailored text message reminders for obese male participants in a worksite weight loss program: randomized controlled trial. JMIR Mhealth Uhealth 2015 Feb 03;3(1):e14 [FREE Full text] [CrossRef] [Medline]
    51. Kim JY, Wineinger NE, Steinhubl SR. The Influence of Wireless Self-Monitoring Program on the Relationship Between Patient Activation and Health Behaviors, Medication Adherence, and Blood Pressure Levels in Hypertensive Patients: A Substudy of a Randomized Controlled Trial. J Med Internet Res 2016 Jun 22;18(6):e116 [FREE Full text] [CrossRef] [Medline]
    52. Kinnafick FE, Thøgersen-Ntoumani C, Duda J. The effect of need supportive text messages on motivation and physical activity behaviour. J Behav Med 2016 Dec;39(4):574-586 [FREE Full text] [CrossRef] [Medline]
    53. Laing BY, Mangione CM, Tseng C, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a smartphone application for weight loss compared with usual care in overweight primary care patients: a randomized, controlled trial. Ann Intern Med 2014 Nov 18;161(10 Suppl):S5-12. [CrossRef] [Medline]
    54. Lubans DR, Smith JJ, Plotnikoff RC, Dally KA, Okely AD, Salmon J, et al. Assessing the sustained impact of a school-based obesity prevention program for adolescent boys: the ATLAS cluster randomized controlled trial. Int J Behav Nutr Phys Act 2016 Aug 20;13:92 [FREE Full text] [CrossRef] [Medline]
    55. Maddison R, Pfaeffli L, Whittaker R, Stewart R, Kerr A, Jiang Y, et al. A mobile phone intervention increases physical activity in people with cardiovascular disease: Results from the HEART randomized controlled trial. Eur J Prev Cardiol 2015 Jun;22(6):701-709. [CrossRef] [Medline]
    56. Maher C, Ferguson M, Vandelanotte C, Plotnikoff R, De Bourdeaudhuij BI, Thomas S, et al. A Web-Based, Social Networking Physical Activity Intervention for Insufficiently Active Adults Delivered via Facebook App: Randomized Controlled Trial. J Med Internet Res 2015;17(7):e174 [FREE Full text] [CrossRef] [Medline]
    57. Martin SS, Feldman DI, Blumenthal RS, Jones SR, Post WS, McKibben RA, et al. mActive: A Randomized Clinical Trial of an Automated mHealth Intervention for Physical Activity Promotion. J Am Heart Assoc 2015 Nov 09;4(11) [FREE Full text] [CrossRef] [Medline]
    58. Nguyen HQ, Donesky D, Reinke LF, Wolpin S, Chyall L, Benditt JO, et al. Internet-based dyspnea self-management support for patients with chronic obstructive pulmonary disease. J Pain Symptom Manage 2013 Jul;46(1):43-55 [FREE Full text] [CrossRef] [Medline]
    59. Pfaeffli DL, Whittaker R, Jiang Y, Stewart R, Rolleston A, Maddison R. Text Message and Internet Support for Coronary Heart Disease Self-Management: Results From the Text4Heart Randomized Controlled Trial. J Med Internet Res 2015;17(10):e237 [FREE Full text] [CrossRef] [Medline]
    60. Poirier J, Bennett WL, Jerome GJ, Shah NG, Lazo M, Yeh H, et al. Effectiveness of an Activity Tracker- and Internet-Based Adaptive Walking Program for Adults: A Randomized Controlled Trial. J Med Internet Res 2016;18(2):e34 [FREE Full text] [CrossRef] [Medline]
    61. Prestwich A, Perugini M, Hurling R. Can implementation intentions and text messages promote brisk walking? A randomized trial. Health Psychology 2010;29(1):40-49.
    62. Rubinstein A, Miranda JJ, Beratarrechea A, Diez-Canseco F, Kanter R, Gutierrez L, et al. Effectiveness of an mHealth intervention to improve the cardiometabolic profile of people with prehypertension in low-resource urban settings in Latin America: a randomised controlled trial. The Lancet Diabetes & Endocrinology 2016 Jan;4(1):52-63. [CrossRef]
    63. Schwerdtfeger AR, Schmitz C, Warken M. Using text messages to bridge the intention-behavior gap? A pilot study on the use of text message reminders to increase objectively assessed physical activity in daily life. Front Psychol 2012;3:270 [FREE Full text] [CrossRef] [Medline]
    64. Silveira P, van de Langenberg R, van Het Reve E, Daniel F, Casati F, de Bruin ED. Tablet-based strength-balance training to motivate and improve adherence to exercise in independently living older people: a phase II preclinical exploratory trial. J Med Internet Res 2013;15(8):e159 [FREE Full text] [CrossRef] [Medline]
    65. Suggs S, Blake H, Bardus M, Lloyd S. Effects of text messaging in addition to emails on physical activity among university and college employees in the UK. J Health Serv Res Policy 2013 Apr;18(1 Suppl):56-64. [CrossRef] [Medline]
    66. Tabak M, op den Akker H, Hermens H. Motivational cues as real-time feedback for changing daily activity behavior of patients with COPD. Patient Educ Couns 2014 Mar;94(3):372-378. [CrossRef] [Medline]
    67. van der Weegen S, Verwey R, Spreeuwenberg M, Tange H, van der Weijden T, de Witte L. It's LiFe! Mobile and Web-Based Monitoring and Feedback Tool Embedded in Primary Care Increases Physical Activity: A Cluster Randomized Controlled Trial. J Med Internet Res 2015 Jul 24;17(7):e184 [FREE Full text] [CrossRef] [Medline]
    68. van Drongelen A, Boot CRL, Hlobil H, Twisk JWR, Smid T, van der Beek AJ. Evaluation of an mHealth intervention aiming to improve health-related behavior and sleep and reduce fatigue among airline pilots. Scand J Work Environ Health 2014;40(6):557-568 [FREE Full text] [CrossRef] [Medline]
    69. Vorrink SNW, Kort HSM, Troosters T, Zanen P, Lammers JJ. Efficacy of an mHealth intervention to stimulate physical activity in COPD patients after pulmonary rehabilitation. Eur Respir J 2016 Oct;48(4):1019-1029. [CrossRef] [Medline]
    70. Walsh JC, Corbett T, Hogan M, Duggan J, McNamara A. An mHealth Intervention Using a Smartphone App to Increase Walking Behavior in Young Adults: A Pilot Study. JMIR Mhealth Uhealth 2016 Sep 22;4(3):e109 [FREE Full text] [CrossRef] [Medline]
    71. Wang JB, Cataldo JK, Ayala GX, Natarajan L, Cadmus-Bertram LA, White MM, et al. Mobile and Wearable Device Features that Matter in Promoting Physical Activity. J Mob Technol Med 2016 Jul;5(2):2-11. [CrossRef] [Medline]
    72. Zach S, Raviv T, Meckel Y. Using information communication technologies (ICTs) for motivating female adolescents to exercise/run in their leisure time. Computers in Human Behavior 2016;60:593-601.
    73. Fjeldsoe BS, Miller YD, Graves N, Barnett AG, Marshall AL. Randomized Controlled Trial of an Improved Version of MobileMums, an Intervention for Increasing Physical Activity in Women with Young Children. Ann Behav Med 2015 Aug;49(4):487-499. [CrossRef] [Medline]
    74. Prince SA, Adamo KB, Hamel ME, Hardt J, Connor GS, Tremblay M. A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. Int J Behav Nutr Phys Act 2008;5:56 [FREE Full text] [CrossRef] [Medline]
    75. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. Chichester: John Wiley & Sons Inc; 2009.
    76. Armijo-Olivo S, Stiles CR, Hagen NA, Biondo PD, Cummings GG. Assessment of study quality for systematic reviews: a comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: methodological research. J Eval Clin Pract 2012 Feb;18(1):12-18. [CrossRef] [Medline]
    77. Hermsen S, Frost J, Renes RJ, Kerkhof P. Using feedback through digital technology to disrupt and change habitual behavior: A critical review of current literature. Computers in Human Behavior 2016 Apr;57:61-74. [CrossRef]
    78. Vandelanotte C, Müller AM, Short CE, Hingle M, Nathan N, Williams SL, et al. Past, Present, and Future of eHealth and mHealth Research to Improve Physical Activity and Dietary Behaviors. J Nutr Educ Behav 2016 Mar;48(3):219-228.e1. [CrossRef] [Medline]
    79. Higgins JPT, Lane PW, Anagnostelis B, Anzures-Cabrera J, Baker NF, Cappelleri JC, et al. A tool to assess the quality of a meta-analysis. Res Synth Methods 2013;4(4):351-366. [CrossRef] [Medline]
    80. R Core Team. Vienna, Austria: R Foundation for Statistical Computing; 2017. R: A Language and Environment for Statistical Computing   URL: http://www.r-project.org/ [accessed 2018-10-08] [WebCite Cache]
    81. Fisher Z, Tipton E, Zhipeng H. https://CRAN.R-project.org/package=robumeta. 2017. robumeta: Robust Variance Meta-Regression   URL: https://cran.r-project.org/web/packages/robumeta/index.html [accessed 2018-02-08] [WebCite Cache]
    82. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 2010;36:1-48 [FREE Full text] [CrossRef]
    83. Del Re AC, Hoyt W. http://cran.r-project.org/web/packages/MAd. 2014. MAd: Meta-Analysis with Mean Differences   URL: http://cran.r-project.org/web/packages/MAd [accessed 2018-02-08] [WebCite Cache]
    84. Wickham H. https://CRAN.R-project.org/package=tidyverse. 2017. tidyverse: Easily Install and Load the 'Tidyverse'   URL: https://CRAN.R-project.org/package=tidyverse [WebCite Cache]
    85. Whickham H, Bryan J. https://CRAN.R-project.org/package=readxl. 2017. readxl: Read Excel Files   URL: https://cran.r-project.org/web/packages/readxl/index.html [accessed 2018-02-08] [WebCite Cache]
    86. Del Re AC. http://cran.r-project.org/web/packages/compute.es. 2013. compute.es: Compute Effect Sizes   URL: http://cran.r-project.org/web/packages/compute.es [accessed 2018-02-08] [WebCite Cache]
    87. Wickham H. ggplot2: Elegant Graphics for Data Analysis. In: ggplot2: Elegant Graphics for Data Analysis. New York: Springer; 2009.
    88. Phillips N. https://CRAN.R-project.org/package=yarrr. 2017. YaRrr!: The Pirate's Guide to R   URL: https://cran.r-project.org/web/packages/yarrr/index.html [accessed 2018-02-08] [WebCite Cache]
    89. Ram K, Wickham H. https://CRAN.R-project.org/package=wesanderson. wesanderson: A Wes Anderson Palette Generator 2015 WebCite original   URL: https://cran.r-project.org/web/packages/wesanderson/index.html [accessed 2018-02-08] [WebCite Cache]
    90. Polanin JR, Hennessy EA, Tanner-Smith EE. A Review of Meta-Analysis Packages in R. Journal of Educational and Behavioral Statistics 2016;42(2):206-242. [CrossRef]
    91. Hedges LV, Tipton E, Johnson MC. Robust variance estimation in meta-regression with dependent effect size estimates. Res Synth Methods 2010 Jan;1(1):39-65. [CrossRef] [Medline]
    92. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997 Sep 13;315(7109):629-634. [CrossRef]
    93. Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000;56(2):455-463. [Medline]
    94. Orwin RG. A Fail-Safe N for Effect Size in Meta-Analysis. Journal of Educational Statistics 2016 Nov 23;8(2):157-159. [CrossRef]
    95. Donner A, Klar N. Issues in the meta-analysis of cluster randomized trials. Stat Med 2002 Oct 15;21(19):2971-2980. [CrossRef] [Medline]
    96. Li X, Dusseldorp E, Meulman JJ. Meta-CART: A tool to identify interactions between moderators in meta-analysis. Br J Math Stat Psychol 2017 Feb;70(1):118-136. [CrossRef] [Medline]
    97. Michie S, Wood C. Reporting Behaviour Change Interventions and Techniques. In: Benyamini Y, Johnston M, Karademas EC, editors. Assessment in health psychology. Goettingen: hogrefe; 2016:252-264.

    ‎
    BCT: behavior change technique
    EPHPP: Effective Public Health Practice Project
    ES: effect size
    mHealth: mobile health
    PA: physical activity
    RCT: randomized controlled trial

    Edited by C Dias; submitted 08.02.18; peer-reviewed by M Conner, J Rawstorn, E Knight; comments to author 20.03.18; revised version received 29.06.18; accepted 26.07.18; published 12.11.18

    Copyright

    ©Lisa V Eckerstorfer, Norbert K Tanzer, Claudia Vogrincic-Haselbacher, Gayannee Kedia, Hilmar Brohmer, Isabelle Dinslaken, Katja Corcoran. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 12.11.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.