Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Concurrent validity of the Fitbit for assessing sedentary behavior and moderate-to-vigorous physical activity

Authors: Nicklaus Redenius, Youngwon Kim, Wonwoo Byun

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Recent advances in sensor technologies have promoted the use of consumer-based accelerometers such as Fitbit Flex in epidemiological and clinical research; however, the validity of the Fitbit Flex in measuring sedentary behavior (SED) and physical activity (PA) has not been fully determined against previously validated research-grade accelerometers such as ActiGraph GT3X+. Therefore, the purpose of this study was to examine the concurrent validity of the Fitbit Flex against ActiGraph GT3X+ in a free-living condition.

Methods

A total of 65 participants (age: M = 42, SD = 14 years, female: 72%) each wore a Fitbit Flex and GT3X+ for seven consecutive days. After excluding sleep and non-wear time, time spent (min/day) in SED and moderate-to-vigorous PA (MVPA) were estimated using various cut-points for GT3X+ and brand-specific algorithms for Fitbit, respectively. Repeated measures one-way ANOVA and mean absolute percent errors (MAPE) served to examine differences and measurement errors in SED and MVPA estimates between Fitbit Flex and GT3X+, respectively. Pearson and Spearman correlations and Bland-Altman (BA) plots were used to evaluate the association and potential systematic bias between Fitbit Flex and GT3X+. PROC MIXED procedure in SAS was used to examine the equivalence (i.e., the 90% confidence interval with ±10% equivalence zone) between the devices.

Results

Fitbit Flex produced similar SED and low MAPE (mean difference [MD] = 37 min/day, P = .21, MAPE = 6.8%), but significantly higher MVPA and relatively large MAPE (MD = 59–77 min/day, P < .0001, MAPE = 56.6–74.3%) compared with the estimates from GT3X+ using three different cut-points. The correlations between Fitbit Flex and GT3X+ were consistently higher for SED (r = 0.90, ρ = 0.86, P < .01), but weaker for MVPA (r = 0.65–0.76, ρ = 0.69–0.79, P < .01). BA plots revealed that there is no apparent bias in estimating SED.

Conclusion

In comparison with the GT3X+ accelerometer, the Fitbit Flex provided comparatively accurate estimates of SED, but the Fitbit Flex overestimated MVPA under free-living conditions. Future investigations using the Fitbit Flex should be aware of present findings.
Literature
1.
go back to reference Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, Ainsworth BE, Pratt M, Ekelund U, Yngve A, Sallis JF, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35(8):1381–95.CrossRef Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, Ainsworth BE, Pratt M, Ekelund U, Yngve A, Sallis JF, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35(8):1381–95.CrossRef
2.
go back to reference Carlson SA, Densmore D, Fulton JE, Yore MM, Kohl HW 3rd. Differences in physical activity prevalence and trends from 3 U.S. surveillance systems: NHIS, NHANES, and BRFSS. J Phys Act Health. 2009;6(Suppl 1):S18–27.CrossRef Carlson SA, Densmore D, Fulton JE, Yore MM, Kohl HW 3rd. Differences in physical activity prevalence and trends from 3 U.S. surveillance systems: NHIS, NHANES, and BRFSS. J Phys Act Health. 2009;6(Suppl 1):S18–27.CrossRef
3.
go back to reference Plasqui G, Bonomi AG, Westerterp KR. Daily physical activity assessment with accelerometers: new insights and validation studies. Obes Rev. 2013;14(6):451–62.CrossRef Plasqui G, Bonomi AG, Westerterp KR. Daily physical activity assessment with accelerometers: new insights and validation studies. Obes Rev. 2013;14(6):451–62.CrossRef
4.
go back to reference Plasqui G, Westerterp KR. Physical activity assessment with accelerometers: an evaluation against doubly labeled water. Obesity (Silver Spring). 2007;15(10):2371–9.CrossRef Plasqui G, Westerterp KR. Physical activity assessment with accelerometers: an evaluation against doubly labeled water. Obesity (Silver Spring). 2007;15(10):2371–9.CrossRef
5.
go back to reference Sasaki JE, John D, Freedson PS. Validation and comparison of ActiGraph activity monitors. J Sci Med Sport. 2011;14(5):411–6.CrossRef Sasaki JE, John D, Freedson PS. Validation and comparison of ActiGraph activity monitors. J Sci Med Sport. 2011;14(5):411–6.CrossRef
6.
go back to reference Santos-Lozano A, Santin-Medeiros F, Cardon G, Torres-Luque G, Bailon R, Bergmeir C, Ruiz JR, Lucia A, Garatachea N. Actigraph GT3X: validation and determination of physical activity intensity cut points. Int J Sports Med. 2013;34(11):975–82.CrossRef Santos-Lozano A, Santin-Medeiros F, Cardon G, Torres-Luque G, Bailon R, Bergmeir C, Ruiz JR, Lucia A, Garatachea N. Actigraph GT3X: validation and determination of physical activity intensity cut points. Int J Sports Med. 2013;34(11):975–82.CrossRef
7.
go back to reference Ozemek C, Kirschner MM, Wilkerson BS, Byun W, Kaminsky LA. Intermonitor reliability of the GT3X+ accelerometer at hip, wrist and ankle sites during activities of daily living. Physiol Meas. 2014;35(2):129–38.CrossRef Ozemek C, Kirschner MM, Wilkerson BS, Byun W, Kaminsky LA. Intermonitor reliability of the GT3X+ accelerometer at hip, wrist and ankle sites during activities of daily living. Physiol Meas. 2014;35(2):129–38.CrossRef
8.
go back to reference Aadland E, Ylvisaker E. Reliability of the Actigraph GT3X+ accelerometer in adults under free-living conditions. PLoS One. 2015;10(8):e0134606.CrossRef Aadland E, Ylvisaker E. Reliability of the Actigraph GT3X+ accelerometer in adults under free-living conditions. PLoS One. 2015;10(8):e0134606.CrossRef
9.
go back to reference NCHS: National Health and Nutrition Examination Survey (NHANES) Physical Activity Monitor (PAM) Procedures Manual. In. Hyattsville, MD: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention; 2011. NCHS: National Health and Nutrition Examination Survey (NHANES) Physical Activity Monitor (PAM) Procedures Manual. In. Hyattsville, MD: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention; 2011.
10.
go back to reference Saint-Maurice PF, Kim Y, Hibbing P, Oh AY, Perna FM, Welk GJ. Calibration and validation of the youth activity profile: the FLASHE study. Am J Prev Med. 2017;52(6):880–7.CrossRef Saint-Maurice PF, Kim Y, Hibbing P, Oh AY, Perna FM, Welk GJ. Calibration and validation of the youth activity profile: the FLASHE study. Am J Prev Med. 2017;52(6):880–7.CrossRef
11.
go back to reference Van Dyck D, Cerin E, De Bourdeaudhuij I, Hinckson E, Reis RS, Davey R, Sarmiento OL, Mitas J, Troelsen J, MacFarlane D, et al. International study of objectively measured physical activity and sedentary time with body mass index and obesity: IPEN adult study. Int J Obes. 2015;39(2):199–207.CrossRef Van Dyck D, Cerin E, De Bourdeaudhuij I, Hinckson E, Reis RS, Davey R, Sarmiento OL, Mitas J, Troelsen J, MacFarlane D, et al. International study of objectively measured physical activity and sedentary time with body mass index and obesity: IPEN adult study. Int J Obes. 2015;39(2):199–207.CrossRef
12.
go back to reference Lee IM, Shiroma EJ, Evenson KR, Kamada M, LaCroix AZ, Buring JE. Accelerometer-measured physical activity and sedentary behavior in relation to all-cause mortality: the Women's health study. Circulation. 2018;137(2):203–5.CrossRef Lee IM, Shiroma EJ, Evenson KR, Kamada M, LaCroix AZ, Buring JE. Accelerometer-measured physical activity and sedentary behavior in relation to all-cause mortality: the Women's health study. Circulation. 2018;137(2):203–5.CrossRef
13.
go back to reference Freedson PS, Melanson E, Sirard J. Calibration of the computer science and applications, Inc. accelerometer. Med Sci Sports Exerc. 1998;30(5):777–81.CrossRef Freedson PS, Melanson E, Sirard J. Calibration of the computer science and applications, Inc. accelerometer. Med Sci Sports Exerc. 1998;30(5):777–81.CrossRef
14.
go back to reference Swartz AM, Strath SJ, Bassett DR Jr, O'Brien WL, King GA, Ainsworth BE. Estimation of energy expenditure using CSA accelerometers at hip and wrist sites. Med Sci Sports Exerc. 2000;32(9 Suppl):S450–6.CrossRef Swartz AM, Strath SJ, Bassett DR Jr, O'Brien WL, King GA, Ainsworth BE. Estimation of energy expenditure using CSA accelerometers at hip and wrist sites. Med Sci Sports Exerc. 2000;32(9 Suppl):S450–6.CrossRef
15.
go back to reference Rothney MP, Schaefer EV, Neumann MM, Choi L, Chen KY. Validity of physical activity intensity predictions by ActiGraph, Actical, and RT3 accelerometers. Obesity (Silver Spring). 2008;16(8):1946–52.CrossRef Rothney MP, Schaefer EV, Neumann MM, Choi L, Chen KY. Validity of physical activity intensity predictions by ActiGraph, Actical, and RT3 accelerometers. Obesity (Silver Spring). 2008;16(8):1946–52.CrossRef
16.
go back to reference Kim Y, Welk GJ. Criterion validity of competing accelerometry-based activity monitoring devices. Med Sci Sports Exerc. 2015;47(11):2456–63.CrossRef Kim Y, Welk GJ. Criterion validity of competing accelerometry-based activity monitoring devices. Med Sci Sports Exerc. 2015;47(11):2456–63.CrossRef
17.
go back to reference Crouter SE, Churilla JR, Bassett DR Jr. Estimating energy expenditure using accelerometers. Eur J Appl Physiol. 2006;98(6):601–12.CrossRef Crouter SE, Churilla JR, Bassett DR Jr. Estimating energy expenditure using accelerometers. Eur J Appl Physiol. 2006;98(6):601–12.CrossRef
18.
go back to reference Ham SA, Reis JP, Strath SJ, Dubose KD, Ainsworth BE. Discrepancies between methods of identifying objectively determined physical activity. Med Sci Sports Exerc. 2007;39(1):52–8.CrossRef Ham SA, Reis JP, Strath SJ, Dubose KD, Ainsworth BE. Discrepancies between methods of identifying objectively determined physical activity. Med Sci Sports Exerc. 2007;39(1):52–8.CrossRef
20.
go back to reference IDC Research, Inc.: Worldwide Quarterly Wearable Device Tracker2017. IDC Research, Inc.: Worldwide Quarterly Wearable Device Tracker2017.
21.
go back to reference iTechWearer: The Best Fitness Trackers in 2015: Best seller list 2015. iTechWearer: The Best Fitness Trackers in 2015: Best seller list 2015.
22.
go back to reference Noah JA, Spierer DK, Gu J, Bronner S. Comparison of steps and energy expenditure assessment in adults of Fitbit tracker and ultra to the Actical and indirect calorimetry. J Medical Engineering & Technology. 2013;37(7):456–62.CrossRef Noah JA, Spierer DK, Gu J, Bronner S. Comparison of steps and energy expenditure assessment in adults of Fitbit tracker and ultra to the Actical and indirect calorimetry. J Medical Engineering & Technology. 2013;37(7):456–62.CrossRef
23.
go back to reference Lee J, Kim Y, Welk G. Validity of consumer-based physical activity monitors. Med Sci Sports Exerc. 2014;46(9):1840–8.CrossRef Lee J, Kim Y, Welk G. Validity of consumer-based physical activity monitors. Med Sci Sports Exerc. 2014;46(9):1840–8.CrossRef
24.
go back to reference Takacs J, Pollock CL, Guenther JR, Bahar M, Napier C, Hunt MA. Validation of the Fitbit one activity monitor device during treadmill walking. J Sci Med Sport. 2014;17(5):496–500.CrossRef Takacs J, Pollock CL, Guenther JR, Bahar M, Napier C, Hunt MA. Validation of the Fitbit one activity monitor device during treadmill walking. J Sci Med Sport. 2014;17(5):496–500.CrossRef
25.
go back to reference Fortune E, Lugade V, Morrow M, Kaufman K. Validity of using tri-axial accelerometers to measure human movement - part II: step counts at a wide range of gait velocities. Med Eng Phys. 2014;36(6):659–69.CrossRef Fortune E, Lugade V, Morrow M, Kaufman K. Validity of using tri-axial accelerometers to measure human movement - part II: step counts at a wide range of gait velocities. Med Eng Phys. 2014;36(6):659–69.CrossRef
26.
go back to reference Fulk GD, Combs SA, Danks KA, Nirider CD, Raja B, Reisman DS. Accuracy of 2 activity monitors in detecting steps in people with stroke and traumatic brain injury. Phys Ther. 2014;94(2):222–9.CrossRef Fulk GD, Combs SA, Danks KA, Nirider CD, Raja B, Reisman DS. Accuracy of 2 activity monitors in detecting steps in people with stroke and traumatic brain injury. Phys Ther. 2014;94(2):222–9.CrossRef
27.
go back to reference Sasaki J, Hickey A, Mavilia M, Tedesco J, John D, Kozey Keadle S, Freedson P. Validation of the Fitbit wireless activity tracker® for prediction of energy expenditure. J Phys Act Health. 2014. Sasaki J, Hickey A, Mavilia M, Tedesco J, John D, Kozey Keadle S, Freedson P. Validation of the Fitbit wireless activity tracker® for prediction of energy expenditure. J Phys Act Health. 2014.
28.
go back to reference Bai Y, Welk GJ, Nam YH, Lee JA, Lee JM, Kim Y, Meier NF, Dixon PM. Comparison of consumer and research monitors under Semistructured settings. Med Sci Sports Exerc. 2016;48(1):151–8.CrossRef Bai Y, Welk GJ, Nam YH, Lee JA, Lee JM, Kim Y, Meier NF, Dixon PM. Comparison of consumer and research monitors under Semistructured settings. Med Sci Sports Exerc. 2016;48(1):151–8.CrossRef
29.
go back to reference Chen KY, Bassett DR Jr. The technology of accelerometry-based activity monitors: current and future. Med Sci Sports Exerc. 2005;37(11 Suppl):S490–500.CrossRef Chen KY, Bassett DR Jr. The technology of accelerometry-based activity monitors: current and future. Med Sci Sports Exerc. 2005;37(11 Suppl):S490–500.CrossRef
30.
go back to reference Nelson MB, Kaminsky LA, Dickin DC, Montoye AH. Validity of consumer-based physical activity monitors for specific activity types. Med Sci Sports Exerc. 2016;48(8):1619–28.CrossRef Nelson MB, Kaminsky LA, Dickin DC, Montoye AH. Validity of consumer-based physical activity monitors for specific activity types. Med Sci Sports Exerc. 2016;48(8):1619–28.CrossRef
33.
go back to reference Ellis K, Kerr J, Godbole S, Lanckriet G, Wing D, Marshall S. A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers. Physiol Meas. 2014;35(11):2191–203.CrossRef Ellis K, Kerr J, Godbole S, Lanckriet G, Wing D, Marshall S. A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers. Physiol Meas. 2014;35(11):2191–203.CrossRef
34.
go back to reference Hildebrand M, VT VANH, Hansen BH, Ekelund U. Age group comparability of raw accelerometer output from wrist- and hip-worn monitors. Med Sci Sports Exerc. 2014;46(9):1816–24.CrossRef Hildebrand M, VT VANH, Hansen BH, Ekelund U. Age group comparability of raw accelerometer output from wrist- and hip-worn monitors. Med Sci Sports Exerc. 2014;46(9):1816–24.CrossRef
35.
go back to reference Stec MJ, Rawson ES. Estimation of resistance exercise energy expenditure using triaxial accelerometry. J Strength Cond Res. 2012;26(5):1413–22.CrossRef Stec MJ, Rawson ES. Estimation of resistance exercise energy expenditure using triaxial accelerometry. J Strength Cond Res. 2012;26(5):1413–22.CrossRef
36.
go back to reference Tudor-Locke C, Barreira TV, Schuna JM Jr. Comparison of step outputs for waist and wrist accelerometer attachment sites. Med Sci Sports Exerc. 2015;47(4):839–42.CrossRef Tudor-Locke C, Barreira TV, Schuna JM Jr. Comparison of step outputs for waist and wrist accelerometer attachment sites. Med Sci Sports Exerc. 2015;47(4):839–42.CrossRef
37.
go back to reference Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40(1):181–8.CrossRef Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40(1):181–8.CrossRef
38.
go back to reference Choi L, Liu Z, Matthews CE, Buchowski MS. Validation of accelerometer wear and nonwear time classification algorithm. Med Sci Sports Exerc. 2011;43(2):357–64.CrossRef Choi L, Liu Z, Matthews CE, Buchowski MS. Validation of accelerometer wear and nonwear time classification algorithm. Med Sci Sports Exerc. 2011;43(2):357–64.CrossRef
39.
go back to reference Gusmer R, Bosch T, Watkins A, Ostrem J, Dengel D. Comparison of FitBit® ultra to ActiGraph™ GT1M for assessment of physical activity in young adults during treadmill walking. Open Sports Medicine Journal. 2014;8:11–5.CrossRef Gusmer R, Bosch T, Watkins A, Ostrem J, Dengel D. Comparison of FitBit® ultra to ActiGraph™ GT1M for assessment of physical activity in young adults during treadmill walking. Open Sports Medicine Journal. 2014;8:11–5.CrossRef
40.
go back to reference Ferguson T, Rowlands AV, Olds T, Maher C. The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study. Int J Behav Nutr Phys Act. 2015;12:42.CrossRef Ferguson T, Rowlands AV, Olds T, Maher C. The validity of consumer-level, activity monitors in healthy adults worn in free-living conditions: a cross-sectional study. Int J Behav Nutr Phys Act. 2015;12:42.CrossRef
41.
go back to reference Alharbi M, Bauman A, Neubeck L, Gallagher R. Validation of Fitbit-flex as a measure of free-living physical activity in a community-based phase III cardiac rehabilitation population. Eur J Prev Cardiol. 2016;23(14):1476–85.CrossRef Alharbi M, Bauman A, Neubeck L, Gallagher R. Validation of Fitbit-flex as a measure of free-living physical activity in a community-based phase III cardiac rehabilitation population. Eur J Prev Cardiol. 2016;23(14):1476–85.CrossRef
42.
go back to reference Sushames A, Edwards A, Thompson F, McDermott R, Gebel K. Validity and reliability of Fitbit flex for step count, moderate to vigorous physical activity and activity energy expenditure. PLoS One. 2016;11(9):e0161224.CrossRef Sushames A, Edwards A, Thompson F, McDermott R, Gebel K. Validity and reliability of Fitbit flex for step count, moderate to vigorous physical activity and activity energy expenditure. PLoS One. 2016;11(9):e0161224.CrossRef
43.
go back to reference Reid RER, Insogna JA, Carver TE, Comptour AM, Bewski NA, Sciortino C, Andersen RE. Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. J Sci Med Sport. 2017;20(6):578–82.CrossRef Reid RER, Insogna JA, Carver TE, Comptour AM, Bewski NA, Sciortino C, Andersen RE. Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. J Sci Med Sport. 2017;20(6):578–82.CrossRef
44.
go back to reference Rosenberger ME, Buman MP, Haskell WL, McConnell MV, Carstensen LL. 24 hours of sleep, sedentary behavior, and physical activity with nine wearable devices. Med Sci Sports Exerc. 2016;48(3):457–65.CrossRef Rosenberger ME, Buman MP, Haskell WL, McConnell MV, Carstensen LL. 24 hours of sleep, sedentary behavior, and physical activity with nine wearable devices. Med Sci Sports Exerc. 2016;48(3):457–65.CrossRef
45.
go back to reference Dominick GM, Winfree KN, Pohlig RT, Papas MA. Physical activity assessment between consumer- and research-grade accelerometers: a comparative study in free-living conditions. JMIR Mhealth Uhealth. 2016;4(3):e110.CrossRef Dominick GM, Winfree KN, Pohlig RT, Papas MA. Physical activity assessment between consumer- and research-grade accelerometers: a comparative study in free-living conditions. JMIR Mhealth Uhealth. 2016;4(3):e110.CrossRef
46.
go back to reference Owen N, Healy GN, Matthews CE, Dunstan DW. Too much sitting: the population health science of sedentary behavior. Exerc Sport Sci Rev. 2010;38(3):105–13.CrossRef Owen N, Healy GN, Matthews CE, Dunstan DW. Too much sitting: the population health science of sedentary behavior. Exerc Sport Sci Rev. 2010;38(3):105–13.CrossRef
47.
go back to reference Carr LJ, Mahar MT: Accuracy of intensity and inclinometer output of three activity monitors for identification of sedentary behavior and light-intensity activity. J Obes 2012, 2012:460271. Carr LJ, Mahar MT: Accuracy of intensity and inclinometer output of three activity monitors for identification of sedentary behavior and light-intensity activity. J Obes 2012, 2012:460271.
Metadata
Title
Concurrent validity of the Fitbit for assessing sedentary behavior and moderate-to-vigorous physical activity
Authors
Nicklaus Redenius
Youngwon Kim
Wonwoo Byun
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0668-1

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue