Skip to main content
Top
Published in: BMC Geriatrics 1/2018

Open Access 01-12-2018 | Research article

Reliability and validity of two fitness tracker devices in the laboratory and home environment for older community-dwelling people

Authors: Elissa Burton, Keith D. Hill, Nicola T. Lautenschlager, Cecilie Thøgersen-Ntoumani, Gill Lewin, Eileen Boyle, Erin Howie

Published in: BMC Geriatrics | Issue 1/2018

Login to get access

Abstract

Background

Two-thirds of older Australians are sedentary. Fitness trackers have been popular with younger people and may encourage older adults to become more active. Older adults may have different gait patterns and as such it is important to establish whether fitness trackers are valid and reliable for this population.
The aim of the study was to test the reliability and validity of two fitness trackers (Fitbit Flex and ChargeHR) by step count when worn by older adults. Reliability and validity were tested in two conditions: 1) in the laboratory using a two-minute-walk-test (2MWT) and 2) in a free-living environment.

Methods

Two 2MWTs were completed while wearing the fitness trackers. Participants were videoed during each test. Participants were then given one fitness tracker and a GENEactiv accelerometer to wear at home for 14-days.

Results

Thirty-one participants completed two 2MWTs and 30 completed the free-living procedure. Intra Class Correlation’s of the fitness trackers with direct observation of steps (criterion validity) was high (ICC:0.86,95%CI:0.76,0.93). However, both fitness trackers underestimated steps. Excellent test-retest reliability (ICC ≥ 0.75) was found between the two 2MWTs for each device, particularly the ChargeHR devices. Good strength of agreement was found for total distance and steps (fitness tracker) and moderate-to-vigorous physical activity (GENEactiv) for the free-living environment (Spearman Rho’s 0.78 and 0.74 respectively).

Conclusion

Reliability and validity of the Flex and ChargeHR when worn by older adults is good, however both devices underestimated step count within the laboratory environment. These fitness trackers appear suitable for consumer use and promoting physical activity for older adults.
Literature
2.
go back to reference Booth F, Roberts C, Laye MJ. Lack of exercise is a major cause of chronic diseases. Compr Physiol. 2012;2(2):1143–211.PubMedPubMedCentral Booth F, Roberts C, Laye MJ. Lack of exercise is a major cause of chronic diseases. Compr Physiol. 2012;2(2):1143–211.PubMedPubMedCentral
3.
go back to reference Pedersen B, Saltin B. Exercise as medicine – evidence for prescribing exercise as therapyin 26 different chronic diseases. Scand J Med Sci Sports. 2015;25(3):1–72.CrossRefPubMed Pedersen B, Saltin B. Exercise as medicine – evidence for prescribing exercise as therapyin 26 different chronic diseases. Scand J Med Sci Sports. 2015;25(3):1–72.CrossRefPubMed
4.
go back to reference Lee J, Chang R, Ehrlich-Jones L, Kwoh C, Nevitt M, Semanik P, Sharma L, Sohn M-W, Song J, Dunlop D. Sedentary behavior and physical function: objective evidence from the osteoarthritis initiative. Arthritis Care Res (Hoboken). 2015;67(3):366–73.CrossRef Lee J, Chang R, Ehrlich-Jones L, Kwoh C, Nevitt M, Semanik P, Sharma L, Sohn M-W, Song J, Dunlop D. Sedentary behavior and physical function: objective evidence from the osteoarthritis initiative. Arthritis Care Res (Hoboken). 2015;67(3):366–73.CrossRef
5.
go back to reference AIHW. Pointer S: trends in hospitalised injury, Australia 1990–00 to 2012–13. Injury research and statistics series no. 95. Cat. No. INJCAT 171. In. Canberra: AIHW; 2015. AIHW. Pointer S: trends in hospitalised injury, Australia 1990–00 to 2012–13. Injury research and statistics series no. 95. Cat. No. INJCAT 171. In. Canberra: AIHW; 2015.
6.
go back to reference Kharrazi R, Nash D, Mielenz T. Increasing trend of fatal falls in older adults in the United States, 1992 to 2005: coding practice or reporting quality? J Am Geriatr Soc. 2015(63):1913–7. Kharrazi R, Nash D, Mielenz T. Increasing trend of fatal falls in older adults in the United States, 1992 to 2005: coding practice or reporting quality? J Am Geriatr Soc. 2015(63):1913–7.
7.
go back to reference Castillo-Retamal M, Hinckson E. Measuring physical activity and sedentary behaviour at work: a review. Work Stress. 2011;40:345–57. Castillo-Retamal M, Hinckson E. Measuring physical activity and sedentary behaviour at work: a review. Work Stress. 2011;40:345–57.
8.
go back to reference Sylvia L, Bernstein E, Hubbard J, Keating L, Anderson E. A practical guide to measuring physical activity. J Acad Nutr Diet. 2014;114(2):199–208.CrossRefPubMed Sylvia L, Bernstein E, Hubbard J, Keating L, Anderson E. A practical guide to measuring physical activity. J Acad Nutr Diet. 2014;114(2):199–208.CrossRefPubMed
9.
go back to reference Terwee C, Bouwmeester W, van Elsland S, de Vet H, Dekker J. Instruments to assess physical activity in patients with osteoarthritis of the hip or knee: a systematic review of measurement properties. Osteoarthr Cartil. 2011;19(6):620–33.CrossRefPubMed Terwee C, Bouwmeester W, van Elsland S, de Vet H, Dekker J. Instruments to assess physical activity in patients with osteoarthritis of the hip or knee: a systematic review of measurement properties. Osteoarthr Cartil. 2011;19(6):620–33.CrossRefPubMed
12.
go back to reference Washburn R, Smith K, Jette A, Janney C. The physical activity scale for the elderly (PASE): development and evaluation. J Clin Epidemiol. 1993;46(2):153–62.CrossRefPubMed Washburn R, Smith K, Jette A, Janney C. The physical activity scale for the elderly (PASE): development and evaluation. J Clin Epidemiol. 1993;46(2):153–62.CrossRefPubMed
13.
go back to reference Washburn R, McAuley E, Katula J, Mihalko S, Boileau R. The physical activity scale for the elderly (PASE): evidence for validity. J Clin Epidemiol. 1999;52(7):643–51.CrossRefPubMed Washburn R, McAuley E, Katula J, Mihalko S, Boileau R. The physical activity scale for the elderly (PASE): evidence for validity. J Clin Epidemiol. 1999;52(7):643–51.CrossRefPubMed
14.
go back to reference Fulk G, Combs S, Danks K, Nirider C, Raja B, Reisman D. Accuracy of 2 activity monitors in detecting steps in people with stroke and traumatic brain injury. Phys Ther. 2014;94(2):222–9.CrossRefPubMed Fulk G, Combs S, Danks K, Nirider C, Raja B, Reisman D. Accuracy of 2 activity monitors in detecting steps in people with stroke and traumatic brain injury. Phys Ther. 2014;94(2):222–9.CrossRefPubMed
15.
go back to reference Esliger D, Rowlands A, Hurst T, Catt M, Murray P, Eston R. Validation of the GENEA accelerometer. Med Sci Sports Exerc. 2011;43(6):1085–93.CrossRefPubMed Esliger D, Rowlands A, Hurst T, Catt M, Murray P, Eston R. Validation of the GENEA accelerometer. Med Sci Sports Exerc. 2011;43(6):1085–93.CrossRefPubMed
16.
go back to reference Butland R, Pang J, Gross E, Woodcock A, Geddes D. Two-, six-, and 12-minute walking tests in respiratory disease. Br Med J. 1982;284:1607–8.CrossRef Butland R, Pang J, Gross E, Woodcock A, Geddes D. Two-, six-, and 12-minute walking tests in respiratory disease. Br Med J. 1982;284:1607–8.CrossRef
17.
go back to reference Connelly D, Thomas B, Cliffe S, Perry W, Smith R. Clinical utility of the 2-minute walk test for older adults living in long-term care. Physiother Can. 2009;61:78–87.CrossRefPubMedPubMedCentral Connelly D, Thomas B, Cliffe S, Perry W, Smith R. Clinical utility of the 2-minute walk test for older adults living in long-term care. Physiother Can. 2009;61:78–87.CrossRefPubMedPubMedCentral
18.
go back to reference Kooiman T, Dontje M, Sprenger S, Krijnen W, van der Schans C, de Groot M. Reliability and validity of ten consumer activity trackers. BMC Sports Sci, Med Rehabil. 2015;7:24.CrossRef Kooiman T, Dontje M, Sprenger S, Krijnen W, van der Schans C, de Groot M. Reliability and validity of ten consumer activity trackers. BMC Sports Sci, Med Rehabil. 2015;7:24.CrossRef
19.
go back to reference Sushames A, Edwards A, Thompson F, McDermott R, Gebel K. Validity and reliability of Fitbit flex for step count, moderate to vigorous physical activity and activity energy expenditure. PLoS One. 2016;11(9):e0161224.CrossRefPubMedPubMedCentral Sushames A, Edwards A, Thompson F, McDermott R, Gebel K. Validity and reliability of Fitbit flex for step count, moderate to vigorous physical activity and activity energy expenditure. PLoS One. 2016;11(9):e0161224.CrossRefPubMedPubMedCentral
20.
go back to reference Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef Cicchetti D. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
21.
go back to reference Altman D. Some common problems in medical research. In: Practical statistics for medical research. London: Chapman & Hall; 1991. p. 398–403. Altman D. Some common problems in medical research. In: Practical statistics for medical research. London: Chapman & Hall; 1991. p. 398–403.
22.
go back to reference Bland J, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.CrossRefPubMed Bland J, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.CrossRefPubMed
24.
go back to reference Lexell J, Downham D. How to assess the reliability of measurements in rehabilitation. Am J Phys Med Rehabil. 2005;84:719–23.CrossRefPubMed Lexell J, Downham D. How to assess the reliability of measurements in rehabilitation. Am J Phys Med Rehabil. 2005;84:719–23.CrossRefPubMed
26.
go back to reference Lee J, Kim Y, Welk G. Validity of consumer-based physical activity monitors. Med Sci Sports Exerc. 2014;46(9):1840–8.CrossRefPubMed Lee J, Kim Y, Welk G. Validity of consumer-based physical activity monitors. Med Sci Sports Exerc. 2014;46(9):1840–8.CrossRefPubMed
27.
go back to reference Diaz K, Krupka D, Chang M, Shaffer J, Ma Y, Goldsmith J, Schwartz J, Davidson K: Validation of the Fitbit One® for physical activity measurement at an upper torso attachment site. BMC Res Notes 2016, 9(213). Diaz K, Krupka D, Chang M, Shaffer J, Ma Y, Goldsmith J, Schwartz J, Davidson K: Validation of the Fitbit One® for physical activity measurement at an upper torso attachment site. BMC Res Notes 2016, 9(213).
28.
go back to reference Floegel T, Florez-Pregonero A, Hekler E, Buman M. Validation of consumer-based hip and wrist activity monitors in older adults with varied ambulatory abilities. J Gerontol Ser A Biol Med Sci. 2017;72(2):229–36.CrossRef Floegel T, Florez-Pregonero A, Hekler E, Buman M. Validation of consumer-based hip and wrist activity monitors in older adults with varied ambulatory abilities. J Gerontol Ser A Biol Med Sci. 2017;72(2):229–36.CrossRef
30.
go back to reference Brooke S, An H-S, Kang S-K, Noble J, Berg K, Lee J-M. Concurrent validity of wearable activity trackers under free-living conditions. J Strength Cond Res. 2017;31(4):1097–106.CrossRefPubMed Brooke S, An H-S, Kang S-K, Noble J, Berg K, Lee J-M. Concurrent validity of wearable activity trackers under free-living conditions. J Strength Cond Res. 2017;31(4):1097–106.CrossRefPubMed
31.
go back to reference Chu A, Ng S, Paknezhad M, Gauterin A, Koh D, Brown M, Müller-Riemenschneider F. Comparison of wrist-worn Fitbit flex and waist-worn ActiGraph for measuring steps in free-living adults. PLoS One. 2017;12(2):e0172535.CrossRefPubMedPubMedCentral Chu A, Ng S, Paknezhad M, Gauterin A, Koh D, Brown M, Müller-Riemenschneider F. Comparison of wrist-worn Fitbit flex and waist-worn ActiGraph for measuring steps in free-living adults. PLoS One. 2017;12(2):e0172535.CrossRefPubMedPubMedCentral
32.
go back to reference Reid R, Insogna J, Carver T, Comptour A, Bewski N, Sciortino C, Andersen R. Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. J Sci Med Sport. 2017;20:578–82.CrossRefPubMed Reid R, Insogna J, Carver T, Comptour A, Bewski N, Sciortino C, Andersen R. Validity and reliability of Fitbit activity monitors compared to ActiGraph GT3X+ with female adults in a free-living environment. J Sci Med Sport. 2017;20:578–82.CrossRefPubMed
33.
go back to reference Paul S, Tiedemann A, Hassett L, Ramsay E, Kirkham C, Chagpar S, Sherrington C. Validity of the Fitbit activity tracker for measuring steps in community-dwelling older adults. BMJ Open Sport Exerc Med. 2015;1:e000013.CrossRefPubMedPubMedCentral Paul S, Tiedemann A, Hassett L, Ramsay E, Kirkham C, Chagpar S, Sherrington C. Validity of the Fitbit activity tracker for measuring steps in community-dwelling older adults. BMJ Open Sport Exerc Med. 2015;1:e000013.CrossRefPubMedPubMedCentral
34.
go back to reference Chen M-D, Kuo C-C, Pellegrini C, Hsu M-J. Accuracy of wristband activity monitors during ambulation and activities. Med Sci Sports Exerc. 2016;48(10):1942–9.CrossRefPubMed Chen M-D, Kuo C-C, Pellegrini C, Hsu M-J. Accuracy of wristband activity monitors during ambulation and activities. Med Sci Sports Exerc. 2016;48(10):1942–9.CrossRefPubMed
35.
go back to reference de Man M, Vanderploeg E, Aimers N, MacMahon C, Wise L, Parrington L. Validity and inter-device reliability of dominant and non-dominant wrist worn activity trackers in suburban walking. Sensoria. 2016;12(2):40–6.CrossRef de Man M, Vanderploeg E, Aimers N, MacMahon C, Wise L, Parrington L. Validity and inter-device reliability of dominant and non-dominant wrist worn activity trackers in suburban walking. Sensoria. 2016;12(2):40–6.CrossRef
36.
go back to reference Montoye A, Mitrzyk J, Molesky M. Comparative accuracy of a wrist-worn activity tracker and a smart shirt for physical activity assessment. Meas Phys Educ Exerc Science. 2017;1(4):201–11. Montoye A, Mitrzyk J, Molesky M. Comparative accuracy of a wrist-worn activity tracker and a smart shirt for physical activity assessment. Meas Phys Educ Exerc Science. 2017;1(4):201–11.
37.
go back to reference Hargens T, Deyarmin K, Snyder K, Mihalik A, Sharpe L. Comparison of wrist-worn and hip-worn activity monitors under free living conditionsb. J Med Eng Technol. 2017;41(3):200–7.CrossRefPubMed Hargens T, Deyarmin K, Snyder K, Mihalik A, Sharpe L. Comparison of wrist-worn and hip-worn activity monitors under free living conditionsb. J Med Eng Technol. 2017;41(3):200–7.CrossRefPubMed
38.
go back to reference Alharbi M, Bauman A, Neubeck L, Gallagher R. Validation of Fitbit-flex as a measure of free-living physical activity in community-based phase III cardiac rehabilitation population. Eur J Prev Cardiol. 2016;23(14):1476–85.CrossRefPubMed Alharbi M, Bauman A, Neubeck L, Gallagher R. Validation of Fitbit-flex as a measure of free-living physical activity in community-based phase III cardiac rehabilitation population. Eur J Prev Cardiol. 2016;23(14):1476–85.CrossRefPubMed
Metadata
Title
Reliability and validity of two fitness tracker devices in the laboratory and home environment for older community-dwelling people
Authors
Elissa Burton
Keith D. Hill
Nicola T. Lautenschlager
Cecilie Thøgersen-Ntoumani
Gill Lewin
Eileen Boyle
Erin Howie
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2018
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-018-0793-4

Other articles of this Issue 1/2018

BMC Geriatrics 1/2018 Go to the issue