Skip to main content
Top
Published in: BMC Public Health 1/2019

Open Access 01-12-2019 | Research article

Reliability of a new measure to assess modern screen time in adults

Authors: Maricarmen Vizcaino, Matthew Buman, C. Tyler DesRoches, Christopher Wharton

Published in: BMC Public Health | Issue 1/2019

Login to get access

Abstract

Background

Screen time among adults represents a continuing and growing problem in relation to health behaviors and health outcomes. However, no instrument currently exists in the literature that quantifies the use of modern screen-based devices. The primary purpose of this study was to develop and assess the reliability of a new screen time questionnaire, an instrument designed to quantify use of multiple popular screen-based devices among the US population.

Methods

An 18-item screen-time questionnaire was created to quantify use of commonly used screen devices (e.g. television, smartphone, tablet) across different time points during the week (e.g. weekday, weeknight, weekend). Test-retest reliability was assessed through intra-class correlation coefficients (ICCs) and standard error of measurement (SEM). The questionnaire was delivered online using Qualtrics and administered through Amazon Mechanical Turk (MTurk).

Results

Eighty MTurk workers completed full study participation and were included in the final analyses. All items in the screen time questionnaire showed fair to excellent relative reliability (ICCs = 0.50–0.90; all < 0.000), except for the item inquiring about the use of smartphone during an average weekend day (ICC = 0.16, p = 0.069). The SEM values were large for all screen types across the different periods under study.

Conclusions

Results from this study suggest this self-administered questionnaire may be used to successfully classify individuals into different categories of screen time use (e.g. high vs. low); however, it is likely that objective measures are needed to increase precision of screen time assessment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dunstan DW, Barr EL, Healy GN, Salmon J, Shaw JE, Balkau B, et al. Television viewing time and mortality: the Australian diabetes, obesity and lifestyle study (AusDiab). Circulation. 2010;121:384–91.PubMedCrossRef Dunstan DW, Barr EL, Healy GN, Salmon J, Shaw JE, Balkau B, et al. Television viewing time and mortality: the Australian diabetes, obesity and lifestyle study (AusDiab). Circulation. 2010;121:384–91.PubMedCrossRef
2.
go back to reference Hu FB, Leitzmann MF, Stampfer MJ, Colditz GA, Willett WC, Rimm EB. Physical activity and television watching in relation to risk for type 2 diabetes mellitus in men. Arch Intern Med. 2001;161:1542–8.PubMedCrossRef Hu FB, Leitzmann MF, Stampfer MJ, Colditz GA, Willett WC, Rimm EB. Physical activity and television watching in relation to risk for type 2 diabetes mellitus in men. Arch Intern Med. 2001;161:1542–8.PubMedCrossRef
3.
go back to reference Hu FB, Li TY, Colditz GA, Willett WC, Manson JE. Television watching and other sedentary behaviors in relation to risk of obesity and type 2 diabetes mellitus in women. JAMA. 2003;289:1785–91.PubMedCrossRef Hu FB, Li TY, Colditz GA, Willett WC, Manson JE. Television watching and other sedentary behaviors in relation to risk of obesity and type 2 diabetes mellitus in women. JAMA. 2003;289:1785–91.PubMedCrossRef
4.
go back to reference Salmon J, Bauman A, Crawford D, Timperio A, Owen N. The association between television viewing and overweight among Australian adults participating in varying levels of leisure-time physical activity. Int J Obes. 2000;24:600–6.CrossRef Salmon J, Bauman A, Crawford D, Timperio A, Owen N. The association between television viewing and overweight among Australian adults participating in varying levels of leisure-time physical activity. Int J Obes. 2000;24:600–6.CrossRef
5.
go back to reference Wijndaele K, Brage S, Besson H, Khaw K, Sharp SJ, Luben R, et al. Television viewing and incident cardiovascular disease: prospective associations and mediation analysis in the EPIC Norfolk study. PLoS One. 2011;6:e20058.PubMedPubMedCentralCrossRef Wijndaele K, Brage S, Besson H, Khaw K, Sharp SJ, Luben R, et al. Television viewing and incident cardiovascular disease: prospective associations and mediation analysis in the EPIC Norfolk study. PLoS One. 2011;6:e20058.PubMedPubMedCentralCrossRef
6.
go back to reference Coon KA, Tucker K. Television and children’s consumption patterns. Minerva Pediatr. 2002;54:423–36.PubMed Coon KA, Tucker K. Television and children’s consumption patterns. Minerva Pediatr. 2002;54:423–36.PubMed
7.
go back to reference Yogesh S, Abha S, Priyanka S. Mobile usage and sleep patterns among medical students. Indian J Physiol Pharmacol. 2014;58:100–3.PubMed Yogesh S, Abha S, Priyanka S. Mobile usage and sleep patterns among medical students. Indian J Physiol Pharmacol. 2014;58:100–3.PubMed
8.
go back to reference Demirci K, Argonul M, Akpinar A. Relationship of smartphone use severity with sleep quality, depression, and anxiety in university students. J Behav Addict. 2015;4:85–92.PubMedPubMedCentralCrossRef Demirci K, Argonul M, Akpinar A. Relationship of smartphone use severity with sleep quality, depression, and anxiety in university students. J Behav Addict. 2015;4:85–92.PubMedPubMedCentralCrossRef
9.
go back to reference Regel SJ, Tinguely G, Schuderer J, Adam M, Kuster N, Landolt H, et al. Pulsed radio-frequency electromagnetic fields: dose-dependent effects on sleep, the sleep EEG and cognitive performance. J Sleep Res. 2007;16:253–8.PubMedCrossRef Regel SJ, Tinguely G, Schuderer J, Adam M, Kuster N, Landolt H, et al. Pulsed radio-frequency electromagnetic fields: dose-dependent effects on sleep, the sleep EEG and cognitive performance. J Sleep Res. 2007;16:253–8.PubMedCrossRef
10.
go back to reference Chang A, Aeschbach D, Duffy JF, Czeisler CA. Evening use of light-emitting eReaders negatively affects sleep, circadian timing, and next-morning alertness. PNAS. 2015;112:1232–7.PubMedCrossRef Chang A, Aeschbach D, Duffy JF, Czeisler CA. Evening use of light-emitting eReaders negatively affects sleep, circadian timing, and next-morning alertness. PNAS. 2015;112:1232–7.PubMedCrossRef
11.
go back to reference Hamer M, Stamatakis E, Mishra GD. Television- and screen-based activity and mental well-being in adults. Am J Prev Med. 2010;38:375–80.PubMedCrossRef Hamer M, Stamatakis E, Mishra GD. Television- and screen-based activity and mental well-being in adults. Am J Prev Med. 2010;38:375–80.PubMedCrossRef
12.
go back to reference Hamer M, Poole L, Messerli-Burgy N. Television viewing, c-reactive protein, and depressive symptoms in older adults. Brain Behav Immun. 2013;33:29–32.PubMedCrossRef Hamer M, Poole L, Messerli-Burgy N. Television viewing, c-reactive protein, and depressive symptoms in older adults. Brain Behav Immun. 2013;33:29–32.PubMedCrossRef
13.
go back to reference Tsigos C, Chrousos GP. Hypothalamic-pituitary-adrenal axis, neuroendocrine factors and stress. J Psychosom Res. 2002;53:865–71.PubMedCrossRef Tsigos C, Chrousos GP. Hypothalamic-pituitary-adrenal axis, neuroendocrine factors and stress. J Psychosom Res. 2002;53:865–71.PubMedCrossRef
19.
go back to reference Jenner M. Binge-watching: video-on-demand, quality TV and mainstreaming fandom. Int J Cult Stud. 2017;20:304–20.CrossRef Jenner M. Binge-watching: video-on-demand, quality TV and mainstreaming fandom. Int J Cult Stud. 2017;20:304–20.CrossRef
20.
go back to reference Wilmot EG, Edwardson CL, Achana FA, Davies MJ, Gorely T, Gray LJ, et al. Sedentary time in adults and the association with diabetes, cardiovascular disease and death: systematic review and meta-analysis. Diabetologia. 2012;55:2895–905.PubMedCrossRef Wilmot EG, Edwardson CL, Achana FA, Davies MJ, Gorely T, Gray LJ, et al. Sedentary time in adults and the association with diabetes, cardiovascular disease and death: systematic review and meta-analysis. Diabetologia. 2012;55:2895–905.PubMedCrossRef
21.
go back to reference Stamatakis E, Hamer M, Dunstan DW. Screen-based entertainment time, all-cause mortality, and cardiovascular events: population-based study with ongoing mortality and hospital events follow-up. J Am Coll Cardiol. 2011;57:292–9.PubMedCrossRef Stamatakis E, Hamer M, Dunstan DW. Screen-based entertainment time, all-cause mortality, and cardiovascular events: population-based study with ongoing mortality and hospital events follow-up. J Am Coll Cardiol. 2011;57:292–9.PubMedCrossRef
22.
go back to reference Wijndaele K, Brage S, Besson H, Khaw KT, Sharp SJ, Luben R, et al. Television viewing time independently predicts all-cause and cardiovascular mortality: the EPIC Norfolk study. Int J Epidemiol. 2011;40:150–9.PubMedCrossRef Wijndaele K, Brage S, Besson H, Khaw KT, Sharp SJ, Luben R, et al. Television viewing time independently predicts all-cause and cardiovascular mortality: the EPIC Norfolk study. Int J Epidemiol. 2011;40:150–9.PubMedCrossRef
28.
go back to reference Hamermesh DS, Frazis H, Stewart J. Data watch: the American time use survey. J Econ Perspect. 2005;19:221–32.CrossRef Hamermesh DS, Frazis H, Stewart J. Data watch: the American time use survey. J Econ Perspect. 2005;19:221–32.CrossRef
29.
go back to reference Kiernan M, Schoffman DE, Lee K, Brown SD, Fair JM, Perri MG, et al. The Stanford leisure-time activity categorical item (L-cat): a single item sensitive to physical activity changes in overweight/obese women. Int J Obes. 2013;37:1597–602.CrossRef Kiernan M, Schoffman DE, Lee K, Brown SD, Fair JM, Perri MG, et al. The Stanford leisure-time activity categorical item (L-cat): a single item sensitive to physical activity changes in overweight/obese women. Int J Obes. 2013;37:1597–602.CrossRef
30.
go back to reference Paolacci G, Chandler J, Ipeirotis PG. Running experiments on Amazon mechanical Turk. Judgm Decis Mak. 2010;5:411–9. Paolacci G, Chandler J, Ipeirotis PG. Running experiments on Amazon mechanical Turk. Judgm Decis Mak. 2010;5:411–9.
31.
go back to reference Paolacci G, Chandler J. Inside the Turk: understanding mechanical Turk as a participant tool. Curr Dir Psychol Sci. 2014;23:184–8.CrossRef Paolacci G, Chandler J. Inside the Turk: understanding mechanical Turk as a participant tool. Curr Dir Psychol Sci. 2014;23:184–8.CrossRef
32.
go back to reference Mason W, Suri S. Conducting behavioral research on Amazon’s mechanical Turk. Behav Res Methods. 2012;44:1–23.PubMedCrossRef Mason W, Suri S. Conducting behavioral research on Amazon’s mechanical Turk. Behav Res Methods. 2012;44:1–23.PubMedCrossRef
33.
go back to reference Casler K, Bickel L, Hackett E. Separate but equal? A comparison of participants and data gathered via Amazon’s Mturk, social media, and face-to-face behavioral testing. Comput Hum Behav. 2013;29:2156–60.CrossRef Casler K, Bickel L, Hackett E. Separate but equal? A comparison of participants and data gathered via Amazon’s Mturk, social media, and face-to-face behavioral testing. Comput Hum Behav. 2013;29:2156–60.CrossRef
34.
go back to reference Hernaez R. Reliability and agreement studies: a guide for clinical investigators. Gut. 2015;64:1018–27.PubMedCrossRef Hernaez R. Reliability and agreement studies: a guide for clinical investigators. Gut. 2015;64:1018–27.PubMedCrossRef
35.
go back to reference Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40.PubMed Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40.PubMed
36.
37.
go back to reference Giraudeau B, Mary JY. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 percent confidence interval of the intraclass correlation coefficient. Stat Med. 2001;20:3205–14.PubMedCrossRef Giraudeau B, Mary JY. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 percent confidence interval of the intraclass correlation coefficient. Stat Med. 2001;20:3205–14.PubMedCrossRef
38.
go back to reference Garber CE, Blissmer B, Deschenes MR, Franklin BA, Lamonte MJ, Lee IM, et al. American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med Sci Sports Exerc. 2011;43:1334–59.PubMedCrossRef Garber CE, Blissmer B, Deschenes MR, Franklin BA, Lamonte MJ, Lee IM, et al. American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med Sci Sports Exerc. 2011;43:1334–59.PubMedCrossRef
39.
go back to reference Clark BK, Sugiyama T, Healy GN, Salmon J, Dunstan DW, Owen N. Validity and reliability of measures of television viewing time and other non-occupational sedentary behaviour of adults: a review. Obes Rev. 2009;10:7–16.PubMedCrossRef Clark BK, Sugiyama T, Healy GN, Salmon J, Dunstan DW, Owen N. Validity and reliability of measures of television viewing time and other non-occupational sedentary behaviour of adults: a review. Obes Rev. 2009;10:7–16.PubMedCrossRef
40.
go back to reference Marshall AL, Miller YD, Burton NW, Brown WJ. Measuring total and domain-specific sitting: a study of reliability and validity. Med Sci Sports Exerc. 2010;42:1094–102.PubMed Marshall AL, Miller YD, Burton NW, Brown WJ. Measuring total and domain-specific sitting: a study of reliability and validity. Med Sci Sports Exerc. 2010;42:1094–102.PubMed
41.
go back to reference Armstrong GB, Greenberg BS. Background television as an inhibitor of cognitive processing. Hum Commun Res. 1990;16:355–86.CrossRef Armstrong GB, Greenberg BS. Background television as an inhibitor of cognitive processing. Hum Commun Res. 1990;16:355–86.CrossRef
42.
go back to reference Armstrong GB, Chung L. Background television and reading memory in context: assessing TV interference and facilitative context effects on encoding versus retrieval processes. Commun Res. 2000;27:327–52.CrossRef Armstrong GB, Chung L. Background television and reading memory in context: assessing TV interference and facilitative context effects on encoding versus retrieval processes. Commun Res. 2000;27:327–52.CrossRef
43.
go back to reference Pettee KK, Ham SA, Macera CA, Ainsworth BE. The reliability of a survey question on television viewing and associations with health risk factors in US adults. Behav Psychol. 2009;17:487–93. Pettee KK, Ham SA, Macera CA, Ainsworth BE. The reliability of a survey question on television viewing and associations with health risk factors in US adults. Behav Psychol. 2009;17:487–93.
44.
go back to reference Jeong S, Hwang Y. Media multitasking effects on cognitive vs. attitudinal outcomes: a meta-analysis. Hum Commun Res. 2016;42:599–618.CrossRef Jeong S, Hwang Y. Media multitasking effects on cognitive vs. attitudinal outcomes: a meta-analysis. Hum Commun Res. 2016;42:599–618.CrossRef
Metadata
Title
Reliability of a new measure to assess modern screen time in adults
Authors
Maricarmen Vizcaino
Matthew Buman
C. Tyler DesRoches
Christopher Wharton
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2019
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-019-7745-6

Other articles of this Issue 1/2019

BMC Public Health 1/2019 Go to the issue