Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Test-retest reliability of selected items of Health Behaviour in School-aged Children (HBSC) survey questionnaire in Beijing, China

Authors: Yang Liu, Mei Wang, Jorma Tynjälä, Yan Lv, Jari Villberg, Zhouyang Zhang, Lasse Kannas

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Children's health and health behaviour are essential for their development and it is important to obtain abundant and accurate information to understand young people's health and health behaviour. The Health Behaviour in School-aged Children (HBSC) study is among the first large-scale international surveys on adolescent health through self-report questionnaires. So far, more than 40 countries in Europe and North America have been involved in the HBSC study. The purpose of this study is to assess the test-retest reliability of selected items in the Chinese version of the HBSC survey questionnaire in a sample of adolescents in Beijing, China.

Methods

A sample of 95 male and female students aged 11 or 15 years old participated in a test and retest with a three weeks interval. Student Identity numbers of respondents were utilized to permit matching of test-retest questionnaires. 23 items concerning physical activity, sedentary behaviour, sleep and substance use were evaluated by using the percentage of response shifts and the single measure Intraclass Correlation Coefficients (ICC) with 95% confidence interval (CI) for all respondents and stratified by gender and age. Items on substance use were only evaluated for school children aged 15 years old.

Results

The percentage of no response shift between test and retest varied from 32% for the item on computer use at weekends to 92% for the three items on smoking. Of all the 23 items evaluated, 6 items (26%) showed a moderate reliability, 12 items (52%) displayed a substantial reliability and 4 items (17%) indicated almost perfect reliability. No gender and age group difference of the test-retest reliability was found except for a few items on sedentary behaviour.

Conclusions

The overall findings of this study suggest that most selected indicators in the HBSC survey questionnaire have satisfactory test-retest reliability for the students in Beijing. Further test-retest studies in a large and diverse sample, as well as validity studies, should be considered for the future Chinese HBSC study.
Appendix
Available only for authorised users
Literature
1.
Du S, Lu B, Zhai F, Popkin BM: A new stage of the nutrition transition in China. Public Health Nutr. 2002, 51 (1A): 169-74.
2.
General Sport Administration of China: Report on the Second National Physical Fitness Surveillance. 2006, Beijing: People's Sport Publishing House
3.
4.
Johnson CA, Palmer PH, Chou CP, Pang Z, Zhou D, Dong L, Xiang H, Yang P, Xu H, Wang J, Fu X, Guo Q, Sun P, Ma H, Gallaher PE, Xie B, Lee L, Fang T, Unger JB: Tobacco use among youth and adults in Mainland China: The China Seven Cities Study. Public Health. 2006, 120: 1156-69. 10.1016/j.puhe.2006.07.023.CrossRef
5.
Li M, Dibley MJ, Sibbritt DW, Zhou X, Yan H: Physical activity and sedentary behaviour in adolescents in Xi'an City, China. J Adolesc Health. 2007, 41: 99-101. 10.1016/j.jadohealth.2007.02.005.CrossRefPubMed
6.
Tudor-Locke C, Ainsworth BE, Adair LS, Du S, Popkin BM: Physical activity and inactivity in Chinese school-aged youth: the China Health and Nutrition Survey. Int J Obesity. 2003, 27: 1093-9. 10.1038/sj.ijo.0802377.CrossRef
7.
Unger JB, Li Y, Anderson JC, Gong J, Chen X, Li C, Trinidad DR, Tran NT, Lo AT: Stressful life events among adolescents in Wuhan, China: Associations with smoking, alcohol use and depressive symptoms. Int J Behav Med. 2001, 8: 1-18. 10.1207/S15327558IJBM0801_01.CrossRef
8.
Xing Y, Ji C, Zhang L: Relationship of binge drinking and other health- compromising behaviours among urban adolescents in China. J Adolesc Health. 2006, 39: 495-500. 10.1016/j.jadohealth.2006.03.014.CrossRefPubMed
9.
Zhu L, Petersen PE, Wang HY, Bian JY, Zhang BX: Oral health knowledge, attitudes and behaviour of children and adolescents in China. Int Dent J. 2003, 53: 289-98.CrossRefPubMed
10.
Currie C, Samdal O, Boyce W, Smith R, (Eds): Health Behaviour in School-aged Children: a WHO Cross-National Study (HBSC), Research Protocol for the 2001/2002 Survey. 2001, Edinburgh: Child and Adolescent Health Research Unit (CAHRU), University of Edinburgh
11.
Roberts C, Currie C, Samdal O, Currie D, Smith R, Maes L: Measuring the health and health behaviours of adolescents through cross-national survey research: recent developments in the Health Behaviour in School-aged Children (HBSC) study. J Pub Health. 2007, 15: 179-86. 10.1007/s10389-007-0100-x.CrossRef
12.
Biddle SJ, Gorely T, Stensel DJ: Health-enhancing physical activity and sedentary behaviour in children and adolescents. J Sports Sci. 2004, 22: 679-701. 10.1080/02640410410001712412.CrossRefPubMed
13.
Blair SN, LaMonte MJ, Nichaman MZ: The evolution of physical activity recommendations: how much is enough?. Am J Clin Nutr. 2004, 79 (5): 913-20.
14.
Rennie KL, Johnson L, Jebb SA: Behavioural determinants of obesity. Best Pract Res Clin Endocrinol Metab. 2005, 19 (3): 343-58. 10.1016/j.beem.2005.04.003.CrossRefPubMed
15.
World Health Organization: Global Status Report on Alcohol. 2004, Geneva: World Health Organization
16.
Mitru G, Millrood DL, Mateika JH: The impact of sleep on learning and behaviour in adolescents. Teach Coll Rec. 2002, 104: 704-26. 10.1111/1467-9620.00176.CrossRef
17.
O'Brien EM, Mindell JA: Sleep and risk-taking behaviour in adolescents. Behav Sleep Med. 2005, 3: 113-33. 10.1207/s15402010bsm0303_1.CrossRefPubMed
18.
Liu X, Liu L, Owens JA, Kaplan DL: Sleep patterns and sleep problems among schoolchildren in the United States and China. Pediatrics. 2005, 115 (1): 241-9. 10.1542/peds.2004-0815F.CrossRefPubMed
19.
Kohl HW, Fulton JE, Casperson CJ: Assessment of physical activity among children and adolescents: a review and synthesis. Prev Med. 2000, 31 (Suppl): S54-S76. 10.1006/pmed.1999.0542.CrossRef
20.
Otter ME, Mellenbergh GJ, Glopper KD: The relation between information-processing variables and test-retest stability for questionnaire items. J Educ Meas. 1995, 32 (2): 199-216. 10.1111/j.1745-3984.1995.tb00463.x.CrossRef
21.
Tourangeau R, Rips LJ, Rasinski K: The Psychology of Survey Response. 2000, Cambridge, Cambridge University PressCrossRef
22.
Wikman A, Wärneryd B: Measurement errors in survey questions: Explaining response variability. Soc Sci Med. 1990, 22: 199-212.
23.
Torsheim T, Wold B, Samdal O, Haugland S: Test-retest reliability of survey indicators measuring adolescent health and health behaviour. 1997, Bergen: Research Centre for Health Promotion, University of Bergen
24.
Boyce W, Torsheim T, Currie C, Zambon A: The family affluence scale as a measure of national wealth: validation of an adolescent self-report measure. Soc Indic Res. 2006, 78: 473-87. 10.1007/s11205-005-1607-6.CrossRef
25.
Vereecken C, Maes LA: A Belgian study on the reliability and relative validity of the Health Behaviour in School-aged Children food frequency questionnaire. Public Health Nutr. 2003, 6: 581-8. 10.1079/PHN2003466.CrossRefPubMed
26.
Elgar FJ, Roberts C, Tudor-Smith C, Moore L: Validity of self-reported height and weight and predictors of bias in adolescents. J Adolesc Health. 2005, 37: 371-5. 10.1016/j.jadohealth.2004.07.014.CrossRefPubMed
27.
Booth ML, Okely AD, Chey T, Bauman A: The reliability and validity of the physical activity questions in the WHO health behaviour in schoolchildren (HBSC) survey: a population study. Br J Sports Med. 2001, 35: 263-7. 10.1136/bjsm.35.4.263.CrossRefPubMedPubMedCentral
28.
Rangul V, Holmen TL, Kurtze N, Cuypers K, Midthjell K: Reliability and validity of two frequently used self-administered physical activity questionnaires in adolescents. BMC Med Res methodol. 2008, 8: 47-10.1186/1471-2288-8-47.CrossRefPubMedPubMedCentral
29.
Vuori M, Ojala K, Tynjälä J, Villberg J, Välimaa R, Kannas L: The stability of physical activity survey items in the HBSC study. Liikunta & Tiede. 2005, 42 (6): 39-46. In Finnish with English abstract
30.
Haugland S, Wold B: Subjective health complaints in adolescence--Reliability and validity of survey methods. J Adolesc. 2001, 24: 611-24. 10.1006/jado.2000.0393.CrossRefPubMed
31.
Ojala K, Vuori M, Välimaa R, Villberg J, Tynjälä J, Kannas L: Reasons for exercise inventory in a school survey: contemplations of the inventory's reliability and structure validity. Liikunta & Tieta. 2005, 42 (6): 30-8. In Finnish with English abstract
32.
Tynjälä J: Sleep habits, perceived sleep quality and tiredness among adolescents: a health behavioural approach. PhD thesis. 1999, University of Jyväskylä, Department of Health Sciences
33.
Torsheim T, Wold B, Samdal O: The teacher and classmate support scale: Factor structure, test-retest reliability and validity in samples of 13- and 15-year-old adolescents. Sch Psychol Int. 2000, 21 (2): 195-212. 10.1177/0143034300212006.CrossRef
34.
Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-8. 10.1037/0033-2909.86.2.420.CrossRefPubMed
35.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-74. 10.2307/2529310.CrossRefPubMed
36.
Prochaska JJ, Sallis JF, Long B: A physical activity screening measure for use with adolescents in primary care. Arch Pediatr Adoles Med. 2001, 155: 554-9.CrossRef
37.
Treuth MS, Hou N, Young DR, Maynard ML: Validity and reliability of the Fels Physical Activity Questionnaire for children. Med Sci Sports Exerc. 2005, 37 (3): 488-95. 10.1249/01.MSS.0000155392.75790.83.CrossRefPubMed
38.
Hardy LL, Booth ML, Okely AD: The reliability of the adolescent sedentary activity questionnaire (ASAQ). Prev Med. 2007, 45 (1): 71-4. 10.1016/j.ypmed.2007.03.014.CrossRefPubMed
39.
Brener ND, McMannus T, Galuska DA, Lowry R, Wechsler H: Reliability and validity of self-reported height and weight among high school students. J Adolesc Health. 2002, 32: 281-7. 10.1016/S1054-139X(02)00708-5.CrossRef
40.
Henriksen L, Jackson C: Reliability of children's self-reported cigarette smoking. Addict Behav. 1999, 24 (2): 271-7. 10.1016/S0306-4603(98)00010-0.CrossRefPubMed
41.
Tourangeau R: Remembering what happened: Memory errors and survey reports. The Science of Self-Report: Implications for Research and Practice. Edited by: Stone AA, Turkkan JS, Bachrach CA, Jobe JB, Kurtzman HS, Cain VS. 2000, Mahwah, NJ: Lawrence Erlbaum Associates, 29-47.
Metadata
Title
Test-retest reliability of selected items of Health Behaviour in School-aged Children (HBSC) survey questionnaire in Beijing, China
Authors
Yang Liu
Mei Wang
Jorma Tynjälä
Yan Lv
Jari Villberg
Zhouyang Zhang
Lasse Kannas
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-73

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue

Research article

Evaluating clinical periodontal measures as surrogates for bacterial exposure: The Oral Infections and Vascular Disease Epidemiology Study (INVEST)

Study protocol

Methods for determining disease burden and calibrating national surveillance data in the United Kingdom: the second study of infectious intestinal disease in the community (IID2 study)

Research article

Sampling and coverage issues of telephone surveys used for collecting health information in Australia: results from a face-to-face survey from 1999 to 2008

Commentary

A tutorial on pilot studies: the what, why and how

Research article

The Total Deviation Index estimated by Tolerance Intervals to evaluate the concordance of measurement devices

Debate

Research methods for subgrouping low back pain