Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Comparison of psychometric properties between recall methods of interview-based physical activity questionnaires: a systematic review

Authors: Kenji Doma, Renée Speyer, Lauren Alese Parsons, Reinie Cordier

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

This systematic review examined the methodological quality of studies and assessed the psychometric qualities of interview-administered Past-week and Usual-week Physical Activity Questionnaires (PAQs). Pubmed and Embase were used to retrieve data sources.

Methods

The studies were selected using the following eligibility criteria: 1) psychometric properties of PAQs were assessed in adults; 2) the PAQs either consisted of recall periods of usual 7-days (Usual-week PAQs) within the past 12 months or during the past 7-days (Past-week PAQs); and 3) PAQs were interview-administered. The COSMIN taxonomy was utilised to critically appraise study quality and a previously established psychometric criteria employed to evaluate the overall psychometric qualities.

Results

Following screening, 42 studies were examined to determine the psychometric properties of 20 PAQs, with the majority of studies demonstrating good to excellent ratings for methodological quality. For convergent validity (i.e., the relationship between PAQs and other measures), similar overall associations were found between Past-week PAQs and Usual-week PAQs. However, PAQs were more strongly associated with direct measures of physical activity (e.g., accelerometer) than indirect measures of physical activity (i.e., physical fitness), irrespective of recall methods. Very few psychometric properties were examined for each PAQ, with the majority exhibiting poor ratings in psychometric quality. Only a few interview-administered PAQs exhibited positive ratings for a single psychometric property, although the other properties were either rated as poor or questionable, demonstrating the limitations of current PAQs.

Conclusion

Accordingly, further research is necessary to explore a greater number of psychometric properties, or to develop new PAQs by addressing the psychometric limitations identified in the current review.
Literature
1.
Rush E, Simmons D. Physical activity in children: prevention of obesity and type 2 diabetes. Med Sport Sci. 2014;60:113–21.PubMedCrossRef
2.
Pedersen BK, Saltin B. Exercise as medicine - evidence for prescribing exercise as therapy in 26 different chronic diseases. Scand J Med Sci Sports. 2015;25(Suppl 3):1–72.PubMedCrossRef
3.
Doma K, Grant A, Morris J. The effects of balance training on balance performance and functional outcome measures following Total knee arthroplasty: a systematic review and meta-analysis. Sports Med. 2018;48(10):2367–85.PubMedCrossRef
4.
Pierce DR, Doma K, Leicht AS. Acute effects of exercise mode on arterial stiffness and wave reflection in healthy young adults: a systematic review and meta-analysis. Front Physiol. 2018;9:73.PubMedPubMedCentralCrossRef
5.
Poirier P, Giles TD, Bray GA, Hong Y, Stern JS, Pi-Sunyer FX, et al. Obesity and cardiovascular disease: pathophysiology, evaluation, and effect of weight loss: an update of the 1997 American Heart Association scientific statement on obesity and heart disease from the obesity Committee of the Council on nutrition, physical activity, and metabolism. Circulation. 2006;113(6):898–918.PubMedCrossRef
6.
Fussenich LM, Boddy LM, Green DJ, Graves LE, Foweather L, Dagger RM, et al. Physical activity guidelines and cardiovascular risk in children: a cross sectional analysis to determine whether 60 minutes is enough. BMC Public Health. 2016;16(1):67.PubMedPubMedCentralCrossRef
7.
8.
Babor TF, Sciamanna CN, Pronk NP. Assessing multiple risk behaviors in primary care. Screening issues and related concepts. Am J Prev Med. 2004;27(2 Suppl):42–53.PubMedCrossRef
9.
Lee PH, Macfarlane DJ, Lam TH, Stewart SM. Validity of the international physical activity questionnaire short form (IPAQ-SF): a systematic review. Int J Behav Nutr Phys Act. 2011;8:115.PubMedPubMedCentralCrossRef
10.
Ainsworth BE, Caspersen CJ, Matthews CE, Masse LC, Baranowski T, Zhu W. Recommendations to improve the accuracy of estimates of physical activity derived from self report. J Phys Act Health. 2012;9(Suppl 1):S76–84.PubMedPubMedCentralCrossRef
11.
Shephard RJ, Aoyagi Y. Seasonal variations in physical activity and implications for human health. Eur J Appl Physiol. 2009;107(3):251–71.PubMedCrossRef
12.
Merkx A, Ausems M, Bude L, de Vries R, Nieuwenhuijze MJ. Factors affecting perceived change in physical activity in pregnancy. Midwifery. 2017;51:16–23.PubMedCrossRef
13.
Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de Vet HC. Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist. Qual Life Res. 2012;21(4):651–7.PubMedCrossRef
14.
Schellingerhout JM, Verhagen AP, Heymans MW, Koes BW, de Vet HC, Terwee CB. Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review. Qual Life Res. 2012;21(4):659–70.PubMedCrossRef
15.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.PubMedCrossRef
16.
Doma K, Speyer R, Leicht AS, Cordier R. Comparison of psychometric properties between usual-week and past-week self-reported physical activity questionnaires: a systematic review. Int J Behav Nutr Phys Act. 2017;14(1):10.PubMedPubMedCentralCrossRef
17.
Brown WJ, Burton NW, Marshall AL, Miller YD. Reliability and validity of a modified self-administered version of the active Australia physical activity survey in a sample of mid-age women. Aust N Z J Public Health. 2008;32(6):535–41.PubMedCrossRef
18.
Fjeldsoe BS, Winkler EA, Marshall AL, Eakin EG, Reeves MM. Active adults recall their physical activity differently to less active adults: test-retest reliability and validity of a physical activity survey. Health Promot J Austr. 2013;24(1):26–31.PubMedCrossRef
19.
Touvier M, Kesse-Guyot E, Mejean C, Pollet C, Malon A, Castetbon K, et al. Comparison between an interactive web-based self-administered 24 h dietary record and an interview by a dietitian for large-scale epidemiological studies. Br J Nutr. 2011;105(7):1055–64.PubMedCrossRef
20.
Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health (Oxf). 2005;27(3):281–91.CrossRef
21.
Okamoto K, Ohsuka K, Shiraishi T, Hukazawa E, Wakasugi S, Furuta K. Comparability of epidemiological information between self- and interviewer-administered questionnaires. J Clin Epidemiol. 2002;55(5):505–11.PubMedCrossRef
22.
Schnall AH, Wolkin A, Nakata N. In: Horney JA, editor. Chapter 9 Methods: questionnaire development and interviewing techniques. London: Mica Haley; 2018.
23.
Forsen L, Loland NW, Vuillemin A, Chinapaw MJ, van Poppel MN, Mokkink LB, et al. Self-administered physical activity questionnaires for the elderly: a systematic review of measurement properties. Sports Med. 2010;40(7):601–23.CrossRefPubMed
24.
van Poppel MN, Chinapaw MJ, Mokkink LB, van Mechelen W, Terwee CB. Physical activity questionnaires for adults: a systematic review of measurement properties. Sports Med. 2010;40(7):565–600.PubMedCrossRef
25.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.PubMedPubMedCentralCrossRef
26.
Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284–90.CrossRef
27.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.PubMedPubMedCentralCrossRef
28.
Aparicio-Ugarriza R, Mielgo-Ayuso J, Benito PJ, Pedrero-Chamizo R, Ara I, Gonzalez-Gross M, et al. Physical activity assessment in the general population; instrumental methods and new technologies. Nutr Hosp. 2015;31(Suppl 3):219–26.PubMed
29.
Cordier R, Speyer R, Chen YW, Wilkes-Gillan S, Brown T, Bourke-Taylor H, et al. Evaluating the psychometric quality of social skills measures: a systematic review. PLoS One. 2015;10(7):e0132299.PubMedPubMedCentralCrossRef
30.
Cordier R, Chen YW, Speyer R, Totino R, Doma K, Leicht A, et al. Child-report measures of occupational performance: a systematic review. PLoS One. 2016;11(1):e0147751.PubMedPubMedCentralCrossRef
31.
Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale: Lawrence Erlbaum Associates; 1988.
32.
Hakkinen A, Malkia E, Hakkinen K, Jappinen I, Laitinen L, Hannonen P. Effects of detraining subsequent to strength training on neuromuscular function in patients with inflammatory arthritis. Br J Rheumatol. 1997;36(10):1075–81.PubMedCrossRef
33.
Sarkin JA, Johnson SS, Prochaska JO, Prochaska JM. Applying the transtheoretical model to regular moderate exercise in an overweight population: validation of a stages of change measure. Prev Med. 2001;33(5):462–9.PubMedCrossRef
34.
de Vet HC, Terwee CB, Knol DL, Bouter LM. When to use agreement versus reliability measures. J Clin Epidemiol. 2006;59(10):1033–9.PubMedCrossRef
35.
Delbaere K, Hauer K, Lord SR. Evaluation of the incidental and planned activity questionnaire (IPEQ) for older people. Br J Sports Med. 2010;44(14):1029–34.PubMedCrossRef
36.
Chu AH, Ng SH, Koh D, Muller-Riemenschneider F. Reliability and validity of the self- and interviewer-administered versions of the global physical activity questionnaire (GPAQ). PLoS One. 2015;10(9):e0136944.PubMedPubMedCentralCrossRef
37.
Vuillemin A, Oppert JM, Guillemin F, Essermeant L, Fontvieille AM, Galan P, et al. Self-administered questionnaire compared with interview to assess past-year physical activity. Med Sci Sports Exerc. 2000;32(6):1119–24.PubMedCrossRef
38.
Mujika I, Padilla S. Muscular characteristics of detraining in humans. Med Sci Sports Exerc. 2001;33(8):1297–303.PubMedCrossRef
39.
Pettee Gabriel K, McClain JJ, High RR, Schmid KK, Whitfield GP, Ainsworth BE. Patterns of accelerometer-derived estimates of inactivity in middle-age women. Med Sci Sports Exerc. 2012;44(1):104–10.PubMedCrossRef
40.
Rehn TA, Munkvik M, Lunde PK, Sjaastad I, Sejersted OM. Intrinsic skeletal muscle alterations in chronic heart failure patients: a disease-specific myopathy or a result of deconditioning? Heart Fail Rev. 2012;17(3):421–36.PubMedCrossRef
41.
Bickel CS, Cross JM, Bamman MM. Exercise dosing to retain resistance training adaptations in young and older adults. Med Sci Sports Exerc. 2011;43(7):1177–87.PubMedCrossRef
42.
Reimers AK, Mess F, Bucksch J, Jekauc D, Woll A. Systematic review on measurement properties of questionnaires assessing the neighbourhood environment in the context of youth physical activity behaviour. BMC Public Health. 2013;13:461.PubMedPubMedCentralCrossRef
43.
Silsbury Z, Goldsmith R, Rushton A. Systematic review of the measurement properties of self-report physical activity questionnaires in healthy adult populations. BMJ Open. 2015;5(9):e008430.PubMedPubMedCentralCrossRef
44.
Terwee CB, Roorda LD, Knol DL, De Boer MR, De Vet HC. Linking measurement error to minimal important change of patient-reported outcomes. J Clin Epidemiol. 2009;62(10):1062–7.PubMedCrossRef
45.
Nadalin V, Bentvelsen K, Kreiger N. Reliability of self-reports: data from the Canadian multi-Centre osteoporosis study (CaMos). Chronic Dis Canada. 2004;25(2):28–31.
46.
Merom D, Delbaere K, Cumming R, Voukelatos A, Rissel C, Van Der Ploeg HP, et al. Incidental and planned exercise questionnaire for seniors: validity and responsiveness. Med Sci Sports Exerc. 2014;46(5):947–54.PubMedCrossRef
47.
Pettee Gabriel K, McClain JJ, Lee CD, Swan PD, Alvar BA, Mitros MR, et al. Evaluation of physical activity measures used in middle-aged women. Med Sci Sports Exerc. 2009;41(7):1403–12.PubMedCrossRef
48.
Kriska AM, Knowler WC, LaPorte RE, Drash AL, Wing RR, Blair SN, et al. Development of questionnaire to examine relationship of physical activity and diabetes in Pima Indians. Diabetes Care. 1990;13(4):401–11.PubMedCrossRef
49.
Kriska AM, Edelstein SL, Hamman RF, Otto A, Bray GA, Mayer-Davis EJ, et al. Physical activity in individuals at risk for diabetes: diabetes prevention program. Med Sci Sports Exerc. 2006;38(5):826–32.PubMedPubMedCentralCrossRef
50.
Schulz LO, Harper IT, Smith CJ, Kriska AM, Ravussin E. Energy intake and physical activity in Pima Indians: comparison with energy expenditure measured by doubly-labeled water. Obes Res. 1994;2(6):541–8.PubMedCrossRef
51.
Gill DP, Jones GR, Zou GY, Speechley M. The phone-FITT: a brief physical activity interview for older adults. J Aging Phys Act. 2008;16(3):292–315.PubMedCrossRef
52.
Colbert LH, Matthews CE, Havighurst TC, Kim K, Schoeller DA. Comparative validity of physical activity measures in older adults. Med Sci Sports Exerc. 2011;43(5):867–76.PubMedPubMedCentralCrossRef
53.
Dipietro L, Caspersen CJ, Ostfeld AM, Nadel ER. A survey for assessing physical activity among older adults. Med Sci Sports Exerc. 1993;25(5):628-42.PubMedCrossRef
54.
Gennuso KP, Matthews CE, Colbert LH. Reliability and validity of 2 self-report measures to assess sedentary behavior in older adults. J Phys Act Health. 2015;12(5):727–32.PubMedCrossRef
55.
Harada ND, Chiu V, King AC, Stewart AL. An evaluation of three self-report physical activity instruments for older adults. Med Sci Sports Exerc. 2001;33(6):962–70.PubMedCrossRef
56.
Kolbe-Alexander TL, Lambert EV, Harkins JB, Ekelund U. Comparison of two methods of measuring physical activity in south African older adults. J Aging Phys Act. 2006;14(1):98–114.PubMedCrossRef
57.
Moore DS, Ellis R, Allen PD, Cherry KE, Monroe PA, O'Neil CE, et al. Construct validation of physical activity surveys in culturally diverse older adults: a comparison of four commonly used questionnaires. Res Q Exerc Sport. 2008;79(1):42–50.PubMed
58.
Brown WJ, Trost SG, Bauman A, Mummery K, Owen N. Test-retest reliability of four physical activity measures used in population surveys. J Sci Med Sport. 2004;7(2):205–15.PubMedCrossRef
59.
Brown W, Bauman A, Chey T, Trost S, Mummery K. Comparison of surveys used to measure physical activity. Aust N Z J Public Health. 2004;28(2):128–34.PubMedCrossRef
60.
Creamer M, Bowles HR, von Hofe B, Pettee Gabriel K, Kohl HW 3rd, Bauman A. Utility of computer-assisted approaches for population surveillance of physical activity. J Phys Act Health. 2014;11(6):1111–9.PubMedCrossRef
61.
Mahabir S, Baer DJ, Giffen C, Clevidence BA, Campbell WS, Taylor PR, et al. Comparison of energy expenditure estimates from 4 physical activity questionnaires with doubly labeled water estimates in postmenopausal women. Am J Clin Nutr. 2006;84(1):230–6.PubMedCrossRef
62.
Rauh MJ, Hovell MF, Hofstetter CR, Sallis JF, Gleghorn A. Reliability and validity of self-reported physical activity in Latinos. Int J Epidemiol. 1992;21(5):966–71.PubMedCrossRef
63.
Washburn RA, Smith KW, Goldfield SR, McKinlay JB. Reliability and physiologic correlates of the Harvard alumni activity survey in a general population. J Clin Epidemiol. 1991;44(12):1319–26.PubMedCrossRef
64.
Masse LC, Fulton JE, Watson KB, Tortolero S, Kohl HW 3rd, Meyers MC, et al. Comparing the validity of 2 physical activity questionnaire formats in African-American and Hispanic women. J Phys Act Health. 2012;9(2):237–48.PubMedCrossRef
65.
Ahn GE, Chmiel JS, Dunlop DD, Helenowski IB, Semanik PA, Song J, et al. Self-reported and objectively measured physical activity in adults with systemic lupus erythematosus. Arthritis Care Res (Hoboken). 2015;67(5):701–7.CrossRef
66.
Garriguet D, Tremblay S, Colley RC. Comparison of physical activity adult questionnaire results with accelerometer data. Health Rep. 2015;26(7):11–7.PubMed
67.
Ainsworth BE, Macera CA, Jones DA, Reis JP, Addy CL, Bowles HR, et al. Comparison of the 2001 BRFSS and the IPAQ physical activity questionnaires. Med Sci Sports Exerc. 2006;38(9):1584–92.PubMedCrossRef
68.
Moy KL, Scragg RK, McLean G, Carr H. The New Zealand physical activity questionnaires: validation by heart-rate monitoring in a multiethnic population. J Phys Act Health. 2008;5(Suppl 1):S45–61.PubMedCrossRef
69.
Dinger MK, Oman RF, Taylor EL, Vesely SK, Able J. Stability and convergent validity of the physical activity scale for the elderly (PASE). J Sports Med Phys Fitness. 2004;44(2):186–92.PubMed
70.
Johansen KL, Painter P, Kent-Braun JA, Ng AV, Carey S, Da Silva M, et al. Validation of questionnaires to estimate physical activity and functioning in end-stage renal disease. Kidney Int. 2001;59(3):1121–7.PubMedCrossRef
71.
Washburn RA, Smith KW, Jette AM, Janney CA. The physical activity scale for the elderly (PASE): development and evaluation. J Clin Epidemiol. 1993;46(2):153–62.PubMedCrossRef
72.
Pettee Gabriel K, McClain JJ, Schmid KK, Storti KL, Ainsworth BE. Reliability and convergent validity of the past-week modifiable activity questionnaire. Public Health Nutr. 2011;14(3):435–42.PubMedCrossRef
73.
Albanes D, Conway JM, Taylor PR, Moe PW, Judd J. Validation and comparison of eight physical activity questionnaires. Epidemiology (Cambridge, Mass). 1990;1(1):65–71.CrossRef
74.
Blair SN, Haskell WL, Ho P, Paffenbarger RS Jr, Vranizan KM, Farquhar JW, et al. Assessment of habitual physical activity by a seven-day recall in a community survey and controlled experiments. Am J Epidemiol. 1985;122(5):794–804.PubMedCrossRef
75.
Conway JM, Seale JL, Jacobs DR Jr, Irwin ML, Ainsworth BE. Comparison of energy expenditure estimates from doubly labeled water, a physical activity questionnaire, and physical activity records. Am J Clin Nutr. 2002;75(3):519–25.PubMedCrossRef
76.
Garfield BE, Canavan JL, Smith CJ, Ingram KA, Fowler RP, Clark AL, et al. Stanford seven-day physical activity recall questionnaire in COPD. Eur Respir J. 2012;40(2):356–62.PubMedCrossRef
77.
Gross LD, Sallis JF, Buono MJ, Roby JJ, Nelson JA. Reliability of interviewers using the seven-day physical activity recall. Res Q Exerc Sport. 1990;61(4):321–5.PubMedCrossRef
78.
Irwin ML, Ainsworth BE, Conway JM. Estimation of energy expenditure from physical activity measures: determinants of accuracy. Obes Res. 2001;9(9):517–25.PubMedCrossRef
79.
Sallis JF, Haskell WL, Wood PD, Fortmann SP, Rogers T, Blair SN, et al. Physical activity assessment methodology in the Five-City project. Am J Epidemiol. 1985;121(1):91–106.PubMedCrossRef
80.
Taylor CB, Coffey T, Berra K, Iaffaldano R, Casey K, Haskell WL. Seven-day activity and self-report compared to a direct measure of physical activity. Am J Epidemiol. 1984;120(6):818–24.PubMedCrossRef
81.
Washburn RA, Jacobsen DJ, Sonko BJ, Hill JO, Donnelly JE. The validity of the Stanford seven-day physical activity recall in young adults. Med Sci Sports Exerc. 2003;35(8):1374–80.PubMedCrossRef
82.
Williams E, Klesges RC, Hanson CL, Eck LH. A prospective study of the reliability and convergent validity of three physical activity measures in a field research trial. J Clin Epidemiol. 1989;42(12):1161–70.PubMedCrossRef
83.
Betz HH, Myers J, Jaffe A, Smith K, Dalman R. Reproducibility of the veterans physical activity questionnaire in an elderly population. J Phys Act Health. 2015;12(3):376–81.PubMedCrossRef
Metadata
Title
Comparison of psychometric properties between recall methods of interview-based physical activity questionnaires: a systematic review
Authors
Kenji Doma
Renée Speyer
Lauren Alese Parsons
Reinie Cordier
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0684-1

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue

Research article

Estimands to quantify prolonged hospital stay associated with nosocomial infections

Research article

Systematic mapping of existing tools to appraise methodological strengths and limitations of qualitative research: first stage in the development of the CAMELOT tool

Research article

Psychometric properties of the Chinese version of the spiritual care-giving scale (C-SCGS) in nursing practice

Research article

Prospective multicenter randomized patient recruitment and sample collection to enable future measurements of sputum biomarkers of inflammation in an observational study of cystic fibrosis

Technical advance

True and false positive rates for different criteria of evaluating statistical evidence from clinical trials

Research article

Quality in perinatal care: applying performance measurement using joint commission on accreditation of healthcare organizations indicators in Italy