Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
BMC Musculoskeletal Disorders
Published in: BMC Musculoskeletal Disorders 1/2016

Open Access 01-12-2016 | Research article

The use of self-report questions to examine the prevalence of musculoskeletal problems: a test-retest study

Authors: Tiffany K. Gill, Graeme R. Tucker, Jodie C. Avery, E. Michael Shanahan, Hylton B. Menz, Anne W. Taylor, Robert J. Adams, Catherine L. Hill

Published in: BMC Musculoskeletal Disorders | Issue 1/2016

Login to get access

Abstract

Background

Case definition has long been an issue for comparability of results obtained for musculoskeletal pain prevalence, however the test-retest reliability of questions used to determine joint pain prevalence has not been examined. The objective of this study was to determine question reliability and the impact of question wording, ordering and the time between questions on responses.

Methods

A Computer Assisted Telephone Interviewing (CATI) survey was used to re-administer questions collected as part of a population-based longitudinal cohort study. On two different occasions questions were asked of the same sample of 203 community dwelling respondents (which were initially randomly selected) aged 18 years and over at two time points 14 to 27 days apart (average 15 days). Reliability of the questions was assessed using Cohen’s kappa (κ) and intraclass correlation coefficient (ICC) and whether question wording and period effects existed was assessed using a crossover design.

Results

The self-reported prevalence of doctor diagnosed arthritis demonstrated excellent reliability (κ = 0.84 and κ = 0.79 for questionnaires 1 and 2 respectively). The reliability of questions relating to musculoskeletal pain and/or stiffness ranged from moderate to excellent for both types of questions, that is, those related to ever having joint pain on most days for at least a month (κ = 0.52 to κ = 0.95) and having pain and/or stiffness on most days for the last month (κ = 0.52 to κ = 0.90). However there was an effect of question wording on the results obtained for hand, foot and back pain and/or stiffness indicating that the area of pain may influence prevalence estimates.

Conclusions

Joint pain and stiffness questions are reliable and can be used to determine prevalence. However, question wording and pain area may impact on estimates with issues such as pain perception and effect on activities playing a possible role in the recall of musculoskeletal pain.
Literature
1.
Cross M, Smith E, Hoy D, Carmona L, Wolfe F, Vos T, et al. The global burden of rheumatoid arthritis: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:1316–22.CrossRefPubMed
2.
Cross M, Smith E, Hoy D, Nolte S, Ackerman I, Fransen M, et al. The global burden of hip and knee osteoarthritis: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:1323–30.CrossRefPubMed
3.
Hoy D, March L, Brooks P, Blyth F, Woolf A, Bain C, et al. The global burden of low back pain: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:968–74.CrossRefPubMed
4.
Hoy D, March L, Woolf A, Blyth F, Brooks P, Smith E, et al. The global burden of neck pain: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:1309–15.CrossRefPubMed
5.
Sànchez-Riera L, Carnahan E, Vos T, Veerman L, Norman R, Lim SS, et al. Global burden attributable to low bone mineral density. Ann Rheum Dis. 2014;73:1635–45.CrossRefPubMed
6.
Smith E, Hoy D, Cross M, Merriman TR, Vos T, Buchbinder R, et al. The global burden of gout: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:1470–6.CrossRefPubMed
7.
Smith E, Hoy DG, Cross M, Vos T, Naghavi M, Buchbinder R, et al. The global burden of other musculoskeletal disorders: estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73:1462–9.CrossRefPubMed
8.
Hoy D, Smith E, Cross M, Sànchez-Riera L, Blyth F, Buchbinder R, et al. Reflecting on the global burden of musculoskeletal conditions: lessons learnt from the Global Burden of Disease 2010 Study and the next steps forward. Ann Rheum Dis. 2015;74:4–7.CrossRefPubMed
9.
10.
Bombard J, Powell K, Martin L, Helmick C, Wilson W. Validity and reliability of self-reported arthritis. Georgia Seniors Centers, 2000–2001. Am J Prev Med. 2005;28:251–8.CrossRefPubMed
11.
Pescatore AM, Spycher BD, Beardsmore CS, Kuehni CE. “Attacks” or “Whistling”: Impact of questionnaire wording on wheeze prevalence estimates. PLoS ONE. 2015;10, e0131618.PubMedCentralCrossRefPubMed
12.
Hoy D, Bain C, Williams G, March L, Brooks P, Blyth F, et al. A systematic review of the global prevalence of low back pain. Arthritis Rheum. 2012;64:2028–37.CrossRefPubMed
13.
Rowen D, Brazier J, Keetharuth A, Tsuchiya A, Mukuria C. Comparison of modes of administration and alternative formats for eliciting societal preferences for burden of illness. Appl Health Econ Health Policy. 2016;36:210–22.
14.
Feveile H, Olsen O, Hogh A. A randomized trial of mailed questionnaires versus telephone interviews: Response patterns in a survey. BMC Med Res Methodol. 2007;7:27.PubMedCentralCrossRefPubMed
15.
Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005;27:281–91.CrossRef
16.
Broering JM, Paciorek A, Carroll PR, Wilson LS, Litwin MS, Miaskowski C. Measurement equivalence using a mixed-mode approach to administer health-related quality of life measurements. Qual Life Res. 2014;23:495–508.CrossRefPubMed
17.
van den Hoven LHJ, Gorter KJ, Picavet HSJ. Measuring musculoskeletal pain by questionnaires: The manikin versus written questionnaires. Eur J Pain. 2010;14:335–8.CrossRefPubMed
18.
Shea S, Stein AD, Lantigua R, Basch CE. Reliability of the behavioral risk factor survey in a triethnic population. Am Journal Epidemiol. 1991;133:489–500.
19.
Dziedzic KS, Thomas E, Myers H, Hill S, Hay EM. The Australian/Canadian osteoarthritis hand index in a community-dwelling population of older adults: reliability and validity. Arthritis Rheum. 2007;57:423–8.CrossRefPubMed
20.
Lavrakas P. Encyclopedia of Survey Research. Thousand Oaks: SAGE Publications; 2008.CrossRef
21.
Andresen EM, Catlin TK, Wyrwich KW, Jackson-Thompson J. Retest reliability of surveillance questions on health related quality of life. J Epidemiol Community Health. 2003;57:339–43.PubMedCentralCrossRefPubMed
22.
Brownson RC, Jackson-Thompson J, Wilkerson JC, Kiani F. Reliability of information on chronic disease risk factors collected in the Missouri Behavioral Risk Factor Surveillance System. Epidemiology. 1994;5:545–9.PubMed
23.
Stein AD, Courval JM, Lederman RI, Shea S. Reproducibility of responses to telephone interviews: demographic predictors of discordance in risk factor status. Am J Epidemiol. 1995;141:1097–105.PubMed
24.
Stein AD, Lederman RI, Shea S. The Behavioral Risk Factor Surveillance System questionnaire: its reliability in a statewide sample. Am J Public Health. 1993;83:1768–72.PubMedCentralCrossRefPubMed
25.
Stein AD, Lederman RI, Shea S. Reproducibility of the women's module of the Behavioral Risk Factor Surveillance System questionnaire. Ann Epidemiol. 1996;6:47–52.CrossRefPubMed
26.
Dal Grande E, Fullerton S, Taylor AW. Reliability of self-reported health risk factors and chronic conditions questions collected using the telephone in South Australia, Australia. BMC Med Res Methodol. 2012;12:108.PubMedCentralCrossRefPubMed
27.
Balogh I, Orbaek P, Winkel J, Nordander C, Ohlsson K, Ektor-Andersen J. Questionnaire-based mechanical exposure indices for large population studies--reliability, internal consistency and predictive validity. Scand J Work Environ Health. 2001;27:41–8.CrossRefPubMed
28.
Haldorsen B, Svege I, Roe Y, Bergland A. Reliability and validity of the Norwegian version of the Disabilities of the Arm, Shoulder and Hand questionnaire in patients with shoulder impingement syndrome. BMC Musculoskelet Disord. 2014;15:78.PubMedCentralCrossRefPubMed
29.
Harris KK, Dawson J, Jones LD, Beard DJ, Price AJ. Extending the use of PROMs in the NHS--using the Oxford Knee Score in patients undergoing non-operative management for knee osteoarthritis: a validation study. BMJ Open. 2013;3, e003365.PubMedCentralPubMed
30.
Walker-Bone K, Palmer KT, Reading I, Coggon D, Cooper C. Prevalence and impact of musculoskeletal disorders of the upper limb in the general population. Arthritis Rheum. 2004;51:642–51.CrossRefPubMed
31.
Palmer K. Regional musculoskeletal conditions. Pain in the forearm, wrist and hand. Best Pract Res Clin Rheumatol. 2003;17:113–35.CrossRefPubMed
32.
Christmas C, Crespo C, Franckowiak S, Bathon J, Bartlett S, Andersen R. How common is hip pain among older adults? Results from the Third National Health and Nutrition Examination Survey. J Fam Pract. 2002;51:345–8.PubMed
33.
Dawson J, Linsell L, Zondervan K, Rose P, Randall T, Carr A, et al. Epidemiology of hip and knee pain and its impact on overall health status in older adults. Rheumatology. 2004;43:497–504.CrossRefPubMed
34.
Theim U, Lamsfuß R, Günther S, Schumacher J, Bäjer C, Endres HG, et al. Prevalence of self-reported pain, joint complaints and knee or hip complaints in adults aged ≥ 40 years: A cross-sectional survey in Herne, Germany. PLoS One. 2013;8, e60753.CrossRef
35.
Chen J, Devine A, Dick I, Dhaliwal S, Prince R. Prevalence of lower extremity pain and its association with functionality and quality of life and elderly women in Australia. J Rheumatol. 2003;30:2689–93.PubMed
36.
Suka M, Yoshida K. Musculoskeletal pain in Japan: prevalence and interference with daily activities. Mod Rheumatol. 2005;15:41–7.CrossRefPubMed
37.
Palacios-Ceña D, Alonso-Blanco C, Hernández-Barrera V, Carrasco-Garrido P, Jiménez-García R, Fernández-de-las-Peñas C. Prevalence of neck and low back pain in community-dwelling adults in Spain: an updated population-base national study (2009/10-2011/12). Eur Spine J. 2015;24:481–92.CrossRef
38.
39.
Grant JF, Taylor AW, Ruffin RE, Wilson DH, Phillips PJ, Adams RJ, et al. Cohort profile: The North West Adelaide Health Study (NWAHS). Int J Epidemiol. 2009;38:1479–86.CrossRefPubMed
40.
Grant JF, Chittleborough CR, Taylor AW, Dal Grande E, Wilson DH, Phillips PJ, et al. The North West Adelaide Health Study: detailed methods and baseline segmentation of a cohort for selected chronic diseases. Epidemiol Perspect Innov. 2006;3:4.PubMedCentralCrossRefPubMed
41.
Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–91.CrossRefPubMed
42.
Altman DG. Practical Statistics for Medical Research. London: Chapman & Hall; 1991.
43.
Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef
44.
Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.CrossRef
45.
StataCorp LP. STATA Base Reference Manual. Release 13. College Station, Texas: Stata Press; 2013.
46.
Hoy D, Brooks P, Blyth F, Buchbinder R. The epidemiology of low back pain. Best Pract Res Clin Rheumatol. 2010;24:769–81.CrossRefPubMed
47.
Hill CL, Gill TK, Menz HB, Taylor AW. Prevalence and correlates of foot pain in a population-based study. The North West Adelaide Health Study. J Foot Ankle Res. 2008;1:2.PubMedCentralCrossRefPubMed
48.
Hill CL, Gill TK, Shanahan EM, Taylor AW. Prevalence and correlates of shoulder pain and stiffness in a population-based study: the North West Adelaide Health Study. Int J Rheum Dis. 2010;13:215–22.CrossRefPubMed
49.
Gill TK, Shanahan EM, Taylor AW, Buchbinder R, Hill CL. Shoulder pain in the community: and examination of associative factors using a longitudinal cohort study. Arthritis Care Res. 2013;65:2000–7.CrossRef
50.
Cole A, Gill TK, Taylor AW, Hill CL. Prevalence and associations of hand pain in the community: results from a population-based study. Scand J Rheumatol. 2011;40:145–9.CrossRefPubMed
Metadata
Title
The use of self-report questions to examine the prevalence of musculoskeletal problems: a test-retest study
Authors
Tiffany K. Gill
Graeme R. Tucker
Jodie C. Avery
E. Michael Shanahan
Hylton B. Menz
Anne W. Taylor
Robert J. Adams
Catherine L. Hill
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2016
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/s12891-016-0946-6

Other articles of this Issue 1/2016

BMC Musculoskeletal Disorders 1/2016 Go to the issue

Research article

Perceived quality of physiotherapist-led orthopaedic triage compared with standard practice in primary care: a randomised controlled trial

Research article

Effect of platelet mediator concentrate (PMC) on Achilles tenocytes: an in vitro study

Research article

Clinical results of endoscopic sciatic nerve decompression for deep gluteal syndrome: mean 2-year follow-up

Research article

Physical therapists’ assessments, analyses and use of behavior change techniques in initial consultations on musculoskeletal pain: direct observations in primary health care

Research article

Quality of life following hip fractures: results from the Norwegian hip fracture register

Research article

Treatment of lumbosacral spinal tuberculosis by one-stage anterior debridement and fusion combined with dual screw-rod anterior instrumentation underneath the iliac vessel