Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2014

Open Access 01-12-2014 | Research article

Screening of the spine in adolescents: inter- and intra-rater reliability and measurement error of commonly used clinical tests

Authors: Ellen Aartun, Anna Degerfalk, Linn Kentsdotter, Lise Hestbaek

Published in: BMC Musculoskeletal Disorders | Issue 1/2014

Login to get access

Abstract

Background

Evidence on the reliability of clinical tests used for the spinal screening of children and adolescents is currently lacking. The aim of this study was to determine the inter- and intra-rater reliability and measurement error of clinical tests commonly used when screening young spines.

Methods

Two experienced chiropractors independently assessed 111 adolescents aged 12–14 years who were recruited from a primary school in Denmark. A standardised examination protocol was used to test inter-rater reliability including tests for scoliosis, hypermobility, general mobility, inter-segmental mobility and end range pain in the spine. Seventy-five of the 111 subjects were re-examined after one to four hours to test intra-rater reliability. Percentage agreement and Cohen’s Kappa were calculated for binary variables, and interclass correlation (ICC) and Bland-Altman plots with Limits of Agreement (LoA) were calculated for continuous measures.

Results

Inter-rater percentage agreement for binary data ranged from 59.5% to 100%. Kappa ranged from 0.06-1.00. Kappa ≥ 0.40 was seen for elbow, thumb, fifth finger and trunk/hip flexion hypermobility, pain response in inter-segmental mobility and end range pain in lumbar flexion and extension. For continuous data, ICCs ranged from 0.40-0.95. Only forward flexion as measured by finger-to-floor distance reached an acceptable ICC(≥ 0.75). Overall, results for intra-rater reliability were better than for inter-rater reliability but for both components, the LoA were quite wide compared with the range of assessments.

Conclusion

Some clinical tests showed good, and some tests poor, reliability when applied in a spinal screening of adolescents. The results could probably be improved by additional training and further test standardization. This is the first step in evaluating the value of these tests for the spinal screening of adolescents. Future research should determine the association between these tests and current and/or future neck and back pain.
Literature
1.
go back to reference Jeffries LJ, Milanese SF, Grimmer-Somers KA: Epidemiology of adolescent spinal pain: a systematic overview of the research literature. Spine. 2007, 32 (23): 2630-2637. 10.1097/BRS.0b013e318158d70b.CrossRefPubMed Jeffries LJ, Milanese SF, Grimmer-Somers KA: Epidemiology of adolescent spinal pain: a systematic overview of the research literature. Spine. 2007, 32 (23): 2630-2637. 10.1097/BRS.0b013e318158d70b.CrossRefPubMed
2.
go back to reference Leboeuf-Yde C, Kyvik KO: At what age does low back pain become a common problem? A study of 29,424 individuals aged 12–41 years. Spine. 1998, 23 (2): 228-234. 10.1097/00007632-199801150-00015.CrossRefPubMed Leboeuf-Yde C, Kyvik KO: At what age does low back pain become a common problem? A study of 29,424 individuals aged 12–41 years. Spine. 1998, 23 (2): 228-234. 10.1097/00007632-199801150-00015.CrossRefPubMed
3.
go back to reference Mikkelsson M, El-Metwally A, Kautiainen H, Auvinen A, Macfarlane GJ, Salminen JJ: Onset, prognosis and risk factors for widespread pain in schoolchildren: a prospective 4-year follow-up study. Pain. 2008, 138 (3): 681-687. 10.1016/j.pain.2008.06.005.CrossRefPubMed Mikkelsson M, El-Metwally A, Kautiainen H, Auvinen A, Macfarlane GJ, Salminen JJ: Onset, prognosis and risk factors for widespread pain in schoolchildren: a prospective 4-year follow-up study. Pain. 2008, 138 (3): 681-687. 10.1016/j.pain.2008.06.005.CrossRefPubMed
4.
go back to reference Stahl M, Kautiainen H, El-Metwally A, Hakkinen A, Ylinen J, Salminen JJ, Mikkelsson M: Non-specific neck pain in schoolchildren: prognosis and risk factors for occurrence and persistence: a 4-year follow-up study. Pain. 2008, 137 (2): 316-322. 10.1016/j.pain.2007.09.012.CrossRefPubMed Stahl M, Kautiainen H, El-Metwally A, Hakkinen A, Ylinen J, Salminen JJ, Mikkelsson M: Non-specific neck pain in schoolchildren: prognosis and risk factors for occurrence and persistence: a 4-year follow-up study. Pain. 2008, 137 (2): 316-322. 10.1016/j.pain.2007.09.012.CrossRefPubMed
5.
go back to reference Hestbaek L, Leboeuf-Yde C, Kyvik KO, Manniche C: The course of low back pain from adolescence to adulthood: eight-year follow-up of 9600 twins. Spine. 2006, 31 (4): 468-472. 10.1097/01.brs.0000199958.04073.d9.CrossRefPubMed Hestbaek L, Leboeuf-Yde C, Kyvik KO, Manniche C: The course of low back pain from adolescence to adulthood: eight-year follow-up of 9600 twins. Spine. 2006, 31 (4): 468-472. 10.1097/01.brs.0000199958.04073.d9.CrossRefPubMed
6.
go back to reference Martin BI, Deyo RA, Mirza SK, Turner JA, Comstock BA, Hollingworth W, Sullivan SD: Expenditures and health status among adults with back and neck problems. JAMA. 2008, 299 (6): 656-664. 10.1001/jama.299.6.656.CrossRefPubMed Martin BI, Deyo RA, Mirza SK, Turner JA, Comstock BA, Hollingworth W, Sullivan SD: Expenditures and health status among adults with back and neck problems. JAMA. 2008, 299 (6): 656-664. 10.1001/jama.299.6.656.CrossRefPubMed
7.
go back to reference Maniadakis N, Gray A: The economic burden of back pain in the UK. Pain. 2000, 84 (1): 95-103. 10.1016/S0304-3959(99)00187-6.CrossRefPubMed Maniadakis N, Gray A: The economic burden of back pain in the UK. Pain. 2000, 84 (1): 95-103. 10.1016/S0304-3959(99)00187-6.CrossRefPubMed
8.
go back to reference Hootman JM, Macera CA, Ainsworth BE, Addy CL, Martin M, Blair SN: Epidemiology of musculoskeletal injuries among sedentary and physically active adults. Med Sci Sports Exerc. 2002, 34 (5): 838-844. 10.1097/00005768-200205000-00017.CrossRefPubMed Hootman JM, Macera CA, Ainsworth BE, Addy CL, Martin M, Blair SN: Epidemiology of musculoskeletal injuries among sedentary and physically active adults. Med Sci Sports Exerc. 2002, 34 (5): 838-844. 10.1097/00005768-200205000-00017.CrossRefPubMed
9.
go back to reference Hestbaek L, Leboeuf-Yde C, Manniche C: Low back pain: what is the long-term course? A review of studies of general patient populations. Eur Spine J. 2003, 12 (2): 149-165.PubMedPubMedCentral Hestbaek L, Leboeuf-Yde C, Manniche C: Low back pain: what is the long-term course? A review of studies of general patient populations. Eur Spine J. 2003, 12 (2): 149-165.PubMedPubMedCentral
10.
go back to reference Cote P, Kreitz BG, Cassidy JD, Dzus AK, Martel J: A study of the diagnostic accuracy and reliability of the Scoliometer and Adam’s forward bend test. Spine (Phila Pa 1976). 1998, 23 (7): 796-802. 10.1097/00007632-199804010-00011. discussion 803CrossRef Cote P, Kreitz BG, Cassidy JD, Dzus AK, Martel J: A study of the diagnostic accuracy and reliability of the Scoliometer and Adam’s forward bend test. Spine (Phila Pa 1976). 1998, 23 (7): 796-802. 10.1097/00007632-199804010-00011. discussion 803CrossRef
11.
go back to reference Karim A, Millet V, Massie K, Olson S, Morganthaler A: Inter-rater reliability of a musculoskeletal screen as administered to female professional contemporary dancers. Work. 2011, 40 (3): 281-288.PubMed Karim A, Millet V, Massie K, Olson S, Morganthaler A: Inter-rater reliability of a musculoskeletal screen as administered to female professional contemporary dancers. Work. 2011, 40 (3): 281-288.PubMed
12.
go back to reference Hirsch C, Hirsch M, John MT, Bock JJ: Reliability of the Beighton Hypermobility Index to determinate the general joint laxity performed by dentists. J Orofac Orthop. 2007, 68 (5): 342-352. 10.1007/s00056-007-0708-z.CrossRefPubMed Hirsch C, Hirsch M, John MT, Bock JJ: Reliability of the Beighton Hypermobility Index to determinate the general joint laxity performed by dentists. J Orofac Orthop. 2007, 68 (5): 342-352. 10.1007/s00056-007-0708-z.CrossRefPubMed
13.
go back to reference Boyle KL, Witt P, Riegger-Krugh C: Intrarater and interrater reliability of the beighton and horan joint mobility index. J Athl Train. 2003, 38 (4): 281-285.PubMedPubMedCentral Boyle KL, Witt P, Riegger-Krugh C: Intrarater and interrater reliability of the beighton and horan joint mobility index. J Athl Train. 2003, 38 (4): 281-285.PubMedPubMedCentral
14.
go back to reference Juul-Kristensen B, Rogind H, Jensen DV, Remvig L: Inter-examiner reproducibility of tests and criteria for generalized joint hypermobility and benign joint hypermobility syndrome. Rheumatology (Oxford). 2007, 46 (12): 1835-1841. 10.1093/rheumatology/kem290.CrossRef Juul-Kristensen B, Rogind H, Jensen DV, Remvig L: Inter-examiner reproducibility of tests and criteria for generalized joint hypermobility and benign joint hypermobility syndrome. Rheumatology (Oxford). 2007, 46 (12): 1835-1841. 10.1093/rheumatology/kem290.CrossRef
15.
go back to reference Perret C, Poiraudeau S, Fermanian J, Colau MM, Benhamou MA, Revel M: Validity, reliability, and responsiveness of the fingertip-to-floor test. Arch Phys Med Rehabil. 2001, 82 (11): 1566-1570. 10.1053/apmr.2001.26064.CrossRefPubMed Perret C, Poiraudeau S, Fermanian J, Colau MM, Benhamou MA, Revel M: Validity, reliability, and responsiveness of the fingertip-to-floor test. Arch Phys Med Rehabil. 2001, 82 (11): 1566-1570. 10.1053/apmr.2001.26064.CrossRefPubMed
16.
go back to reference Viitanen JV, Heikkila S, Kokko ML, Kautiainen H: Clinical assessment of spinal mobility measurements in ankylosing spondylitis: a compact set for follow-up and trials?. Clin Rheumatol. 2000, 19 (2): 131-137. 10.1007/s100670050031.CrossRefPubMed Viitanen JV, Heikkila S, Kokko ML, Kautiainen H: Clinical assessment of spinal mobility measurements in ankylosing spondylitis: a compact set for follow-up and trials?. Clin Rheumatol. 2000, 19 (2): 131-137. 10.1007/s100670050031.CrossRefPubMed
17.
go back to reference Frost M, Stuckey S, Smalley LA, Dorman G: Reliability of measuring trunk motions in centimeters. Phys Ther. 1982, 62 (10): 1431-1437.PubMed Frost M, Stuckey S, Smalley LA, Dorman G: Reliability of measuring trunk motions in centimeters. Phys Ther. 1982, 62 (10): 1431-1437.PubMed
18.
go back to reference Hyytiainen K, Salminen JJ, Suvitie T, Wickstrom G, Pentti J: Reproducibility of nine tests to measure spinal mobility and trunk muscle strength. Scand J Rehabil Med. 1991, 23 (1): 3-10.PubMed Hyytiainen K, Salminen JJ, Suvitie T, Wickstrom G, Pentti J: Reproducibility of nine tests to measure spinal mobility and trunk muscle strength. Scand J Rehabil Med. 1991, 23 (1): 3-10.PubMed
19.
go back to reference Stochkendahl MJ, Christensen HW, Hartvigsen J, Vach W, Haas M, Hestbaek L, Adams A, Bronfort G: Manual examination of the spine: a systematic critical literature review of reproducibility. J Manip Physiol Ther. 2006, 29 (6): 475-485. 10.1016/j.jmpt.2006.06.011. 485 e471-410CrossRef Stochkendahl MJ, Christensen HW, Hartvigsen J, Vach W, Haas M, Hestbaek L, Adams A, Bronfort G: Manual examination of the spine: a systematic critical literature review of reproducibility. J Manip Physiol Ther. 2006, 29 (6): 475-485. 10.1016/j.jmpt.2006.06.011. 485 e471-410CrossRef
20.
go back to reference Pool JJ, Hoving JL, de Vet HC, van Mameren H, Bouter LM: The interexaminer reproducibility of physical examination of the cervical spine. J Manip Physiol Ther. 2004, 27 (2): 84-90. 10.1016/j.jmpt.2003.12.002.CrossRef Pool JJ, Hoving JL, de Vet HC, van Mameren H, Bouter LM: The interexaminer reproducibility of physical examination of the cervical spine. J Manip Physiol Ther. 2004, 27 (2): 84-90. 10.1016/j.jmpt.2003.12.002.CrossRef
21.
go back to reference Vach W: The dependence of Cohen’s kappa on the prevalence does not matter. J Clin Epidemiol. 2005, 58 (7): 655-661. 10.1016/j.jclinepi.2004.02.021.CrossRefPubMed Vach W: The dependence of Cohen’s kappa on the prevalence does not matter. J Clin Epidemiol. 2005, 58 (7): 655-661. 10.1016/j.jclinepi.2004.02.021.CrossRefPubMed
22.
23.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010, 63 (7): 737-745. 10.1016/j.jclinepi.2010.02.006.CrossRefPubMed Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010, 63 (7): 737-745. 10.1016/j.jclinepi.2010.02.006.CrossRefPubMed
24.
go back to reference Cohen J: Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968, 70 (4): 213-220.CrossRefPubMed Cohen J: Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull. 1968, 70 (4): 213-220.CrossRefPubMed
25.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33 (1): 159-174. 10.2307/2529310.CrossRefPubMed
26.
go back to reference Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979, 86 (2): 420-428.CrossRefPubMed
27.
go back to reference Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.CrossRefPubMed Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.CrossRefPubMed
28.
go back to reference Remvig L, Jensen DV, Ward RC: Epidemiology of general joint hypermobility and basis for the proposed criteria for benign joint hypermobility syndrome: review of the literature. J Rheumatol. 2007, 34 (4): 804-809.PubMed Remvig L, Jensen DV, Ward RC: Epidemiology of general joint hypermobility and basis for the proposed criteria for benign joint hypermobility syndrome: review of the literature. J Rheumatol. 2007, 34 (4): 804-809.PubMed
29.
go back to reference Portney LG, Watkins M: Foundation of clinical research: applications to practice. 2009, Upper Saddle River, NJ: Pearson Education, Inc., 3 Portney LG, Watkins M: Foundation of clinical research: applications to practice. 2009, Upper Saddle River, NJ: Pearson Education, Inc., 3
30.
go back to reference van Trijffel E, Anderegg Q, Bossuyt PM, Lucas C: Inter-examiner reliability of passive assessment of intervertebral motion in the cervical and lumbar spine: a systematic review. Man Ther. 2005, 10 (4): 256-269. 10.1016/j.math.2005.04.008.CrossRefPubMed van Trijffel E, Anderegg Q, Bossuyt PM, Lucas C: Inter-examiner reliability of passive assessment of intervertebral motion in the cervical and lumbar spine: a systematic review. Man Ther. 2005, 10 (4): 256-269. 10.1016/j.math.2005.04.008.CrossRefPubMed
32.
go back to reference Muller R, Buttner P: A critical discussion of intraclass correlation coefficients. Stat Med. 1994, 13 (23–24): 2465-2476.CrossRefPubMed Muller R, Buttner P: A critical discussion of intraclass correlation coefficients. Stat Med. 1994, 13 (23–24): 2465-2476.CrossRefPubMed
33.
go back to reference Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG: Calibration of two objective measures of physical activity for children. J Sports Sci. 2008, 26 (14): 1557-1565. 10.1080/02640410802334196.CrossRefPubMed Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG: Calibration of two objective measures of physical activity for children. J Sports Sci. 2008, 26 (14): 1557-1565. 10.1080/02640410802334196.CrossRefPubMed
Metadata
Title
Screening of the spine in adolescents: inter- and intra-rater reliability and measurement error of commonly used clinical tests
Authors
Ellen Aartun
Anna Degerfalk
Linn Kentsdotter
Lise Hestbaek
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2014
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-15-37

Other articles of this Issue 1/2014

BMC Musculoskeletal Disorders 1/2014 Go to the issue