Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2012

Open Access 01-12-2012 | Research article

Inter- and intra-observer reliability of clinical movement-control tests for marines

Authors: Andreas Monnier, Joachim Heuer, Kjell Norman, Björn O Äng

Published in: BMC Musculoskeletal Disorders | Issue 1/2012

Login to get access

Abstract

Background

Musculoskeletal disorders particularly in the back and lower extremities are common among marines. Here, movement-control tests are considered clinically useful for screening and follow-up evaluation. However, few studies have addressed the reliability of clinical tests, and no such published data exists for marines. The present aim was therefore to determine the inter- and intra-observer reliability of clinically convenient tests emphasizing movement control of the back and hip among marines. A secondary aim was to investigate the sensitivity and specificity of these clinical tests for discriminating musculoskeletal pain disorders in this group of military personnel.

Methods

This inter- and intra-observer reliability study used a test-retest approach with six standardized clinical tests focusing on movement control for back and hip. Thirty-three marines (age 28.7 yrs, SD 5.9) on active duty volunteered and were recruited. They followed an in-vivo observation test procedure that covered both low- and high-load (threshold) tasks relevant for marines on operational duty. Two independent observers simultaneously rated performance as “correct” or “incorrect” following a standardized assessment protocol. Re-testing followed 7–10 days thereafter. Reliability was analysed using kappa (κ) coefficients, while discriminative power of the best-fitting tests for back- and lower-extremity pain was assessed using a multiple-variable regression model.

Results

Inter-observer reliability for the six tests was moderate to almost perfect with κ-coefficients ranging between 0.56-0.95. Three tests reached almost perfect inter-observer reliability with mean κ-coefficients > 0.81. However, intra-observer reliability was fair-to-moderate with mean κ-coefficients between 0.22-0.58. Three tests achieved moderate intra-observer reliability with κ-coefficients > 0.41. Combinations of one low- and one high-threshold test best discriminated prior back pain, but results were inconsistent for lower-extremity pain.

Conclusions

Our results suggest that clinical tests of movement control of back and hip are reliable for use in screening protocols using several observers with marines. However, test-retest reproducibility was less accurate, which should be considered in follow-up evaluations. The results also indicate that combinations of low- and high-threshold tests have discriminative validity for prior back pain, but were inconclusive for lower-extremity pain.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kaufman KR, Brodine S, Shaffer R: Military training-related injuries: surveillance, research, and prevention. Am J Prev Med. 2000, 18: 54-63.CrossRefPubMed Kaufman KR, Brodine S, Shaffer R: Military training-related injuries: surveillance, research, and prevention. Am J Prev Med. 2000, 18: 54-63.CrossRefPubMed
2.
go back to reference Riddell D: Changes in the incidence of medical conditions at the commando training centre, royal marines. J R Nav Med Serv. 1990, 76: 105-PubMed Riddell D: Changes in the incidence of medical conditions at the commando training centre, royal marines. J R Nav Med Serv. 1990, 76: 105-PubMed
3.
go back to reference Linenger J, West L: Epidemiology of soft-tissue/musculoskeletal injury among US marine recruits undergoing basic training. Mil Med. 1992, 157: 491-PubMed Linenger J, West L: Epidemiology of soft-tissue/musculoskeletal injury among US marine recruits undergoing basic training. Mil Med. 1992, 157: 491-PubMed
4.
go back to reference Hayton J: Reducing medical downgrading in a high readiness royal marine unit. JR Army Med Corps. 2004, 150: 164-167.CrossRef Hayton J: Reducing medical downgrading in a high readiness royal marine unit. JR Army Med Corps. 2004, 150: 164-167.CrossRef
5.
go back to reference Skeehan CD, Tribble DR, Sanders JW, Putnam SD, Armstrong AW, Riddle MS: Nonbattle injury among deployed troops: an epidemiologic study. Mil Med. 2009, 174: 1256-1262.CrossRefPubMed Skeehan CD, Tribble DR, Sanders JW, Putnam SD, Armstrong AW, Riddle MS: Nonbattle injury among deployed troops: an epidemiologic study. Mil Med. 2009, 174: 1256-1262.CrossRefPubMed
6.
go back to reference Lincoln AE, Smith GS, Amoroso PJ, Bell NS: The natural history and risk factors of musculoskeletal conditions resulting in disability among US army personnel. Work. 2002, 18: 99-113.PubMedPubMedCentral Lincoln AE, Smith GS, Amoroso PJ, Bell NS: The natural history and risk factors of musculoskeletal conditions resulting in disability among US army personnel. Work. 2002, 18: 99-113.PubMedPubMedCentral
7.
go back to reference Larsson H, Broman L, Harms-Ringdahl K: Individual risk factors associated with premature discharge from military service. Mil Med. 2009, 174: 9-20.CrossRefPubMed Larsson H, Broman L, Harms-Ringdahl K: Individual risk factors associated with premature discharge from military service. Mil Med. 2009, 174: 9-20.CrossRefPubMed
8.
go back to reference Larsson H, Larsson M, Sterberg H, Harms-Ringdahl K: Screening tests detect knee pain and predict discharge from military service. Mil Med. 2008, 173: 259-265.CrossRefPubMed Larsson H, Larsson M, Sterberg H, Harms-Ringdahl K: Screening tests detect knee pain and predict discharge from military service. Mil Med. 2008, 173: 259-265.CrossRefPubMed
9.
go back to reference Belmont PJ, Goodman GP, Waterman B, DeZee K, Burks R, Owens BD: Disease and nonbattle injuries sustained by a US army brigade combat team during operation iraqi freedom. Mil Med. 2010, 175: 469-476.CrossRefPubMed Belmont PJ, Goodman GP, Waterman B, DeZee K, Burks R, Owens BD: Disease and nonbattle injuries sustained by a US army brigade combat team during operation iraqi freedom. Mil Med. 2010, 175: 469-476.CrossRefPubMed
10.
go back to reference Cohen SP, Brown C, Kurihara C, Plunkett A, Nguyen C, Strassels SA: Diagnoses and factors associated with medical evacuation and return to duty for service members participating in operation Iraqi freedom or operation enduring freedom: a prospective cohort study. Lancet. 2010, 375: 301-309. 10.1016/S0140-6736(09)61797-9.CrossRefPubMed Cohen SP, Brown C, Kurihara C, Plunkett A, Nguyen C, Strassels SA: Diagnoses and factors associated with medical evacuation and return to duty for service members participating in operation Iraqi freedom or operation enduring freedom: a prospective cohort study. Lancet. 2010, 375: 301-309. 10.1016/S0140-6736(09)61797-9.CrossRefPubMed
11.
go back to reference Hodges PW, Richardson CA: Inefficient muscular stabilization of the lumbar spine associated with low back pain: a motor control evaluation of transversus abdominis. Spine. 1996, 21: 2640-10.1097/00007632-199611150-00014.CrossRefPubMed Hodges PW, Richardson CA: Inefficient muscular stabilization of the lumbar spine associated with low back pain: a motor control evaluation of transversus abdominis. Spine. 1996, 21: 2640-10.1097/00007632-199611150-00014.CrossRefPubMed
12.
go back to reference Luomajoki H, Kool J, de Bruin ED, Airaksinen O: Movement control tests of the low back; evaluation of the difference between patients with low back pain and healthy controls. BMC Musculoskelet Disord. 2008, 9: 170-10.1186/1471-2474-9-170.CrossRefPubMedPubMedCentral Luomajoki H, Kool J, de Bruin ED, Airaksinen O: Movement control tests of the low back; evaluation of the difference between patients with low back pain and healthy controls. BMC Musculoskelet Disord. 2008, 9: 170-10.1186/1471-2474-9-170.CrossRefPubMedPubMedCentral
13.
go back to reference Moseley GL, Hodges PW: Reduced variability of postural strategy prevents normalization of motor changes induced by back pain: a risk factor for chronic trouble?. Behav Neurosci. 2006, 120: 474-476.CrossRefPubMed Moseley GL, Hodges PW: Reduced variability of postural strategy prevents normalization of motor changes induced by back pain: a risk factor for chronic trouble?. Behav Neurosci. 2006, 120: 474-476.CrossRefPubMed
14.
go back to reference Enoch F, Kjaer P, Elkjaer A, Remvig L, Juul-Kristensen B: Inter-examiner reproducibility of tests for lumbar motor control. BMC Musculoskelet Disord. 2011, 12: 114-10.1186/1471-2474-12-114.CrossRefPubMedPubMedCentral Enoch F, Kjaer P, Elkjaer A, Remvig L, Juul-Kristensen B: Inter-examiner reproducibility of tests for lumbar motor control. BMC Musculoskelet Disord. 2011, 12: 114-10.1186/1471-2474-12-114.CrossRefPubMedPubMedCentral
15.
go back to reference Roussel NA, Nijs J, Mottram S, Van Moorsel A, Truijen S, Stassijns G: Altered lumbopelvic movement control but not generalized joint hypermobility is associated with increased injury in dancers. A prospective study. Man Ther. 2009, 14: 630-635. 10.1016/j.math.2008.12.004.CrossRefPubMed Roussel NA, Nijs J, Mottram S, Van Moorsel A, Truijen S, Stassijns G: Altered lumbopelvic movement control but not generalized joint hypermobility is associated with increased injury in dancers. A prospective study. Man Ther. 2009, 14: 630-635. 10.1016/j.math.2008.12.004.CrossRefPubMed
16.
go back to reference Roussel N, Nijs J, Truijen S, Vervecken L, Mottram S, Stassijns G: Altered breathing patterns during lumbopelvic motor control tests in chronic low back pain: a case–control study. Eur Spine J. 2009, 18: 1066-1073. 10.1007/s00586-009-1020-y.CrossRefPubMedPubMedCentral Roussel N, Nijs J, Truijen S, Vervecken L, Mottram S, Stassijns G: Altered breathing patterns during lumbopelvic motor control tests in chronic low back pain: a case–control study. Eur Spine J. 2009, 18: 1066-1073. 10.1007/s00586-009-1020-y.CrossRefPubMedPubMedCentral
17.
go back to reference Mottram S, Comerford M: A new perspective on risk assessment. Phys Ther Sport. 2008, 9: 40-51. 10.1016/j.ptsp.2007.11.003.CrossRefPubMed Mottram S, Comerford M: A new perspective on risk assessment. Phys Ther Sport. 2008, 9: 40-51. 10.1016/j.ptsp.2007.11.003.CrossRefPubMed
18.
go back to reference Stephens J, Usherwood T: The mechanical properties of human motor units with special reference to their fatiguability and recruitment threshold. Brain Res. 1977, 125: 91-97. 10.1016/0006-8993(77)90361-4.CrossRefPubMed Stephens J, Usherwood T: The mechanical properties of human motor units with special reference to their fatiguability and recruitment threshold. Brain Res. 1977, 125: 91-97. 10.1016/0006-8993(77)90361-4.CrossRefPubMed
19.
go back to reference Sim J, Wright CC: The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005, 85: 257-PubMed Sim J, Wright CC: The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005, 85: 257-PubMed
20.
go back to reference Bruton A, Conway J, Holgate S: Reliability: what is it, and how is it measured?. Physiotherapy. 2000, 86: 94-99. 10.1016/S0031-9406(05)61211-4.CrossRef Bruton A, Conway J, Holgate S: Reliability: what is it, and how is it measured?. Physiotherapy. 2000, 86: 94-99. 10.1016/S0031-9406(05)61211-4.CrossRef
21.
go back to reference Luomajoki H, Kool J, de Bruin ED, Airaksinen O: Reliability of movement control tests in the lumbar spine. BMC Musculoskelet Disord. 2007, 8: 90-10.1186/1471-2474-8-90.CrossRefPubMedPubMedCentral Luomajoki H, Kool J, de Bruin ED, Airaksinen O: Reliability of movement control tests in the lumbar spine. BMC Musculoskelet Disord. 2007, 8: 90-10.1186/1471-2474-8-90.CrossRefPubMedPubMedCentral
22.
go back to reference Murphy D, Byfield D, McCarthy P, Humphreys K, Gregory A, Rochon R: Interexaminer reliability of the Hip extension test for suspected impaired motor control of the lumbar spine. J Manipulative Physiol Ther. 2006, 29: 374-377. 10.1016/j.jmpt.2006.04.012.CrossRefPubMed Murphy D, Byfield D, McCarthy P, Humphreys K, Gregory A, Rochon R: Interexaminer reliability of the Hip extension test for suspected impaired motor control of the lumbar spine. J Manipulative Physiol Ther. 2006, 29: 374-377. 10.1016/j.jmpt.2006.04.012.CrossRefPubMed
23.
go back to reference Van Dillen LR, Sahrmann SA, Norton BJ, Caldwell CA, Fleming DA, McDonnell MK, Woolsey NB: Reliability of physical examination items used for classification of patients with low back pain. Phys Ther. 1998, 78: 979-PubMed Van Dillen LR, Sahrmann SA, Norton BJ, Caldwell CA, Fleming DA, McDonnell MK, Woolsey NB: Reliability of physical examination items used for classification of patients with low back pain. Phys Ther. 1998, 78: 979-PubMed
24.
go back to reference Norman GR: SD: biostatistics: The bare essentials. 2008, McGraw-Hill Medical, London, 3ed Norman GR: SD: biostatistics: The bare essentials. 2008, McGraw-Hill Medical, London, 3ed
25.
go back to reference Williamson A, Hoggart B: Pain: a review of three commonly used pain rating scales. J Clin Nurs. 2005, 14: 798-804. 10.1111/j.1365-2702.2005.01121.x.CrossRefPubMed Williamson A, Hoggart B: Pain: a review of three commonly used pain rating scales. J Clin Nurs. 2005, 14: 798-804. 10.1111/j.1365-2702.2005.01121.x.CrossRefPubMed
26.
go back to reference Kuorinka I, Jonsson B, Kilbom A, Vinterberg H, Biering-Sørensen F, Andersson G, Jørgensen K: Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Appl Ergon. 1987, 18: 233-237. 10.1016/0003-6870(87)90010-X.CrossRefPubMed Kuorinka I, Jonsson B, Kilbom A, Vinterberg H, Biering-Sørensen F, Andersson G, Jørgensen K: Standardised Nordic questionnaires for the analysis of musculoskeletal symptoms. Appl Ergon. 1987, 18: 233-237. 10.1016/0003-6870(87)90010-X.CrossRefPubMed
27.
go back to reference Von Korff M, Jensen MP, Karoly P: Assessing global pain severity by self-report in clinical and health services research. Spine. 2000, 25: 3140-3151. 10.1097/00007632-200012150-00009.CrossRefPubMed Von Korff M, Jensen MP, Karoly P: Assessing global pain severity by self-report in clinical and health services research. Spine. 2000, 25: 3140-3151. 10.1097/00007632-200012150-00009.CrossRefPubMed
28.
go back to reference Comerford MJ: The performance matrix performance profiling, risk assessment & training strategies for injury prevention & performance enhancement. 2008, KC International/Movement Performance Solutions, UK Comerford MJ: The performance matrix performance profiling, risk assessment & training strategies for injury prevention & performance enhancement. 2008, KC International/Movement Performance Solutions, UK
29.
go back to reference Comerford MJ, Mottram SL: Diagnosis of uncontrolled movement, subgroup classification and motor control retraining of the lumbar spine. 2010, KC International/Movement Performance Solutions, UK Comerford MJ, Mottram SL: Diagnosis of uncontrolled movement, subgroup classification and motor control retraining of the lumbar spine. 2010, KC International/Movement Performance Solutions, UK
30.
go back to reference Lieber R: Skeletal muscle structure, function, & plasticity - The physiological basis of rehabilitation. 2002, Lippincott Williams & Wilkins, United States of America, 2 Lieber R: Skeletal muscle structure, function, & plasticity - The physiological basis of rehabilitation. 2002, Lippincott Williams & Wilkins, United States of America, 2
31.
go back to reference Jull GRC, Toppenberg R, Comerford M, Bui B: Towards a measurement of active muscle control for lumbar stabilisation. Aust J Physiother. 1993, 39: 187-193.CrossRefPubMed Jull GRC, Toppenberg R, Comerford M, Bui B: Towards a measurement of active muscle control for lumbar stabilisation. Aust J Physiother. 1993, 39: 187-193.CrossRefPubMed
32.
go back to reference Richardson C, Jull G: Muscle control–pain control. What exercises would you prescribe?. Man Ther. 1995, 1: 2-10. 10.1054/math.1995.0243.CrossRefPubMed Richardson C, Jull G: Muscle control–pain control. What exercises would you prescribe?. Man Ther. 1995, 1: 2-10. 10.1054/math.1995.0243.CrossRefPubMed
33.
go back to reference Falla DL, Campbell CD, Fagan AE, Thompson DC, Jull GA: Relationship between cranio-cervical flexion range of motion and pressure change during the cranio-cervical flexion test. Man Ther. 2003, 8: 92-96. 10.1016/S1356-689X(03)00008-0.CrossRefPubMed Falla DL, Campbell CD, Fagan AE, Thompson DC, Jull GA: Relationship between cranio-cervical flexion range of motion and pressure change during the cranio-cervical flexion test. Man Ther. 2003, 8: 92-96. 10.1016/S1356-689X(03)00008-0.CrossRefPubMed
34.
go back to reference Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20: 37-46. 10.1177/001316446002000104.CrossRef Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20: 37-46. 10.1177/001316446002000104.CrossRef
35.
go back to reference Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-10.2307/2529310.CrossRefPubMed Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-10.2307/2529310.CrossRefPubMed
36.
go back to reference Birnbaum DP: Who is at risk of what?. Infect Control Hosp Epidemiol. 1999, 20: 706-707. 10.1086/501570.CrossRefPubMed Birnbaum DP: Who is at risk of what?. Infect Control Hosp Epidemiol. 1999, 20: 706-707. 10.1086/501570.CrossRefPubMed
37.
go back to reference Carragee EJ, Cohen SP: Lifetime asymptomatic for back pain: the validity of self-report measures in soldiers. Spine. 2009, 34: 978-983. 10.1097/BRS.0b013e318198d517.CrossRefPubMed Carragee EJ, Cohen SP: Lifetime asymptomatic for back pain: the validity of self-report measures in soldiers. Spine. 2009, 34: 978-983. 10.1097/BRS.0b013e318198d517.CrossRefPubMed
38.
go back to reference Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes* 1. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.CrossRefPubMed Feinstein AR, Cicchetti DV: High agreement but low kappa: I. The problems of two paradoxes* 1. J Clin Epidemiol. 1990, 43: 543-549. 10.1016/0895-4356(90)90158-L.CrossRefPubMed
39.
go back to reference Byrt T, Bishop J, Carlin JB: Bias, prevalence and kappa. J Clin Epidemiol. 1993, 46: 423-429. 10.1016/0895-4356(93)90018-V.CrossRefPubMed Byrt T, Bishop J, Carlin JB: Bias, prevalence and kappa. J Clin Epidemiol. 1993, 46: 423-429. 10.1016/0895-4356(93)90018-V.CrossRefPubMed
40.
go back to reference Hoehler FK: Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity. J Clin Epidemiol. 2000, 53: 499-503. 10.1016/S0895-4356(99)00174-2.CrossRefPubMed Hoehler FK: Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity. J Clin Epidemiol. 2000, 53: 499-503. 10.1016/S0895-4356(99)00174-2.CrossRefPubMed
Metadata
Title
Inter- and intra-observer reliability of clinical movement-control tests for marines
Authors
Andreas Monnier
Joachim Heuer
Kjell Norman
Björn O Äng
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2012
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-13-263

Other articles of this Issue 1/2012

BMC Musculoskeletal Disorders 1/2012 Go to the issue