Skip to main content
Top
Published in: Intensive Care Medicine 6/2010

01-06-2010 | Brief Report

Inter-rater reliability of manual muscle strength testing in ICU survivors and simulated patients

Authors: Eddy Fan, Nancy D. Ciesla, Alex D. Truong, Vinodh Bhoopathi, Scott L. Zeger, Dale M. Needham

Published in: Intensive Care Medicine | Issue 6/2010

Login to get access

Abstract

Objective

The goal of the paper is to determine inter-rater reliability of trained examiners performing standardized strength assessments using manual muscle testing (MMT).

Design, subjects, and setting

The authors report on 19 trainees undergoing quality assurance within a multi-site prospective cohort study.

Intervention

Inter-rater reliability for specially trained evaluators (“trainees”) and a reference rater, performing MMT using both simulated and actual patients recovering from critical illness was evaluated.

Measurements and results

Across 26 muscle groups tested by 19 trainee-reference rater pairs, the median (interquartile range) percent agreement and intraclass correlation coefficient (ICC; 95% CI) were: 96% (91, 98%) and 0.98 (0.95, 1.00), respectively. Across all 19 pairs, the ICC (95% CI) for the overall composite MMT score was 0.99 (0.98–1.00). When limited to actual patients, the ICC was 1.00 (95% CI 0.99–1.00). The agreement (kappa; 95% CI) in detecting clinically significant weakness was 0.88 (0.44–1.00).

Conclusions

MMT has excellent inter-rater reliability in trained examiners and is a reliable method of comprehensively assessing muscle strength.
Appendix
Available only for authorised users
Literature
1.
go back to reference Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F, Cooper AB, Guest CB, Mazer CD, Mehta S, Stewart TE, Barr A, Cook D, Slutsky AS, Canadian Critical Care Trials Group (2003) One-year outcomes in survivors of the acute respiratory distress syndrome. New Engl J Med 348:683–693CrossRefPubMed Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F, Cooper AB, Guest CB, Mazer CD, Mehta S, Stewart TE, Barr A, Cook D, Slutsky AS, Canadian Critical Care Trials Group (2003) One-year outcomes in survivors of the acute respiratory distress syndrome. New Engl J Med 348:683–693CrossRefPubMed
2.
go back to reference Stevens RD, Dowdy DW, Micheals RK, Mendez-Tellez PA, Pronovost PJ, Needham DM (2007) Neuromuscular dysfunction acquired in critical illness: a systematic review. Intensive Care Med 33:1876–1891CrossRefPubMed Stevens RD, Dowdy DW, Micheals RK, Mendez-Tellez PA, Pronovost PJ, Needham DM (2007) Neuromuscular dysfunction acquired in critical illness: a systematic review. Intensive Care Med 33:1876–1891CrossRefPubMed
3.
go back to reference Nanas S, Kritikos K, Angelopoulos E, Siafaka A, Tsikriki S, Poriazi M, Kanaloupiti D, Kontogeorgi M, Pratikaki M, Zervakis D, Routsi C, Roussos C (2008) Predisposing factors for critical illness polyneuropathy in a multidisciplinary intensive care unit. Acta Neurol Scand 118:175–181CrossRefPubMed Nanas S, Kritikos K, Angelopoulos E, Siafaka A, Tsikriki S, Poriazi M, Kanaloupiti D, Kontogeorgi M, Pratikaki M, Zervakis D, Routsi C, Roussos C (2008) Predisposing factors for critical illness polyneuropathy in a multidisciplinary intensive care unit. Acta Neurol Scand 118:175–181CrossRefPubMed
4.
go back to reference Guarneri B, Bertolini G, Latronico N (2008) Long-term outcome in patients with critical illness myopathy or neuropathy: the Italian multicenter CRIMYNE study. J Neurol Neurosurg Psychiatry 79:838–841CrossRefPubMed Guarneri B, Bertolini G, Latronico N (2008) Long-term outcome in patients with critical illness myopathy or neuropathy: the Italian multicenter CRIMYNE study. J Neurol Neurosurg Psychiatry 79:838–841CrossRefPubMed
5.
go back to reference Ali NA, O’Brien JM Jr, Hoffmann SP, Phillips G, Garland A, Finley JC, Almoosa K, Hejal R, Wolf KM, Lemeshow S, Connors AF Jr, Marsh CB, Midwest Critical Care Consortium (2008) Acquired weakness, handgrip strength, and mortality in critically ill patients. Am J Respir Crit Care Med 178:261–268CrossRefPubMed Ali NA, O’Brien JM Jr, Hoffmann SP, Phillips G, Garland A, Finley JC, Almoosa K, Hejal R, Wolf KM, Lemeshow S, Connors AF Jr, Marsh CB, Midwest Critical Care Consortium (2008) Acquired weakness, handgrip strength, and mortality in critically ill patients. Am J Respir Crit Care Med 178:261–268CrossRefPubMed
6.
go back to reference Hughes VA, Frontera WR, Wood M, Evans WJ, Dallal GE, Roubenoff R, Fiatarone Singh MA (2001) Longitudinal muscle strength changes in older adults: influence of muscle mass, physical activity, and health. J Gerontol A Biol Sci Med Sci 56:B209–B217PubMed Hughes VA, Frontera WR, Wood M, Evans WJ, Dallal GE, Roubenoff R, Fiatarone Singh MA (2001) Longitudinal muscle strength changes in older adults: influence of muscle mass, physical activity, and health. J Gerontol A Biol Sci Med Sci 56:B209–B217PubMed
7.
go back to reference Steffensen BF, Lyager S, Werge B, Rahbek J, Mattsson E (2002) Physical capacity in non-ambulatory people with Duchenne muscular dystrophy or spinal muscular atrophy: a longitudinal study. Dev Med Child Neurol 44:623–632CrossRefPubMed Steffensen BF, Lyager S, Werge B, Rahbek J, Mattsson E (2002) Physical capacity in non-ambulatory people with Duchenne muscular dystrophy or spinal muscular atrophy: a longitudinal study. Dev Med Child Neurol 44:623–632CrossRefPubMed
8.
go back to reference Carin-Levy G, Greig C, Young A, Lewis S, Hannan J, Mead G (2006) Longitudinal changes in muscle strength and mass after acute stroke. Cerebrovasc Dis 21:201–207CrossRefPubMed Carin-Levy G, Greig C, Young A, Lewis S, Hannan J, Mead G (2006) Longitudinal changes in muscle strength and mass after acute stroke. Cerebrovasc Dis 21:201–207CrossRefPubMed
9.
go back to reference De Jonghe B, Sharshar T, Lefaucheur JP, Authier FJ, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, Raphael JC, Outin H, Bastuji-Garin S, Groupe de Reflexion et d’Etude des Neuromyopathies en Reanimation (2002) Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA 288:2859–2867CrossRefPubMed De Jonghe B, Sharshar T, Lefaucheur JP, Authier FJ, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, Raphael JC, Outin H, Bastuji-Garin S, Groupe de Reflexion et d’Etude des Neuromyopathies en Reanimation (2002) Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA 288:2859–2867CrossRefPubMed
10.
go back to reference Medical Research Council/Guarantors of Brain (1986) Aids to the examination of the peripheral nervous system. Bailliere Tindall, London Medical Research Council/Guarantors of Brain (1986) Aids to the examination of the peripheral nervous system. Bailliere Tindall, London
11.
go back to reference Polard H, Lakay B, Tucker F, Watson E, Bablis P (2005) Interexaminer reliability of the deltoid and psoas muscle test. J Manipulative Physiol Ther 18:52–56CrossRef Polard H, Lakay B, Tucker F, Watson E, Bablis P (2005) Interexaminer reliability of the deltoid and psoas muscle test. J Manipulative Physiol Ther 18:52–56CrossRef
12.
go back to reference Gregson JM, Leathley MJ, Moore P, Smith TL, Sharma AK, Watkins CL (2000) Reliability of measure tones and muscle power in stroke patients. Age Aging 29:223–228CrossRef Gregson JM, Leathley MJ, Moore P, Smith TL, Sharma AK, Watkins CL (2000) Reliability of measure tones and muscle power in stroke patients. Age Aging 29:223–228CrossRef
13.
go back to reference Florence JM, Pandya S, King WM, Robison JD, Signore LC, Wentzell M, Province MA (1984) Clinical trials in Duchenne dystrophy: standardization and evaluation of reliability procedures. Phys Ther 64:41–45PubMed Florence JM, Pandya S, King WM, Robison JD, Signore LC, Wentzell M, Province MA (1984) Clinical trials in Duchenne dystrophy: standardization and evaluation of reliability procedures. Phys Ther 64:41–45PubMed
14.
go back to reference Kleyweg RP, Meche FGA, Schmitz PI (1991) Interobserver agreement in the assessment of muscle strength and functional abilities Guillain-Barre syndrome. Muscle Nerve 14:1103–1109CrossRefPubMed Kleyweg RP, Meche FGA, Schmitz PI (1991) Interobserver agreement in the assessment of muscle strength and functional abilities Guillain-Barre syndrome. Muscle Nerve 14:1103–1109CrossRefPubMed
15.
go back to reference Needham DM, Dennison CR, Dowdy DW, Mendez-Tellez PA, Ciesla N, Desai SV, Sevransky J, Shanholtz C, Scharfstein D, Herridge MS, Pronovost PJ (2005) Study protocol: the improving care of acute lung injury patients (ICAP) study. Crit Care 10:R9CrossRef Needham DM, Dennison CR, Dowdy DW, Mendez-Tellez PA, Ciesla N, Desai SV, Sevransky J, Shanholtz C, Scharfstein D, Herridge MS, Pronovost PJ (2005) Study protocol: the improving care of acute lung injury patients (ICAP) study. Crit Care 10:R9CrossRef
16.
go back to reference Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–427CrossRefPubMed Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–427CrossRefPubMed
17.
go back to reference Perry J, Weiss WB, Burnfield JM, Gronley JK (2004) The supine hip extensor manual muscle test: a reliability and validity study. Arch Phys Med Rehabil 85:1345–1350CrossRefPubMed Perry J, Weiss WB, Burnfield JM, Gronley JK (2004) The supine hip extensor manual muscle test: a reliability and validity study. Arch Phys Med Rehabil 85:1345–1350CrossRefPubMed
18.
go back to reference Barr AE, Diamond BE, Wade CK, Harashima T, Pecorella WA, Potts CC, Rosenthal H, Fleiss JL, McMahon DJ (1991) Reliability of testing measures in Duchenne or Becker muscular dystrophy. Arch Phys Med Rehabil 72:315–319PubMed Barr AE, Diamond BE, Wade CK, Harashima T, Pecorella WA, Potts CC, Rosenthal H, Fleiss JL, McMahon DJ (1991) Reliability of testing measures in Duchenne or Becker muscular dystrophy. Arch Phys Med Rehabil 72:315–319PubMed
19.
go back to reference Escolar DM, Henricson EK, Mayhew J, Florence J, Leshner R, Patel KM, Clemens PR (2001) Clinical evaluator reliability for quantitative and manual muscle testing measures of strength in children. Muscle Nerve 24:787–793CrossRefPubMed Escolar DM, Henricson EK, Mayhew J, Florence J, Leshner R, Patel KM, Clemens PR (2001) Clinical evaluator reliability for quantitative and manual muscle testing measures of strength in children. Muscle Nerve 24:787–793CrossRefPubMed
20.
go back to reference Caruso W, Leisman G (2000) A force/displacement analysis of muscle testing. Percept Mot Skills 91:683–692CrossRefPubMed Caruso W, Leisman G (2000) A force/displacement analysis of muscle testing. Percept Mot Skills 91:683–692CrossRefPubMed
Metadata
Title
Inter-rater reliability of manual muscle strength testing in ICU survivors and simulated patients
Authors
Eddy Fan
Nancy D. Ciesla
Alex D. Truong
Vinodh Bhoopathi
Scott L. Zeger
Dale M. Needham
Publication date
01-06-2010
Publisher
Springer-Verlag
Published in
Intensive Care Medicine / Issue 6/2010
Print ISSN: 0342-4642
Electronic ISSN: 1432-1238
DOI
https://doi.org/10.1007/s00134-010-1796-6

Other articles of this Issue 6/2010

Intensive Care Medicine 6/2010 Go to the issue