Skip to main content
Top
Published in: Rheumatology International 1/2013

01-01-2013 | Original Article

Inter- and intra-observer agreement of high-resolution ultrasonography and power Doppler in assessment of joint inflammation and bone erosions in patients with rheumatoid arthritis

Authors: Mario Alfredo Chávez-López, Cristina Hernández-Díaz, Carlos Moya, Carlos Pineda, Lucio Ventura-Ríos, Ingrid Möller, Esperanza Naredo, Rolando Espinosa, Angélica Peña, Alejandro Rosas-Cabral, Emilio Filippucci

Published in: Rheumatology International | Issue 1/2013

Login to get access

Abstract

To assess the inter- and intra-observer reproducibility of musculoskeletal ultrasonography among rheumatologist in detecting inflammatory and morphostructural changes in small joints of the hands in patients with rheumatoid arthritis (RA). Five members of the “Escuela de Ecografía del Colegio Mexicano de Reumatología” tested their inter- and intra-observer reliabilities in the assessment of basic sonographic findings of joint inflammation and bone erosion. Their results were compared to those obtained by a group of international experts from European League Against Rheumatism. A clinical rheumatologist evaluated eight RA patients. Five Siemens Acuson Antares ultrasound machines (7–13 MHz linear probes) were used. The OMERACT preliminary definitions of joint effusion, synovial hypertrophy, bone erosions and tenosynovitis were adopted. Inter-observer and intra-observer agreement was calculated by overall agreement and kappa statistics. Mean kappa value for joint effusion was good, 0.654 (85%); synovial hypertrophy, 0.550 (77.2%); power Doppler signal, 0.550 (82.5%); bone erosions, 0.549 (81%); and tenosynovitis, 0.500 (91.5%). Mean and overall intra-observer agreement for semiquantitative score was good for joint effusion, 0.630 (77.2%) and bone erosions, 0.605 (56.25%); and moderate to synovial hypertrophy, 0.476 (65%) and power Doppler signal, 0.471 (80%). Mean kappa value for joint effusion was 0.381 (95%), synovial hypertrophy, 0.447 (72%); power Doppler signal, 0.496 (81%); bone erosions, 0.294 (81%); and tenosynovitis, 0.030 (66%). Mean and overall inter-observer agreement for semiquantitative score was poor for joint effusion, 0.325 (57%) and bone erosions, 0.360 (43%); and moderate to synovial hypertrophy, 0.431 (55%) and power Doppler signal, 0.496 (81%). Intra-observer variability reached the highest levels of agreement. Factors related to the experience of the rheumatologist, the time spent in each examination and knowledge of the software ultrasound equipment could influence the lower level of inter-observer agreement in this study.
Literature
1.
go back to reference Hau M, Kneitz C, Tony HP, Keberle M, Jahns R, Jenett M (2002) High resolution ultrasound detects a decrease in pannus vascularization of small finger joints in patients with rheumatoid arthritis receiving treatment with soluble tumour necrosis factor a receptor (etanercept). Ann Rheum Dis 61:55–58PubMedCrossRef Hau M, Kneitz C, Tony HP, Keberle M, Jahns R, Jenett M (2002) High resolution ultrasound detects a decrease in pannus vascularization of small finger joints in patients with rheumatoid arthritis receiving treatment with soluble tumour necrosis factor a receptor (etanercept). Ann Rheum Dis 61:55–58PubMedCrossRef
2.
go back to reference Taylor PC, Steuer A, Gruber J, Cosgrove DO, Blomley MJK, Marsters PA et al (2004) Comparison of ultrasonographic assessment of synovitis and joint vascularity with radiographic evaluation in a randomized, placebo-controlled study of infliximab therapy in early rheumatoid arthritis. Arthritis Rheum 50:1107–1116PubMedCrossRef Taylor PC, Steuer A, Gruber J, Cosgrove DO, Blomley MJK, Marsters PA et al (2004) Comparison of ultrasonographic assessment of synovitis and joint vascularity with radiographic evaluation in a randomized, placebo-controlled study of infliximab therapy in early rheumatoid arthritis. Arthritis Rheum 50:1107–1116PubMedCrossRef
3.
go back to reference Ribbens C, Andre B, Marcelis S, Kaye O, Mathy L, Bonnet V et al (2003) Rheumatoid hand joint synovitis: gray-scale and power Doppler US quantifications following anti-tumor necrosis factor-alpha treatment: pilot study. Radiology 229:562–569PubMedCrossRef Ribbens C, Andre B, Marcelis S, Kaye O, Mathy L, Bonnet V et al (2003) Rheumatoid hand joint synovitis: gray-scale and power Doppler US quantifications following anti-tumor necrosis factor-alpha treatment: pilot study. Radiology 229:562–569PubMedCrossRef
4.
go back to reference Naredo E, Bonilla G, Gamero F, Uson J, Carmona L, Laffon A (2005) Assessment of inflammatory activity in rheumatoid arthritis: a comparative study of clinical evaluation with grey scale and power Doppler ultrasonography. Ann Rheum Dis 64:375–381PubMedCrossRef Naredo E, Bonilla G, Gamero F, Uson J, Carmona L, Laffon A (2005) Assessment of inflammatory activity in rheumatoid arthritis: a comparative study of clinical evaluation with grey scale and power Doppler ultrasonography. Ann Rheum Dis 64:375–381PubMedCrossRef
5.
go back to reference Naredo E, Collado P, Cruz A, Palop MJ, Cabero F, Richi P, Carmona L, Crespo M (2007) Longitudinal power Doppler ultrasonographic assessment of joint inflammatory activity in early rheumatoid arthritis: predictive value in disease activity and radiologic progression. Arthritis Rheum 57:116–124PubMedCrossRef Naredo E, Collado P, Cruz A, Palop MJ, Cabero F, Richi P, Carmona L, Crespo M (2007) Longitudinal power Doppler ultrasonographic assessment of joint inflammatory activity in early rheumatoid arthritis: predictive value in disease activity and radiologic progression. Arthritis Rheum 57:116–124PubMedCrossRef
6.
go back to reference Szkudlarek M, Court-Payen M, Jacobsen S, Klarlund M, Thomsen HS, Østergaard M (2003) Interobserver agreement in ultrasonography of the finger and toe joints in rheumatoid arthritis. Arthritis Rheum 48:955–962PubMedCrossRef Szkudlarek M, Court-Payen M, Jacobsen S, Klarlund M, Thomsen HS, Østergaard M (2003) Interobserver agreement in ultrasonography of the finger and toe joints in rheumatoid arthritis. Arthritis Rheum 48:955–962PubMedCrossRef
7.
go back to reference Van Riel PLCM, Schumacher HR (2001) How does one assess early rheumatoid arthritis in daily clinical practice? Best Pract Res Clin Rheumatol 151:67–76 Van Riel PLCM, Schumacher HR (2001) How does one assess early rheumatoid arthritis in daily clinical practice? Best Pract Res Clin Rheumatol 151:67–76
8.
go back to reference Jousse-Joulin S, D′Agostino MA, Marhadour T, Albert JD, Bentin J, Chary Valckenaere I et al (2010) Reproducibility of joint swelling assessment by sonography in patients with long lasting rheumatoid arthritis (SEA-repro study part II). J Rheumatol 37(5):938–945PubMedCrossRef Jousse-Joulin S, D′Agostino MA, Marhadour T, Albert JD, Bentin J, Chary Valckenaere I et al (2010) Reproducibility of joint swelling assessment by sonography in patients with long lasting rheumatoid arthritis (SEA-repro study part II). J Rheumatol 37(5):938–945PubMedCrossRef
9.
go back to reference Wakefield RJ, Balint PV, Szkudlarek M, Filippucci E, Backhaus M, D’Agostino MA et al (2005) Musculoskeletal ultrasound including definitions for ultrasonographic pathology. J Rheumatol 32:2485–2487PubMed Wakefield RJ, Balint PV, Szkudlarek M, Filippucci E, Backhaus M, D’Agostino MA et al (2005) Musculoskeletal ultrasound including definitions for ultrasonographic pathology. J Rheumatol 32:2485–2487PubMed
10.
go back to reference Bruyn GAW, Naredo E, Möller I, Moragues C, Garrido J, de Bock GH et al (2009) Reliability of ultrasonography in detecting shoulder disease in patients with rheumatoid arthritis. Ann Rheum Dis 68(3):357–361PubMedCrossRef Bruyn GAW, Naredo E, Möller I, Moragues C, Garrido J, de Bock GH et al (2009) Reliability of ultrasonography in detecting shoulder disease in patients with rheumatoid arthritis. Ann Rheum Dis 68(3):357–361PubMedCrossRef
11.
go back to reference Pineda C, Filippucci E, Chávez-López M, Hernández-Díaz C, Moya C, Ventura L et al (2008) Ultrasound in rheumatology. The Mexican experience. Clin Exp Rheumatol 26:929–932PubMed Pineda C, Filippucci E, Chávez-López M, Hernández-Díaz C, Moya C, Ventura L et al (2008) Ultrasound in rheumatology. The Mexican experience. Clin Exp Rheumatol 26:929–932PubMed
12.
go back to reference Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS et al (1988) The American rheumatism association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum 31:315–324PubMedCrossRef Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS et al (1988) The American rheumatism association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum 31:315–324PubMedCrossRef
13.
go back to reference Rubin JM, Adler RS, Fowlkes JB, Spratt S, Pallister JE, Chen JF et al (1995) Fractional moving blood volume: estimation with power Doppler US. Radiology 197:183–190PubMed Rubin JM, Adler RS, Fowlkes JB, Spratt S, Pallister JE, Chen JF et al (1995) Fractional moving blood volume: estimation with power Doppler US. Radiology 197:183–190PubMed
14.
go back to reference Kane D, Grassi W, Sturrock R, Balint PV (2004) Musculoskeletal ultrasound—a state of the art review in rheumatology. Part 2: clinical indications for musculoskeletal ultrasound in rheumatology. Rheumatology (Oxford) 43:829–838CrossRef Kane D, Grassi W, Sturrock R, Balint PV (2004) Musculoskeletal ultrasound—a state of the art review in rheumatology. Part 2: clinical indications for musculoskeletal ultrasound in rheumatology. Rheumatology (Oxford) 43:829–838CrossRef
15.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef
16.
go back to reference Scheel AK, Schmidt WA, Hermann KGA, Bruyn GA, D’Agostino MA, Grassi W et al (2005) Interobserver reliability of rheumatologists performing musculoskeletal ultrasonography: results from a EULAR “train the trainers” course. Ann Rheum Dis 64:1043–1049PubMedCrossRef Scheel AK, Schmidt WA, Hermann KGA, Bruyn GA, D’Agostino MA, Grassi W et al (2005) Interobserver reliability of rheumatologists performing musculoskeletal ultrasonography: results from a EULAR “train the trainers” course. Ann Rheum Dis 64:1043–1049PubMedCrossRef
17.
go back to reference Naredo E, Rodríguez M, Campos C, Rodriguez-Heredia JM, Medina J, Giner E et al (2008) Validity, reproducibility, and responsiveness of a twelve-joint simplified power Doppler ultrasonographic assessment of joint inflammation in rheumatoid arthritis. Arthritis Rheum (Arthritis Care & Research) 59:515–522CrossRef Naredo E, Rodríguez M, Campos C, Rodriguez-Heredia JM, Medina J, Giner E et al (2008) Validity, reproducibility, and responsiveness of a twelve-joint simplified power Doppler ultrasonographic assessment of joint inflammation in rheumatoid arthritis. Arthritis Rheum (Arthritis Care & Research) 59:515–522CrossRef
18.
go back to reference Brown AK, Roberts TE, Wakefield RJ, Karim Z, Hensor E, O’Connor PJ et al (2007) The challenges of integrating ultrasonography into routine rheumatology practice: addressing the needs of clinical rheumatologists. Rheumatology (Oxford) 46:821–829CrossRef Brown AK, Roberts TE, Wakefield RJ, Karim Z, Hensor E, O’Connor PJ et al (2007) The challenges of integrating ultrasonography into routine rheumatology practice: addressing the needs of clinical rheumatologists. Rheumatology (Oxford) 46:821–829CrossRef
19.
go back to reference Wakefield RJ, Gibbon WW, Conaghan PG, O’Connor P, McGonagle D, Pease C et al (2000) The value of sonography in the detection of bone erosions in patients with rheumatoid arthritis: a comparison with conventional radiography. Arthritis Rheum 43:2762–2770PubMedCrossRef Wakefield RJ, Gibbon WW, Conaghan PG, O’Connor P, McGonagle D, Pease C et al (2000) The value of sonography in the detection of bone erosions in patients with rheumatoid arthritis: a comparison with conventional radiography. Arthritis Rheum 43:2762–2770PubMedCrossRef
20.
go back to reference Szkudlarek M, Narvestad E, Klarlund M, Court-Payen M, Thomsen HS, Østergaard M (2004) Ultrasonography of the metatarsophalangeal joints in rheumatoid arthritis. Comparison with magnetic resonance imaging, conventional radiography, and clinical examination. Arthritis Rheum 50:2103–2112PubMedCrossRef Szkudlarek M, Narvestad E, Klarlund M, Court-Payen M, Thomsen HS, Østergaard M (2004) Ultrasonography of the metatarsophalangeal joints in rheumatoid arthritis. Comparison with magnetic resonance imaging, conventional radiography, and clinical examination. Arthritis Rheum 50:2103–2112PubMedCrossRef
21.
go back to reference Terslev L, Torp-Pedersen S, Qvistgaard E, Kristoffersen H, Rogind H, Danneskiold-Samsoe B et al (2003) Effects of treatment with etanercept (Enbrel, TNRF:Fc) on rheumatoid arthritis evaluated by Doppler ultrasonography. Ann Rheum Dis 62:178–181PubMedCrossRef Terslev L, Torp-Pedersen S, Qvistgaard E, Kristoffersen H, Rogind H, Danneskiold-Samsoe B et al (2003) Effects of treatment with etanercept (Enbrel, TNRF:Fc) on rheumatoid arthritis evaluated by Doppler ultrasonography. Ann Rheum Dis 62:178–181PubMedCrossRef
22.
go back to reference Ostergaard M, Wiell C (2004) Ultrasonography in rheumatoid arthritis: a very promising method still needing more validation. Curr Opin Rheumatol 16:223–230PubMedCrossRef Ostergaard M, Wiell C (2004) Ultrasonography in rheumatoid arthritis: a very promising method still needing more validation. Curr Opin Rheumatol 16:223–230PubMedCrossRef
23.
go back to reference Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I the problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I the problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef
Metadata
Title
Inter- and intra-observer agreement of high-resolution ultrasonography and power Doppler in assessment of joint inflammation and bone erosions in patients with rheumatoid arthritis
Authors
Mario Alfredo Chávez-López
Cristina Hernández-Díaz
Carlos Moya
Carlos Pineda
Lucio Ventura-Ríos
Ingrid Möller
Esperanza Naredo
Rolando Espinosa
Angélica Peña
Alejandro Rosas-Cabral
Emilio Filippucci
Publication date
01-01-2013
Publisher
Springer-Verlag
Published in
Rheumatology International / Issue 1/2013
Print ISSN: 0172-8172
Electronic ISSN: 1437-160X
DOI
https://doi.org/10.1007/s00296-011-2297-9

Other articles of this Issue 1/2013

Rheumatology International 1/2013 Go to the issue