Skip to main content
Top
Published in: Pediatric Radiology 10/2003

01-10-2003 | Original Article

Inter- and intrareader variability in the interpretation of two radiographic classification systems for juvenile rheumatoid arthritis

Authors: Andréa S. Doria, Cláudio C. de Castro, Maria Helena B. Kiss, Renato A. Sernik, Luís F. Vitule, Carlos H. M. Silva, Cristiano A. F. Zerbini, Paula R. Arantes, Leandro Lucato, Marco A. N. Germano, Giovanni G. Cerri

Published in: Pediatric Radiology | Issue 10/2003

Login to get access

Abstract

Objective

To evaluate the inter- and intrareader variability for interpretation of a modified Larsen's radiographic classification system for juvenile rheumatoid arthritis (JRA) focused on osteochondral lesions and a conventional Larsen's classification system, compared to a reference MR scoring system of corresponding images.

Materials and methods

Seventy-five radiographs of 60 children with JRA, performed within a short interval of time from the MR examinations, were independently evaluated by three experienced radiologists, three diagnostic imaging residents and three rheumatologists, in two separate sessions, according to the two different classification methods, blinded to the corresponding MR images.

Results

The inter- and intrareader concordance rates between the two radiographic classification systems and the MR-related radiographs were respectively poor and poor/moderate. The interobserver range of weighted kappa values for the conventional and the modified Larsen's system respectively was 0.25–0.37 vs 0.19–0.39 for radiologists, 0.25–0.37 vs 0.18–0.30 for residents and 0.19–0.51 vs 0.17–0.29 for rheumatologists. The intrareader rate ranged from 0.17–0.55 for radiologists, 0.2–0.56 for residents, and 0.14–0.59 for rheumatologists.

Conclusion

Although the proposal of a new radiographic classification system for JRA focused on osteochondral abnormalities sounds promising, the low inter- and intrareader concordance rates with an MR-related radiographic system makes the clinical applicability of such a radiographic system less suitable.
Literature
1.
go back to reference Wallace CA, Levinson JE (1991) Juvenile rheumatoid arthritis: outcome and treatment for the 1990s. Rheum Dis Clin North Am 17:891–905PubMed Wallace CA, Levinson JE (1991) Juvenile rheumatoid arthritis: outcome and treatment for the 1990s. Rheum Dis Clin North Am 17:891–905PubMed
2.
go back to reference Stanley P, Senac M (1990) Miscellaneous disorders of the musculoskeletal system. In: Cohen MD, Edwards MK (eds) Magnetic resonance imaging of children. Decker, Philadelphia, pp 944–995 Stanley P, Senac M (1990) Miscellaneous disorders of the musculoskeletal system. In: Cohen MD, Edwards MK (eds) Magnetic resonance imaging of children. Decker, Philadelphia, pp 944–995
3.
go back to reference Steinbrocker O, Traeger CH, Batterman RC (1949) Therapeutic criteria in rheumatoid arthritis. JAMA 140:659–662 Steinbrocker O, Traeger CH, Batterman RC (1949) Therapeutic criteria in rheumatoid arthritis. JAMA 140:659–662
4.
go back to reference Sharp JT, Lidsky MD, Collins LC, et al (1971) Methods of scoring the progression of radiologic changes in rheumatoid arthritis: correlation of radiologic, clinical, and laboratory abnormalities. Arthritis Rheum 14:706–720PubMed Sharp JT, Lidsky MD, Collins LC, et al (1971) Methods of scoring the progression of radiologic changes in rheumatoid arthritis: correlation of radiologic, clinical, and laboratory abnormalities. Arthritis Rheum 14:706–720PubMed
5.
go back to reference Larsen A, Dale K, Eek M (1977) Radiographic evaluation of rheumatoid arthritis and related conditions by standard reference films. Acta Radiol Diagnosis 18: 481–491 Larsen A, Dale K, Eek M (1977) Radiographic evaluation of rheumatoid arthritis and related conditions by standard reference films. Acta Radiol Diagnosis 18: 481–491
6.
go back to reference Petterson H, Rydholm U (1984) Radiologic classification of knee joint destruction in juvenile chronic arthritis. Pediatr Radiol 14:719–722 Petterson H, Rydholm U (1984) Radiologic classification of knee joint destruction in juvenile chronic arthritis. Pediatr Radiol 14:719–722
7.
go back to reference Scott DL, Grindulis KA, Struthers GR, et al (1984) Progression of radiological changes in rheumatoid arthritis. Ann Rheum Dis 43:8-17 Scott DL, Grindulis KA, Struthers GR, et al (1984) Progression of radiological changes in rheumatoid arthritis. Ann Rheum Dis 43:8-17
8.
go back to reference Brewer EJ, Bass J, Baum J, et al (1977) Current proposed revision of JRA criteria. Arthritis Rheum 20[Suppl37]:195–199 Brewer EJ, Bass J, Baum J, et al (1977) Current proposed revision of JRA criteria. Arthritis Rheum 20[Suppl37]:195–199
9.
go back to reference Doria AS, Kiss MHB, Sallum AM, et al (2001) Correlation between osteochondral changes depicted by magnetic resonance imaging and disease progression. Rev Hosp Clin Fac Med S Paulo 56:107–114 Doria AS, Kiss MHB, Sallum AM, et al (2001) Correlation between osteochondral changes depicted by magnetic resonance imaging and disease progression. Rev Hosp Clin Fac Med S Paulo 56:107–114
10.
go back to reference Winalski CS, Palmer WE, Rosenthal DI, et al (1996) Magnetic resonance imaging of rheumatoid arthritis. Radiol Clin North Am 34:243–258PubMed Winalski CS, Palmer WE, Rosenthal DI, et al (1996) Magnetic resonance imaging of rheumatoid arthritis. Radiol Clin North Am 34:243–258PubMed
11.
go back to reference Gubler FM, Algra PR, Maas M, et al (1993). Gadolinium-DTPA enhanced magnetic resonance imaging of bone cysts in patients with rheumatoid arthritis. Ann Rheum Dis 52:716–719PubMed Gubler FM, Algra PR, Maas M, et al (1993). Gadolinium-DTPA enhanced magnetic resonance imaging of bone cysts in patients with rheumatoid arthritis. Ann Rheum Dis 52:716–719PubMed
12.
go back to reference Burk DL Jr, Dalinka MK, Schliebler ML, et al (1988) Strategies for musculoskeletal magnetic resonance imaging. Radiologic Clin North Am 26:653–672 Burk DL Jr, Dalinka MK, Schliebler ML, et al (1988) Strategies for musculoskeletal magnetic resonance imaging. Radiologic Clin North Am 26:653–672
13.
go back to reference Altman DG (1991) Practical statistics for medical research. Chapman and Hall, London, pp 404–408 Altman DG (1991) Practical statistics for medical research. Chapman and Hall, London, pp 404–408
14.
go back to reference Cicchetti H (1981) A computer program for determining the significance of the difference between pairs od independently derived values of kappa or weighted kappa scores. Educational Psychol Meas 41:189–193 Cicchetti H (1981) A computer program for determining the significance of the difference between pairs od independently derived values of kappa or weighted kappa scores. Educational Psychol Meas 41:189–193
15.
go back to reference Graham TB, Blebea JS, Gylys-Morin V, et al (1997) Magnetic resonance imaging in juvenile rheumatoid arthritis. Semin Arthritis Rheum 27:161–168PubMed Graham TB, Blebea JS, Gylys-Morin V, et al (1997) Magnetic resonance imaging in juvenile rheumatoid arthritis. Semin Arthritis Rheum 27:161–168PubMed
16.
go back to reference Gylys-Morin VM, Graham TB, Blebea JS, et al (2001) Knee in early juvenile rheumatoid arthritis: MR imaging findings. Radiology 220:696–706PubMed Gylys-Morin VM, Graham TB, Blebea JS, et al (2001) Knee in early juvenile rheumatoid arthritis: MR imaging findings. Radiology 220:696–706PubMed
17.
go back to reference Cakmakci H, Kovanlikaya A, Unsal E (2001) Short-term follow-up of the juvenile rheumatoid knee with fat-saturated 3D MRI. Pediatr Radiol 31:189–195CrossRefPubMed Cakmakci H, Kovanlikaya A, Unsal E (2001) Short-term follow-up of the juvenile rheumatoid knee with fat-saturated 3D MRI. Pediatr Radiol 31:189–195CrossRefPubMed
18.
go back to reference Beltran J, Caudill JL, Herman LA, et al (1987) Rheumatoid arthritis: MR imaging manifestations. Radiology 165:153–157PubMed Beltran J, Caudill JL, Herman LA, et al (1987) Rheumatoid arthritis: MR imaging manifestations. Radiology 165:153–157PubMed
19.
go back to reference Foley-Nolan D, Stack JP, Ryan M, et al (1991) Magnetic resonance imaging in the assessment of rheumatoid arthritis—a comparison with plain film radiographs. Br J Rheumatol 30:101–106PubMed Foley-Nolan D, Stack JP, Ryan M, et al (1991) Magnetic resonance imaging in the assessment of rheumatoid arthritis—a comparison with plain film radiographs. Br J Rheumatol 30:101–106PubMed
20.
go back to reference Poleksic L, Zdravkovic D, Kablanovic D, et al (1993) Magnetic resonance imaging of bone destruction in rheumatoid arthritis: comparison with radiography. Skeletal Radiol 22:577–580PubMed Poleksic L, Zdravkovic D, Kablanovic D, et al (1993) Magnetic resonance imaging of bone destruction in rheumatoid arthritis: comparison with radiography. Skeletal Radiol 22:577–580PubMed
21.
go back to reference Gilkeson G, Polisson R, Sinclair H, et al (1988) Early detection of carpal erosions in patients with rheumatoid arthritis: a pilot study of magnetic resonance imaging. J Rheumatol 15:1361–1366PubMed Gilkeson G, Polisson R, Sinclair H, et al (1988) Early detection of carpal erosions in patients with rheumatoid arthritis: a pilot study of magnetic resonance imaging. J Rheumatol 15:1361–1366PubMed
22.
go back to reference Disler DG (1997) Fat-suppressed three-dimensional spoiled gradient-recalled MR imaging: assessment of articular and physeal hyaline cartilage. AJR 169:1117–1123PubMed Disler DG (1997) Fat-suppressed three-dimensional spoiled gradient-recalled MR imaging: assessment of articular and physeal hyaline cartilage. AJR 169:1117–1123PubMed
23.
go back to reference Senac MO, Deutsch D, Bernstein BH, et al (1988) MR imaging in juvenile rheumatoid arthritis. AJR 150:873–878 Senac MO, Deutsch D, Bernstein BH, et al (1988) MR imaging in juvenile rheumatoid arthritis. AJR 150:873–878
24.
go back to reference Vuillez JP, Peltier P, Mayer JC, et al (1991) Reproducibility of image interpretation in immunoscintigraphy performed with indium-111- and iodine-131-labeled OC125 F(ab')2 antibody injected into the same patients. J Nucl Med 32:221–226 Vuillez JP, Peltier P, Mayer JC, et al (1991) Reproducibility of image interpretation in immunoscintigraphy performed with indium-111- and iodine-131-labeled OC125 F(ab')2 antibody injected into the same patients. J Nucl Med 32:221–226
25.
go back to reference Brunett A, Tedeschi G, Di Constanzo, et al (1997) White matter lesion detection in multiple sclerosis: improved interobserver concordance with multispectral MRI display. J Neurol 244:586–590CrossRefPubMed Brunett A, Tedeschi G, Di Constanzo, et al (1997) White matter lesion detection in multiple sclerosis: improved interobserver concordance with multispectral MRI display. J Neurol 244:586–590CrossRefPubMed
26.
go back to reference Robinson PJA, Wilson D, Coral A, et al (1999) Variation between experienced readers in the interpretation of accident and emergency radiographs. Br J Radiol 72:323–330PubMed Robinson PJA, Wilson D, Coral A, et al (1999) Variation between experienced readers in the interpretation of accident and emergency radiographs. Br J Radiol 72:323–330PubMed
27.
go back to reference Varich LJ, Laor T, Jaramillo D (2000) Normal maturation of the distal femoral epiphyseal cartilage: age-related changes at MR imaging. Radiology 214:705–709PubMed Varich LJ, Laor T, Jaramillo D (2000) Normal maturation of the distal femoral epiphyseal cartilage: age-related changes at MR imaging. Radiology 214:705–709PubMed
Metadata
Title
Inter- and intrareader variability in the interpretation of two radiographic classification systems for juvenile rheumatoid arthritis
Authors
Andréa S. Doria
Cláudio C. de Castro
Maria Helena B. Kiss
Renato A. Sernik
Luís F. Vitule
Carlos H. M. Silva
Cristiano A. F. Zerbini
Paula R. Arantes
Leandro Lucato
Marco A. N. Germano
Giovanni G. Cerri
Publication date
01-10-2003
Publisher
Springer-Verlag
Published in
Pediatric Radiology / Issue 10/2003
Print ISSN: 0301-0449
Electronic ISSN: 1432-1998
DOI
https://doi.org/10.1007/s00247-003-0912-y

Other articles of this Issue 10/2003

Pediatric Radiology 10/2003 Go to the issue