Skip to main content
Top
Published in: Pediatric Radiology 4/2014

01-04-2014 | Original Article

Observer agreement in pediatric semiquantitative vertebral fracture diagnosis

Authors: Kerry Siminoski, Brian Lentle, Mary Ann Matzinger, Nazih Shenouda, Leanne M. Ward, the Canadian STOPP Consortium

Published in: Pediatric Radiology | Issue 4/2014

Login to get access

Abstract

Background

The Genant semiquantitative (GSQ) method has been a standard procedure for diagnosis of vertebral fractures in adults but has only recently been shown to be of clinical utility in children. Observer agreement using the GSQ method in this age group has not been described.

Objective

To evaluate observer agreement on vertebral readability and vertebral fracture diagnosis using the GSQ method in pediatric vertebral morphometry.

Materials and methods

Spine radiographs of 186 children with acute lymphoblastic leukemia were evaluated independently by three radiologists using the same GSQ methodology as in adults. A subset of 100 radiographs was evaluated on two occasions.

Results

An average of 4.7% of vertebrae were unreadable for the three radiologists. Intraobserver Cohen’s kappa (κ) on readability ranged from 0.434 to 0.648 at the vertebral level and from 0.416 to 0.611 at the patient level, while interobserver κ for readability had a range of 0.330 to 0.504 at the vertebral level and 0.295 to 0.467 at the patient level. Intraobserver κ for the presence of vertebral fracture had a range of 0.529 to 0.726 at the vertebral level and was 0.528 to 0.767 at the patient level. Interobserver κ for fracture at the vertebral level ranged from 0.455 to 0.548 and from 0.433 to 0.486 at the patient level.

Conclusion

Most κ values for both intra- and interobserver agreement in applying the GSQ method to pediatric spine radiographs were in the moderate to substantial range, comparable to the performance of the technique in adult studies. The GSQ method should be considered for use in pediatric research and clinical practice.
Literature
1.
go back to reference Genant HK, Wu CY, van Kuijk C et al (1993) Vertebral fracture assessment using a semiquantitative technique. J Bone Miner Res 8:137–148 Genant HK, Wu CY, van Kuijk C et al (1993) Vertebral fracture assessment using a semiquantitative technique. J Bone Miner Res 8:137–148
2.
go back to reference Wu CY, Li J, Jergas M et al (1995) Comparison of semiquantitative and quantitative techniques for the assessment of prevalent and incident vertebral fractures. Osteoporos Int 5:354–370PubMedCrossRef Wu CY, Li J, Jergas M et al (1995) Comparison of semiquantitative and quantitative techniques for the assessment of prevalent and incident vertebral fractures. Osteoporos Int 5:354–370PubMedCrossRef
3.
go back to reference Takada M, Wu CY, Lang TF et al (1998) Vertebral fracture assessment using the lateral scoutview of computed tomography in comparison with radiographs. Osteoporos Int 8:197–203PubMedCrossRef Takada M, Wu CY, Lang TF et al (1998) Vertebral fracture assessment using the lateral scoutview of computed tomography in comparison with radiographs. Osteoporos Int 8:197–203PubMedCrossRef
4.
go back to reference Wu C, van Kuijk C, Li J et al (2000) Comparison of digitized images with original radiography for semiquantitative assessment of osteoporotic fractures. Osteoporos Int 11:25–30PubMedCrossRef Wu C, van Kuijk C, Li J et al (2000) Comparison of digitized images with original radiography for semiquantitative assessment of osteoporotic fractures. Osteoporos Int 11:25–30PubMedCrossRef
5.
go back to reference Grados F, Roux C, de Vernejoul MC et al (2001) Comparison of four morphometric definitions and a semiquantitative consensus reading for assessing prevalent vertebral fractures. Osteoporos Int 12:716–722PubMedCrossRef Grados F, Roux C, de Vernejoul MC et al (2001) Comparison of four morphometric definitions and a semiquantitative consensus reading for assessing prevalent vertebral fractures. Osteoporos Int 12:716–722PubMedCrossRef
6.
go back to reference Damiano J, Kolta S, Porcher R et al (2006) Diagnosis of vertebral fractures by vertebral fracture assessment. J Clin Densitom 9:66–71PubMedCrossRef Damiano J, Kolta S, Porcher R et al (2006) Diagnosis of vertebral fractures by vertebral fracture assessment. J Clin Densitom 9:66–71PubMedCrossRef
7.
go back to reference Shousboe JT, DeBold CR (2006) Reliability and accuracy of vertebral fracture assessment with densitometry compared to radiography in clinical practice. Osteoporos Int 17:281–289CrossRef Shousboe JT, DeBold CR (2006) Reliability and accuracy of vertebral fracture assessment with densitometry compared to radiography in clinical practice. Osteoporos Int 17:281–289CrossRef
8.
go back to reference Fuerst T, Wu C, Genant HK et al (2009) Evaluation of vertebral fracture assessment by dual X-ray absorptiometry in a multicenter setting. Osteoporos Int 20:1199–1205PubMedCrossRef Fuerst T, Wu C, Genant HK et al (2009) Evaluation of vertebral fracture assessment by dual X-ray absorptiometry in a multicenter setting. Osteoporos Int 20:1199–1205PubMedCrossRef
9.
go back to reference Sanfelix-Genoves J, Arana E, Sanfelix-Gimeno G et al (2011) Agreement between semi-automatic radiographic morphometry and Genant semi-quantitative method in the assessment of vertebral fracture. Osteoporos Int 23:2129–2134PubMedCrossRef Sanfelix-Genoves J, Arana E, Sanfelix-Gimeno G et al (2011) Agreement between semi-automatic radiographic morphometry and Genant semi-quantitative method in the assessment of vertebral fracture. Osteoporos Int 23:2129–2134PubMedCrossRef
10.
go back to reference Cooper C, Dennison EM, Leufkens HG et al (2004) Epidemiology of childhood fractures in Britain: a study using the general practice research database. J Bone Miner Res 19:1976–1981PubMedCrossRef Cooper C, Dennison EM, Leufkens HG et al (2004) Epidemiology of childhood fractures in Britain: a study using the general practice research database. J Bone Miner Res 19:1976–1981PubMedCrossRef
12.
go back to reference Olmez N, Kaya T, Gunaydin R et al (2005) Intra- and interobserver variability of Kleerekoper’s method in vertebral fracture assessment. Clin Rheumatol 24:215–218PubMedCrossRef Olmez N, Kaya T, Gunaydin R et al (2005) Intra- and interobserver variability of Kleerekoper’s method in vertebral fracture assessment. Clin Rheumatol 24:215–218PubMedCrossRef
13.
go back to reference Guglielmi G, Diacinti D, van Kuikl C et al (2008) Vertebral morphometry: current methods and recent advances. Eur Radiol 18:1484–1496PubMedCrossRef Guglielmi G, Diacinti D, van Kuikl C et al (2008) Vertebral morphometry: current methods and recent advances. Eur Radiol 18:1484–1496PubMedCrossRef
14.
go back to reference Lentle BC, Brown JP, Khan A et al (2007) Recognizing and reporting vertebral fractures: reducing the risk of future osteoporotic fractures. Can Assoc Radiol J 58:27–36PubMed Lentle BC, Brown JP, Khan A et al (2007) Recognizing and reporting vertebral fractures: reducing the risk of future osteoporotic fractures. Can Assoc Radiol J 58:27–36PubMed
15.
go back to reference Schousboe JT, Vokes T, Broy SB et al (2008) Vertebral fracture assessment: the 2007 ISCD official positions. J Clin Densitom 11:92–108PubMedCrossRef Schousboe JT, Vokes T, Broy SB et al (2008) Vertebral fracture assessment: the 2007 ISCD official positions. J Clin Densitom 11:92–108PubMedCrossRef
16.
go back to reference Genant HK, Jergas M, Palermo L et al (1996) Comparison of semiquantitative visual and quantitative morphometric assessment of prevalent and incident vertebral fractures in osteoporosis. J Bone Miner Res 11:984–996PubMedCrossRef Genant HK, Jergas M, Palermo L et al (1996) Comparison of semiquantitative visual and quantitative morphometric assessment of prevalent and incident vertebral fractures in osteoporosis. J Bone Miner Res 11:984–996PubMedCrossRef
17.
go back to reference Halton J, Gaboury I, Grant R et al (2009) Advanced vertebral fracture among newly diagnosed children with acute lymphoblastic leukemia: results of the Canadian Steroid-associated Osteoporosis in the Pediatric Population (STOPP) Research Program. J Bone Miner Res 24:1326–1334PubMedCentralPubMedCrossRef Halton J, Gaboury I, Grant R et al (2009) Advanced vertebral fracture among newly diagnosed children with acute lymphoblastic leukemia: results of the Canadian Steroid-associated Osteoporosis in the Pediatric Population (STOPP) Research Program. J Bone Miner Res 24:1326–1334PubMedCentralPubMedCrossRef
18.
go back to reference Huber AM, Gaboury I, Cabral DA et al (2010) Prevalent vertebral fractures among children initiating glucocorticoid therapy for the treatment of rheumatic disorders. Arthritis Care Res 62:516–528CrossRef Huber AM, Gaboury I, Cabral DA et al (2010) Prevalent vertebral fractures among children initiating glucocorticoid therapy for the treatment of rheumatic disorders. Arthritis Care Res 62:516–528CrossRef
19.
go back to reference Ward LM (2005) Osteoporosis due to glucocorticoid use in children with chronic illness. Horm Res 64:209–221PubMedCrossRef Ward LM (2005) Osteoporosis due to glucocorticoid use in children with chronic illness. Horm Res 64:209–221PubMedCrossRef
20.
go back to reference Mäkitie O, Doria AS, Henriques F et al (2005) Radiographic vertebral morphology: a diagnostic tool in pediatric osteoporosis. J Pediatr 146:395–401PubMedCrossRef Mäkitie O, Doria AS, Henriques F et al (2005) Radiographic vertebral morphology: a diagnostic tool in pediatric osteoporosis. J Pediatr 146:395–401PubMedCrossRef
21.
go back to reference Land C, Rauch F, Munns CF et al (2006) Vertebral morphometry in children and adolescents with osteogenesis imperfecta: effect of intravenous pamidronate treatment. Bone 39:901–906PubMedCrossRef Land C, Rauch F, Munns CF et al (2006) Vertebral morphometry in children and adolescents with osteogenesis imperfecta: effect of intravenous pamidronate treatment. Bone 39:901–906PubMedCrossRef
22.
go back to reference Sumnik Z, Land C, Rieger-Wettengl G et al (2004) Effect of pamidronate treatment on vertebral deformity in children with primary osteoporosis. Horm Res 61:137–142PubMedCrossRef Sumnik Z, Land C, Rieger-Wettengl G et al (2004) Effect of pamidronate treatment on vertebral deformity in children with primary osteoporosis. Horm Res 61:137–142PubMedCrossRef
23.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef
24.
go back to reference Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220PubMedCrossRef Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220PubMedCrossRef
25.
go back to reference Rea JA, Li J, Blake GM et al (2000) Visual assessment of vertebral deformity by X-ray absorptiometry: a highly predictive method to exclude vertebral deformity. Osteoporos Int 11:660–668PubMedCrossRef Rea JA, Li J, Blake GM et al (2000) Visual assessment of vertebral deformity by X-ray absorptiometry: a highly predictive method to exclude vertebral deformity. Osteoporos Int 11:660–668PubMedCrossRef
26.
go back to reference Mayranpaa MK, Helenius I, Valta H et al (2007) Bone densitometry in the diagnosis of vertebral fractures in children: accuracy of vertebral fracture assessment. Bone 41:353–359PubMedCrossRef Mayranpaa MK, Helenius I, Valta H et al (2007) Bone densitometry in the diagnosis of vertebral fractures in children: accuracy of vertebral fracture assessment. Bone 41:353–359PubMedCrossRef
27.
go back to reference Rea JA, Chen MB, Li J et al (2000) Morphometric x-ray absorptiometry and morphometric radiography of the spine: a comparison of prevalent vertebral deformity identification. J Bone Miner Res 15:564–574PubMedCrossRef Rea JA, Chen MB, Li J et al (2000) Morphometric x-ray absorptiometry and morphometric radiography of the spine: a comparison of prevalent vertebral deformity identification. J Bone Miner Res 15:564–574PubMedCrossRef
28.
go back to reference Chapurlat RD, Duboeuf F, Marion-Audibert HO et al (2006) Effectiveness of instant vertebral assessment to detect prevalent vertebral fracture. Osteoporos Int 17:1189–1195PubMedCrossRef Chapurlat RD, Duboeuf F, Marion-Audibert HO et al (2006) Effectiveness of instant vertebral assessment to detect prevalent vertebral fracture. Osteoporos Int 17:1189–1195PubMedCrossRef
29.
go back to reference Hospers IC, van der Laan JG, Zeebregts CJ et al (2009) Vertebral fracture assessment in supine position: comparison by using conventional semiquantitative radiography and visual radiography. Radiology 251:822–828PubMedCrossRef Hospers IC, van der Laan JG, Zeebregts CJ et al (2009) Vertebral fracture assessment in supine position: comparison by using conventional semiquantitative radiography and visual radiography. Radiology 251:822–828PubMedCrossRef
30.
go back to reference Gwet K (2002) Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. Stat Methods Inter-rater Reliab Assess 2:1–9 Gwet K (2002) Inter-rater reliability: dependency on trait prevalence and marginal homogeneity. Stat Methods Inter-rater Reliab Assess 2:1–9
31.
go back to reference Black DM, Palermo L, Nevitt MC et al (1995) Comparison of methods for defining prevalent vertebral deformities: the Study of Osteoporotic Fractures. J Bone Miner Res 10:890–902PubMedCrossRef Black DM, Palermo L, Nevitt MC et al (1995) Comparison of methods for defining prevalent vertebral deformities: the Study of Osteoporotic Fractures. J Bone Miner Res 10:890–902PubMedCrossRef
32.
go back to reference Fechtenbaum J, Cropet C, Kolta S et al (2005) Reporting of vertebral fracture on spine x-rays. Osteoporos Int 16:1823–1826PubMedCrossRef Fechtenbaum J, Cropet C, Kolta S et al (2005) Reporting of vertebral fracture on spine x-rays. Osteoporos Int 16:1823–1826PubMedCrossRef
33.
go back to reference Pearson D, Horton B, Green DJ et al (2006) Vertebral morphometry by DXA: a comparison of supine lateral and decubitus lateral densitometers. J Clin Densitom 9:295–301PubMedCrossRef Pearson D, Horton B, Green DJ et al (2006) Vertebral morphometry by DXA: a comparison of supine lateral and decubitus lateral densitometers. J Clin Densitom 9:295–301PubMedCrossRef
34.
go back to reference Siminoski K, Lee K-C, Jen H et al (2011) Anatomical distribution of vertebral fractures: comparison of pediatric and adult spines. Osteoporos Int 23:1999–2008PubMedCrossRef Siminoski K, Lee K-C, Jen H et al (2011) Anatomical distribution of vertebral fractures: comparison of pediatric and adult spines. Osteoporos Int 23:1999–2008PubMedCrossRef
35.
go back to reference Szulc P, Munoz F, Sornay-Rendu E et al (2000) Comparison of morphometric assessment of prevalent vertebral deformities in women using different reference data. Bone 27:841–846PubMedCrossRef Szulc P, Munoz F, Sornay-Rendu E et al (2000) Comparison of morphometric assessment of prevalent vertebral deformities in women using different reference data. Bone 27:841–846PubMedCrossRef
36.
go back to reference Jackson SA, Tenenhouse A, Robertson L (2000) Vertebral fracture definition from population-based data: preliminary results from the Canadian Multicenter Osteoporosis Study (CaMos). Osteoporos Int 11:680–687PubMedCrossRef Jackson SA, Tenenhouse A, Robertson L (2000) Vertebral fracture definition from population-based data: preliminary results from the Canadian Multicenter Osteoporosis Study (CaMos). Osteoporos Int 11:680–687PubMedCrossRef
37.
go back to reference Gaca AM, Barnhart HX, Bisset GS (2010) Evaluation of wedging of lower thoracic and upper lumbar vertebral bodies in the pediatric population. AJR Am J Roentgenol 194:516–520PubMedCrossRef Gaca AM, Barnhart HX, Bisset GS (2010) Evaluation of wedging of lower thoracic and upper lumbar vertebral bodies in the pediatric population. AJR Am J Roentgenol 194:516–520PubMedCrossRef
38.
go back to reference Alos N, Grant RM, Ramsay T et al (2012) High incidence of vertebral fractures in children with acute lymphoblastic leukemia 12 months after the initiation of therapy. J Clin Oncol 30:2760–2767PubMedCrossRef Alos N, Grant RM, Ramsay T et al (2012) High incidence of vertebral fractures in children with acute lymphoblastic leukemia 12 months after the initiation of therapy. J Clin Oncol 30:2760–2767PubMedCrossRef
39.
go back to reference Grados F, Fechtenbaum J, Flipon E et al (2009) Radiographic methods for evaluating osteoporotic vertebral fractures. Joint Bone Spine 76:241–247PubMedCrossRef Grados F, Fechtenbaum J, Flipon E et al (2009) Radiographic methods for evaluating osteoporotic vertebral fractures. Joint Bone Spine 76:241–247PubMedCrossRef
40.
go back to reference Hanrahan CJ, Shah LM (2011) MRI of spinal bone marrow: part 2, T1-weighted imaging-based differential diagnosis. AJR Am J Roentgenol 197:1309–1321PubMedCrossRef Hanrahan CJ, Shah LM (2011) MRI of spinal bone marrow: part 2, T1-weighted imaging-based differential diagnosis. AJR Am J Roentgenol 197:1309–1321PubMedCrossRef
Metadata
Title
Observer agreement in pediatric semiquantitative vertebral fracture diagnosis
Authors
Kerry Siminoski
Brian Lentle
Mary Ann Matzinger
Nazih Shenouda
Leanne M. Ward
the Canadian STOPP Consortium
Publication date
01-04-2014
Publisher
Springer Berlin Heidelberg
Published in
Pediatric Radiology / Issue 4/2014
Print ISSN: 0301-0449
Electronic ISSN: 1432-1998
DOI
https://doi.org/10.1007/s00247-013-2837-4

Other articles of this Issue 4/2014

Pediatric Radiology 4/2014 Go to the issue