Skip to main content
Top
Published in: European Radiology 12/2019

Open Access 01-12-2019 | Paediatric

Are semi-automated software program designed for adults accurate for the identification of vertebral fractures in children?

Authors: Fawaz F. Alqahtani, Fabrizio Messina, Amaka C. Offiah

Published in: European Radiology | Issue 12/2019

Login to get access

Abstract

Objectives

To assess whether diagnostic accuracy of morphometric vertebral fracture (VF) diagnosis in children can be improved using AVERT™ (a 33-point semi-automated program developed for VF diagnosis in adults) compared with SpineAnalyzer™ (a 6-point program), which has previously been shown to be of insufficient accuracy.

Materials and methods

Lateral spine radiographs (XR) and dual-energy X-ray absorptiometry (DXA) scans of 50 children and young people were analysed by two observers using two different programs (AVERT™ and SpineAnalyzer™). Diagnostic accuracy (sensitivity, specificity, false-negative (FN) and false-positive rates (FP)) was calculated by comparing with a previously established consensus arrived at by three experienced paediatric musculoskeletal radiologists, using a simplified algorithm-based qualitative scoring system. Observer agreement was calculated using Cohen’s kappa.

Results

For XR, overall sensitivity, specificity, FP and FN rates using AVERT™ were 36%, 95%, 5% and 64% respectively and 26%, 98%, 2% and 75% respectively, using SpineAnalyzer™. For DXA, overall sensitivity, specificity, FP and FN rates using AVERT™ were 41%, 91%, 9% and 59% respectively and 31%, 96%, 4% and 69% respectively, using SpineAnalyzer. Reliability (kappa) ranged from 0.34 to 0.37 (95%CI, 0.26–0.46) for AVERT™ and from 0.26 to 0.31 (95%CI, 0.16–0.44) for SpineAnalyzer™. Inter- and intra-observer agreement ranged from 0.41 to 0.47 for AVERT™ and from 0.50 to 0.79 for SpineAnalyzer™.

Conclusion

AVERT™ has slightly higher accuracy but lower observer reliability for the representation of vertebral morphometry in children when compared with SpineAnalyzer™. However, neither software program is satisfactorily reliable for VF diagnosis in children.

Key Points

• SpineAnalyzer™ and AVERT™ have low diagnostic accuracy and observer agreement when compared to three paediatric radiologists’ readings for the diagnosis of vertebral fractures (VF) in children.
• Neither AVERT™ nor SpineAnalyzer™ is satisfactorily reliable for VF diagnosis in children.
• Development of specific paediatric software and normative values (incorporating age-related physiological variation in children) is required.
Literature
1.
go back to reference Bishop N, Arundel P, Clark E et al (2014) Fracture prediction and the definition of osteoporosis in children and adolescents: the ISCD 2013 pediatric official positions. J Clin Densitom 17:275–280CrossRef Bishop N, Arundel P, Clark E et al (2014) Fracture prediction and the definition of osteoporosis in children and adolescents: the ISCD 2013 pediatric official positions. J Clin Densitom 17:275–280CrossRef
2.
go back to reference Bishop N (2010) Characterising and treating osteogenesis imperfecta. Early Hum Dev 86:743–746CrossRef Bishop N (2010) Characterising and treating osteogenesis imperfecta. Early Hum Dev 86:743–746CrossRef
3.
go back to reference Halton J, Gaboury I, Grant R et al (2009) Advanced vertebral fracture among newly diagnosed children with acute lymphoblastic leukemia: results of the Canadian Steroid-Associated Osteoporosis in the Pediatric Population (STOPP) research program. J Bone Miner Res 24:1326–1334CrossRef Halton J, Gaboury I, Grant R et al (2009) Advanced vertebral fracture among newly diagnosed children with acute lymphoblastic leukemia: results of the Canadian Steroid-Associated Osteoporosis in the Pediatric Population (STOPP) research program. J Bone Miner Res 24:1326–1334CrossRef
4.
go back to reference Alos N, Grant R, Ramsay T et al (2012) High incidence of vertebral fractures in children with acute lymphoblastic leukemia 12 months after the initiation of therapy. J Clin Oncol 30:2760CrossRef Alos N, Grant R, Ramsay T et al (2012) High incidence of vertebral fractures in children with acute lymphoblastic leukemia 12 months after the initiation of therapy. J Clin Oncol 30:2760CrossRef
5.
go back to reference Bothwell JE, Gordon KE, Dooley JM, Mac Sween J, Cummings EA, Salisbury S (2003) Vertebral fractures in boys with Duchenne muscular dystrophy. Clin Pediatr (Phila) 42:353–356CrossRef Bothwell JE, Gordon KE, Dooley JM, Mac Sween J, Cummings EA, Salisbury S (2003) Vertebral fractures in boys with Duchenne muscular dystrophy. Clin Pediatr (Phila) 42:353–356CrossRef
6.
go back to reference Adiotomre E, Summers L, Allison A et al (2017) Diagnostic accuracy of DXA compared to conventional spine radiographs for the detection of vertebral fractures in children. Eur Radiol 27:2188–2199CrossRef Adiotomre E, Summers L, Allison A et al (2017) Diagnostic accuracy of DXA compared to conventional spine radiographs for the detection of vertebral fractures in children. Eur Radiol 27:2188–2199CrossRef
7.
go back to reference Kyriakou A, Shepherd S, Mason A, Faisal Ahmed S (2015) A critical appraisal of vertebral fracture assessment in paediatrics. Bone 81:255–259CrossRef Kyriakou A, Shepherd S, Mason A, Faisal Ahmed S (2015) A critical appraisal of vertebral fracture assessment in paediatrics. Bone 81:255–259CrossRef
8.
go back to reference Crabtree N, Chapman S, Högler W et al (2017) Vertebral fractures assessment in children: evaluation of DXA imaging versus conventional spine radiography. Bone 97:168–174CrossRef Crabtree N, Chapman S, Högler W et al (2017) Vertebral fractures assessment in children: evaluation of DXA imaging versus conventional spine radiography. Bone 97:168–174CrossRef
9.
go back to reference Mäyränpää MK, Helenius I, Valta H, Mäyränpää MI, Toiviainen-Salo S, Mäkitie O (2007) Bone densitometry in the diagnosis of vertebral fractures in children: accuracy of vertebral fracture assessment. Bone 41:353–359CrossRef Mäyränpää MK, Helenius I, Valta H, Mäyränpää MI, Toiviainen-Salo S, Mäkitie O (2007) Bone densitometry in the diagnosis of vertebral fractures in children: accuracy of vertebral fracture assessment. Bone 41:353–359CrossRef
10.
go back to reference Siminoski K, Lentle B, Matzinger MA, Shenouda N, Ward LM (2014) Observer agreement in pediatric semiquantitative vertebral fracture diagnosis. Pediatr Radiol 44:457–466CrossRef Siminoski K, Lentle B, Matzinger MA, Shenouda N, Ward LM (2014) Observer agreement in pediatric semiquantitative vertebral fracture diagnosis. Pediatr Radiol 44:457–466CrossRef
11.
go back to reference Adiotomre E, Summers L, Allison A et al (2016) Diagnosis of vertebral fractures in children: is a simplified algorithm-based qualitative technique reliable? Pediatr Radiol 46:680–688CrossRef Adiotomre E, Summers L, Allison A et al (2016) Diagnosis of vertebral fractures in children: is a simplified algorithm-based qualitative technique reliable? Pediatr Radiol 46:680–688CrossRef
12.
go back to reference Alqahtani FF, Messina F, Kruger E et al (2017) Evaluation of a semi-automated software program for the identification of vertebral fractures in children. Clin Radiol 72:904–e11CrossRef Alqahtani FF, Messina F, Kruger E et al (2017) Evaluation of a semi-automated software program for the identification of vertebral fractures in children. Clin Radiol 72:904–e11CrossRef
13.
go back to reference Lindner C, Bromiley PA, Ionita MC, Cootes TF (2015) Robust and accurate shape model matching using random forest regression-voting. IEEE Trans Pattern Anal Mach Intell 37:1862–1874CrossRef Lindner C, Bromiley PA, Ionita MC, Cootes TF (2015) Robust and accurate shape model matching using random forest regression-voting. IEEE Trans Pattern Anal Mach Intell 37:1862–1874CrossRef
14.
go back to reference Genant HK, Wu CY, Vankuijk C, Nevitt MC (1993) Vertebral fracture assessment using a semiquantitative technique. J Bone Miner Res 8:1137–1148CrossRef Genant HK, Wu CY, Vankuijk C, Nevitt MC (1993) Vertebral fracture assessment using a semiquantitative technique. J Bone Miner Res 8:1137–1148CrossRef
15.
go back to reference Diacinti D, Pisani D, D'Avanzo M et al (2015) Reliability of vertebral fractures assessment (VFA) in children with osteogenesis imperfecta. Calcif Tissue Int 96:307–312CrossRef Diacinti D, Pisani D, D'Avanzo M et al (2015) Reliability of vertebral fractures assessment (VFA) in children with osteogenesis imperfecta. Calcif Tissue Int 96:307–312CrossRef
16.
go back to reference Shaw NJ (2008) Management of osteoporosis in children. Eur J Endocrinol 159:S33–S39CrossRef Shaw NJ (2008) Management of osteoporosis in children. Eur J Endocrinol 159:S33–S39CrossRef
17.
go back to reference Guglielmi G, Palmieri F, Placentino MG, D’Errico F, Stoppino LP (2009) Assessment of osteoporotic vertebral fractures using specialized workflow software for 6-point morphometry. Eur J Radiol 70:142–148CrossRef Guglielmi G, Palmieri F, Placentino MG, D’Errico F, Stoppino LP (2009) Assessment of osteoporotic vertebral fractures using specialized workflow software for 6-point morphometry. Eur J Radiol 70:142–148CrossRef
18.
go back to reference Guglielmi G, Stoppino LP, Placentino MG, D’Errico F, Palmieri F (2009) Reproducibility of a semi-automatic method for 6-point vertebral morphometry in a multi-centre trial. Eur J Radiol 69:173–178CrossRef Guglielmi G, Stoppino LP, Placentino MG, D’Errico F, Palmieri F (2009) Reproducibility of a semi-automatic method for 6-point vertebral morphometry in a multi-centre trial. Eur J Radiol 69:173–178CrossRef
19.
go back to reference Sanfélix-Genovés J, Arana E, Sanfélix-Gimeno G, Peiró S, Graells-Ferrer M, Vega-Martínez M (2012) Agreement between semi-automatic radiographic morphometry and Genant semi-quantitative method in the assessment of vertebral fractures. Osteoporos Int 23:2129–2134CrossRef Sanfélix-Genovés J, Arana E, Sanfélix-Gimeno G, Peiró S, Graells-Ferrer M, Vega-Martínez M (2012) Agreement between semi-automatic radiographic morphometry and Genant semi-quantitative method in the assessment of vertebral fractures. Osteoporos Int 23:2129–2134CrossRef
20.
go back to reference Birch C, Knapp K, Hopkins S, Gallimore S, Rock B (2015) SpineAnalyzer (TM) is an accurate and precise method of vertebral fracture detection and classification on dual-energy lateral vertebral assessment scans. Radiography 21:278–281CrossRef Birch C, Knapp K, Hopkins S, Gallimore S, Rock B (2015) SpineAnalyzer (TM) is an accurate and precise method of vertebral fracture detection and classification on dual-energy lateral vertebral assessment scans. Radiography 21:278–281CrossRef
21.
go back to reference Diacinti D, Del Fiacco R, Pisani D et al (2012) Diagnostic performance of vertebral fracture assessment by the lunar iDXA scanner compared to conventional radiography. Calcif Tissue Int 91:335–342CrossRef Diacinti D, Del Fiacco R, Pisani D et al (2012) Diagnostic performance of vertebral fracture assessment by the lunar iDXA scanner compared to conventional radiography. Calcif Tissue Int 91:335–342CrossRef
22.
go back to reference Jaremko JL, Siminoski K, Firth GB et al (2015) Common normal variants of pediatric vertebral development that mimic fractures: a pictorial review from a national longitudinal bone health study. Pediatr Radiol 45:593–605CrossRef Jaremko JL, Siminoski K, Firth GB et al (2015) Common normal variants of pediatric vertebral development that mimic fractures: a pictorial review from a national longitudinal bone health study. Pediatr Radiol 45:593–605CrossRef
23.
go back to reference Kim SB, Heo YM, Hwang CM et al (2018) Reliability of the EOS imaging system for assessment of the spinal and pelvic alignment in the sagittal plane. Clin Orthop Surg 10:500–507CrossRef Kim SB, Heo YM, Hwang CM et al (2018) Reliability of the EOS imaging system for assessment of the spinal and pelvic alignment in the sagittal plane. Clin Orthop Surg 10:500–507CrossRef
Metadata
Title
Are semi-automated software program designed for adults accurate for the identification of vertebral fractures in children?
Authors
Fawaz F. Alqahtani
Fabrizio Messina
Amaka C. Offiah
Publication date
01-12-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 12/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-019-06250-4

Other articles of this Issue 12/2019

European Radiology 12/2019 Go to the issue