Skip to main content
Top
Published in: Skeletal Radiology 11/2022

06-05-2022 | Artificial Intelligence | Scientific Article

Automated detection of acute appendicular skeletal fractures in pediatric patients using deep learning

Authors: Daichi Hayashi, Andrew J. Kompel, Jeanne Ventre, Alexis Ducarouge, Toan Nguyen, Nor-Eddine Regnard, Ali Guermazi

Published in: Skeletal Radiology | Issue 11/2022

Login to get access

Abstract

Objective

We aimed to perform an external validation of an existing commercial AI software program (BoneView™) for the detection of acute appendicular fractures in pediatric patients.

Materials and methods

In our retrospective study, anonymized radiographic exams of extremities, with or without fractures, from pediatric patients (aged 2–21) were included. Three hundred exams (150 with fractures and 150 without fractures) were included, comprising 60 exams per body part (hand/wrist, elbow/upper arm, shoulder/clavicle, foot/ankle, leg/knee). The Ground Truth was defined by experienced radiologists. A deep learning algorithm interpreted the radiographs for fracture detection, and its diagnostic performance was compared against the Ground Truth, and receiver operating characteristic analysis was done. Statistical analyses included sensitivity per patient (the proportion of patients for whom all fractures were identified) and sensitivity per fracture (the proportion of fractures identified by the AI among all fractures), specificity per patient, and false-positive rate per patient.

Results

There were 167 boys and 133 girls with a mean age of 10.8 years. For all fractures, sensitivity per patient (average [95% confidence interval]) was 91.3% [85.6, 95.3], specificity per patient was 90.0% [84.0,94.3], sensitivity per fracture was 92.5% [87.0, 96.2], and false-positive rate per patient in patients who had no fracture was 0.11. The patient-wise area under the curve was 0.93 for all fractures. AI diagnostic performance was consistently high across all anatomical locations and different types of fractures except for avulsion fractures (sensitivity per fracture 72.7% [39.0, 94.0]).

Conclusion

The BoneView™ deep learning algorithm provides high overall diagnostic performance for appendicular fracture detection in pediatric patients.
Appendix
Available only for authorised users
Literature
1.
go back to reference Van Rijn RR, Lequin MH, Thodberg HH. Automatic determination of Greulich and Pyle bone age in healthy Dutch children. Pediatr Radiol. 2009;39:591–7.CrossRef Van Rijn RR, Lequin MH, Thodberg HH. Automatic determination of Greulich and Pyle bone age in healthy Dutch children. Pediatr Radiol. 2009;39:591–7.CrossRef
2.
go back to reference Thodberg HH, Sävendahl L. Validation and reference values of automated bone age determination for four ethnicities. Acad Radiol. 2010;17:1425–32.CrossRef Thodberg HH, Sävendahl L. Validation and reference values of automated bone age determination for four ethnicities. Acad Radiol. 2010;17:1425–32.CrossRef
4.
go back to reference Mutasa C, Chang PD, Ruzal-Shapiro C, Ayyala R. MABAL: a novel deep-learning architecture for machine-assisted bone age labeling. J Digit Imaging. 2018;31:513–9.CrossRef Mutasa C, Chang PD, Ruzal-Shapiro C, Ayyala R. MABAL: a novel deep-learning architecture for machine-assisted bone age labeling. J Digit Imaging. 2018;31:513–9.CrossRef
5.
go back to reference Tajmir SH, Lee H, Shailam RS, et al. Artificial intelligence assisted interpretation of bone age radiographs improves accuracy and decreases variability. Skelet Radiol. 2019;48:275–83.CrossRef Tajmir SH, Lee H, Shailam RS, et al. Artificial intelligence assisted interpretation of bone age radiographs improves accuracy and decreases variability. Skelet Radiol. 2019;48:275–83.CrossRef
6.
go back to reference Pan I, Baird GL, Mutasa S, et al. Rethinking Greulich and Pyle: a deep learning approach to pediatric bone age assessment using pediatric trauma hand radiographs. Radiol Artif Intell. 2020;2: e190198.CrossRef Pan I, Baird GL, Mutasa S, et al. Rethinking Greulich and Pyle: a deep learning approach to pediatric bone age assessment using pediatric trauma hand radiographs. Radiol Artif Intell. 2020;2: e190198.CrossRef
7.
go back to reference Reddy NE, Rayan JC, Annapragada AV, et al. Bone age determination using only the index finger: a novel approach using a convolutional neural network compared with human radiologists. Pediatr Radiol. 2020;50:516–23.CrossRef Reddy NE, Rayan JC, Annapragada AV, et al. Bone age determination using only the index finger: a novel approach using a convolutional neural network compared with human radiologists. Pediatr Radiol. 2020;50:516–23.CrossRef
8.
go back to reference England JR, Gross JS, White EA, et al. Detection of traumatic pediatric elbow joint effusion using a deep convolutional neural network. AJR Am J Roentgenol. 2018;211:1361–8.CrossRef England JR, Gross JS, White EA, et al. Detection of traumatic pediatric elbow joint effusion using a deep convolutional neural network. AJR Am J Roentgenol. 2018;211:1361–8.CrossRef
9.
go back to reference Rayan JC, Reddy N, Kan JH, et al. Binomial classification of pediatric elbow fractures using a deep learning multiview approach emulating radiologist decision making. Radiol Artif Intell. 2019;1: e180015.CrossRef Rayan JC, Reddy N, Kan JH, et al. Binomial classification of pediatric elbow fractures using a deep learning multiview approach emulating radiologist decision making. Radiol Artif Intell. 2019;1: e180015.CrossRef
10.
go back to reference Choi JW, Cho YJ, Lee S, et al. Using a dual-input convolutional neural network for automated detection of pediatric supracondylar fracture on conventional radiography. Investig Radiol. 2020;55:101–10.CrossRef Choi JW, Cho YJ, Lee S, et al. Using a dual-input convolutional neural network for automated detection of pediatric supracondylar fracture on conventional radiography. Investig Radiol. 2020;55:101–10.CrossRef
11.
go back to reference Kim DH, MacKinnon T. Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. Clin Radiol. 2018;73:439–45.CrossRef Kim DH, MacKinnon T. Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. Clin Radiol. 2018;73:439–45.CrossRef
12.
go back to reference Yu JS, Yu SM, Erdal BS, et al. Detection and localisation of hip fractures on anteroposterior radiographs with artificial intelligence: proof of concept. Clin Radiol. 2020;75:237.e1-237.e9.CrossRef Yu JS, Yu SM, Erdal BS, et al. Detection and localisation of hip fractures on anteroposterior radiographs with artificial intelligence: proof of concept. Clin Radiol. 2020;75:237.e1-237.e9.CrossRef
13.
go back to reference Duron L, Ducarouge A, Gillibert A, et al. Assessment of an AI aid in detection of adult appendicular skeletal fractures by emergency physicians and radiologists: a multicenter cross-sectional diagnostic study. Radiology. 2021;300:120–9.CrossRef Duron L, Ducarouge A, Gillibert A, et al. Assessment of an AI aid in detection of adult appendicular skeletal fractures by emergency physicians and radiologists: a multicenter cross-sectional diagnostic study. Radiology. 2021;300:120–9.CrossRef
14.
go back to reference Tobler P, Cyriac J, Kovacs BK, et al. AI-based detection and classification of distal radius fractures using low-effort data labeling: evaluation of applicability and effect of training set size. Eur Radiol. 2021;31:6816–24.CrossRef Tobler P, Cyriac J, Kovacs BK, et al. AI-based detection and classification of distal radius fractures using low-effort data labeling: evaluation of applicability and effect of training set size. Eur Radiol. 2021;31:6816–24.CrossRef
15.
go back to reference Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci U S A. 2018;115:11591–6.CrossRef Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci U S A. 2018;115:11591–6.CrossRef
16.
go back to reference Cheng CT, Ho TY, Lee TY, et al. Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs. Eur Radiol. 2019;29:5469–77.CrossRef Cheng CT, Ho TY, Lee TY, et al. Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs. Eur Radiol. 2019;29:5469–77.CrossRef
19.
go back to reference Joeris A, Lutz N, Blumenthal A, Slongo T, Audigé L. The AO pediatric comprehensive classification of long bone fractures (PCCF). Acta Orthop. 2017;88:123–8.CrossRef Joeris A, Lutz N, Blumenthal A, Slongo T, Audigé L. The AO pediatric comprehensive classification of long bone fractures (PCCF). Acta Orthop. 2017;88:123–8.CrossRef
21.
go back to reference Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 1934;404–413. Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika 1934;404–413.
22.
go back to reference Chasm RM, Swencki SA. Pediatric orthopedic emergencies. Emerg Med Clin North Am. 2010;28:907–26.CrossRef Chasm RM, Swencki SA. Pediatric orthopedic emergencies. Emerg Med Clin North Am. 2010;28:907–26.CrossRef
23.
go back to reference Kim HHR, Menashe SJ, Ngo AV, et al. Uniquely pediatric upper extremity injuries. Clin Imaging. 2021;80:249–61.CrossRef Kim HHR, Menashe SJ, Ngo AV, et al. Uniquely pediatric upper extremity injuries. Clin Imaging. 2021;80:249–61.CrossRef
24.
go back to reference Crowe JE, Swischuk LE. Acute bowing fractures of the forearm in children: a frequently missed injury. AJR Am J Roentgenol. 1977;128:981–4.CrossRef Crowe JE, Swischuk LE. Acute bowing fractures of the forearm in children: a frequently missed injury. AJR Am J Roentgenol. 1977;128:981–4.CrossRef
25.
go back to reference Zhou Y, Teomete U, Dandin O, et al. Computer-aided detection (CADx) for plastic deformation fractures in pediatric forearm. Comput Biol Med. 2016;78:120–5.CrossRef Zhou Y, Teomete U, Dandin O, et al. Computer-aided detection (CADx) for plastic deformation fractures in pediatric forearm. Comput Biol Med. 2016;78:120–5.CrossRef
26.
go back to reference Cheema JI, Grissom LE, Harcke HT. Radiographic characteristics of lower-extremity bowing in children. Radiographics. 2003;23:871–80.CrossRef Cheema JI, Grissom LE, Harcke HT. Radiographic characteristics of lower-extremity bowing in children. Radiographics. 2003;23:871–80.CrossRef
27.
go back to reference Ruffing T, Danko T, Henzler T, Weiss C, Hofmann A, Muhm M. Number of positive radiographic findings in pediatric trauma patients. Emerg Radiol. 2017;24:281–6.CrossRef Ruffing T, Danko T, Henzler T, Weiss C, Hofmann A, Muhm M. Number of positive radiographic findings in pediatric trauma patients. Emerg Radiol. 2017;24:281–6.CrossRef
Metadata
Title
Automated detection of acute appendicular skeletal fractures in pediatric patients using deep learning
Authors
Daichi Hayashi
Andrew J. Kompel
Jeanne Ventre
Alexis Ducarouge
Toan Nguyen
Nor-Eddine Regnard
Ali Guermazi
Publication date
06-05-2022
Publisher
Springer Berlin Heidelberg
Published in
Skeletal Radiology / Issue 11/2022
Print ISSN: 0364-2348
Electronic ISSN: 1432-2161
DOI
https://doi.org/10.1007/s00256-022-04070-0

Other articles of this Issue 11/2022

Skeletal Radiology 11/2022 Go to the issue