Skip to main content
Top
Published in: Pediatric Radiology 5/2021

01-05-2021 | Rickets | Original Article

Artificial intelligence research within reach: an object detection model to identify rickets on pediatric wrist radiographs

Authors: Karthik C. Meda, Sarah S. Milla, Bradley S. Rostad

Published in: Pediatric Radiology | Issue 5/2021

Login to get access

Abstract

Background

Artificial intelligence models have been successful in analyzing ordinary photographic images. One type of artificial intelligence model is object detection, where a labeled bounding box is drawn around an area of interest. Object detection can be applied to medical imaging tasks.

Objective

To demonstrate object detection in identifying rickets and normal wrists on pediatric wrist radiographs using a small dataset, simple software and modest computer hardware.

Materials and methods

The institutional review board at Children’s Healthcare of Atlanta approved this study. The radiology information system was searched for radiographic examinations of the wrist for the evaluation of rickets from 2007 to 2018 in children younger than 7 years of age. Inclusion criteria were an exam type of “Rickets Survey” or “Joint Survey 1 View” with reports containing the words “rickets” or “rachitic.” Exclusion criteria were reports containing the words “renal,” “kidney” or “transplant.” Two pediatric radiologists reviewed the images and categorized them as either rickets or normal. Images were annotated by drawing a labeled bounding box around the distal radial and ulnar metaphases. The training dataset was created from images acquired from Jan. 1, 2007, to Dec. 31, 2017. This included 104 wrists with rickets and 264 normal wrists. This training dataset was used to create the object detection model. The testing dataset consisted of images acquired during the 2018 calendar year. This included 20 wrists with rickets and 37 normal wrists. Model sensitivity, specificity and accuracy were measured.

Results

Of the 20 wrists with rickets in the testing set, 16 were correctly identified as rickets, 2 were incorrectly identified as normal and 2 had no prediction. Of the 37 normal wrists, 33 were correctly identified as normal, 2 were incorrectly identified as rickets and 2 had no prediction. This yielded a sensitivity and specificity of 80% and 95% for wrists with rickets and 89% and 90% for normal wrists. Overall model accuracy was 86%.

Conclusion

Object detection can identify rickets on pediatric wrist radiographs. Object detection models can be developed with a small dataset, simple software tools and modest computing power.
Literature
1.
go back to reference Asada N, Doi K, MacMahon H et al (1990) Potential usefulness of an artificial neural network for differential diagnosis of interstitial lung diseases: pilot study. Radiology 177:857–860CrossRef Asada N, Doi K, MacMahon H et al (1990) Potential usefulness of an artificial neural network for differential diagnosis of interstitial lung diseases: pilot study. Radiology 177:857–860CrossRef
2.
go back to reference Gross GW, Boone JM, Greco-Hunt V, Greenberg B (1990) Neural networks in radiologic diagnosis; II. Interpretation of neonatal chest radiographs. Invest Radiol 25:1017–1023 Gross GW, Boone JM, Greco-Hunt V, Greenberg B (1990) Neural networks in radiologic diagnosis; II. Interpretation of neonatal chest radiographs. Invest Radiol 25:1017–1023
3.
go back to reference Scott JA, Palmer EL (1993) Neural network analysis of ventilation-perfusion lung scans. Radiology 186:661–664 Scott JA, Palmer EL (1993) Neural network analysis of ventilation-perfusion lung scans. Radiology 186:661–664
4.
go back to reference Tourassi GD, Floyd CE, Sostman HD, Coleman RE (1993) Acute pulmonary embolism: artificial neural network approach for diagnosis. Radiology 189:555–558 Tourassi GD, Floyd CE, Sostman HD, Coleman RE (1993) Acute pulmonary embolism: artificial neural network approach for diagnosis. Radiology 189:555–558
5.
go back to reference Boone JM (1993) Neural networks at the crossroads. Radiology 189:357–359 Boone JM (1993) Neural networks at the crossroads. Radiology 189:357–359
6.
go back to reference West E, Mutasa S, Zhu Z, Ha R (2019) Global trend in artificial intelligence–based publications in radiology from 2000 to 2018. AJR Am J Roentgenol 213:1204–1206 West E, Mutasa S, Zhu Z, Ha R (2019) Global trend in artificial intelligence–based publications in radiology from 2000 to 2018. AJR Am J Roentgenol 213:1204–1206
7.
go back to reference Boone JM, Gross GW, Greco-Hunt V (1990) Neural networks in radiologic diagnosis. I. Introduction and illustration. Investig Radiol 25:1012–1016 Boone JM, Gross GW, Greco-Hunt V (1990) Neural networks in radiologic diagnosis. I. Introduction and illustration. Investig Radiol 25:1012–1016
8.
go back to reference Reinus WR (1997) Machines that learn: can they learn to interpret radiographs? AJR Am J Roentgenol 169:19–21 Reinus WR (1997) Machines that learn: can they learn to interpret radiographs? AJR Am J Roentgenol 169:19–21
9.
go back to reference Chartrand G, Cheng PM, Vorontsov E et al (2017) Deep learning: a primer for radiologists. Radiographics 37:2113–2131 Chartrand G, Cheng PM, Vorontsov E et al (2017) Deep learning: a primer for radiologists. Radiographics 37:2113–2131
10.
go back to reference Erickson BJ, Korfiatis P, Akkus Z, Kline TL (2017) Machine learning for medical imaging. Radiographics 37:505–515 Erickson BJ, Korfiatis P, Akkus Z, Kline TL (2017) Machine learning for medical imaging. Radiographics 37:505–515
11.
go back to reference Kahn CE Jr (2017) From images to actions: opportunities for artificial intelligence in radiology. Radiology 285:719–720 Kahn CE Jr (2017) From images to actions: opportunities for artificial intelligence in radiology. Radiology 285:719–720
12.
go back to reference Kohli M, Prevedello LM, Filice RW, Geis JR (2017) Implementing machine learning in radiology practice and research. AJR Am J Roentgenol 208:754–760 Kohli M, Prevedello LM, Filice RW, Geis JR (2017) Implementing machine learning in radiology practice and research. AJR Am J Roentgenol 208:754–760
13.
go back to reference Handelman GS, Kok HK, Chandra RV et al (2019) Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods. AJR Am J Roentgenol 212:38–43 Handelman GS, Kok HK, Chandra RV et al (2019) Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods. AJR Am J Roentgenol 212:38–43
14.
go back to reference Moore MM, Slonimsky E, Long AD et al (2019) Machine learning concepts, concerns and opportunities for a pediatric radiologist. Pediatr Radiol 49:509–516 Moore MM, Slonimsky E, Long AD et al (2019) Machine learning concepts, concerns and opportunities for a pediatric radiologist. Pediatr Radiol 49:509–516
15.
go back to reference Soffer S, Ben-Cohen A, Shimon O et al (2019) Convolutional neural networks for radiologic images: a radiologist’s guide. Radiology 290:590–606 Soffer S, Ben-Cohen A, Shimon O et al (2019) Convolutional neural networks for radiologic images: a radiologist’s guide. Radiology 290:590–606
16.
go back to reference England JR, Gross JS, White EA et al (2018) Detection of traumatic pediatric elbow joint effusion using a deep convolutional neural network. AJR Am J Roentgenol 211:1361–1368 England JR, Gross JS, White EA et al (2018) Detection of traumatic pediatric elbow joint effusion using a deep convolutional neural network. AJR Am J Roentgenol 211:1361–1368
17.
go back to reference Larson DB, Chen MC, Lungren MP et al (2018) Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 287:313–322 Larson DB, Chen MC, Lungren MP et al (2018) Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 287:313–322
18.
go back to reference Halabi SS, Prevedello LM, Kalpathy-Cramer J et al (2019) The RSNA pediatric bone age machine learning challenge. Radiology 290:498–503 Halabi SS, Prevedello LM, Kalpathy-Cramer J et al (2019) The RSNA pediatric bone age machine learning challenge. Radiology 290:498–503
19.
go back to reference Rayan JC, Reddy N, Kan JH et al (2019) Binomial classification of pediatric elbow fractures using a deep learning multiview approach emulating radiologist decision making. Radiology: Artificial Intelligence 1:e180015 Rayan JC, Reddy N, Kan JH et al (2019) Binomial classification of pediatric elbow fractures using a deep learning multiview approach emulating radiologist decision making. Radiology: Artificial Intelligence 1:e180015
20.
go back to reference Reddy NE, Rayan JC, Annapragada AV et al (2020) Bone age determination using only the index finger: a novel approach using a convolutional neural network compared with human radiologists. Pediatr Radiol 50:516–523 Reddy NE, Rayan JC, Annapragada AV et al (2020) Bone age determination using only the index finger: a novel approach using a convolutional neural network compared with human radiologists. Pediatr Radiol 50:516–523
21.
go back to reference Yi PH, Kim TK, Wei J et al (2019) Automated semantic labeling of pediatric musculoskeletal radiographs using deep learning. Pediatr Radiol 49:1066–1070 Yi PH, Kim TK, Wei J et al (2019) Automated semantic labeling of pediatric musculoskeletal radiographs using deep learning. Pediatr Radiol 49:1066–1070
22.
go back to reference Mahomed N, van Ginneken B, Philipsen RHHM et al (2020) Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children. Pediatr Radiol 50:482–491 Mahomed N, van Ginneken B, Philipsen RHHM et al (2020) Computer-aided diagnosis for World Health Organization-defined chest radiograph primary-endpoint pneumonia in children. Pediatr Radiol 50:482–491
23.
go back to reference Otjen JP, Stanescu AL, Alessio AM, Parisi MT (2020) Ovarian torsion: developing a machine-learned algorithm for diagnosis. Pediatr Radiol 50:706–714 Otjen JP, Stanescu AL, Alessio AM, Parisi MT (2020) Ovarian torsion: developing a machine-learned algorithm for diagnosis. Pediatr Radiol 50:706–714
24.
go back to reference Zheng Q, Shellikeri S, Huang H et al (2020) Deep learning measurement of leg length discrepancy in children based on radiographs. Radiology 296:152–158 Zheng Q, Shellikeri S, Huang H et al (2020) Deep learning measurement of leg length discrepancy in children based on radiographs. Radiology 296:152–158
25.
go back to reference Shore RM, Chesney RW (2012) Rickets: part I. Pediatr Radiol 43:140–151 Shore RM, Chesney RW (2012) Rickets: part I. Pediatr Radiol 43:140–151
26.
go back to reference Creo AL, Thacher TD, Pettifor JM et al (2017) Nutritional rickets around the world: an update. Paediatr Int Child Health 37:84–98 Creo AL, Thacher TD, Pettifor JM et al (2017) Nutritional rickets around the world: an update. Paediatr Int Child Health 37:84–98
27.
go back to reference Thacher TD, Fischer PR, Tebben PJ et al (2013) Increasing incidence of nutritional rickets: a population-based study in Olmsted County, Minnesota. Mayo Clin Proc 88:176–183 Thacher TD, Fischer PR, Tebben PJ et al (2013) Increasing incidence of nutritional rickets: a population-based study in Olmsted County, Minnesota. Mayo Clin Proc 88:176–183
33.
go back to reference Redmon J, Divvala S, Girshick R, Farhadi A (2015) You only look once: unified, real-time object detection. arXiv preprint arXiv:1506.02640 Redmon J, Divvala S, Girshick R, Farhadi A (2015) You only look once: unified, real-time object detection. arXiv preprint arXiv:1506.02640
34.
go back to reference Redmon J, Farhadi A (2016) YOLO9000: better, faster, stronger. arXiv preprint arXiv:1612.08242 Redmon J, Farhadi A (2016) YOLO9000: better, faster, stronger. arXiv preprint arXiv:1612.08242
35.
go back to reference Sundaram M (1989) Renal osteodystrophy. Skeletal Radiol 18:415–426 Sundaram M (1989) Renal osteodystrophy. Skeletal Radiol 18:415–426
36.
go back to reference Shore RM, Chesney RW (2013) Rickets: part II. Pediatr Radiol 43:152–172 Shore RM, Chesney RW (2013) Rickets: part II. Pediatr Radiol 43:152–172
37.
go back to reference Chang CY, Rosenthal DI, Mitchell DM et al (2016) Imaging findings of metabolic bone disease. Radiographics 36:1871–1887 Chang CY, Rosenthal DI, Mitchell DM et al (2016) Imaging findings of metabolic bone disease. Radiographics 36:1871–1887
38.
go back to reference Oestreich AE (2015) Concave distal end of ulna metaphysis alone is not a sign of rickets. Pediatr Radiol 45:998–1000 Oestreich AE (2015) Concave distal end of ulna metaphysis alone is not a sign of rickets. Pediatr Radiol 45:998–1000
40.
go back to reference Annarumma M, Withey SJ, Bakewell RJ et al (2019) Automated triaging of adult chest radiographs with deep artificial neural networks. Radiology 291:196–202 Annarumma M, Withey SJ, Bakewell RJ et al (2019) Automated triaging of adult chest radiographs with deep artificial neural networks. Radiology 291:196–202
41.
go back to reference Seah JCY, Tang JSN, Kitchen A et al (2019) Chest radiographs in congestive heart failure: visualizing neural network learning. Radiology 290:514–522 Seah JCY, Tang JSN, Kitchen A et al (2019) Chest radiographs in congestive heart failure: visualizing neural network learning. Radiology 290:514–522
44.
go back to reference Willemink MJ, Koszek WA, Hardell C et al (2020) Preparing medical imaging data for machine learning. Radiology 295:4–15 Willemink MJ, Koszek WA, Hardell C et al (2020) Preparing medical imaging data for machine learning. Radiology 295:4–15
45.
go back to reference Liu F, Guan B, Zhou Z et al (2019) Fully automated diagnosis of anterior cruciate ligament tears on knee MR images by using deep learning. Radiology: Artificial Intelligence 1:180091 Liu F, Guan B, Zhou Z et al (2019) Fully automated diagnosis of anterior cruciate ligament tears on knee MR images by using deep learning. Radiology: Artificial Intelligence 1:180091
47.
go back to reference Philbrick KA, Yoshida K, Inoue D et al (2018) What does deep learning see? Insights from a classifier trained to predict contrast enhancement phase from CT images. AJR Am J Roentgenol 211:1184–1193 Philbrick KA, Yoshida K, Inoue D et al (2018) What does deep learning see? Insights from a classifier trained to predict contrast enhancement phase from CT images. AJR Am J Roentgenol 211:1184–1193
Metadata
Title
Artificial intelligence research within reach: an object detection model to identify rickets on pediatric wrist radiographs
Authors
Karthik C. Meda
Sarah S. Milla
Bradley S. Rostad
Publication date
01-05-2021
Publisher
Springer Berlin Heidelberg
Published in
Pediatric Radiology / Issue 5/2021
Print ISSN: 0301-0449
Electronic ISSN: 1432-1998
DOI
https://doi.org/10.1007/s00247-020-04895-8

Other articles of this Issue 5/2021

Pediatric Radiology 5/2021 Go to the issue

Hermes

Hermes