Skip to main content
Top
Published in: Journal of Digital Imaging 1/2020

01-02-2020 | Computed Tomography

Performance of a Deep Learning Algorithm for Automated Segmentation and Quantification of Traumatic Pelvic Hematomas on CT

Authors: David Dreizin, Yuyin Zhou, Yixiao Zhang, Nikki Tirada, Alan L. Yuille

Published in: Journal of Imaging Informatics in Medicine | Issue 1/2020

Login to get access

Abstract

The volume of pelvic hematoma at CT has been shown to be the strongest independent predictor of major arterial injury requiring angioembolization in trauma victims with pelvic fractures, and also correlates with transfusion requirement and mortality. Measurement of pelvic hematomas (unopacified extraperitoneal blood accumulated from time of injury) using semi-automated seeded region growing is time-consuming and requires trained experts, precluding routine measurement at the point of care. Pelvic hematomas are markedly variable in shape and location, have irregular ill-defined margins, have low contrast with respect to viscera and muscle, and reside within anatomically distorted pelvises. Furthermore, pelvic hematomas occupy a small proportion of the entire volume of a chest, abdomen, and pelvis (C/A/P) trauma CT. The challenges are many, and no automated methods for segmentation and volumetric analysis have been described to date. Traditional approaches using fully convolutional networks result in coarse segmentations and class imbalance with suboptimal convergence. In this study, we implement a modified coarse-to-fine deep learning approach—the Recurrent Saliency Transformation Network (RSTN) for pelvic hematoma volume segmentation. RSTN previously yielded excellent results in pancreas segmentation, where low contrast with adjacent structures, small target volume, variable location, and fine contours are also problematic. We have curated a unique single-institution corpus of 253 C/A/P admission trauma CT studies in patients with bleeding pelvic fractures with manually labeled pelvic hematomas. We hypothesized that RSTN would result in sufficiently high Dice similarity coefficients to facilitate accurate and objective volumetric measurements for outcome prediction (arterial injury requiring angioembolization). Cases were separated into five combinations of training and test sets in an 80/20 split and fivefold cross-validation was performed. Dice scores in the test set were 0.71 (SD ± 0.10) using RSTN, compared to 0.49 (SD ± 0.16) using a baseline Deep Learning Tool Kit (DLTK) reference 3D U-Net architecture. Mean inference segmentation time for RSTN was 0.90 min (± 0.26). Pearson correlation between predicted and manual labels was 0.95 with p < 0.0001. Measurement bias was within 10 mL. AUC of hematoma volumes for predicting need for angioembolization was 0.81 (predicted) versus 0.80 (manual). Qualitatively, predicted labels closely followed hematoma contours and avoided muscle and displaced viscera. Further work will involve validation using a federated dataset and incorporation into a predictive model using multiple segmented features.
Literature
1.
go back to reference Yoon W, Kim JK, Jeong YY, Seo JJ, Park JG, Kang HK: Pelvic arterial hemorrhage in patients with pelvic fractures: Detection with contrast-enhanced CT. Radiographics. 24(6):1591–1605, 2004CrossRef Yoon W, Kim JK, Jeong YY, Seo JJ, Park JG, Kang HK: Pelvic arterial hemorrhage in patients with pelvic fractures: Detection with contrast-enhanced CT. Radiographics. 24(6):1591–1605, 2004CrossRef
2.
go back to reference Demetriades D, Karaiskakis M, Toutouzas K, Alo K, Velmahos G, Chan L: Pelvic fractures: Epidemiology and predictors of associated abdominal injuries and outcomes1. Journal of the American College of Surgeons 195(1):1–10, 2002CrossRef Demetriades D, Karaiskakis M, Toutouzas K, Alo K, Velmahos G, Chan L: Pelvic fractures: Epidemiology and predictors of associated abdominal injuries and outcomes1. Journal of the American College of Surgeons 195(1):1–10, 2002CrossRef
3.
go back to reference Holstein JH, Culemann U, Pohlemann T, WGMiPF P: What are predictors of mortality in patients with pelvic fractures? Clinical Orthopaedics and Related Research®. 470(8):2090–2097, 2012CrossRef Holstein JH, Culemann U, Pohlemann T, WGMiPF P: What are predictors of mortality in patients with pelvic fractures? Clinical Orthopaedics and Related Research®. 470(8):2090–2097, 2012CrossRef
4.
go back to reference Heckbert SR, Vedder NB, Hoffman W, Winn RK, Hudson LD, Jurkovich GJ, Copass MK, Harlan JM, Rice CL, Maier RV: Outcome after hemorrhagic shock in trauma patients. Journal of Trauma and Acute Care Surgery. 45(3):545–549, 1998CrossRef Heckbert SR, Vedder NB, Hoffman W, Winn RK, Hudson LD, Jurkovich GJ, Copass MK, Harlan JM, Rice CL, Maier RV: Outcome after hemorrhagic shock in trauma patients. Journal of Trauma and Acute Care Surgery. 45(3):545–549, 1998CrossRef
5.
go back to reference Sathy AK, Starr AJ, Smith WR, Elliott A, Agudelo J, Reinert CM, Minei JP: The effect of pelvic fracture on mortality after trauma: An analysis of 63,000 trauma patients. JBJS. 91(12):2803–2810, 2009CrossRef Sathy AK, Starr AJ, Smith WR, Elliott A, Agudelo J, Reinert CM, Minei JP: The effect of pelvic fracture on mortality after trauma: An analysis of 63,000 trauma patients. JBJS. 91(12):2803–2810, 2009CrossRef
6.
go back to reference Dreizin D, Munera F: Blunt polytrauma: Evaluation with 64-section whole-body CT angiography. Radiographics. 32(3):609–631, 2012CrossRef Dreizin D, Munera F: Blunt polytrauma: Evaluation with 64-section whole-body CT angiography. Radiographics. 32(3):609–631, 2012CrossRef
7.
go back to reference Cullinane DC, Schiller HJ, Zielinski MD, Bilaniuk JW, Collier BR, Como J, Holevar M, Sabater EA, Sems SA, Vassy WM, Wynne JL: Eastern Association for the Surgery of trauma practice management guidelines for hemorrhage in pelvic fracture—Update and systematic review. Journal of Trauma and Acute Care Surgery. 71(6):1850–1868, 2011CrossRef Cullinane DC, Schiller HJ, Zielinski MD, Bilaniuk JW, Collier BR, Como J, Holevar M, Sabater EA, Sems SA, Vassy WM, Wynne JL: Eastern Association for the Surgery of trauma practice management guidelines for hemorrhage in pelvic fracture—Update and systematic review. Journal of Trauma and Acute Care Surgery. 71(6):1850–1868, 2011CrossRef
8.
go back to reference Blackmore CC, Jurkovich GJ, Linnau KF, Cummings P, Hoffer EK, Rivara FP: Assessment of volume of hemorrhage and outcome from pelvic fracture. Archives of surgery. 138(5):504–509, 2003CrossRef Blackmore CC, Jurkovich GJ, Linnau KF, Cummings P, Hoffer EK, Rivara FP: Assessment of volume of hemorrhage and outcome from pelvic fracture. Archives of surgery. 138(5):504–509, 2003CrossRef
9.
go back to reference Dreizin D, Bodanapally U, Boscak A, Tirada N, Issa G, Nascone JW, Bivona L, Mascarenhas D, O’Toole RV, Nixon E, Chen R, Siegel E: CT prediction model for major arterial injury after blunt pelvic ring disruption. Radiology. 287(3):1061–1069, 2018CrossRef Dreizin D, Bodanapally U, Boscak A, Tirada N, Issa G, Nascone JW, Bivona L, Mascarenhas D, O’Toole RV, Nixon E, Chen R, Siegel E: CT prediction model for major arterial injury after blunt pelvic ring disruption. Radiology. 287(3):1061–1069, 2018CrossRef
10.
go back to reference Dreizin D, Bodanapally UK, Neerchal N, Tirada N, Patlas M, Herskovits E: Volumetric analysis of pelvic hematomas after blunt trauma using semi-automated seeded region growing segmentation: A method validation study. Abdominal Radiology. 41(11):2203–2208, 2016CrossRef Dreizin D, Bodanapally UK, Neerchal N, Tirada N, Patlas M, Herskovits E: Volumetric analysis of pelvic hematomas after blunt trauma using semi-automated seeded region growing segmentation: A method validation study. Abdominal Radiology. 41(11):2203–2208, 2016CrossRef
11.
go back to reference Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI: A survey on deep learning in medical image analysis. Medical image analysis. 42:60–88, 2017CrossRef Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI: A survey on deep learning in medical image analysis. Medical image analysis. 42:60–88, 2017CrossRef
12.
go back to reference Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems2012, pp. 1097–1105 Krizhevsky A, Sutskever I, Hinton GE: Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems2012, pp. 1097–1105
13.
go back to reference Chartrand G, Cheng PM, Vorontsov E, Drozdzal M, Turcotte S, Pal CJ, Kadoury S, Tang A: Deep learning: A primer for radiologists. Radiographics. 37(7):2113–2131, 2017CrossRef Chartrand G, Cheng PM, Vorontsov E, Drozdzal M, Turcotte S, Pal CJ, Kadoury S, Tang A: Deep learning: A primer for radiologists. Radiographics. 37(7):2113–2131, 2017CrossRef
14.
go back to reference Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention: Springer:234–241, 2015 Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention: Springer:234–241, 2015
15.
go back to reference Milletari F, Navab N, Ahmadi S-A: V-net: Fully convolutional neural networks for volumetric medical image segmentation. 3D vision (3DV), 2016 fourth international conference on. IEEE, 2016, pp. 565–571 Milletari F, Navab N, Ahmadi S-A: V-net: Fully convolutional neural networks for volumetric medical image segmentation. 3D vision (3DV), 2016 fourth international conference on. IEEE, 2016, pp. 565–571
16.
go back to reference Long J, Shelhamer E, Darrell T.: Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition2015; p. 3431–3440. Long J, Shelhamer E, Darrell T.: Fully convolutional networks for semantic segmentation. Proceedings of the IEEE conference on computer vision and pattern recognition2015; p. 3431–3440.
17.
go back to reference Yasaka K, Akai H, Abe O, Kiryu S: Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: A preliminary study. Radiology. 286(3):887–896, 2017CrossRef Yasaka K, Akai H, Abe O, Kiryu S: Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: A preliminary study. Radiology. 286(3):887–896, 2017CrossRef
18.
go back to reference Christ PF, Elshaer MEA, Ettlinger F et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer:415–423, 2016 Christ PF, Elshaer MEA, Ettlinger F et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer:415–423, 2016
19.
go back to reference Yang D, Xu D, Zhou SK, et al. Automatic liver segmentation using an adversarial image-to-image network. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer, 2017; p. 507–15. Yang D, Xu D, Zhou SK, et al. Automatic liver segmentation using an adversarial image-to-image network. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer, 2017; p. 507–15.
20.
go back to reference Roth HR, Lu L, Farag A et al.: Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, 2015, pp. 556–564 Roth HR, Lu L, Farag A et al.: Deeporgan: Multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, 2015, pp. 556–564
21.
go back to reference Roth HR, Farag A, Lu L, Turkbey EB, Summers RM.: Deep convolutional networks for pancreas segmentation in CT imaging. Medical Imaging 2015: Image Processing: International Society for Optics and Photonics, 2015; p. 94131G. Roth HR, Farag A, Lu L, Turkbey EB, Summers RM.: Deep convolutional networks for pancreas segmentation in CT imaging. Medical Imaging 2015: Image Processing: International Society for Optics and Photonics, 2015; p. 94131G.
22.
go back to reference Zhou Y, Xie L, Fishman EK, Yuille AL: Deep supervision for pancreatic cyst segmentation in abdominal CT scans. International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 222–230 Zhou Y, Xie L, Fishman EK, Yuille AL: Deep supervision for pancreatic cyst segmentation in abdominal CT scans. International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 222–230
23.
go back to reference Zhou Y, Xie L, Shen W, Wang Y, Fishman EK, Yuille AL: A fixed-point model for pancreas segmentation in abdominal CT scans. In: International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 693–701 Zhou Y, Xie L, Shen W, Wang Y, Fishman EK, Yuille AL: A fixed-point model for pancreas segmentation in abdominal CT scans. In: International conference on medical image computing and computer-assisted intervention. Springer, 2017, pp. 693–701
24.
go back to reference Yu L, Yang X, Chen H, Qin J, Heng P-A: Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. AAAI2017, pp. 66–72 Yu L, Yang X, Chen H, Qin J, Heng P-A: Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. AAAI2017, pp. 66–72
25.
go back to reference Kohl S, Bonekamp D, Schlemmer H-P, et al. Adversarial networks for the detection of aggressive prostate cancer. arXiv preprint arXiv:170208014. 2017. Kohl S, Bonekamp D, Schlemmer H-P, et al. Adversarial networks for the detection of aggressive prostate cancer. arXiv preprint arXiv:170208014. 2017.
26.
go back to reference Dreizin D, Bodanapally U, Mascarenhas D et al.: Quantitative MDCT assessment of binder effects after pelvic ring disruptions using segmented pelvic haematoma volumes and multiplanar caliper measurements. European radiology.:1–10, 2018 Dreizin D, Bodanapally U, Mascarenhas D et al.: Quantitative MDCT assessment of binder effects after pelvic ring disruptions using segmented pelvic haematoma volumes and multiplanar caliper measurements. European radiology.:1–10, 2018
27.
go back to reference Dreizin D, Nascone J, Davis DL, Mascarenhas D, Tirada N, Chen H, Bodanapally UK: Can MDCT unmask instability in binder-stabilized pelvic ring disruptions? American Journal of Roentgenology. 207(6):1244–1251, 2016CrossRef Dreizin D, Nascone J, Davis DL, Mascarenhas D, Tirada N, Chen H, Bodanapally UK: Can MDCT unmask instability in binder-stabilized pelvic ring disruptions? American Journal of Roentgenology. 207(6):1244–1251, 2016CrossRef
28.
go back to reference Yu Q, Xie L, Wang Y, Zhou Y, Fishman EK, Yuille AL: Recurrent saliency transformation network: Incorporating multi-stage visual cues for small organ segmentation. Conference on Computer Vision and Pattern Recognition (CVPR), 2018 Yu Q, Xie L, Wang Y, Zhou Y, Fishman EK, Yuille AL: Recurrent saliency transformation network: Incorporating multi-stage visual cues for small organ segmentation. Conference on Computer Vision and Pattern Recognition (CVPR), 2018
29.
go back to reference Elzik ME, Dirschl DR, Dahners LE: Correlation of transfusion volume to change in hematocrit. American journal of hematology. 81(2):145–146, 2006CrossRef Elzik ME, Dirschl DR, Dahners LE: Correlation of transfusion volume to change in hematocrit. American journal of hematology. 81(2):145–146, 2006CrossRef
30.
go back to reference Dou Q, Chen H, Jin Y, Yu L, Qin J, Heng P-A: 3D deeply supervised network for automatic liver segmentation from CT volumes. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer:149–157, 2016 Dou Q, Chen H, Jin Y, Yu L, Qin J, Heng P-A: 3D deeply supervised network for automatic liver segmentation from CT volumes. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer:149–157, 2016
31.
go back to reference Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ.: Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer, 2017; p. 621–9. Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ.: Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer, 2017; p. 621–9.
32.
go back to reference Roth HR, Lu L, Farag A, Sohn A, Summers RM: Spatial aggregation of holistically-nested networks for automated pancreas segmentation. International conference on medical image computing and computer-assisted intervention. Springer, 2016, pp. 451–459 Roth HR, Lu L, Farag A, Sohn A, Summers RM: Spatial aggregation of holistically-nested networks for automated pancreas segmentation. International conference on medical image computing and computer-assisted intervention. Springer, 2016, pp. 451–459
33.
go back to reference Pawlowski N, Ktena SI, Lee MC et al.: Dltk: State of the art reference implementations for deep learning on medical images. arXiv preprint arXiv:171106853, 2017 Pawlowski N, Ktena SI, Lee MC et al.: Dltk: State of the art reference implementations for deep learning on medical images. arXiv preprint arXiv:171106853, 2017
34.
go back to reference He K, Zhang X, Ren S, Sun J: Identity mappings in deep residual networks. European conference on computer vision: Springer:630–645, 2016 He K, Zhang X, Ren S, Sun J: Identity mappings in deep residual networks. European conference on computer vision: Springer:630–645, 2016
35.
go back to reference Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3D U-net: Learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Springer, 2016, pp. 424–432 Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3D U-net: Learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Springer, 2016, pp. 424–432
36.
go back to reference Cicchetti DV: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment. 6(4):284–290, 1994CrossRef Cicchetti DV: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment. 6(4):284–290, 1994CrossRef
37.
go back to reference Hanley JA, McNeil BJ: A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 148(3):839–843, 1983CrossRef Hanley JA, McNeil BJ: A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 148(3):839–843, 1983CrossRef
38.
go back to reference EnvoyAI launches with 35 algorithms contributed by 14 newly-contracted artificial intelligence development partners. Global newswire. CAMBRIDGE, Mass.2017. EnvoyAI launches with 35 algorithms contributed by 14 newly-contracted artificial intelligence development partners. Global newswire. CAMBRIDGE, Mass.2017.
39.
go back to reference Dreizin D: Segmented pelvic hematoma volumes, intravenous contrast extravasation volumes, and extravasation rate are all independently predictive of major arterial injury after pelvic fracture: Analysis of a prospective cohort. Radiologic Society of North America 104th Scientific Assembly and Annual Meeting2018 Dreizin D: Segmented pelvic hematoma volumes, intravenous contrast extravasation volumes, and extravasation rate are all independently predictive of major arterial injury after pelvic fracture: Analysis of a prospective cohort. Radiologic Society of North America 104th Scientific Assembly and Annual Meeting2018
40.
go back to reference Dreizin D, Chen R, Rosales R, Li G, Bodanapally U.: Volumetric Markers of Body Composition Improve Personalized Prediction of Major Arterial Bleeding after Blunt Pelvic Ring Disruption. American Society of Emergency Radiology Annual Scientific Meeting and Postgraduate Course. McLean, Virginia: Springer-Verlag, 2018; p. 565–611. Dreizin D, Chen R, Rosales R, Li G, Bodanapally U.: Volumetric Markers of Body Composition Improve Personalized Prediction of Major Arterial Bleeding after Blunt Pelvic Ring Disruption. American Society of Emergency Radiology Annual Scientific Meeting and Postgraduate Course. McLean, Virginia: Springer-Verlag, 2018; p. 565–611.
Metadata
Title
Performance of a Deep Learning Algorithm for Automated Segmentation and Quantification of Traumatic Pelvic Hematomas on CT
Authors
David Dreizin
Yuyin Zhou
Yixiao Zhang
Nikki Tirada
Alan L. Yuille
Publication date
01-02-2020
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 1/2020
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00207-1

Other articles of this Issue 1/2020

Journal of Digital Imaging 1/2020 Go to the issue