Skip to main content
Top
Published in: European Radiology 1/2021

01-01-2021 | Computed Tomography | Imaging Informatics and Artificial Intelligence

Automated quantification of COVID-19 severity and progression using chest CT images

Authors: Jiantao Pu, Joseph K. Leader, Andriy Bandos, Shi Ke, Jing Wang, Junli Shi, Pang Du, Youmin Guo, Sally E. Wenzel, Carl R. Fuhrman, David O. Wilson, Frank C. Sciurba, Chenwang Jin

Published in: European Radiology | Issue 1/2021

Login to get access

Abstract

Objective

To develop and test computer software to detect, quantify, and monitor progression of pneumonia associated with COVID-19 using chest CT scans.

Methods

One hundred twenty chest CT scans from subjects with lung infiltrates were used for training deep learning algorithms to segment lung regions and vessels. Seventy-two serial scans from 24 COVID-19 subjects were used to develop and test algorithms to detect and quantify the presence and progression of infiltrates associated with COVID-19. The algorithm included (1) automated lung boundary and vessel segmentation, (2) registration of the lung boundary between serial scans, (3) computerized identification of the pneumonitis regions, and (4) assessment of disease progression. Agreement between radiologist manually delineated regions and computer-detected regions was assessed using the Dice coefficient. Serial scans were registered and used to generate a heatmap visualizing the change between scans. Two radiologists, using a five-point Likert scale, subjectively rated heatmap accuracy in representing progression.

Results

There was strong agreement between computer detection and the manual delineation of pneumonic regions with a Dice coefficient of 81% (CI 76–86%). In detecting large pneumonia regions (> 200 mm3), the algorithm had a sensitivity of 95% (CI 94–97%) and specificity of 84% (CI 81–86%). Radiologists rated 95% (CI 72 to 99) of heatmaps at least “acceptable” for representing disease progression.

Conclusion

The preliminary results suggested the feasibility of using computer software to detect and quantify pneumonic regions associated with COVID-19 and to generate heatmaps that can be used to visualize and assess progression.

Key Points

• Both computer vision and deep learning technology were used to develop computer software to quantify the presence and progression of pneumonia associated with COVID-19 depicted on CT images.
• The computer software was tested using both quantitative experiments and subjective assessment.
• The computer software has the potential to assist in the detection of the pneumonic regions, monitor disease progression, and assess treatment efficacy related to COVID-19.
Appendix
Available only for authorised users
Literature
5.
go back to reference Lin C, Ding Y, Xie B et al (2020) Asymptomatic novel coronavirus pneumonia patient outside Wuhan: the value of CT images in the course of the disease. Clin Imaging 63:7–9CrossRef Lin C, Ding Y, Xie B et al (2020) Asymptomatic novel coronavirus pneumonia patient outside Wuhan: the value of CT images in the course of the disease. Clin Imaging 63:7–9CrossRef
11.
go back to reference Hwang EJ, Park S, Jin KN et al (2019) Development and validation of a deep learning-based automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Netw Open 2:e191095CrossRef Hwang EJ, Park S, Jin KN et al (2019) Development and validation of a deep learning-based automated detection algorithm for major thoracic diseases on chest radiographs. JAMA Netw Open 2:e191095CrossRef
12.
go back to reference Fiszman M, Chapman WW, Aronsky D, Evans RS, Haug PJ (2000) Automatic detection of acute bacterial pneumonia from chest X-ray reports. J Am Med Inform Assoc 7:593–604CrossRef Fiszman M, Chapman WW, Aronsky D, Evans RS, Haug PJ (2000) Automatic detection of acute bacterial pneumonia from chest X-ray reports. J Am Med Inform Assoc 7:593–604CrossRef
13.
go back to reference Parveen NR, Sathik MM (2011) Detection of pneumonia in chest X-ray images. J Xray Sci Technol 19:423–428PubMed Parveen NR, Sathik MM (2011) Detection of pneumonia in chest X-ray images. J Xray Sci Technol 19:423–428PubMed
14.
go back to reference Meystre S, Gouripeddi R, Tieder J, Simmons J, Srivastava R, Shah S (2017) Enhancing comparative effectiveness research with automated pediatric pneumonia detection in a multi-institutional clinical repository: a PHIS+ pilot study. J Med Internet Res 19:e162CrossRef Meystre S, Gouripeddi R, Tieder J, Simmons J, Srivastava R, Shah S (2017) Enhancing comparative effectiveness research with automated pediatric pneumonia detection in a multi-institutional clinical repository: a PHIS+ pilot study. J Med Internet Res 19:e162CrossRef
15.
go back to reference Kauczor HU, Heitmann K, Heussel CP, Marwede D, Uthmann T, Thelen M (2000) Automatic detection and quantification of ground-glass opacities on high-resolution CT using multiple neural networks: comparison with a density mask. AJR Am J Roentgenol 175:1329–1334CrossRef Kauczor HU, Heitmann K, Heussel CP, Marwede D, Uthmann T, Thelen M (2000) Automatic detection and quantification of ground-glass opacities on high-resolution CT using multiple neural networks: comparison with a density mask. AJR Am J Roentgenol 175:1329–1334CrossRef
16.
go back to reference Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF, (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Springer International Publishing, Cham, pp. 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF, (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Springer International Publishing, Cham, pp. 234–241
17.
go back to reference van der Heyden B, van de Worp W, van Helvoort A et al (2020) Automated CT-derived skeletal muscle mass determination in lower hind limbs of mice using a 3D U-Net deep learning network. J Appl Physiol (1985) 128:42–49CrossRef van der Heyden B, van de Worp W, van Helvoort A et al (2020) Automated CT-derived skeletal muscle mass determination in lower hind limbs of mice using a 3D U-Net deep learning network. J Appl Physiol (1985) 128:42–49CrossRef
19.
go back to reference Gu S, Meng X, Sciurba FC et al (2014) Bidirectional elastic image registration using B-spline affine transformation. Comput Med Imaging Graph 38:306–314CrossRef Gu S, Meng X, Sciurba FC et al (2014) Bidirectional elastic image registration using B-spline affine transformation. Comput Med Imaging Graph 38:306–314CrossRef
20.
go back to reference Pu J, Fuhrman C, Good WF, Sciurba FC, Gur D (2011) A differential geometric approach to automated segmentation of human airway tree. IEEE Trans Med Imaging 30:266–278CrossRef Pu J, Fuhrman C, Good WF, Sciurba FC, Gur D (2011) A differential geometric approach to automated segmentation of human airway tree. IEEE Trans Med Imaging 30:266–278CrossRef
21.
go back to reference Zou KH, Warfield SK, Bharatha A et al (2004) Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol 11:178–189CrossRef Zou KH, Warfield SK, Bharatha A et al (2004) Statistical validation of image segmentation quality based on a spatial overlap index. Acad Radiol 11:178–189CrossRef
22.
go back to reference Zou K, Liu A, Bandos AI, Ohno-Machado L, Rockette HE (2016) Statistical evaluation of diagnostic performance: topics in ROC analysis. Chapman and Hall/CRC Zou K, Liu A, Bandos AI, Ohno-Machado L, Rockette HE (2016) Statistical evaluation of diagnostic performance: topics in ROC analysis. Chapman and Hall/CRC
23.
go back to reference Gerard SE, Herrmann J, Kaczka DW, Musch G, Fernandez-Bustamante A, Reinhardt JM (2020) Multi-resolution convolutional neural networks for fully automated segmentation of acutely injured lungs in multiple species. Med Image Anal 60:101592CrossRef Gerard SE, Herrmann J, Kaczka DW, Musch G, Fernandez-Bustamante A, Reinhardt JM (2020) Multi-resolution convolutional neural networks for fully automated segmentation of acutely injured lungs in multiple species. Med Image Anal 60:101592CrossRef
24.
go back to reference Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ (2017) Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins DL, Duchesne S (eds) Medical Image Computing and Computer Assisted Intervention − MICCAI 2017. Springer International Publishing, Cham, pp 621–629CrossRef Harrison AP, Xu Z, George K, Lu L, Summers RM, Mollura DJ (2017) Progressive and multi-path holistically nested neural networks for pathological lung segmentation from CT images. In: Descoteaux M, Maier-Hein L, Franz A, Jannin P, Collins DL, Duchesne S (eds) Medical Image Computing and Computer Assisted Intervention − MICCAI 2017. Springer International Publishing, Cham, pp 621–629CrossRef
26.
go back to reference Pu J, Zheng B, Leader JK, Wang XH, Gur D (2008) An automated CT based lung nodule detection scheme using geometric analysis of signed distance field. Med Phys 35:3453–3461CrossRef Pu J, Zheng B, Leader JK, Wang XH, Gur D (2008) An automated CT based lung nodule detection scheme using geometric analysis of signed distance field. Med Phys 35:3453–3461CrossRef
27.
go back to reference Pu J, Paik DS, Meng X, Roos JE, Rubin GD (2011) Shape “break-and-repair” strategy and its application to automated medical image segmentation. IEEE Trans Vis Comput Graph 17:115–124CrossRef Pu J, Paik DS, Meng X, Roos JE, Rubin GD (2011) Shape “break-and-repair” strategy and its application to automated medical image segmentation. IEEE Trans Vis Comput Graph 17:115–124CrossRef
Metadata
Title
Automated quantification of COVID-19 severity and progression using chest CT images
Authors
Jiantao Pu
Joseph K. Leader
Andriy Bandos
Shi Ke
Jing Wang
Junli Shi
Pang Du
Youmin Guo
Sally E. Wenzel
Carl R. Fuhrman
David O. Wilson
Frank C. Sciurba
Chenwang Jin
Publication date
01-01-2021
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 1/2021
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-020-07156-2

Other articles of this Issue 1/2021

European Radiology 1/2021 Go to the issue