Top

Published in:

Open Access 01-12-2019 | Artificial Intelligence | Statement

What the radiologist should know about artificial intelligence – an ESR white paper

Author: European Society of Radiology (ESR)

Published in: Insights into Imaging | Issue 1/2019

Abstract

This paper aims to provide a review of the basis for application of AI in radiology, to discuss the immediate ethical and professional impact in radiology, and to consider possible future evolution.

Even if AI does add significant value to image interpretation, there are implications outside the traditional radiology activities of lesion detection and characterisation. In radiomics, AI can foster the analysis of the features and help in the correlation with other omics data. Imaging biobanks would become a necessary infrastructure to organise and share the image data from which AI models can be trained. AI can be used as an optimising tool to assist the technologist and radiologist in choosing a personalised patient’s protocol, tracking the patient’s dose parameters, providing an estimate of the radiation risks. AI can also aid the reporting workflow and help the linking between words, images, and quantitative data. Finally, AI coupled with CDS can improve the decision process and thereby optimise clinical and radiological workflow.

Morgenstern M (2017) Automation and anxiety. The Economist https://www.economist.com/special-report/2016/06/25/automation-and-anxiety. Accessed 7 Aug 2017

Mukherjee S (2017) A.I Versus M.D. New Yorker. http://www.newyorker.com/magazine/2017/04/03/ai-versus-md. Accessed 7 Aug 2017

Brink JA, Arenson RL, Grist TM, Lewin JS, Enzmann D (2017) Bits and bytes; the future of radiology lies in informatics and information technology. Eur Radiol 27:3647–3651 https://doi.org/10.1007/s00330-016-4688-5

Nilsson NJ (1998) Artificial Intelligence: A New Synthesis. Morgan Kaufmann Publishers, Inc

Turing A (1936) On computable numbers, with an application to the Entscheidungsproblem. Proc Lond Math Soc 2nd Ser 42:230–265

Smith G (2018) The AI Delusion. Oxford University Press

https://www.ubs.com/microsites/artificial-intelligence/en/new-dawn.html Accessed 20 Mar 2019

McCarthy J, Minsky ML, Rochester N, Shannon, CE (1955) Proposal for the Dartmouth summer research project on artificial intelligence. Tech rep, Dartmouth College. Original document available at http://www-formal.stanford.edu/jmc/history/dartmouth/dartmouth.html. Accessed 13 Oct 2018

Russel S, Norvig P (2010) Artificial Intelligence. A modern approach. Pearson Education, Inc. Upper Saddle River, New Jersey, p 07458

10.

Samuel AL (1959) Some studies in machine learning using the game of checkers. IBM Journal 3:211–229

11.

Zhou N, Siegel ZD, Zarecor S et al (2018) Crowdsourcing image analysis for plant phenomics to generate ground truth data for machine learning. PLoS Comput Biol 14(7):e1006337. https://doi.org/10.1371/journal.pcbi.1006337 CrossRefPubMedPubMedCentral

12.

Fry H (2018) Hello World: How to be human in the age of the machine. Doubleday

13.

Yamashita R, Nishio M, Do RKG, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights Imaging 9(4):611–629.

14.

Doi K (2007) Computer-Aided Diagnosis in Medical Imaging: Historical Review, Current Status and Future Potential. Comput Med Imaging Graph 31(4-5):198–211CrossRef

15.

Lodwick GS, Haun CL, Smith WE, Keller RF, Robertson ED (1963) Computer diagnosis of primary bone tumor. Radiology 80:273–275

16.

Meyers PH, Nice CM Jr, Becker HC, Nettleton JW Jr, Sweeney JW, Meckstroth GR (1964) Automated computer analysis of radiographic images. Radiology 83:1029–1034

17.

Winsberg F, Elkin M, Macy J Jr, Bordaz V, Weymouth W (1967) Detection of radiographic abnormalities in mammograms by means of optical scanning and computer analysis. Radiology 89:211–215

18.

Kruger RP, Towns JR, Hall DL, Dwyer SJ 3rd, Lodwick GS (1972) Automated radiographic diagnosis via feature extraction and classification of cardiac size and shape descriptors. IEEE Trans Biomed Eng 19(3):174–186

19.

Kruger RP, Thompson WB, Turner AF (1974) Computer diagnosis of pneumoconiosis. IEEE Trans Syst Man Cybern SMC-4:44–47 31CrossRef

20.

Regge D, Halligan S (2013) CAD: how it works, how to use it, performance. Eur J Radiol. 82(8):1171–1176CrossRef

21.

Al Mohammad B, Brennan PC, Mello-Thoms C (2017) A review of lung cancer screening and the role of computer-aided detection. Clin Radiol. 72(6):433–442CrossRef

22.

Katzen J, Dodelzon K (2018) A review of computer aided detection in mammography. Clin Imaging 52:305–309CrossRef

23.

Halabi SS, Prevedello LM, Kalpathy-Cramer J et al (2018) The RSNA Pediatric Bone Age Machine Learning Challenge. Radiology 290:498–503

24.

Sadoughi F, Kazemy Z, Hamedan F, Owji L, Rahmanikatigari M, Azadboni TT (2018) Artificial intelligence methods for the diagnosis of breast cancer by image processing: a review. Breast Cancer (Dove Med Press) 10:219–230. https://doi.org/10.2147/BCTT.S175311 CrossRef

25.

Ayer T, Chen Q, Burnside ES (2013) Artificial neural networks in mammography interpretation and diagnostic decision making. Comput Math Methods Med. 2013:832509. https://doi.org/10.1155/2013/832509 CrossRefPubMedPubMedCentral

26.

Houssami N, Lee CI, Buist DSM, Tao D (2017) Artificial intelligence for breast cancer screening: Opportunity or hype? Breast 36:31–33. https://doi.org/10.1016/j.breast.2017.09.003 CrossRefPubMed

27.

Codari M, Schiaffino S, Sardanelli F, Trimboli RM (2019) Artificial Intelligence for Breast MRI in 2008-2018: A Systematic Mapping Review. AJR Am J Roentgenol 212:280–292 https://doi.org/10.2214/AJR.18.20389

28.

Dalmiş MU, Gubern-Mérida A, Vreemann S et al (2019) Artificial Intelligence-Based Classification of Breast Lesions Imaged With a Multiparametric Breast MRI Protocol With Ultrafast DCE-MRI, T2, and DWI. Invest Radiol. https://doi.org/10.1097/RLI.0000000000000544

29.

Ha R, Chin C, Karcich J et al (2018) Prior to Initiation of Chemotherapy, Can We Predict Breast Tumor Response? Deep Learning Convolutional Neural Networks Approach Using a Breast MRI Tumor Dataset. J Digit Imaging https://doi.org/10.1007/s10278-018-0144-1.

30.

Rajpurkar P, Irvin J, Ball RL et al (2018) Deep learning for chest radiograph diagnosis: A retrospective comparison of CheXNeXt to practicing radiologists. PLoS Med 15(11):e1002686 https://doi.org/10.1371/journal.pmed.1002686

31.

Taylor AG, Mielke C, Mongan J (2018) Automated detection of clinically-significant pneumothorax on frontal chest X-rays using deep convolutional neural networks. PLoS Med. 15(11):e1002697 https://doi.org/10.1371/journal.pmed.1002697 CrossRef

32.

Zech JR, Badgeley MA, Liu M, Costa AB, Titano JJ, Oermann EK (2018) Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study. PLoS Med. 15(11):e1002683 https://doi.org/10.1371/journal.pmed.1002683 CrossRef

33.

Setio AAA, Traverso A, de Bel T et al (2017) Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge. Med Image Anal 42:1–13.CrossRef

34.

Yasaka K, Akai H, Abe O, Kiryu S (2018) Deep Learning with Convolutional Neural Network for Differentiation of Liver Masses at Dynamic Contrast-enhanced CT: A Preliminary Study. Radiology 286(3):887–896 https://doi.org/10.1148/radiol.2017170706 CrossRef

35.

Yasaka K, Akai H, Kunimatsu A, Abe O, Kiryu S (2018) Liver Fibrosis: Deep Convolutional Neural Network for Staging by Using Gadoxetic Acid-enhanced Hepatobiliary Phase MR Images. Radiology 287(1):146–155 https://doi.org/10.1148/radiol.2017171928 CrossRef

36.

Streba CT, Ionescu M, Gheonea DI et al (2012) Contrast-enhanced ultrasonography parameters in neural network diagnosis of liver tumors. World J Gastroenterol 18(32):4427–4434

37.

Lotan E, Jain R, Razavian N, Fatterpekar GM, Lui YW (2019) State of the Art: Machine Learning Applications in Glioma Imaging. AJR Am J Roentgenol 212(1):26–37.CrossRef

38.

Naceur MB, Saouli R, Akil M, Kachouri R (2018) Fully Automatic Brain Tumor Segmentation using End-To-End Incremental Deep Neural Networks in MRI images. Comput Methods Programs Biomed. 166:39–49. https://doi.org/10.1016/j.cmpb.2018.09.007 CrossRefPubMed

39.

Yuan Y, Qin W, Buyyounouski M et al (2018) Prostate Cancer Classification with Multi-parametric MRI Transfer Learning Model. Med Phys. https://doi.org/10.1002/mp.13367

40.

Wang J, Wu CJ, Bao ML, Zhang J, Wang XN, Zhang YD (2017) Machine learning-based analysis of MR radiomics can help to improve the diagnostic performance of PI-RADS v2 in clinically relevant prostate cancer. Eur Radiol 27(10):4082–4090

41.

Smyser CD, Dosenbach NU, Smyser TA et al (2016) Prediction of brain maturity in infants using machine-learning algorithms. Neuroimage 136:1–9.

42.

Fartaria MJ, Bonnier G, Roche A et al (2016) Automated detection of white matter and cortical lesions in early stages of multiple sclerosis. J Magn Reson Imaging 43(6):1445–1454. https://doi.org/10.1002/jmri.25095

43.

Zhang X, Yan LF, Hu YC et al (2017) Optimizing a machine learning based glioma grading system using multi-parametric MRI histogram and texture features. Oncotarget 8(29):47816–47830.

44.

Avendi MR, Kheradvar A, Jafarkhani H (2016) A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI. Med Image Anal 30:108–119. https://doi.org/10.1016/j.media.2016.01.005

45.

Cheng R, Roth HR, Lay N et al (2017) Automatic magnetic resonance prostate segmentation by deep learning with holistically nested networks. J Med Imaging (Bellingham) 4(4):041302. https://doi.org/10.1117/1.JMI.4.4.041302

46.

Roth HR, Lu L, Lay N et al (2018) Spatial aggregation of holistically-nested convolutional neural networks for automated pancreas localization and segmentation. Med Image Anal 45:94–107. https://doi.org/10.1016/j.media.2018.01.006

47.

Wang S, Summers RM (2012) Machine learning and radiology. Med Image Anal 16(5):933–951. https://doi.org/10.1016/j.media.2012.02.005 CrossRefPubMedPubMedCentral

48.

Trebeschi S, van Griethuysen JJM, Lambregts DMJ et al (2017) Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR. Sci Rep 7(1):5301.

49.

Weston AD, Korfiatis P, Kline TL et al (2018) Automated Abdominal Segmentation of CT Scans for Body Composition Analysis Using Deep Learning. Radiology 290:669–679.

50.

Gibson E, Giganti F, Hu Y et al (2018) Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks. IEEE Trans Med Imaging 37(8):1822–1834. https://doi.org/10.1109/TMI.2018.2806309

51.

Hu P, Wu F, Peng J, Liang P, Kong D (2016) Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution. Phys Med Biol 61(24):8676–8698CrossRef

52.

Liu Y, Stojadinovic S, Hrycushko B et al (2017) A deep convolutional neural network-based automatic delineation strategy for multiple brain metastases stereotactic radiosurgery. PLoS One 12(10):e0185844. https://doi.org/10.1371/journal.pone.0185844

53.

Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446CrossRef

54.

Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: Images Are More than Pictures, They Are Data. Radiology 278:563–577CrossRef

55.

Neri E, Del Re M, Paiar F et al (2018) Radiomics and liquid biopsy in oncology: the holons of systems medicine. Insights Imaging 9(6):915–924. https://doi.org/10.1007/s13244-018-0657-7

56.

Neri E, Regge D (2017) Imaging biobanks in oncology: European perspective. Future Oncol. 13(5):433–441. https://doi.org/10.2217/fon-2016-0239 CrossRefPubMed

57.

European Society of Radiology (ESR) (2015) ESR Position Paper on Imaging Biobanks. Insights Imaging 6(4):403–410. https://doi.org/10.1007/s13244-015-0409-x CrossRef

58.

Hong Y, Kahn CE Jr (2013) Content analysis of reporting templates and free-text radiology reports. J Digit Imaging 26(5):843–849. https://doi.org/10.1007/s10278-013-9597-4 CrossRefPubMedPubMedCentral

59.

Rubin DL, Kahn CE Jr (2017) Common Data Elements in Radiology. Radiology 283(3):837–844. https://doi.org/10.1148/radiol.2016161553 CrossRefPubMed

60.

Choy G, Khalilzadeh O, Michalski M et al (2018) Current Applications and Future Impact of Machine Learning in Radiology. Radiology 288(2):318–328. https://doi.org/10.1148/radiol.2018171820

61.

Remedios D, Brkljacic B, Ebdon-Jackson S, Hierath M, Sinitsyn V, Vassileva J (2018) Collaboration, campaigns and champions for appropriate imaging: feedback from the Zagreb workshop. Insights Imaging 9(2):211–214. https://doi.org/10.1007/s13244-018-0602-9 CrossRefPubMedPubMedCentral

62.

Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL (2018) Artificial intelligence in radiology. Nat Rev Cancer 18(8):500–510.

63.

Asimov I (1950) “Runaround”. I, Robot. The Isaac Asimov Collection ed. Doubleday, New York City, p 40 ISBN 0-385-42304-7

64.

Trapero García MA, López Parrilla I (2019) SERAM guide for the renewal and technological update in radiology. Radiologia 61(1):35–41. https://doi.org/10.1016/j.rx.2018.09.004 CrossRefPubMed

65.

European Society of Radiology (ESR) (2014) Renewal of radiological equipment. Insights Imaging 5(5):543–546. https://doi.org/10.1007/s13244-014-0345-1 CrossRef

66.

The European Parliament and the Council of the European Union (2017) Regulation (EU) 2017/745 on medical devices, amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and repealing Council Directives 90/385/EEC and 93/42/EEC. Official Journal of the European Union. Available via https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32017R0745 Accessed 20 Mar 2019

67.

Kohli M, Prevedello LM, Filice RW, Geis JR (2017) Implementing Machine Learning in Radiology Practice and Research. AJR Am J Roentgenol 208(4):754–760. https://doi.org/10.2214/AJR.16.17224 CrossRefPubMed

68.

Kohli M, Geis R (2018) Ethics, Artificial Intelligence, and Radiology. J Am Coll Radiol 15:1317–1319. https://doi.org/10.1016/j.jacr.2018.05.020 CrossRefPubMed

69.

Gartner Hype Cycle (2019). Available at https://www.gartner.com/en/research/methodologies/gartner-hype-cycle. Accessed 20 Mar 2019

70.

Hricak H (2018) 2016. New Horizons Lecture: Beyond Imaging – Radiology of tomorrow. Radiology 286:764–775CrossRef

71.

Pesapane F, Codari M, Sardanelli F (2018) Artificial intelligence in medical imaging: threat or opportunity? Radiologists again at the forefront of innovation in medicine. Eur Radiol Exp 2(1):35.

Title: What the radiologist should know about artificial intelligence – an ESR white paper
Author: European Society of Radiology (ESR)
Publication date: 01-12-2019
Publisher: Springer Berlin Heidelberg
Keyword: Artificial Intelligence
Published in: Insights into Imaging / Issue 1/2019
Electronic ISSN: 1869-4101
DOI: https://doi.org/10.1186/s13244-019-0738-2

Keynote webinar | Spotlight on medication adherence

Springer Medicine

What the radiologist should know about artificial intelligence – an ESR white paper

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2019

The skin dose of pelvic radiographs since 1896

Endoscopic stenting of malignant, benign and iatrogenic colorectal disorders: a primer for radiologists

Anatomical variation in the ankle and foot: from incidental finding to inductor of pathology. Part II: midfooot and forefoot

Non-neoplastic pathology at the crossroads between neck imaging and cardiothoracic imaging

Pathology of the carotid space

Emergency imaging in paediatric oncology: a pictorial review