Skip to main content
Top
Published in: Journal of Digital Imaging 2/2023

30-11-2022

DLA-H: A Deep Learning Accelerator for Histopathologic Image Classification

Authors: Hamidreza Bolhasani, Somayyeh Jafarali Jassbi, Arash Sharifi

Published in: Journal of Imaging Informatics in Medicine | Issue 2/2023

Login to get access

Abstract

It is more than a decade since machine learning and especially its leading subtype deep learning have become one of the most interesting topics in almost all areas of science and industry. In numerous contexts, at least one of the applications of deep learning is utilized or is going to be utilized. Using deep learning for image classification is now very popular and widely used in various use cases. Many types of research in medical sciences have been focused on the advantages of deep learning for image classification problems. Some recent researches show more than 90% accuracy for breast tissue classification which is a breakthrough. A huge number of computations in deep neural networks are considered a big challenge both from software and hardware point of view. From the architectural perspective, this big amount of computing operations will result in high power consumption and computation runtime. This led to the emersion of deep learning accelerators which are designed mainly for improving performance and energy efficiency. Data reuse and localization are two great opportunities for achieving energy-efficient computations with lower runtime. Data flows are mainly designed based on these important parameters. In this paper, DLA-H and BJS, a deep learning accelerator, and its data flow for histopathologic image classification are proposed. The simulation results with the MAESTRO tool showed 756 cycles for total runtime and \(3.21\times {10}^{6}\) GFLOPS roofline throughput that is an extreme performance improvement in comparison to current general-purpose deep learning accelerators and data flows.
Literature
1.
go back to reference M. Capra et al., “Hardware and software optimizations for accelerating deep neural networks: survey of current trends, challenges, and the road ahead,” IEEE Access, 2020. M. Capra et al., “Hardware and software optimizations for accelerating deep neural networks: survey of current trends, challenges, and the road ahead,” IEEE Access, 2020.
2.
go back to reference Jurgen Brauer. Introduction to Deep Learning. 1st Edition, August 2018. Jurgen Brauer. Introduction to Deep Learning. 1st Edition, August 2018.
4.
go back to reference Sze, V., Chen, Y.-H., Yang, T.-J., and Emer, J. S. Efficient processing of deep neural networks. Synthesis Lectures on Computer Architecture, 15(2):1–341, 2020.CrossRef Sze, V., Chen, Y.-H., Yang, T.-J., and Emer, J. S. Efficient processing of deep neural networks. Synthesis Lectures on Computer Architecture, 15(2):1–341, 2020.CrossRef
6.
go back to reference Bolhasani Hamidreza, Jafarali Jassbi Somayyeh. Deep learning accelerators: a case study with MAESTRO. in Journal of Big Data 12 Nov 2020;7. Article Number: 100 (2020). Bolhasani Hamidreza, Jafarali Jassbi Somayyeh. Deep learning accelerators: a case study with MAESTRO. in Journal of Big Data 12 Nov 2020;7. Article Number: 100 (2020).
7.
go back to reference S. Dong, P. Wang, and K. Abbas, “A survey on deep learning and its applications,” Computer Science Review, 2021. S. Dong, P. Wang, and K. Abbas, “A survey on deep learning and its applications,” Computer Science Review, 2021.
8.
go back to reference A. Dhillon, and G. K. Verma, “Convolutional neural network: a review of models, methodologies and applications to object detection,” Progress in Artificial Intelligence, 2019/12/20, 2019. A. Dhillon, and G. K. Verma, “Convolutional neural network: a review of models, methodologies and applications to object detection,” Progress in Artificial Intelligence, 2019/12/20, 2019.
9.
go back to reference Chao Wang, Lei Gong, Qi Yu, Xi Li, Yuan Xie, and Xuehai Zhou. 2016. DLAU: a scalable deep learning accelerator unit on FPGA. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 36, 3 (2016), 513–517. Chao Wang, Lei Gong, Qi Yu, Xi Li, Yuan Xie, and Xuehai Zhou. 2016. DLAU: a scalable deep learning accelerator unit on FPGA. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 36, 3 (2016), 513–517.
10.
go back to reference Y.-H. Chen, T. Krishna, J. Emer, and V. Sze, “Eyeriss: an energy-efficient reconfigurable accelerator for deep convolutional neural networks,” IEEE J. Solid-State Circuits, vol. 51, no. 1, 2017. Y.-H. Chen, T. Krishna, J. Emer, and V. Sze, “Eyeriss: an energy-efficient reconfigurable accelerator for deep convolutional neural networks,” IEEE J. Solid-State Circuits, vol. 51, no. 1, 2017.
11.
go back to reference Jouppi, N. P., Young, C., Patil, N. et al. In-datacenter performance analysis of a tensor processing unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture, ISCA ’17, 1–12 (ACM, 2017). Jouppi, N. P., Young, C., Patil, N. et al. In-datacenter performance analysis of a tensor processing unit. In Proceedings of the 44th Annual International Symposium on Computer Architecture, ISCA ’17, 1–12 (ACM, 2017).
12.
go back to reference Chen, Y., Yang, T., Emer, J. & Sze, V. Eyeriss v2: a flexible accelerator for emerging deep neural networks on mobile devices. IEEE J. Em. Sel. Top. C 9, 292–308 (2019). Chen, Y., Yang, T., Emer, J. & Sze, V. Eyeriss v2: a flexible accelerator for emerging deep neural networks on mobile devices. IEEE J. Em. Sel. Top. C 9, 292–308 (2019).
13.
go back to reference Hyoukjun Kwon, Prasanth Chatarasi, Michael Pellauer, Angshuman Parashar, Vivek Sarkar, and Tushar Krishna. Understanding reuse, performance, and hardware cost of dnn dataflow: a data-centric approach. In Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture, pages 754–768, 2019. Hyoukjun Kwon, Prasanth Chatarasi, Michael Pellauer, Angshuman Parashar, Vivek Sarkar, and Tushar Krishna. Understanding reuse, performance, and hardware cost of dnn dataflow: a data-centric approach. In Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture, pages 754–768, 2019.
14.
go back to reference Michael Pellauer, Hyoukjun Kwon, and Tushar Krishna. Modeling and analyzing deep learning accelerator dataflows with MAESTRO, MAERI Tutorials, ISCA 2018. Michael Pellauer, Hyoukjun Kwon, and Tushar Krishna. Modeling and analyzing deep learning accelerator dataflows with MAESTRO, MAERI Tutorials, ISCA 2018.
15.
go back to reference Yu-Hsin Chen, Joel Emer, and Vivienne Sze. 2016. Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks. In International Symposium on Computer Architecture (ISCA). Yu-Hsin Chen, Joel Emer, and Vivienne Sze. 2016. Eyeriss: a spatial architecture for energy-efficient dataflow for convolutional neural networks. In International Symposium on Computer Architecture (ISCA).
16.
go back to reference I. Fernandez, R. Quislant, C. Giannoula, M. Alser et al., “NATSA: a near-data processing accelerator for time series analysis,” ICCD, 2020. I. Fernandez, R. Quislant, C. Giannoula, M. Alser et al., “NATSA: a near-data processing accelerator for time series analysis,” ICCD, 2020.
17.
go back to reference Yari, Yasin, Thuy V. Nguyen, and Hieu T. Nguyen. "Deep learning applied for histological diagnosis of breast cancer." IEEE Access 8 (2020): 162432-162448.CrossRef Yari, Yasin, Thuy V. Nguyen, and Hieu T. Nguyen. "Deep learning applied for histological diagnosis of breast cancer." IEEE Access 8 (2020): 162432-162448.CrossRef
18.
go back to reference Syed A. Hoda, Edi Brogi, Fredrick C. Koerner and Paul Peter Rosen, “ROSEN’s Breast Pathology,” fourth edition, pp 430-431. Syed A. Hoda, Edi Brogi, Fredrick C. Koerner and Paul Peter Rosen, “ROSEN’s Breast Pathology,” fourth edition, pp 430-431.
19.
go back to reference Schwartz AM, Henson DE, Chen D, and Rajamarthandan S., “Histologic grade remains a prognostic factor for breast cancer regardless of the number of positive lymph nodes and tumor size: a study of 161 708 cases of breast cancer from the SEER Program.,” in Arch Pathol Lab Med. 2014 Aug;138(8):1048-52. https://doi.org/10.5858/arpa.2013-0435-OA.CrossRefPubMed Schwartz AM, Henson DE, Chen D, and Rajamarthandan S., “Histologic grade remains a prognostic factor for breast cancer regardless of the number of positive lymph nodes and tumor size: a study of 161 708 cases of breast cancer from the SEER Program.,” in Arch Pathol Lab Med. 2014 Aug;138(8):1048-52. https://​doi.​org/​10.​5858/​arpa.​2013-0435-OA.CrossRefPubMed
20.
go back to reference Bolhasani, H.; Amjadi, E.; Tabatabaeian, M.; Jassbi, S.J. A histopathological image dataset for grading breast invasive ductal carcinomas. Inform. Med. Unlocked 2020, 19, 100341.CrossRef Bolhasani, H.; Amjadi, E.; Tabatabaeian, M.; Jassbi, S.J. A histopathological image dataset for grading breast invasive ductal carcinomas. Inform. Med. Unlocked 2020, 19, 100341.CrossRef
21.
go back to reference Zavareh, PH.; Safayari, A.; Bolhasani, H. BCNet: a deep convolutional neural network for breast cancer grading. arXiv:2107.05037, Jul 2021. Zavareh, PH.; Safayari, A.; Bolhasani, H. BCNet: a deep convolutional neural network for breast cancer grading. arXiv:​2107.​05037, Jul 2021.
22.
go back to reference H. Kwon, M. Pellauer, T. Krishna, Maestro: an open-source infrastructure for modeling dataflows within deep learning accelerators (2018). arXiv preprint arXiv:1805.02566. H. Kwon, M. Pellauer, T. Krishna, Maestro: an open-source infrastructure for modeling dataflows within deep learning accelerators (2018). arXiv preprint arXiv:​1805.​02566.
Metadata
Title
DLA-H: A Deep Learning Accelerator for Histopathologic Image Classification
Authors
Hamidreza Bolhasani
Somayyeh Jafarali Jassbi
Arash Sharifi
Publication date
30-11-2022
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 2/2023
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-022-00743-3

Other articles of this Issue 2/2023

Journal of Digital Imaging 2/2023 Go to the issue