Skip to main content
Top
Published in: Journal of Nuclear Cardiology 2/2023

08-07-2022 | Original Article

Content-based image retrieval for the diagnosis of myocardial perfusion imaging using a deep convolutional autoencoder

Authors: Akinori Higaki, MD, PhD, Naoto Kawaguchi, MD, PhD, Tsukasa Kurokawa, MD, Hikaru Okabe, MD, Takuro Kazatani, MD, Shinsuke Kido, MD, Tetsuya Aono, MD, Kensho Matsuda, MD, MSc, Yuta Tanaka, MD, Saki Hosokawa, MD, Tetsuya Kosaki, MD, Go Kawamura, MD, Tatsuya Shigematsu, MD, Yoshitaka Kawada, MD, Go Hiasa, MD, PhD, Tadakatsu Yamada, MD, Hideki Okayama, MD, PhD

Published in: Journal of Nuclear Cardiology | Issue 2/2023

Login to get access

Abstract

Background

Single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI) plays a crucial role in the optimal treatment strategy for patients with coronary heart disease. We tested the feasibility of feature extraction from MPI using a deep convolutional autoencoder (CAE) model.

Methods

Eight hundred and forty-three pairs of stress and rest myocardial perfusion images were collected from consecutive patients who underwent cardiac scintigraphy in our hospital between December 2019 and February 2022. We trained a CAE model to reproduce the input paired image data, so as the encoder to output a 256-dimensional feature vector. The extracted feature vectors were further dimensionally reduced via principal component analysis (PCA) for data visualization. Content-based image retrieval (CBIR) was performed based on the cosine similarity of the feature vectors between the query and reference images. The agreement of the radiologist’s finding between the query and retrieved MPI was evaluated using binary accuracy, precision, recall, and F1-score.

Results

A three-dimensional scatter plot with PCA revealed that feature vectors retained clinical information such as percent summed difference score, presence of ischemia, and the location of scar reported by radiologists. When CBIR was used as a similarity-based diagnostic tool, the binary accuracy was 81.0%.

Conclusion

The results indicated the utility of unsupervised feature learning for CBIR in MPI.

Graphical abstract

Appendix
Available only for authorised users
Literature
1.
go back to reference Hachamovitch R, Rozanski A, Shaw LJ, Stone GW, Thomson LE, Friedman JD. Impact of ischaemia and scar on the therapeutic benefit derived from myocardial revascularization vs. medical therapy among patients undergoing stress-rest myocardial perfusion scintigraphy. Eur Heart J 2011;32:1012‐24.CrossRefPubMed Hachamovitch R, Rozanski A, Shaw LJ, Stone GW, Thomson LE, Friedman JD. Impact of ischaemia and scar on the therapeutic benefit derived from myocardial revascularization vs. medical therapy among patients undergoing stress-rest myocardial perfusion scintigraphy. Eur Heart J 2011;32:1012‐24.CrossRefPubMed
2.
go back to reference Seifert R, Weber M, Kocakavuk E, Rischpler C, Kersting D. Artificial intelligence and machine learning in nuclear medicine: Future perspectives. Semin Nucl Med 2021;51:170‐7.CrossRefPubMed Seifert R, Weber M, Kocakavuk E, Rischpler C, Kersting D. Artificial intelligence and machine learning in nuclear medicine: Future perspectives. Semin Nucl Med 2021;51:170‐7.CrossRefPubMed
3.
go back to reference Guner LA, et al. An open-source framework of neural networks for diagnosis of coronary artery disease from myocardial perfusion SPECT. J Nucl Cardiol 2010;17:405‐13.CrossRefPubMed Guner LA, et al. An open-source framework of neural networks for diagnosis of coronary artery disease from myocardial perfusion SPECT. J Nucl Cardiol 2010;17:405‐13.CrossRefPubMed
4.
go back to reference Betancur J, et al. Deep learning for prediction of obstructive disease from fast myocardial perfusion SPECT: A multicenter study. JACC Cardiovasc Imaging 2018;11:1654‐63.CrossRefPubMedPubMedCentral Betancur J, et al. Deep learning for prediction of obstructive disease from fast myocardial perfusion SPECT: A multicenter study. JACC Cardiovasc Imaging 2018;11:1654‐63.CrossRefPubMedPubMedCentral
5.
go back to reference Kaplan Berkaya S, Ak Sivrikoz I, Gunal S. Classification models for SPECT myocardial perfusion imaging. Comput Biol Med 2020;123:103893.CrossRefPubMed Kaplan Berkaya S, Ak Sivrikoz I, Gunal S. Classification models for SPECT myocardial perfusion imaging. Comput Biol Med 2020;123:103893.CrossRefPubMed
6.
go back to reference Sengupta PP, et al. Proposed requirements for cardiovascular imaging-related machine learning evaluation (PRIME): A checklist. JACC Cardiovasc Imaging 2020;13:2017‐35.CrossRefPubMedPubMedCentral Sengupta PP, et al. Proposed requirements for cardiovascular imaging-related machine learning evaluation (PRIME): A checklist. JACC Cardiovasc Imaging 2020;13:2017‐35.CrossRefPubMedPubMedCentral
8.
go back to reference Müller H, Michoux N, Bandon D, Geissbuhler A. A review of content-based image retrieval systems in medical applications: Clinical benefits and future directions. Int J Med Inform 2004;73:1‐23.CrossRefPubMed Müller H, Michoux N, Bandon D, Geissbuhler A. A review of content-based image retrieval systems in medical applications: Clinical benefits and future directions. Int J Med Inform 2004;73:1‐23.CrossRefPubMed
9.
go back to reference Dhara AK, Mukhopadhyay S, Dutta A, Garg M, Khandelwal N. Content-based image retrieval system for pulmonary nodules: assisting radiologists in self-learning and diagnosis of lung cancer. J Digit Imaging 2017;30:63‐77.CrossRefPubMed Dhara AK, Mukhopadhyay S, Dutta A, Garg M, Khandelwal N. Content-based image retrieval system for pulmonary nodules: assisting radiologists in self-learning and diagnosis of lung cancer. J Digit Imaging 2017;30:63‐77.CrossRefPubMed
11.
go back to reference Klocke FJ, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging–executive summary: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (ACC/AHA/ASNC Committee to Revise the 1995 Guideli. Circulation 2003;108:1404‐18.CrossRefPubMed Klocke FJ, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging–executive summary: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (ACC/AHA/ASNC Committee to Revise the 1995 Guideli. Circulation 2003;108:1404‐18.CrossRefPubMed
12.
go back to reference Cerqueira MD, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. J Cardiovasc Magn Reson 2002;4:203‐10.CrossRef Cerqueira MD, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart. J Cardiovasc Magn Reson 2002;4:203‐10.CrossRef
13.
go back to reference Nakajima K, et al. Creation and characterization of Japanese standards for myocardial perfusion SPECT: Database from the Japanese Society of Nuclear Medicine Working Group. Ann Nucl Med 2007;21:505‐11.CrossRefPubMed Nakajima K, et al. Creation and characterization of Japanese standards for myocardial perfusion SPECT: Database from the Japanese Society of Nuclear Medicine Working Group. Ann Nucl Med 2007;21:505‐11.CrossRefPubMed
14.
go back to reference Moroi M, Yamashina A, Tsukamoto K, Nishimura T, J-ACCESS Investigators. Coronary revascularization does not decrease cardiac events in patients with stable ischemic heart disease but might do in those who showed moderate to severe ischemia. Int J Cardiol 2012;158:246‐52.CrossRefPubMed Moroi M, Yamashina A, Tsukamoto K, Nishimura T, J-ACCESS Investigators. Coronary revascularization does not decrease cardiac events in patients with stable ischemic heart disease but might do in those who showed moderate to severe ischemia. Int J Cardiol 2012;158:246‐52.CrossRefPubMed
15.
go back to reference Maron DJ, et al. International study of comparative health effectiveness with medical and invasive approaches (ISCHEMIA) trial: Rationale and design. Am Heart J 2018;201:124‐35.CrossRefPubMed Maron DJ, et al. International study of comparative health effectiveness with medical and invasive approaches (ISCHEMIA) trial: Rationale and design. Am Heart J 2018;201:124‐35.CrossRefPubMed
16.
go back to reference Lever J, Krzywinski M, Altman N. Points of significance: principal component analysis. Nat Methods 2017;14:641‐2.CrossRef Lever J, Krzywinski M, Altman N. Points of significance: principal component analysis. Nat Methods 2017;14:641‐2.CrossRef
17.
go back to reference Higaki A, Mahmoud AUM, Paradis P, Schiffrin EL. Automated detection and diameter estimation for mouse mesenteric artery using semantic segmentation. J Vasc Res 2021;58:379‐87.CrossRefPubMed Higaki A, Mahmoud AUM, Paradis P, Schiffrin EL. Automated detection and diameter estimation for mouse mesenteric artery using semantic segmentation. J Vasc Res 2021;58:379‐87.CrossRefPubMed
18.
go back to reference Higaki A, Uetani T, Ikeda S, Yamaguchi O. Co-authorship network analysis in cardiovascular research utilizing machine learning (2009–2019). Int J Med Inform 2020;143:104274.CrossRefPubMed Higaki A, Uetani T, Ikeda S, Yamaguchi O. Co-authorship network analysis in cardiovascular research utilizing machine learning (2009–2019). Int J Med Inform 2020;143:104274.CrossRefPubMed
19.
go back to reference Vollmer S, Mateen BA, Bohner G, Király FJ, Ghani R, Jonsson P, et al. Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 2020;368:15. Vollmer S, Mateen BA, Bohner G, Király FJ, Ghani R, Jonsson P, et al. Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 2020;368:15.
20.
go back to reference Latif A, Rasheed A, Sajid U, Ahmed J, Ali N, Ratyal NI et al. Content-based image retrieval and feature extraction: a comprehensive review. Math Probl Eng 2019, (2019). Latif A, Rasheed A, Sajid U, Ahmed J, Ali N, Ratyal NI et al. Content-based image retrieval and feature extraction: a comprehensive review. Math Probl Eng 2019, (2019).
21.
go back to reference Higaki A, Kurokawa T, Kazatani T, Kido S, Aono T, Matsuda K et al. Image similarity-based cardiac rhythm device identification from X-rays using feature point matching. Pacing Clin Electrophysiol 2021;44:633‐40.CrossRefPubMed Higaki A, Kurokawa T, Kazatani T, Kido S, Aono T, Matsuda K et al. Image similarity-based cardiac rhythm device identification from X-rays using feature point matching. Pacing Clin Electrophysiol 2021;44:633‐40.CrossRefPubMed
22.
Metadata
Title
Content-based image retrieval for the diagnosis of myocardial perfusion imaging using a deep convolutional autoencoder
Authors
Akinori Higaki, MD, PhD
Naoto Kawaguchi, MD, PhD
Tsukasa Kurokawa, MD
Hikaru Okabe, MD
Takuro Kazatani, MD
Shinsuke Kido, MD
Tetsuya Aono, MD
Kensho Matsuda, MD, MSc
Yuta Tanaka, MD
Saki Hosokawa, MD
Tetsuya Kosaki, MD
Go Kawamura, MD
Tatsuya Shigematsu, MD
Yoshitaka Kawada, MD
Go Hiasa, MD, PhD
Tadakatsu Yamada, MD
Hideki Okayama, MD, PhD
Publication date
08-07-2022
Publisher
Springer International Publishing
Published in
Journal of Nuclear Cardiology / Issue 2/2023
Print ISSN: 1071-3581
Electronic ISSN: 1532-6551
DOI
https://doi.org/10.1007/s12350-022-03030-4

Other articles of this Issue 2/2023

Journal of Nuclear Cardiology 2/2023 Go to the issue