Skip to main content
Top
Published in: European Journal of Nuclear Medicine and Molecular Imaging 13/2017

Open Access 01-12-2017 | Original Article

Diagnostic accuracy of an artificial neural network compared with statistical quantitation of myocardial perfusion images: a Japanese multicenter study

Authors: Kenichi Nakajima, Takashi Kudo, Tomoaki Nakata, Keisuke Kiso, Tokuo Kasai, Yasuyo Taniguchi, Shinro Matsuo, Mitsuru Momose, Masayasu Nakagawa, Masayoshi Sarai, Satoshi Hida, Hirokazu Tanaka, Kunihiko Yokoyama, Koichi Okuda, Lars Edenbrandt

Published in: European Journal of Nuclear Medicine and Molecular Imaging | Issue 13/2017

Login to get access

Abstract

Purpose

Artificial neural networks (ANN) might help to diagnose coronary artery disease. This study aimed to determine whether the diagnostic accuracy of an ANN-based diagnostic system and conventional quantitation are comparable.

Methods

The ANN was trained to classify potentially abnormal areas as true or false based on the nuclear cardiology expert interpretation of 1001 gated stress/rest 99mTc-MIBI images at 12 hospitals. The diagnostic accuracy of the ANN was compared with 364 expert interpretations that served as the gold standard of abnormality for the validation study. Conventional summed stress/rest/difference scores (SSS/SRS/SDS) were calculated and compared with receiver operating characteristics (ROC) analysis.

Results

The ANN generated a better area under the ROC curves (AUC) than SSS (0.92 vs. 0.82, p < 0.0001), indicating better identification of stress defects. The ANN also generated a better AUC than SDS (0.90 vs. 0.75, p < 0.0001) for stress-induced ischemia. The AUC for patients with old myocardial infarction based on rest defects was 0.97 (0.91 for SRS, p = 0.0061), and that for patients with and without a history of revascularization based on stress defects was 0.94 and 0.90 (p = 0.0055 and p < 0.0001 vs. SSS, respectively). The SSS/SRS/SDS steeply increased when ANN values (probability of abnormality) were >0.80.

Conclusion

The ANN was diagnostically accurate in various clinical settings, including that of patients with previous myocardial infarction and coronary revascularization. The ANN could help to diagnose coronary artery disease.
Literature
1.
go back to reference Henzlova MJ, Duvall WL, Einstein AJ, Travin MI, Verberne HJ. ASNC imaging guidelines for SPECT nuclear cardiology procedures: stress, protocols, and tracers. J Nucl Cardiol. 2016;23:606–39.CrossRefPubMed Henzlova MJ, Duvall WL, Einstein AJ, Travin MI, Verberne HJ. ASNC imaging guidelines for SPECT nuclear cardiology procedures: stress, protocols, and tracers. J Nucl Cardiol. 2016;23:606–39.CrossRefPubMed
2.
go back to reference Klocke FJ, Baird MG, Lorell BH, Bateman TM, Messer JV, Berman DS, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging--executive summary: a report of the American College of Cardiology/American Heart Association task force on practice guidelines (ACC/AHA/ASNC Committee to revise the 1995 guidelines for the clinical use of cardiac radionuclide imaging). J Am Coll Cardiol. 2003;42:1318–33.CrossRefPubMed Klocke FJ, Baird MG, Lorell BH, Bateman TM, Messer JV, Berman DS, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging--executive summary: a report of the American College of Cardiology/American Heart Association task force on practice guidelines (ACC/AHA/ASNC Committee to revise the 1995 guidelines for the clinical use of cardiac radionuclide imaging). J Am Coll Cardiol. 2003;42:1318–33.CrossRefPubMed
3.
go back to reference Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: a statement for healthcare professionals from the cardiac imaging Committee of the Council on clinical cardiology of the American Heart Association. Circulation. 2002;105:539–42.CrossRefPubMed Cerqueira MD, Weissman NJ, Dilsizian V, Jacobs AK, Kaul S, Laskey WK, et al. Standardized myocardial segmentation and nomenclature for tomographic imaging of the heart: a statement for healthcare professionals from the cardiac imaging Committee of the Council on clinical cardiology of the American Heart Association. Circulation. 2002;105:539–42.CrossRefPubMed
4.
go back to reference Berman DS, Abidov A, Kang X, Hayes SW, Friedman JD, Sciammarella MG, et al. Prognostic validation of a 17-segment score derived from a 20-segment score for myocardial perfusion SPECT interpretation. J Nucl Cardiol. 2004;11:414–23.CrossRefPubMed Berman DS, Abidov A, Kang X, Hayes SW, Friedman JD, Sciammarella MG, et al. Prognostic validation of a 17-segment score derived from a 20-segment score for myocardial perfusion SPECT interpretation. J Nucl Cardiol. 2004;11:414–23.CrossRefPubMed
5.
go back to reference Germano G, Kavanagh PB, Slomka PJ, Van Kriekinge SD, Pollard G, Berman DS. Quantitation in gated perfusion SPECT imaging: the cedars-Sinai approach. J Nucl Cardiol. 2007;14:433–54.CrossRefPubMed Germano G, Kavanagh PB, Slomka PJ, Van Kriekinge SD, Pollard G, Berman DS. Quantitation in gated perfusion SPECT imaging: the cedars-Sinai approach. J Nucl Cardiol. 2007;14:433–54.CrossRefPubMed
6.
go back to reference Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Comparison of the short-term survival benefit associated with revascularization compared with medical therapy in patients with no prior coronary artery disease undergoing stress myocardial perfusion single photon emission computed tomography. Circulation. 2003;107:2900–7.CrossRefPubMed Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Comparison of the short-term survival benefit associated with revascularization compared with medical therapy in patients with no prior coronary artery disease undergoing stress myocardial perfusion single photon emission computed tomography. Circulation. 2003;107:2900–7.CrossRefPubMed
7.
go back to reference Guner LA, Karabacak NI, Akdemir OU, Karagoz PS, Kocaman SA, Cengel A, et al. An open-source framework of neural networks for diagnosis of coronary artery disease from myocardial perfusion SPECT. J Nucl Cardiol. 2010;17:405–13.CrossRefPubMed Guner LA, Karabacak NI, Akdemir OU, Karagoz PS, Kocaman SA, Cengel A, et al. An open-source framework of neural networks for diagnosis of coronary artery disease from myocardial perfusion SPECT. J Nucl Cardiol. 2010;17:405–13.CrossRefPubMed
8.
go back to reference Arsanjani R, Xu Y, Dey D, Fish M, Dorbala S, Hayes S, et al. Improved accuracy of myocardial perfusion SPECT for the detection of coronary artery disease using a support vector machine algorithm. J Nucl Med. 2013;54:549–55.CrossRefPubMedPubMedCentral Arsanjani R, Xu Y, Dey D, Fish M, Dorbala S, Hayes S, et al. Improved accuracy of myocardial perfusion SPECT for the detection of coronary artery disease using a support vector machine algorithm. J Nucl Med. 2013;54:549–55.CrossRefPubMedPubMedCentral
9.
go back to reference Johansson L, Edenbrandt L, Nakajima K, Lomsky M, Svensson SE, Tragardh E. Computer-aided diagnosis system outperforms scoring analysis in myocardial perfusion imaging. J Nucl Cardiol. 2014;21:416–23.CrossRefPubMed Johansson L, Edenbrandt L, Nakajima K, Lomsky M, Svensson SE, Tragardh E. Computer-aided diagnosis system outperforms scoring analysis in myocardial perfusion imaging. J Nucl Cardiol. 2014;21:416–23.CrossRefPubMed
10.
go back to reference Nakajima K, Matsuo S, Wakabayashi H, Yokoyama K, Bunko H, Okuda K, et al. Diagnostic performance of artificial neural network for detecting ischemia in myocardial perfusion imaging. Circ J. 2015;79:1549–56.CrossRefPubMed Nakajima K, Matsuo S, Wakabayashi H, Yokoyama K, Bunko H, Okuda K, et al. Diagnostic performance of artificial neural network for detecting ischemia in myocardial perfusion imaging. Circ J. 2015;79:1549–56.CrossRefPubMed
11.
go back to reference Motwani M, Dey D, Berman DS, Germano G, Achenbach S, Al-Mallah MH, et al. Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis. Eur Heart J. 2016;38:500-507. Motwani M, Dey D, Berman DS, Germano G, Achenbach S, Al-Mallah MH, et al. Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis. Eur Heart J. 2016;38:500-507.
12.
go back to reference Lomsky M, Gjertsson P, Johansson L, Richter J, Ohlsson M, Tout D, et al. Evaluation of a decision support system for interpretation of myocardial perfusion gated SPECT. Eur J Nucl Med Mol Imaging. 2008;35:1523–9.CrossRefPubMed Lomsky M, Gjertsson P, Johansson L, Richter J, Ohlsson M, Tout D, et al. Evaluation of a decision support system for interpretation of myocardial perfusion gated SPECT. Eur J Nucl Med Mol Imaging. 2008;35:1523–9.CrossRefPubMed
13.
go back to reference Garcia EV, Klein JL, Taylor AT. Clinical decision support systems in myocardial perfusion imaging. J Nucl Cardiol. 2014;21:427–39. quiz 40CrossRefPubMed Garcia EV, Klein JL, Taylor AT. Clinical decision support systems in myocardial perfusion imaging. J Nucl Cardiol. 2014;21:427–39. quiz 40CrossRefPubMed
15.
go back to reference Lomsky M, Richter J, Johansson L, Hoilund-Carlsen PF, Edenbrandt L. Validation of a new automated method for analysis of gated-SPECT images. Clin Physiol Funct Imaging. 2006;26:139–45.CrossRefPubMed Lomsky M, Richter J, Johansson L, Hoilund-Carlsen PF, Edenbrandt L. Validation of a new automated method for analysis of gated-SPECT images. Clin Physiol Funct Imaging. 2006;26:139–45.CrossRefPubMed
16.
go back to reference Nakajima K, Okuda K, Nystrom K, Richter J, Minarik D, Wakabayashi H, et al. Improved quantification of small hearts for gated myocardial perfusion imaging. Eur J Nucl Med Mol Imaging. 2013;40:1163–70.CrossRefPubMedPubMedCentral Nakajima K, Okuda K, Nystrom K, Richter J, Minarik D, Wakabayashi H, et al. Improved quantification of small hearts for gated myocardial perfusion imaging. Eur J Nucl Med Mol Imaging. 2013;40:1163–70.CrossRefPubMedPubMedCentral
17.
go back to reference Kass M, Witkin A, Terzopoulos D. Snakes: active contour models. Int J Comput Vis. 1988;1:321–31.CrossRef Kass M, Witkin A, Terzopoulos D. Snakes: active contour models. Int J Comput Vis. 1988;1:321–31.CrossRef
18.
go back to reference Nakajima K. Normal values for nuclear cardiology: Japanese databases for myocardial perfusion, fatty acid and sympathetic imaging and left ventricular function. Ann Nucl Med. 2010;24:125–35.CrossRefPubMedPubMedCentral Nakajima K. Normal values for nuclear cardiology: Japanese databases for myocardial perfusion, fatty acid and sympathetic imaging and left ventricular function. Ann Nucl Med. 2010;24:125–35.CrossRefPubMedPubMedCentral
19.
go back to reference Nakajima K, Matsumoto N, Kasai T, Matsuo S, Kiso K, Okuda K. Normal values and standardization of parameters in nuclear cardiology: Japanese Society of Nuclear Medicine working group database. Ann Nucl Med. 2016;30:188–99.CrossRefPubMedPubMedCentral Nakajima K, Matsumoto N, Kasai T, Matsuo S, Kiso K, Okuda K. Normal values and standardization of parameters in nuclear cardiology: Japanese Society of Nuclear Medicine working group database. Ann Nucl Med. 2016;30:188–99.CrossRefPubMedPubMedCentral
20.
go back to reference Yoneyama H, Nakajima K, Okuda K, Matsuo S, Onoguchi M, Kinuya S, et al. Reducing the small-heart effect in pediatric gated myocardial perfusion single-photon emission computed tomography. J Nucl Cardiol. 2016;24:1378-1388. Yoneyama H, Nakajima K, Okuda K, Matsuo S, Onoguchi M, Kinuya S, et al. Reducing the small-heart effect in pediatric gated myocardial perfusion single-photon emission computed tomography. J Nucl Cardiol. 2016;24:1378-1388.
21.
go back to reference Nakajima K, Okuda K, Matsuo S, Kiso K, Kinuya S, Garcia EV. Comparison of phase dyssynchrony analysis using gated myocardial perfusion imaging with four software programs: based on the Japanese Society of Nuclear Medicine working group normal database. J Nucl Cardiol. 2017;24:611–21.CrossRefPubMed Nakajima K, Okuda K, Matsuo S, Kiso K, Kinuya S, Garcia EV. Comparison of phase dyssynchrony analysis using gated myocardial perfusion imaging with four software programs: based on the Japanese Society of Nuclear Medicine working group normal database. J Nucl Cardiol. 2017;24:611–21.CrossRefPubMed
22.
go back to reference Nakajima K, Okuda K, Kawano M, Matsuo S, Slomka P, Germano G, et al. The importance of population-specific normal database for quantification of myocardial ischemia: comparison between Japanese 360 and 180-degree databases and a US database. J Nucl Cardiol. 2009;16:422–30.CrossRefPubMedPubMedCentral Nakajima K, Okuda K, Kawano M, Matsuo S, Slomka P, Germano G, et al. The importance of population-specific normal database for quantification of myocardial ischemia: comparison between Japanese 360 and 180-degree databases and a US database. J Nucl Cardiol. 2009;16:422–30.CrossRefPubMedPubMedCentral
23.
go back to reference Garcia EV, Faber TL, Cooke CD, Folks RD, Chen J, Santana C. The increasing role of quantification in clinical nuclear cardiology: the Emory approach. J Nucl Cardiol. 2007;14:420–32.CrossRefPubMed Garcia EV, Faber TL, Cooke CD, Folks RD, Chen J, Santana C. The increasing role of quantification in clinical nuclear cardiology: the Emory approach. J Nucl Cardiol. 2007;14:420–32.CrossRefPubMed
24.
go back to reference Ficaro EP, Lee BC, Kritzman JN, Corbett JR. Corridor4DM: The Michigan method for quantitative nuclear cardiology. J Nucl Cardiol. 2007;14:455–65.CrossRefPubMed Ficaro EP, Lee BC, Kritzman JN, Corbett JR. Corridor4DM: The Michigan method for quantitative nuclear cardiology. J Nucl Cardiol. 2007;14:455–65.CrossRefPubMed
25.
go back to reference Slomka PJ, Nishina H, Berman DS, Akincioglu C, Abidov A, Friedman JD, et al. Automated quantification of myocardial perfusion SPECT using simplified normal limits. J Nucl Cardiol. 2005;12:66–77.CrossRefPubMed Slomka PJ, Nishina H, Berman DS, Akincioglu C, Abidov A, Friedman JD, et al. Automated quantification of myocardial perfusion SPECT using simplified normal limits. J Nucl Cardiol. 2005;12:66–77.CrossRefPubMed
26.
go back to reference Authors/Task Force members, Windecker S, Kolh P, Alfonso F, Collet JP, Cremer J, et al. 2014 ESC/EACTS guidelines on myocardial revascularization: the task force on myocardial revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS) developed with the special contribution of the European Association of Percutaneous Cardiovascular Interventions (EAPCI). Eur Heart J. 2014;35:2541–619.CrossRef Authors/Task Force members, Windecker S, Kolh P, Alfonso F, Collet JP, Cremer J, et al. 2014 ESC/EACTS guidelines on myocardial revascularization: the task force on myocardial revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS) developed with the special contribution of the European Association of Percutaneous Cardiovascular Interventions (EAPCI). Eur Heart J. 2014;35:2541–619.CrossRef
Metadata
Title
Diagnostic accuracy of an artificial neural network compared with statistical quantitation of myocardial perfusion images: a Japanese multicenter study
Authors
Kenichi Nakajima
Takashi Kudo
Tomoaki Nakata
Keisuke Kiso
Tokuo Kasai
Yasuyo Taniguchi
Shinro Matsuo
Mitsuru Momose
Masayasu Nakagawa
Masayoshi Sarai
Satoshi Hida
Hirokazu Tanaka
Kunihiko Yokoyama
Koichi Okuda
Lars Edenbrandt
Publication date
01-12-2017
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging / Issue 13/2017
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-017-3834-x

Other articles of this Issue 13/2017

European Journal of Nuclear Medicine and Molecular Imaging 13/2017 Go to the issue