Skip to main content
Top
Published in: Journal of Nuclear Cardiology 5/2019

01-10-2019 | Original Article

Prediction of cardiac death after adenosine myocardial perfusion SPECT based on machine learning

Authors: David Haro Alonso, MSc, Miles N. Wernick, PhD, Yongyi Yang, PhD, Guido Germano, PhD, Daniel S. Berman, MD, Piotr Slomka, PhD

Published in: Journal of Nuclear Cardiology | Issue 5/2019

Login to get access

Abstract

Background

We developed machine-learning (ML) models to estimate a patient’s risk of cardiac death based on adenosine myocardial perfusion SPECT (MPS) and associated clinical data, and compared their performance to baseline logistic regression (LR). We demonstrated an approach to visually convey the reasoning behind a patient’s risk to provide insight to clinicians beyond that of a “black box.”

Methods

We trained multiple models using 122 potential clinical predictors (features) for 8321 patients, including 551 cases of subsequent cardiac death. Accuracy was measured by area under the ROC curve (AUC), computed within a cross-validation framework. We developed a method to display the model’s rationale to facilitate clinical interpretation.

Results

The baseline LR (AUC = 0.76; 14 features) was outperformed by all other methods. A least absolute shrinkage and selection operator (LASSO) model (AUC = 0.77; p = .045; 6 features) required the fewest features. A support vector machine (SVM) model (AUC = 0.83; p < .0001; 49 features) provided the highest accuracy.

Conclusions

LASSO outperformed LR in both accuracy and simplicity (number of features), with SVM yielding best AUC for prediction of cardiac death in patients undergoing MPS. Combined with presenting the reasoning behind the risk scores, our results suggest that ML can be more effective than LR for this application.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wernick MN, Aarsvold JN. Emission tomography: The engineering and physics of PET and SPECT. San Diego: Academic Press; 2004. p. 596. Wernick MN, Aarsvold JN. Emission tomography: The engineering and physics of PET and SPECT. San Diego: Academic Press; 2004. p. 596.
2.
go back to reference Hachamovitch R, Berman DS, Kiat H, Cohen I, Lewin H, Amanullah A, et al. Incremental prognostic value of adenosine stress myocardial perfusion single-photon emission computed tomography and impact on subsequent management in patients with or suspected of having myocardial ischemia. Am J Cardiol 1997;80:426-33.CrossRefPubMed Hachamovitch R, Berman DS, Kiat H, Cohen I, Lewin H, Amanullah A, et al. Incremental prognostic value of adenosine stress myocardial perfusion single-photon emission computed tomography and impact on subsequent management in patients with or suspected of having myocardial ischemia. Am J Cardiol 1997;80:426-33.CrossRefPubMed
3.
go back to reference Hachamovitch R, Berman DS, Shaw LJ, Kiat H, Cohen I, Cabico JA, et al. Incremental prognostic value of myocardial perfusion single photon emission computed tomography for the prediction of cardiac death. Circulation 1998;97:535-43.CrossRefPubMed Hachamovitch R, Berman DS, Shaw LJ, Kiat H, Cohen I, Cabico JA, et al. Incremental prognostic value of myocardial perfusion single photon emission computed tomography for the prediction of cardiac death. Circulation 1998;97:535-43.CrossRefPubMed
4.
go back to reference Klocke FJ, Baird MG, Lorell BH, Bateman TM, Messer JV, Berman DS, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging—executive summary. Circulation 2003;108:1404-18.CrossRefPubMed Klocke FJ, Baird MG, Lorell BH, Bateman TM, Messer JV, Berman DS, et al. ACC/AHA/ASNC guidelines for the clinical use of cardiac radionuclide imaging—executive summary. Circulation 2003;108:1404-18.CrossRefPubMed
5.
go back to reference Sharir T, Ben-Haim S, Merzon K, Prochorov V, Dickman D, Ben-Haim S, et al. High-speed myocardial perfusion imaging: initial clinical comparison with conventional dual detector anger camera imaging. JACC: Cardiovasc Imaging 2008;1:156-63. Sharir T, Ben-Haim S, Merzon K, Prochorov V, Dickman D, Ben-Haim S, et al. High-speed myocardial perfusion imaging: initial clinical comparison with conventional dual detector anger camera imaging. JACC: Cardiovasc Imaging 2008;1:156-63.
6.
go back to reference Heller GV, Herman SD, Travin MI, Baron JI, Santos-Ocampo C, Mcclellan JR. Independent prognostic value of intravenous dipyridamole with technetium-99 m sestamibi tomographic imaging in predicting cardiac events and cardiac-related hospital admissions. J Am Coll Cardiol 1995;26:1202-8.CrossRefPubMed Heller GV, Herman SD, Travin MI, Baron JI, Santos-Ocampo C, Mcclellan JR. Independent prognostic value of intravenous dipyridamole with technetium-99 m sestamibi tomographic imaging in predicting cardiac events and cardiac-related hospital admissions. J Am Coll Cardiol 1995;26:1202-8.CrossRefPubMed
7.
go back to reference Arsanjani R, Xu Y, Dey D, Fish M, Dorbala S, Hayes S, et al. Improved accuracy of myocardial perfusion SPECT for the detection of coronary artery disease using a support vector machine algorithm. J Nuclear Med 2013;54:549-55.CrossRef Arsanjani R, Xu Y, Dey D, Fish M, Dorbala S, Hayes S, et al. Improved accuracy of myocardial perfusion SPECT for the detection of coronary artery disease using a support vector machine algorithm. J Nuclear Med 2013;54:549-55.CrossRef
8.
go back to reference Bishop CM. Pattern recognition. Mach Learn 2006;128:1-58. Bishop CM. Pattern recognition. Mach Learn 2006;128:1-58.
9.
go back to reference Duda RO, Hart PE, Stork DG. Pattern classification. New York: Wiley; 2012. Duda RO, Hart PE, Stork DG. Pattern classification. New York: Wiley; 2012.
10.
go back to reference Wernick MN, Yang Y, Brankov JG, Yourganov G, Strother SC. Machine learning in medical imaging. Signal Process Mag IEEE 2010;27:25-38.CrossRef Wernick MN, Yang Y, Brankov JG, Yourganov G, Strother SC. Machine learning in medical imaging. Signal Process Mag IEEE 2010;27:25-38.CrossRef
11.
go back to reference Hastie T, Tibshirani R, Friedman J, Hastie T, Friedman J, Tibshirani R. The elements of statistical learning. Berlin: Springer; 2009.CrossRef Hastie T, Tibshirani R, Friedman J, Hastie T, Friedman J, Tibshirani R. The elements of statistical learning. Berlin: Springer; 2009.CrossRef
12.
go back to reference Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Stress myocardial perfusion single-photon emission computed tomography is clinically effective and cost effective in risk stratification of patients with a high likelihood of coronary artery disease (CAD) but no known CAD. J Am Coll Cardiol 2004;43:200-8.CrossRefPubMed Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Stress myocardial perfusion single-photon emission computed tomography is clinically effective and cost effective in risk stratification of patients with a high likelihood of coronary artery disease (CAD) but no known CAD. J Am Coll Cardiol 2004;43:200-8.CrossRefPubMed
13.
go back to reference Nakajima K, Matsuo S, Okuyama C, Hatta T, Tsukamoto K, Nishimura S, et al. Cardiac event risk in Japanese subjects estimated using gated myocardial perfusion imaging, in conjunction with diabetes mellitus and chronic kidney disease. Circ J 2012;76:168-75.CrossRefPubMed Nakajima K, Matsuo S, Okuyama C, Hatta T, Tsukamoto K, Nishimura S, et al. Cardiac event risk in Japanese subjects estimated using gated myocardial perfusion imaging, in conjunction with diabetes mellitus and chronic kidney disease. Circ J 2012;76:168-75.CrossRefPubMed
14.
go back to reference Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Comparison of the short-term survival benefit associated with revascularization compared with medical therapy in patients with no prior coronary artery disease undergoing stress myocardial perfusion single photon emission computed tomography. Circulation 2003;107:2900-7.CrossRefPubMed Hachamovitch R, Hayes SW, Friedman JD, Cohen I, Berman DS. Comparison of the short-term survival benefit associated with revascularization compared with medical therapy in patients with no prior coronary artery disease undergoing stress myocardial perfusion single photon emission computed tomography. Circulation 2003;107:2900-7.CrossRefPubMed
15.
go back to reference Berman DS, Kang X, Hayes SW, Friedman JD, Cohen I, Abidov A, et al. Adenosine myocardial perfusion single-photon emission computed tomography in women compared with men: Impact of diabetes mellitus on incremental prognostic value and effect on patient management. J Am Coll Cardiol 2003;41:1125-33.CrossRefPubMed Berman DS, Kang X, Hayes SW, Friedman JD, Cohen I, Abidov A, et al. Adenosine myocardial perfusion single-photon emission computed tomography in women compared with men: Impact of diabetes mellitus on incremental prognostic value and effect on patient management. J Am Coll Cardiol 2003;41:1125-33.CrossRefPubMed
16.
go back to reference Berman DS, Kiat H, Friedman JD, Wang FP, Van Train K, Matzer L, et al. Separate acquisition rest thallium-201/stress technetium-99 m sestamibi dual-isotope myocardial perfusion single-photon emission computed tomography: A clinical validation study. J Am Coll Cardiol 1993;22:1455-64.CrossRefPubMed Berman DS, Kiat H, Friedman JD, Wang FP, Van Train K, Matzer L, et al. Separate acquisition rest thallium-201/stress technetium-99 m sestamibi dual-isotope myocardial perfusion single-photon emission computed tomography: A clinical validation study. J Am Coll Cardiol 1993;22:1455-64.CrossRefPubMed
17.
go back to reference Raschka S. Python machine learning. Birmingham: Packt Publishing Ltd; 2015. Raschka S. Python machine learning. Birmingham: Packt Publishing Ltd; 2015.
18.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837-45.CrossRefPubMed DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988;44:837-45.CrossRefPubMed
19.
go back to reference Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 1996;58:267-88. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 1996;58:267-88.
20.
go back to reference Vapnik VN, Vapnik V. Statistical learning theory. New York: Wiley; 1998. Vapnik VN, Vapnik V. Statistical learning theory. New York: Wiley; 1998.
21.
go back to reference El-Naqa I, Yang Y, Wernick MN, Galatsanos NP, Nishikawa RM. A support vector machine approach for detection of microcalcifications. Med Imaging IEEE Trans 2002;21:1552-63.CrossRef El-Naqa I, Yang Y, Wernick MN, Galatsanos NP, Nishikawa RM. A support vector machine approach for detection of microcalcifications. Med Imaging IEEE Trans 2002;21:1552-63.CrossRef
24.
go back to reference Cox DR. Regression models and life-tables. Breakthr Stat 1992;527-541. Cox DR. Regression models and life-tables. Breakthr Stat 1992;527-541.
26.
go back to reference Ho TK. The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 1998;20:832-44.CrossRef Ho TK. The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 1998;20:832-44.CrossRef
27.
go back to reference Schapire RE. The boosting approach to machine learning: An overview. Nonlinear Estim Classif 2003;149-71. Schapire RE. The boosting approach to machine learning: An overview. Nonlinear Estim Classif 2003;149-71.
28.
go back to reference Pudil P, Novovičová J, Kittler J. Floating search methods in feature selection. Pattern Recognit Lett 1994;15:1119-25.CrossRef Pudil P, Novovičová J, Kittler J. Floating search methods in feature selection. Pattern Recognit Lett 1994;15:1119-25.CrossRef
29.
go back to reference Scholkopf B, Smola AJ. Learning with kernels: Support vector machines, regularization, optimization, and beyond. Cambridge: MIT Press; 2001. Scholkopf B, Smola AJ. Learning with kernels: Support vector machines, regularization, optimization, and beyond. Cambridge: MIT Press; 2001.
30.
go back to reference Park MY, Hastie T. L1-regularization path algorithm for generalized linear models. J R Stat Soc 2007;69:659-77.CrossRef Park MY, Hastie T. L1-regularization path algorithm for generalized linear models. J R Stat Soc 2007;69:659-77.CrossRef
31.
go back to reference Niculescu-Mizil A, Caruana R. Predicting good probabilities with supervised learning. In: Proceedings of the 22nd international conference on machine learning; 2005. p. 625–632. Niculescu-Mizil A, Caruana R. Predicting good probabilities with supervised learning. In: Proceedings of the 22nd international conference on machine learning; 2005. p. 625–632.
32.
go back to reference Platt J. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Classif 1999;10:61-74. Platt J. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Classif 1999;10:61-74.
33.
go back to reference Rozanski A, Gransar H, Hayes SW, Min J, Friedman JD, Thomson LE, et al. Temporal trends in the frequency of inducible myocardial ischemia during cardiac stress testing: 1991 to 2009. J Am Coll Cardiol 2013;61:1054-65.CrossRefPubMed Rozanski A, Gransar H, Hayes SW, Min J, Friedman JD, Thomson LE, et al. Temporal trends in the frequency of inducible myocardial ischemia during cardiac stress testing: 1991 to 2009. J Am Coll Cardiol 2013;61:1054-65.CrossRefPubMed
Metadata
Title
Prediction of cardiac death after adenosine myocardial perfusion SPECT based on machine learning
Authors
David Haro Alonso, MSc
Miles N. Wernick, PhD
Yongyi Yang, PhD
Guido Germano, PhD
Daniel S. Berman, MD
Piotr Slomka, PhD
Publication date
01-10-2019
Publisher
Springer International Publishing
Published in
Journal of Nuclear Cardiology / Issue 5/2019
Print ISSN: 1071-3581
Electronic ISSN: 1532-6551
DOI
https://doi.org/10.1007/s12350-018-1250-7

Other articles of this Issue 5/2019

Journal of Nuclear Cardiology 5/2019 Go to the issue