Skip to main content
Top
Published in: EJNMMI Research 1/2011

Open Access 01-12-2011 | Original research

Diagnostic evaluation of three cardiac software packages using a consecutive group of patients

Authors: Lena Johansson, Milan Lomsky, Jens Marving, Mattias Ohlsson, Sven-Eric Svensson, Lars Edenbrandt

Published in: EJNMMI Research | Issue 1/2011

Login to get access

Abstract

Purpose

The aim of this study was to compare the diagnostic performance of the three software packages 4DMSPECT (4DM), Emory Cardiac Toolbox (ECTb), and Cedars Quantitative Perfusion SPECT (QPS) for quantification of myocardial perfusion scintigram (MPS) using a large group of consecutive patients.

Methods

We studied 1,052 consecutive patients who underwent 2-day stress/rest 99mTc-sestamibi MPS studies. The reference/gold-standard classifications for the MPS studies were obtained from three physicians, with more than 25 years each of experience in nuclear cardiology, who re-evaluated all MPS images. Automatic processing was carried out using 4DM, ECTb, and QPS software packages. Total stress defect extent (TDE) and summed stress score (SSS) based on a 17-segment model were obtained from the software packages. Receiver-operating characteristic (ROC) analysis was performed.

Results

A total of 734 patients were classified as normal and the remaining 318 were classified as having infarction and/or ischemia. The performance of the software packages calculated as the area under the SSS ROC curve were 0.87 for 4DM, 0.80 for QPS, and 0.76 for ECTb (QPS vs. ECTb p = 0.03; other differences p < 0.0001). The area under the TDE ROC curve were 0.87 for 4DM, 0.82 for QPS, and 0.76 for ECTb (QPS vs. ECTb p = 0.0005; other differences p < 0.0001).

Conclusion

There are considerable differences in performance between the three software packages with 4DM showing the best performance and ECTb the worst. These differences in performance should be taken in consideration when software packages are used in clinical routine or in clinical studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lindahl D, Lanke J, Lundin A, Palmer J, Edenbrandt L: Improved classifications of myocardial bull's-eye scintigrams with computer-based decision support system. J Nucl Med 1999, 40: 96–101.PubMed Lindahl D, Lanke J, Lundin A, Palmer J, Edenbrandt L: Improved classifications of myocardial bull's-eye scintigrams with computer-based decision support system. J Nucl Med 1999, 40: 96–101.PubMed
2.
go back to reference Lomsky M, Richter J, Johansson L, Høilund-Carlsen PF, Edenbrandt L: Validation of a new automated method for analysis of gated-SPECT images. Clin Physiol Funct Imaging 2006, 26: 139–145. 10.1111/j.1475-097X.2006.00667.xPubMedCrossRef Lomsky M, Richter J, Johansson L, Høilund-Carlsen PF, Edenbrandt L: Validation of a new automated method for analysis of gated-SPECT images. Clin Physiol Funct Imaging 2006, 26: 139–145. 10.1111/j.1475-097X.2006.00667.xPubMedCrossRef
3.
go back to reference Winz OH, Meyer PT, Knollmann D, Lipke DSA, Kuhl HP, Oelve C, Schaefer WM: Quantification of left ventricular volumes and ejection fraction from gated 99mTc-MIBI SPECT: MRI validation of the EXINI heart software package. Clin Physiol Funct Imaging 2009, 29: 89–94. 10.1111/j.1475-097X.2008.00840.xPubMedCrossRef Winz OH, Meyer PT, Knollmann D, Lipke DSA, Kuhl HP, Oelve C, Schaefer WM: Quantification of left ventricular volumes and ejection fraction from gated 99mTc-MIBI SPECT: MRI validation of the EXINI heart software package. Clin Physiol Funct Imaging 2009, 29: 89–94. 10.1111/j.1475-097X.2008.00840.xPubMedCrossRef
4.
go back to reference Hedeer F, Palmer J, Arheden H, Ugander M: Gated myocardial perfusion SPECT underestimates left ventricular volumes and shows high variability compared to cardiac magnetic resonance imaging - a comparison of four different commercial automated software packages. BMC Med Imaging 2010, 10: 10. 10.1186/1471-2342-10-10PubMedCentralPubMedCrossRef Hedeer F, Palmer J, Arheden H, Ugander M: Gated myocardial perfusion SPECT underestimates left ventricular volumes and shows high variability compared to cardiac magnetic resonance imaging - a comparison of four different commercial automated software packages. BMC Med Imaging 2010, 10: 10. 10.1186/1471-2342-10-10PubMedCentralPubMedCrossRef
5.
go back to reference Svensson A, Åkesson L, Edenbrandt L: Quantification of myocardial perfusion defects using three different software packages. Eur J Nucl Med Mol Imaging 2004, 31: 229–232. 10.1007/s00259-003-1361-4PubMedCrossRef Svensson A, Åkesson L, Edenbrandt L: Quantification of myocardial perfusion defects using three different software packages. Eur J Nucl Med Mol Imaging 2004, 31: 229–232. 10.1007/s00259-003-1361-4PubMedCrossRef
6.
go back to reference Wolak A, Slomka PJ, Fish MB, Lorenzo S, Acampa W, Berman DS, Germano G: Quantitative myocardial-perfusion SPECT. Comparison of three state-of-the-art software packages. J Nucl Cardiol 2008, 15: 27–34. 10.1016/j.nuclcard.2007.09.020PubMedCrossRef Wolak A, Slomka PJ, Fish MB, Lorenzo S, Acampa W, Berman DS, Germano G: Quantitative myocardial-perfusion SPECT. Comparison of three state-of-the-art software packages. J Nucl Cardiol 2008, 15: 27–34. 10.1016/j.nuclcard.2007.09.020PubMedCrossRef
7.
go back to reference Guner LA, Karabacak NI, Cakir T, Akdemir OU, Kocaman SA, Cengel A, Unlu M: Comparison of diagnostic performances of three different software packages in detecting coronary artery disease. Eur J Nucl Med Mol Imaging 2010, 37: 2070–2078. 10.1007/s00259-010-1522-1PubMedCrossRef Guner LA, Karabacak NI, Cakir T, Akdemir OU, Kocaman SA, Cengel A, Unlu M: Comparison of diagnostic performances of three different software packages in detecting coronary artery disease. Eur J Nucl Med Mol Imaging 2010, 37: 2070–2078. 10.1007/s00259-010-1522-1PubMedCrossRef
8.
go back to reference Berman DS, Abidov A, Kang X, Hayes SW, Friedman JD, Sciammarella MG, Cohen I, Gerlach J, Waechter PB, Germano G, Hachamovitch R: Prognostic validation of a 17-segment score derived from a 20-segment score for myocardial perfusion SPECT interpretation. J Nucl Cardiol 2004, 11: 414–423. 10.1016/j.nuclcard.2004.03.033PubMedCrossRef Berman DS, Abidov A, Kang X, Hayes SW, Friedman JD, Sciammarella MG, Cohen I, Gerlach J, Waechter PB, Germano G, Hachamovitch R: Prognostic validation of a 17-segment score derived from a 20-segment score for myocardial perfusion SPECT interpretation. J Nucl Cardiol 2004, 11: 414–423. 10.1016/j.nuclcard.2004.03.033PubMedCrossRef
9.
go back to reference Ficaro EP, Lee BC, Kritzman JN, Corbett JR: Corridor4DM: The Michigan method for quantitative nuclear cardiology. J Nucl Cardiol 2007, 14: 455–465. 10.1016/j.nuclcard.2007.06.006PubMedCrossRef Ficaro EP, Lee BC, Kritzman JN, Corbett JR: Corridor4DM: The Michigan method for quantitative nuclear cardiology. J Nucl Cardiol 2007, 14: 455–465. 10.1016/j.nuclcard.2007.06.006PubMedCrossRef
10.
go back to reference Garcia EV, Faber TL, Cooke CD, Folks RD, Chen J, Santana C: The increasing role of quantification in clinical nuclear cardiology: The Emory approach. J Nucl Cardiol 2007, 14: 420–432. 10.1016/j.nuclcard.2007.06.009PubMedCrossRef Garcia EV, Faber TL, Cooke CD, Folks RD, Chen J, Santana C: The increasing role of quantification in clinical nuclear cardiology: The Emory approach. J Nucl Cardiol 2007, 14: 420–432. 10.1016/j.nuclcard.2007.06.009PubMedCrossRef
11.
go back to reference Germano G, Kavanagh PB, Slomka PJ, Van Kriekinge SD, Pollard G, Berman DS: Quantitation in gated perfusion SPECT imaging: The Cedars-Sinai approach. J Nucl Cardiol 2007, 14: 433–454. 10.1016/j.nuclcard.2007.06.008PubMedCrossRef Germano G, Kavanagh PB, Slomka PJ, Van Kriekinge SD, Pollard G, Berman DS: Quantitation in gated perfusion SPECT imaging: The Cedars-Sinai approach. J Nucl Cardiol 2007, 14: 433–454. 10.1016/j.nuclcard.2007.06.008PubMedCrossRef
12.
go back to reference Wehrens RPH, Buydens LMC: The bootstrap: a tutorial. Chemom Intell Lab Syst 2000, 54: 35–52. 10.1016/S0169-7439(00)00102-7CrossRef Wehrens RPH, Buydens LMC: The bootstrap: a tutorial. Chemom Intell Lab Syst 2000, 54: 35–52. 10.1016/S0169-7439(00)00102-7CrossRef
13.
go back to reference Banerjee S, Crook AM, Dawson JR, Timmis AD, Hemingway H: Magnitude and consequences of error in coronary angiography interpretation (the ACRE study). Am J Cardiol 2000, 85: 309–314. 10.1016/S0002-9149(99)00738-9PubMedCrossRef Banerjee S, Crook AM, Dawson JR, Timmis AD, Hemingway H: Magnitude and consequences of error in coronary angiography interpretation (the ACRE study). Am J Cardiol 2000, 85: 309–314. 10.1016/S0002-9149(99)00738-9PubMedCrossRef
Metadata
Title
Diagnostic evaluation of three cardiac software packages using a consecutive group of patients
Authors
Lena Johansson
Milan Lomsky
Jens Marving
Mattias Ohlsson
Sven-Eric Svensson
Lars Edenbrandt
Publication date
01-12-2011
Publisher
Springer Berlin Heidelberg
Published in
EJNMMI Research / Issue 1/2011
Electronic ISSN: 2191-219X
DOI
https://doi.org/10.1186/2191-219X-1-22

Other articles of this Issue 1/2011

EJNMMI Research 1/2011 Go to the issue