Skip to main content
Top
Published in: Journal of Cardiovascular Magnetic Resonance 1/2017

Open Access 01-12-2017 | Research

Sources of variability in quantification of cardiovascular magnetic resonance infarct size - reproducibility among three core laboratories

Authors: Igor Klem, Einar Heiberg, Lowie Van Assche, Michele A. Parker, Han W. Kim, John D. Grizzard, Håkan Arheden, Raymond J. Kim

Published in: Journal of Cardiovascular Magnetic Resonance | Issue 1/2017

Login to get access

Abstract

Background

Acute myocardial infarct (AMI) size depicted by late gadolinium enhancement cardiovascular magnetic resonance (CMR) is increasingly used as an efficacy endpoint in randomized trials comparing AMI therapies. Infarct size is quantified using manual planimetry (MANUAL), visual scoring (VISUAL), or automated techniques using signal-intensity thresholding (AUTO). Although AUTO is considered the most reproducible, prior studies did not account for the subjective determination of endocardial/epicardial borders, which all methods require. For MANUAL and VISUAL, prior studies did not address how to treat intermediate signal intensities due to partial volume.

Methods

To assess sources of variability, AMI size was measured in 30 patients and 12 controls by 3 core-laboratories using 8 methods, each separated by more than 2 months time (n = 720 evaluations). The methods were: (1,2) AUTOSegment, AUTOFWHM (using Segment software or the full-width-at-half-maximum algorithm, respectively); (3,4) AUTO-UCSegment, AUTO-UCFWHM (user correction for endocardial border pixels, no-reflow, etc.); (5) MANUAL; (6) MANUAL-ISI (adjustment for intermediate signal-intensities); (7) VISUAL; (8) VISUAL-ISI.

Results

Mean infarct size varied between 16.8% and 27.2% of LV mass depending on method. Even automated techniques with no user interaction for infarct borders resulted in significant within-patient variability given the need to subjectively trace endocardial/epicardial contours. The coefficient-of-variation (CV) was 10.6% and 14.6% for AUTOSegment and AUTOFWHM, respectively. For manual and visual categories, reproducibility was improved when intermediate signal-intensities were considered (MANUAL-ISI vs MANUAL: CV = 8.3% vs 14.4%; p = 0.03; VISUAL-ISI vs VISUAL: CV = 8.4% vs 10.9%; p = 0.01). For AUTO-UCSegment, MANUAL-ISI, and VISUAL-ISI (best technique in each category) within-patient variability due to the quantification method was less than 10% of total variability, and the required sample sizes for detecting a 5% absolute difference in infarct size were 62, 63, and 62 patients, respectively.

Conclusion

Among CMR core-laboratories, an important source of variability in infarct size quantification is the subjective delineation of endocardial/epicardial borders. When intermediate signal intensities are considered in manual planimetry and visual scoring, reproducibility and impact on sample size are similar to automated techniques.
Literature
1.
go back to reference Gibbons RJ, Miller TD, Christian TF. Infarct size measured by single photon emission computed tomographic imaging with (99m)Tc-sestamibi: a measure of the efficacy of therapy in acute myocardial infarction. Circulation. 2000;101(1):101–8.CrossRef Gibbons RJ, Miller TD, Christian TF. Infarct size measured by single photon emission computed tomographic imaging with (99m)Tc-sestamibi: a measure of the efficacy of therapy in acute myocardial infarction. Circulation. 2000;101(1):101–8.CrossRef
2.
go back to reference Kim HW, Farzaneh-Far A, Kim RJ. Cardiovascular magnetic resonance in patients with myocardial infarction: current and emerging applications. J Am Coll Cardiol. 2009;55(1):1–16.CrossRefPubMed Kim HW, Farzaneh-Far A, Kim RJ. Cardiovascular magnetic resonance in patients with myocardial infarction: current and emerging applications. J Am Coll Cardiol. 2009;55(1):1–16.CrossRefPubMed
4.
go back to reference Wagner A, Mahrholdt H, Holly TA, Elliott MD, Regenfus M, Parker M, Klocke FJ, Bonow RO, Kim RJ, Judd RM. Contrast-enhanced MRI and routine single photon emission computed tomography (SPECT) perfusion imaging for detection of subendocardial myocardial infarcts: an imaging study. Lancet. 2003;361(9355):374–9.CrossRefPubMed Wagner A, Mahrholdt H, Holly TA, Elliott MD, Regenfus M, Parker M, Klocke FJ, Bonow RO, Kim RJ, Judd RM. Contrast-enhanced MRI and routine single photon emission computed tomography (SPECT) perfusion imaging for detection of subendocardial myocardial infarcts: an imaging study. Lancet. 2003;361(9355):374–9.CrossRefPubMed
5.
go back to reference Kim RJ, Albert TS, Wible JH, Elliott MD, Allen JC, Lee JC, Parker M, Napoli A, Judd RM. Performance of delayed-enhancement magnetic resonance imaging with gadoversetamide contrast for the detection and assessment of myocardial infarction: an international, multicenter, double-blinded, randomized trial. Circulation. 2008;117(5):629–37.CrossRefPubMed Kim RJ, Albert TS, Wible JH, Elliott MD, Allen JC, Lee JC, Parker M, Napoli A, Judd RM. Performance of delayed-enhancement magnetic resonance imaging with gadoversetamide contrast for the detection and assessment of myocardial infarction: an international, multicenter, double-blinded, randomized trial. Circulation. 2008;117(5):629–37.CrossRefPubMed
6.
go back to reference Thiele H, Kappl MJ, Conradi S, Niebauer J, Hambrecht R, Schuler G. Reproducibility of chronic and acute infarct size measurement by delayed enhancement-magnetic resonance imaging. J Am Coll Cardiol. 2006;47(8):1641–5.CrossRefPubMed Thiele H, Kappl MJ, Conradi S, Niebauer J, Hambrecht R, Schuler G. Reproducibility of chronic and acute infarct size measurement by delayed enhancement-magnetic resonance imaging. J Am Coll Cardiol. 2006;47(8):1641–5.CrossRefPubMed
7.
go back to reference Ezekowitz JA, Armstrong PW, Granger CB, Theroux P, Stebbins A, Kim RJ, Patel MR. Predicting chronic left ventricular dysfunction 90 days after ST-segment elevation myocardial infarction: an assessment of Pexelizumab in acute myocardial infarction (APEX-AMI) substudy. Am Heart J. 2010;160(2):272–8.CrossRefPubMed Ezekowitz JA, Armstrong PW, Granger CB, Theroux P, Stebbins A, Kim RJ, Patel MR. Predicting chronic left ventricular dysfunction 90 days after ST-segment elevation myocardial infarction: an assessment of Pexelizumab in acute myocardial infarction (APEX-AMI) substudy. Am Heart J. 2010;160(2):272–8.CrossRefPubMed
8.
go back to reference Bondarenko O, Beek AM, Hofman MB, Kuhl HP, Twisk JW, van Dockum WG, Visser CA, van Rossum AC. Standardizing the definition of hyperenhancement in the quantitative assessment of infarct size and myocardial viability using delayed contrast-enhanced CMR. J Cardiovasc Magn Reson. 2005;7(2):481–5.CrossRefPubMed Bondarenko O, Beek AM, Hofman MB, Kuhl HP, Twisk JW, van Dockum WG, Visser CA, van Rossum AC. Standardizing the definition of hyperenhancement in the quantitative assessment of infarct size and myocardial viability using delayed contrast-enhanced CMR. J Cardiovasc Magn Reson. 2005;7(2):481–5.CrossRefPubMed
9.
go back to reference Amado LC, Gerber BL, Gupta SN, Rettmann DW, Szarf G, Schock R, Nasir K, Kraitchman DL, Lima JA. Accurate and objective infarct sizing by contrast-enhanced magnetic resonance imaging in a canine myocardial infarction model. J Am Coll Cardiol. 2004;44(12):2383–9.CrossRefPubMed Amado LC, Gerber BL, Gupta SN, Rettmann DW, Szarf G, Schock R, Nasir K, Kraitchman DL, Lima JA. Accurate and objective infarct sizing by contrast-enhanced magnetic resonance imaging in a canine myocardial infarction model. J Am Coll Cardiol. 2004;44(12):2383–9.CrossRefPubMed
10.
go back to reference Flett AS, Hasleton J, Cook C, Hausenloy D, Quarta G, Ariti C, Muthurangu V, Moon JC. Evaluation of techniques for the quantification of myocardial scar of differing etiology using cardiac magnetic resonance. JACC Cardiovasc Imaging. 2011;4(2):150–6.CrossRefPubMed Flett AS, Hasleton J, Cook C, Hausenloy D, Quarta G, Ariti C, Muthurangu V, Moon JC. Evaluation of techniques for the quantification of myocardial scar of differing etiology using cardiac magnetic resonance. JACC Cardiovasc Imaging. 2011;4(2):150–6.CrossRefPubMed
11.
go back to reference Hsu LY, Ingkanisorn WP, Kellman P, Aletras AH, Arai AE. Quantitative myocardial infarction on delayed enhancement MRI. Part II: clinical application of an automated feature analysis and combined thresholding infarct sizing algorithm. J Magn Reson imaging : JMRI. 2006;23(3):309–14.CrossRefPubMed Hsu LY, Ingkanisorn WP, Kellman P, Aletras AH, Arai AE. Quantitative myocardial infarction on delayed enhancement MRI. Part II: clinical application of an automated feature analysis and combined thresholding infarct sizing algorithm. J Magn Reson imaging : JMRI. 2006;23(3):309–14.CrossRefPubMed
12.
go back to reference Alba X, Figueras IVRM, Lekadir K, Tobon-Gomez C, Hoogendoorn C, Frangi AF. Automatic cardiac LV segmentation in MRI using modified graph cuts with smoothness and interslice constraints. Magn Reson Med : Official J Soc Magn Reson Med / Soc Magn Reson Med. 2014;72(6):1775–84.CrossRef Alba X, Figueras IVRM, Lekadir K, Tobon-Gomez C, Hoogendoorn C, Frangi AF. Automatic cardiac LV segmentation in MRI using modified graph cuts with smoothness and interslice constraints. Magn Reson Med : Official J Soc Magn Reson Med / Soc Magn Reson Med. 2014;72(6):1775–84.CrossRef
13.
go back to reference Tao Q, Piers SR, Lamb HJ, van der Geest RJ. Automated left ventricle segmentation in late gadolinium-enhanced MRI for objective myocardial scar assessment. J Magn Reson Imaging : JMRI. 2015;42(2):390–9.CrossRefPubMed Tao Q, Piers SR, Lamb HJ, van der Geest RJ. Automated left ventricle segmentation in late gadolinium-enhanced MRI for objective myocardial scar assessment. J Magn Reson Imaging : JMRI. 2015;42(2):390–9.CrossRefPubMed
14.
go back to reference Wei D, Sun Y, Chai P, Low A, Ong SH. Myocardial segmentation of late gadolinium enhanced MR images by propagation of contours from cine MR images. Med Image Comput Comput Assist Interv. 2011;14(Pt 3):428–35.PubMed Wei D, Sun Y, Chai P, Low A, Ong SH. Myocardial segmentation of late gadolinium enhanced MR images by propagation of contours from cine MR images. Med Image Comput Comput Assist Interv. 2011;14(Pt 3):428–35.PubMed
15.
go back to reference Ringenberg J, Deo M, Devabhaktuni V, Filgueiras-Rama D, Pizarro G, Ibanez B, Berenfeld O, Boyers P, Gold J: Automated segmentation and reconstruction of patient-specific cardiac anatomy and pathology from in vivo MRI. J Meas Sci Technol. 2012;23:125405 (13pp). Ringenberg J, Deo M, Devabhaktuni V, Filgueiras-Rama D, Pizarro G, Ibanez B, Berenfeld O, Boyers P, Gold J: Automated segmentation and reconstruction of patient-specific cardiac anatomy and pathology from in vivo MRI. J Meas Sci Technol. 2012;23:125405 (13pp).
16.
go back to reference Kim RJ, Fieno DS, Parrish TB, Harris K, Chen EL, Simonetti O, Bundy J, Finn JP, Klocke FJ, Judd RM. Relationship of MRI delayed contrast enhancement to irreversible injury, infarct age, and contractile function. Circulation. 1999;100(19):1992–2002.CrossRefPubMed Kim RJ, Fieno DS, Parrish TB, Harris K, Chen EL, Simonetti O, Bundy J, Finn JP, Klocke FJ, Judd RM. Relationship of MRI delayed contrast enhancement to irreversible injury, infarct age, and contractile function. Circulation. 1999;100(19):1992–2002.CrossRefPubMed
17.
go back to reference Gibbons RJ, Valeti US, Araoz PA, Jaffe AS. The quantification of infarct size. J Am Coll Cardiol. 2004;44(8):1533–42.CrossRefPubMed Gibbons RJ, Valeti US, Araoz PA, Jaffe AS. The quantification of infarct size. J Am Coll Cardiol. 2004;44(8):1533–42.CrossRefPubMed
18.
go back to reference Thygesen K, Alpert JS, Jaffe AS, Simoons ML, Chaitman BR, White HD, Joint ESCAAHAWHFTFfUDoMI, Authors/Task Force Members C, Thygesen K, Alpert JS, et al. Third universal definition of myocardial infarction. J Am Coll Cardiol. 2012;60(16):1581–98.CrossRefPubMed Thygesen K, Alpert JS, Jaffe AS, Simoons ML, Chaitman BR, White HD, Joint ESCAAHAWHFTFfUDoMI, Authors/Task Force Members C, Thygesen K, Alpert JS, et al. Third universal definition of myocardial infarction. J Am Coll Cardiol. 2012;60(16):1581–98.CrossRefPubMed
19.
go back to reference Kramer CM, Barkhausen J, Flamm SD, Kim RJ, Nagel E, Society for Cardiovascular Magnetic Resonance Board of Trustees Task Force on Standardized P. Standardized cardiovascular magnetic resonance (CMR) protocols 2013 update. J Cardiovasc Magn Reson. 2013;15:91.CrossRefPubMedPubMedCentral Kramer CM, Barkhausen J, Flamm SD, Kim RJ, Nagel E, Society for Cardiovascular Magnetic Resonance Board of Trustees Task Force on Standardized P. Standardized cardiovascular magnetic resonance (CMR) protocols 2013 update. J Cardiovasc Magn Reson. 2013;15:91.CrossRefPubMedPubMedCentral
20.
go back to reference Heiberg E, Sjogren J, Ugander M, Carlsson M, Engblom H, Arheden H. Design and validation of segment--freely available software for cardiovascular image analysis. BMC Med Imaging. 2010;10:1.CrossRefPubMedPubMedCentral Heiberg E, Sjogren J, Ugander M, Carlsson M, Engblom H, Arheden H. Design and validation of segment--freely available software for cardiovascular image analysis. BMC Med Imaging. 2010;10:1.CrossRefPubMedPubMedCentral
21.
go back to reference Heiberg E, Ugander M, Engblom H, Gotberg M, Olivecrona GK, Erlinge D, Arheden H. Automated quantification of myocardial infarction from MR images by accounting for partial volume effects: animal, phantom, and human study. Radiology. 2008;246(2):581–8.CrossRefPubMed Heiberg E, Ugander M, Engblom H, Gotberg M, Olivecrona GK, Erlinge D, Arheden H. Automated quantification of myocardial infarction from MR images by accounting for partial volume effects: animal, phantom, and human study. Radiology. 2008;246(2):581–8.CrossRefPubMed
22.
go back to reference Schulz-Menger J, Bluemke DA, Bremerich J, Flamm SD, Fogel MA, Friedrich MG, Kim RJ, von Knobelsdorff-Brenkenhoff F, Kramer CM, Pennell DJ, et al. Standardized image interpretation and post processing in cardiovascular magnetic resonance: Society for Cardiovascular Magnetic Resonance (SCMR) board of trustees task force on standardized post processing. J Cardiovasc Magn Reson. 2013;15:35.CrossRefPubMedPubMedCentral Schulz-Menger J, Bluemke DA, Bremerich J, Flamm SD, Fogel MA, Friedrich MG, Kim RJ, von Knobelsdorff-Brenkenhoff F, Kramer CM, Pennell DJ, et al. Standardized image interpretation and post processing in cardiovascular magnetic resonance: Society for Cardiovascular Magnetic Resonance (SCMR) board of trustees task force on standardized post processing. J Cardiovasc Magn Reson. 2013;15:35.CrossRefPubMedPubMedCentral
23.
go back to reference Grothues F, Smith GC, Moon JC, Bellenger NG, Collins P, Klein HU, Pennell DJ. Comparison of interstudy reproducibility of cardiovascular magnetic resonance with two-dimensional echocardiography in normal subjects and in patients with heart failure or left ventricular hypertrophy. Am J Cardiol. 2002;90(1):29–34.CrossRefPubMed Grothues F, Smith GC, Moon JC, Bellenger NG, Collins P, Klein HU, Pennell DJ. Comparison of interstudy reproducibility of cardiovascular magnetic resonance with two-dimensional echocardiography in normal subjects and in patients with heart failure or left ventricular hypertrophy. Am J Cardiol. 2002;90(1):29–34.CrossRefPubMed
24.
go back to reference Fleiss JL. The design and analysis of clinical experiments. United States of America: John Wiley & Sons, Inc; 1986. Fleiss JL. The design and analysis of clinical experiments. United States of America: John Wiley & Sons, Inc; 1986.
25.
go back to reference Sievers B, Elliott MD, Hurwitz LM, Albert TS, Klem I, Rehwald WG, Parker MA, Judd RM, Kim RJ. Rapid detection of myocardial infarction by subsecond, free-breathing delayed contrast-enhancement cardiovascular magnetic resonance. Circulation. 2007;115(2):236–44.CrossRefPubMed Sievers B, Elliott MD, Hurwitz LM, Albert TS, Klem I, Rehwald WG, Parker MA, Judd RM, Kim RJ. Rapid detection of myocardial infarction by subsecond, free-breathing delayed contrast-enhancement cardiovascular magnetic resonance. Circulation. 2007;115(2):236–44.CrossRefPubMed
Metadata
Title
Sources of variability in quantification of cardiovascular magnetic resonance infarct size - reproducibility among three core laboratories
Authors
Igor Klem
Einar Heiberg
Lowie Van Assche
Michele A. Parker
Han W. Kim
John D. Grizzard
Håkan Arheden
Raymond J. Kim
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Journal of Cardiovascular Magnetic Resonance / Issue 1/2017
Electronic ISSN: 1532-429X
DOI
https://doi.org/10.1186/s12968-017-0378-y

Other articles of this Issue 1/2017

Journal of Cardiovascular Magnetic Resonance 1/2017 Go to the issue