Skip to main content
Top
Published in: Cardiovascular Ultrasound 1/2019

Open Access 01-12-2019 | Echocardiography | Research

Impact of a training program incorporating cardiac magnetic resonance imaging on the accuracy and reproducibility of two-dimensional echocardiographic measurements of left ventricular volumes and ejection fraction

Authors: Yosuke Nabeshima, Hidehiro Namisaki, Toshihiro Teshima, Yasuhiko Kurashige, Akiko Kakio, Azusa Fukumitsu, Yutaka Otsuji, Masaaki Takeuchi

Published in: Cardiovascular Ultrasound | Issue 1/2019

Login to get access

Abstract

Background

Left ventricular (LV) ejection fraction (LVEF) assessed by two-dimensional echocardiography (2DE) is the most widely used parameter for clinical decision-making, but reproducibility and accuracy problems remain. We evaluated the usefulness of a novel training program based on cardiac magnetic resonance (CMR) imaging to obtain more reliable values of 2DE-derived LVEF and LV volumes.

Methods

Fifty-four sonographers from five hospitals independently measured LV volumes and LVEF using the same 2DE images from 15 patients who underwent CMR and 2DE. After receiving a lecture from an expert on how to properly trace the LV endocardium, each sonographer voluntary performed the measurements using the same datasets, and was invited to perform the same analysis for additional patients. The effect of the training intervention was evaluated using the coefficient of variation (CV) and coverage probability (CP).

Results

Before the intervention, the LV volumes were significantly underestimated and the LVEF was significantly overestimated compared to the CMR results; however, these differences were reduced after the intervention. In particular, the CP (0.52 vs. 0.76, p < 0.001) for the LVEF showed significant improvement. However, the degree of improvement differed among institutions, and the CV actually became worse in two hospitals after the intervention. Level of experience and self-practice was associated with the reproducibility after the intervention.

Conclusions

A training program using CMR as a reference improved the accuracy of 2DE-determined LV measurements. Since the degree of improvements differed among hospitals, individualization of training programs and periodical objective evaluation may be required to reduce inter-institutional variability.
Appendix
Available only for authorised users
Literature
1.
go back to reference Douglas PS, Garcia MJ, Haines DE, Lai WW, Manning WJ, Patel AR, et al. ACCF/ASE/AHA/ASNC/HFSA/HRS/SCAI/SCCM/SCCT/SCMR 2011 Appropriate Use Criteria for Echocardiography. A Report of the American College of Cardiology Foundation Appropriate Use Criteria Task Force, American Society of Echocardiography, American Heart Association, American Society of Nuclear Cardiology, Heart Failure Society of America, Heart Rhythm Society, Society for Cardiovascular Angiography and Interventions, Society of Critical Care Medicine, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance American College of Chest Physicians. J Am Soc Echocardiogr. 2011;24(3):229–67.PubMedCrossRef Douglas PS, Garcia MJ, Haines DE, Lai WW, Manning WJ, Patel AR, et al. ACCF/ASE/AHA/ASNC/HFSA/HRS/SCAI/SCCM/SCCT/SCMR 2011 Appropriate Use Criteria for Echocardiography. A Report of the American College of Cardiology Foundation Appropriate Use Criteria Task Force, American Society of Echocardiography, American Heart Association, American Society of Nuclear Cardiology, Heart Failure Society of America, Heart Rhythm Society, Society for Cardiovascular Angiography and Interventions, Society of Critical Care Medicine, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance American College of Chest Physicians. J Am Soc Echocardiogr. 2011;24(3):229–67.PubMedCrossRef
2.
go back to reference Plana JC, Galderisi M, Barac A, Ewer MS, Ky B, Scherrer-Crosbie M, et al. Expert consensus for multimodality imaging evaluation of adult patients during and after cancer therapy: a report from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2014;27(9):911–39.PubMedCrossRef Plana JC, Galderisi M, Barac A, Ewer MS, Ky B, Scherrer-Crosbie M, et al. Expert consensus for multimodality imaging evaluation of adult patients during and after cancer therapy: a report from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr. 2014;27(9):911–39.PubMedCrossRef
3.
go back to reference Tracy CM, Epstein AE, Darbar D, DiMarco JP, Dunbar SB, Estes NA 3rd, et al. 2012 ACCF/AHA/HRS focused update of the 2008 guidelines for device-based therapy of cardiac rhythm abnormalities: a report of the American College of Cardiology Foundation/American Heart Association task force on practice guidelines and the Heart Rhythm Society. [corrected]. Circulation. 2012;126(14):1784–800.PubMedCrossRef Tracy CM, Epstein AE, Darbar D, DiMarco JP, Dunbar SB, Estes NA 3rd, et al. 2012 ACCF/AHA/HRS focused update of the 2008 guidelines for device-based therapy of cardiac rhythm abnormalities: a report of the American College of Cardiology Foundation/American Heart Association task force on practice guidelines and the Heart Rhythm Society. [corrected]. Circulation. 2012;126(14):1784–800.PubMedCrossRef
4.
go back to reference Brignole M, Auricchio A, Baron-Esquivias G, Bordachar P, Boriani G, Breithardt OA, et al. 2013 ESC guidelines on cardiac pacing and cardiac resynchronization therapy: the task force on cardiac pacing and resynchronization therapy of the European Society of Cardiology (ESC). Developed in collaboration with the European heart rhythm association (EHRA). Eur Heart J. 2013;34(29):2281–329.PubMedCrossRef Brignole M, Auricchio A, Baron-Esquivias G, Bordachar P, Boriani G, Breithardt OA, et al. 2013 ESC guidelines on cardiac pacing and cardiac resynchronization therapy: the task force on cardiac pacing and resynchronization therapy of the European Society of Cardiology (ESC). Developed in collaboration with the European heart rhythm association (EHRA). Eur Heart J. 2013;34(29):2281–329.PubMedCrossRef
5.
go back to reference Douglas PS, Chen J, Gillam L, Hendel R, Hundley WG, Masoudi F, et al. Achieving quality in cardiovascular imaging II: proceedings from the second American College of Cardiology - Duke University medical center think tank on quality in cardiovascular imaging. JACC Cardiovasc Imaging. 2009;2(2):231–40.PubMedCrossRef Douglas PS, Chen J, Gillam L, Hendel R, Hundley WG, Masoudi F, et al. Achieving quality in cardiovascular imaging II: proceedings from the second American College of Cardiology - Duke University medical center think tank on quality in cardiovascular imaging. JACC Cardiovasc Imaging. 2009;2(2):231–40.PubMedCrossRef
6.
go back to reference Bovelli D, Plataniotis G, Roila F, Group EGW. Cardiotoxicity of chemotherapeutic agents and radiotherapy-related heart disease: ESMO clinical practice guidelines. Ann Oncol. 2010;21(Suppl 5):v277–v82.PubMedCrossRef Bovelli D, Plataniotis G, Roila F, Group EGW. Cardiotoxicity of chemotherapeutic agents and radiotherapy-related heart disease: ESMO clinical practice guidelines. Ann Oncol. 2010;21(Suppl 5):v277–v82.PubMedCrossRef
7.
go back to reference Johri AM, Picard MH, Newell J, Marshall JE, King ME, Hung J. Can a teaching intervention reduce interobserver variability in LVEF assessment: a quality control exercise in the echocardiography lab. JACC Cardiovasc Imaging. 2011;4(8):821–9.PubMedCrossRef Johri AM, Picard MH, Newell J, Marshall JE, King ME, Hung J. Can a teaching intervention reduce interobserver variability in LVEF assessment: a quality control exercise in the echocardiography lab. JACC Cardiovasc Imaging. 2011;4(8):821–9.PubMedCrossRef
8.
go back to reference Picard MH, Adams D, Bierig SM, Dent JM, Douglas PS, Gillam LD, et al. American Society of Echocardiography recommendations for quality echocardiography laboratory operations. J Am Soc Echocardiogr. 2011;24(1):1–10.PubMedCrossRef Picard MH, Adams D, Bierig SM, Dent JM, Douglas PS, Gillam LD, et al. American Society of Echocardiography recommendations for quality echocardiography laboratory operations. J Am Soc Echocardiogr. 2011;24(1):1–10.PubMedCrossRef
9.
go back to reference Semelka RC, Tomei E, Wagner S, Mayo J, Kondo C, Suzuki J, et al. Normal left ventricular dimensions and function: interstudy reproducibility of measurements with cine MR imaging. Radiology. 1990;174(3 Pt 1):763–8.PubMedCrossRef Semelka RC, Tomei E, Wagner S, Mayo J, Kondo C, Suzuki J, et al. Normal left ventricular dimensions and function: interstudy reproducibility of measurements with cine MR imaging. Radiology. 1990;174(3 Pt 1):763–8.PubMedCrossRef
10.
go back to reference Frederiksen CA, Juhl-Olsen P, Nielsen DG, Eika B, Sloth E. Limited intervention improves technical skill in focus assessed transthoracic echocardiography among novice examiners. BMC Med Educ. 2012;12:65.PubMedPubMedCentralCrossRef Frederiksen CA, Juhl-Olsen P, Nielsen DG, Eika B, Sloth E. Limited intervention improves technical skill in focus assessed transthoracic echocardiography among novice examiners. BMC Med Educ. 2012;12:65.PubMedPubMedCentralCrossRef
11.
go back to reference Crowley AL, Yow E, Barnhart HX, Daubert MA, Bigelow R, Sullivan DC, et al. Critical review of current approaches for echocardiographic reproducibility and reliability assessment in clinical research. J Am Soc Echocardiogr. 2016;29(12):1144–54 e7.PubMedCrossRef Crowley AL, Yow E, Barnhart HX, Daubert MA, Bigelow R, Sullivan DC, et al. Critical review of current approaches for echocardiographic reproducibility and reliability assessment in clinical research. J Am Soc Echocardiogr. 2016;29(12):1144–54 e7.PubMedCrossRef
12.
go back to reference Daubert MA, Yow E, Barnhart HX, Rabineau D, Crowley AL, Douglas PS. Quality improvement implementation: improving reproducibility in the echocardiography laboratory. J Am Coll Cardiol. 2015;28(8):959–68. Daubert MA, Yow E, Barnhart HX, Rabineau D, Crowley AL, Douglas PS. Quality improvement implementation: improving reproducibility in the echocardiography laboratory. J Am Coll Cardiol. 2015;28(8):959–68.
13.
go back to reference Khouri MG, Ky B, Dunn G, Plappert T, Englefield V, Rabineau D, et al. Echocardiography Core Laboratory reproducibility of cardiac safety assessments in cardio-oncology. J Am Soc Echocardiogr. 2018;31(3):361–71 e3.PubMedPubMedCentralCrossRef Khouri MG, Ky B, Dunn G, Plappert T, Englefield V, Rabineau D, et al. Echocardiography Core Laboratory reproducibility of cardiac safety assessments in cardio-oncology. J Am Soc Echocardiogr. 2018;31(3):361–71 e3.PubMedPubMedCentralCrossRef
14.
go back to reference Akinboboye O, Sumner J, Gopal A, King D, Shen Z, Bardfeld P, et al. Visual estimation of ejection fraction by two-dimensional echocardiography: the learning curve. Clin Cardiol. 1995;18(12):726–9.PubMedCrossRef Akinboboye O, Sumner J, Gopal A, King D, Shen Z, Bardfeld P, et al. Visual estimation of ejection fraction by two-dimensional echocardiography: the learning curve. Clin Cardiol. 1995;18(12):726–9.PubMedCrossRef
15.
go back to reference Thavendiranathan P, Popovic ZB, Flamm SD, Dahiya A, Grimm RA, Marwick TH. Improved interobserver variability and accuracy of echocardiographic visual left ventricular ejection fraction assessment through a self-directed learning program using cardiac magnetic resonance images. J Am Soc Echocardiogr. 2013;26(11):1267–73.PubMedCrossRef Thavendiranathan P, Popovic ZB, Flamm SD, Dahiya A, Grimm RA, Marwick TH. Improved interobserver variability and accuracy of echocardiographic visual left ventricular ejection fraction assessment through a self-directed learning program using cardiac magnetic resonance images. J Am Soc Echocardiogr. 2013;26(11):1267–73.PubMedCrossRef
16.
go back to reference Marsella M, Borgna-Pignatti C, Meloni A, Caldarelli V, Dell'Amico MC, Spasiano A, et al. Cardiac iron and cardiac disease in males and females with transfusion-dependent thalassemia major: a T2* magnetic resonance imaging study. Haematologica. 2011;96(4):515–20.PubMedPubMedCentralCrossRef Marsella M, Borgna-Pignatti C, Meloni A, Caldarelli V, Dell'Amico MC, Spasiano A, et al. Cardiac iron and cardiac disease in males and females with transfusion-dependent thalassemia major: a T2* magnetic resonance imaging study. Haematologica. 2011;96(4):515–20.PubMedPubMedCentralCrossRef
17.
go back to reference Wood PW, Choy JB, Nanda NC, Becher H. Left ventricular ejection fraction and volumes: it depends on the imaging method. Echocardiography. 2014;31(1):87–100.PubMedCrossRef Wood PW, Choy JB, Nanda NC, Becher H. Left ventricular ejection fraction and volumes: it depends on the imaging method. Echocardiography. 2014;31(1):87–100.PubMedCrossRef
18.
go back to reference Mor-Avi V, Jenkins C, Kuhl HP, Nesser HJ, Marwick T, Franke A, et al. Real-time 3-dimensional echocardiographic quantification of left ventricular volumes: multicenter study for validation with magnetic resonance imaging and investigation of sources of error. JACC Cardiovasc Imaging. 2008;1(4):413–23.PubMedCrossRef Mor-Avi V, Jenkins C, Kuhl HP, Nesser HJ, Marwick T, Franke A, et al. Real-time 3-dimensional echocardiographic quantification of left ventricular volumes: multicenter study for validation with magnetic resonance imaging and investigation of sources of error. JACC Cardiovasc Imaging. 2008;1(4):413–23.PubMedCrossRef
19.
go back to reference Aquaro GD, Camastra G, Monti L, Lombardi M, Pepe A, Castelletti S, et al. Reference values of cardiac volumes, dimensions, and new functional parameters by MR: a multicenter, multivendor study. J Magn Reson Imaging. 2017;45(4):1055–67.PubMedCrossRef Aquaro GD, Camastra G, Monti L, Lombardi M, Pepe A, Castelletti S, et al. Reference values of cardiac volumes, dimensions, and new functional parameters by MR: a multicenter, multivendor study. J Magn Reson Imaging. 2017;45(4):1055–67.PubMedCrossRef
20.
go back to reference Lang RM, Bierig M, Devereux RB, Flachskampf FA, Foster E, Pellikka PA, et al. Recommendations for chamber quantification: a report from the American Society of Echocardiography’s guidelines and standards committee and the chamber quantification writing group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardiology. J Am Soc Echocardiogr. 2005;18(12):1440–63.PubMedCrossRef Lang RM, Bierig M, Devereux RB, Flachskampf FA, Foster E, Pellikka PA, et al. Recommendations for chamber quantification: a report from the American Society of Echocardiography’s guidelines and standards committee and the chamber quantification writing group, developed in conjunction with the European Association of Echocardiography, a branch of the European Society of Cardiology. J Am Soc Echocardiogr. 2005;18(12):1440–63.PubMedCrossRef
21.
go back to reference Kusunose K, Shibayama K, Iwano H, Izumo M, Kagiyama N, Kurosawa K, et al. Reduced variability of visual left ventricular ejection fraction assessment with reference images: the Japanese Association of Young Echocardiography Fellows multicenter study. J Cardiol. 2018;72(1):74–80.PubMedCrossRef Kusunose K, Shibayama K, Iwano H, Izumo M, Kagiyama N, Kurosawa K, et al. Reduced variability of visual left ventricular ejection fraction assessment with reference images: the Japanese Association of Young Echocardiography Fellows multicenter study. J Cardiol. 2018;72(1):74–80.PubMedCrossRef
22.
go back to reference Medvedofsky D, Kebed K, Laffin L, Stone J, Addetia K, Lang RM, et al. Reproducibility and experience dependence of echocardiographic indices of left ventricular function: side-by-side comparison of global longitudinal strain and ejection fraction. Echocardiography. 2017;34(3):365–70.PubMedCrossRef Medvedofsky D, Kebed K, Laffin L, Stone J, Addetia K, Lang RM, et al. Reproducibility and experience dependence of echocardiographic indices of left ventricular function: side-by-side comparison of global longitudinal strain and ejection fraction. Echocardiography. 2017;34(3):365–70.PubMedCrossRef
23.
go back to reference Heller GV, Katanick SL, Sloper T, Garcia M. Accreditation for cardiovascular imaging: setting quality standards for patient care. JACC Cardiovasc Imaging. 2008;1(3):390–7.PubMedCrossRef Heller GV, Katanick SL, Sloper T, Garcia M. Accreditation for cardiovascular imaging: setting quality standards for patient care. JACC Cardiovasc Imaging. 2008;1(3):390–7.PubMedCrossRef
24.
go back to reference Farsalinos KE, Daraban AM, Unlu S, Thomas JD, Badano LP, Voigt JU. Head-to-head comparison of global longitudinal strain measurements among nine different vendors: the EACVI/ASE inter-vendor comparison study. J Am Soc Echocardiogr. 2015;28(10):1171–81 e2.PubMedCrossRef Farsalinos KE, Daraban AM, Unlu S, Thomas JD, Badano LP, Voigt JU. Head-to-head comparison of global longitudinal strain measurements among nine different vendors: the EACVI/ASE inter-vendor comparison study. J Am Soc Echocardiogr. 2015;28(10):1171–81 e2.PubMedCrossRef
25.
go back to reference SOLVD Investigators, Yusuf S, Pitt B, Davis CE, Hood WB Jr, Cohn JN. Effect of enalapril on mortality and the development of heart failure in asymptomatic patients with reduced left ventricular ejection fractions. N Engl J Med. 1992;327(10):685–91. SOLVD Investigators, Yusuf S, Pitt B, Davis CE, Hood WB Jr, Cohn JN. Effect of enalapril on mortality and the development of heart failure in asymptomatic patients with reduced left ventricular ejection fractions. N Engl J Med. 1992;327(10):685–91.
26.
go back to reference Pfeffer MA, Braunwald E, Moye LA, Basta L, Brown EJ Jr, Cuddy TE, et al. Effect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction. Results of the survival and ventricular enlargement trial. The SAVE Investigators. N Engl J Med. 1992;327(10):669–77.PubMedCrossRef Pfeffer MA, Braunwald E, Moye LA, Basta L, Brown EJ Jr, Cuddy TE, et al. Effect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction. Results of the survival and ventricular enlargement trial. The SAVE Investigators. N Engl J Med. 1992;327(10):669–77.PubMedCrossRef
27.
go back to reference Cohn JN, Johnson GR, Shabetai R, Loeb H, Tristani F, Rector T, et al. Ejection fraction, peak exercise oxygen consumption, cardiothoracic ratio, ventricular arrhythmias, and plasma norepinephrine as determinants of prognosis in heart failure. The V-HeFT VA cooperative studies group. Circulation. 1993;87(6 Suppl):VI5–16.PubMed Cohn JN, Johnson GR, Shabetai R, Loeb H, Tristani F, Rector T, et al. Ejection fraction, peak exercise oxygen consumption, cardiothoracic ratio, ventricular arrhythmias, and plasma norepinephrine as determinants of prognosis in heart failure. The V-HeFT VA cooperative studies group. Circulation. 1993;87(6 Suppl):VI5–16.PubMed
28.
go back to reference Kober L, Torp-Pedersen C, Carlsen JE, Bagger H, Eliasen P, Lyngborg K, et al. A clinical trial of the angiotensin-converting-enzyme inhibitor trandolapril in patients with left ventricular dysfunction after myocardial infarction. Trandolapril cardiac evaluation (TRACE) study group. N Engl J Med. 1995;333(25):1670–6.PubMedCrossRef Kober L, Torp-Pedersen C, Carlsen JE, Bagger H, Eliasen P, Lyngborg K, et al. A clinical trial of the angiotensin-converting-enzyme inhibitor trandolapril in patients with left ventricular dysfunction after myocardial infarction. Trandolapril cardiac evaluation (TRACE) study group. N Engl J Med. 1995;333(25):1670–6.PubMedCrossRef
29.
go back to reference Clay S, Alfakih K, Messroghli DR, Jones T, Ridgway JP, Sivananthan MU. The reproducibility of left ventricular volume and mass measurements: a comparison between dual-inversion-recovery black-blood sequence and SSFP. Eur Radiol. 2006;16(1):32–7.PubMedCrossRef Clay S, Alfakih K, Messroghli DR, Jones T, Ridgway JP, Sivananthan MU. The reproducibility of left ventricular volume and mass measurements: a comparison between dual-inversion-recovery black-blood sequence and SSFP. Eur Radiol. 2006;16(1):32–7.PubMedCrossRef
30.
go back to reference Grothues F, Smith GC, Moon JC, Bellenger NG, Collins P, Klein HU, et al. Comparison of interstudy reproducibility of cardiovascular magnetic resonance with two-dimensional echocardiography in normal subjects and in patients with heart failure or left ventricular hypertrophy. Am J Cardiol. 2002;90(1):29–34.PubMedCrossRef Grothues F, Smith GC, Moon JC, Bellenger NG, Collins P, Klein HU, et al. Comparison of interstudy reproducibility of cardiovascular magnetic resonance with two-dimensional echocardiography in normal subjects and in patients with heart failure or left ventricular hypertrophy. Am J Cardiol. 2002;90(1):29–34.PubMedCrossRef
Metadata
Title
Impact of a training program incorporating cardiac magnetic resonance imaging on the accuracy and reproducibility of two-dimensional echocardiographic measurements of left ventricular volumes and ejection fraction
Authors
Yosuke Nabeshima
Hidehiro Namisaki
Toshihiro Teshima
Yasuhiko Kurashige
Akiko Kakio
Azusa Fukumitsu
Yutaka Otsuji
Masaaki Takeuchi
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Cardiovascular Ultrasound / Issue 1/2019
Electronic ISSN: 1476-7120
DOI
https://doi.org/10.1186/s12947-019-0173-z

Other articles of this Issue 1/2019

Cardiovascular Ultrasound 1/2019 Go to the issue