Skip to main content
Top
Published in: The International Journal of Cardiovascular Imaging 7/2018

01-07-2018 | Original Paper

Impact of acquisition and interpretation on total inter-observer variability in echocardiography: results from the quality assurance program of the STAAB cohort study

Authors: Caroline Morbach, Götz Gelbrich, Margret Breunig, Theresa Tiffe, Martin Wagner, Peter U. Heuschmann, Stefan Störk

Published in: The International Journal of Cardiovascular Imaging | Issue 7/2018

Login to get access

Abstract

Variability related to image acquisition and interpretation is an important issue of echocardiography in clinical trials. Nevertheless, there is no broadly accepted standard method for quality assessment of echocardiography in clinical research reports. We present analyses based on the echocardiography quality-assurance program of the ongoing STAAB cohort study (characteristics and course of heart failure stages A–B and determinants of progression). In 43 healthy individuals (mean age 50 ± 14 years; 18 females), duplicate echocardiography scans were acquired and mutually interpreted by one of three trained sonographers and an EACVI certified physician, respectively. Acquisition (AcV), interpretation (InV), and inter-observer variability (IOV; i.e., variability between the acquisition-interpretation sequences of two different observers), were determined for selected M-mode, B-mode, and Doppler parameters. We calculated Bland–Altman upper 95% limits of absolute differences, implying that 95% of measurement differences were smaller/equal to the given value: e.g. LV end-diastolic volume (mL): 25.0, 25.0, 27.9; septal e′ velocity (cm/s): 3.03, 1.25, 3.58. Further, 90, 85, and 80% upper limits of absolute differences were determined for the respective parameters. Both, acquisition and interpretation, independently and sizably contributed to IOV. As such, separate assessment of AcV and InV is likely to aid in echocardiography training and quality-assurance. Our results further suggest to routinely determine IOV in clinical trials as a comprehensive measure of imaging quality. The derived 95, 90, 85, and 80% upper limits of absolute differences are suggested as reproducibility targets of future studies, thus contributing to the international efforts of standardization in quality-assurance.
Literature
2.
go back to reference Pellikka PA, Douglas PS, Miller JG, Abraham TP, Baumann R, Buxton DB, Byrd BF 3rd, Chen P, Cook NL, Gardin JM, Hansen G, Houle HC, Husson S, Kaul S, Klein AL, Lang RM, Leong-Poi H, Lopez H, Mahmoud TM, Maslak S, McCulloch ML, Metz S, Nagueh SF, Pearlman AS, Pibarot P, Picard MH, Porter TR, Prater D, Rodriguez R, Sarano ME, Scherrer-Crosbie M, Shirali GS, Sinusas A, Slosky JJ, Sugeng L, Tatpati A, Villanueva FS, von Ramm OT, Weissman NJ, Zamani S (2013) American society of echocardiography cardiovascular technology and research summit: a roadmap for 2020. J Am Soc Echocardiogr 26(4):325–338. https://doi.org/10.1016/j.echo.2013.02.003 CrossRefPubMed Pellikka PA, Douglas PS, Miller JG, Abraham TP, Baumann R, Buxton DB, Byrd BF 3rd, Chen P, Cook NL, Gardin JM, Hansen G, Houle HC, Husson S, Kaul S, Klein AL, Lang RM, Leong-Poi H, Lopez H, Mahmoud TM, Maslak S, McCulloch ML, Metz S, Nagueh SF, Pearlman AS, Pibarot P, Picard MH, Porter TR, Prater D, Rodriguez R, Sarano ME, Scherrer-Crosbie M, Shirali GS, Sinusas A, Slosky JJ, Sugeng L, Tatpati A, Villanueva FS, von Ramm OT, Weissman NJ, Zamani S (2013) American society of echocardiography cardiovascular technology and research summit: a roadmap for 2020. J Am Soc Echocardiogr 26(4):325–338. https://​doi.​org/​10.​1016/​j.​echo.​2013.​02.​003 CrossRefPubMed
4.
go back to reference Kou S, Caballero L, Dulgheru R, Voilliot D, De Sousa C, Kacharava G, Athanassopoulos GD, Barone D, Baroni M, Cardim N, Gomez De Diego JJ, Hagendorff A, Henri C, Hristova K, Lopez T, Magne J, De La Morena G, Popescu BA, Penicka M, Ozyigit T, Rodrigo Carbonero JD, Salustri A, Van De Veire N, Von Bardeleben RS, Vinereanu D, Voigt JU, Zamorano JL, Donal E, Lang RM, Badano LP, Lancellotti P (2014) Echocardiographic reference ranges for normal cardiac chamber size: results from the NORRE study. Eur Heart J Cardiovasc Imaging 15(6):680–690. https://doi.org/10.1093/ehjci/jet284 CrossRefPubMedPubMedCentral Kou S, Caballero L, Dulgheru R, Voilliot D, De Sousa C, Kacharava G, Athanassopoulos GD, Barone D, Baroni M, Cardim N, Gomez De Diego JJ, Hagendorff A, Henri C, Hristova K, Lopez T, Magne J, De La Morena G, Popescu BA, Penicka M, Ozyigit T, Rodrigo Carbonero JD, Salustri A, Van De Veire N, Von Bardeleben RS, Vinereanu D, Voigt JU, Zamorano JL, Donal E, Lang RM, Badano LP, Lancellotti P (2014) Echocardiographic reference ranges for normal cardiac chamber size: results from the NORRE study. Eur Heart J Cardiovasc Imaging 15(6):680–690. https://​doi.​org/​10.​1093/​ehjci/​jet284 CrossRefPubMedPubMedCentral
7.
go back to reference Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, Flachskampf FA, Foster E, Goldstein SA, Kuznetsova T, Lancellotti P, Muraru D, Picard MH, Rietzschel ER, Rudski L, Spencer KT, Tsang W, Voigt JU (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 16(3):233–270. https://doi.org/10.1093/ehjci/jev014 CrossRefPubMed Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L, Flachskampf FA, Foster E, Goldstein SA, Kuznetsova T, Lancellotti P, Muraru D, Picard MH, Rietzschel ER, Rudski L, Spencer KT, Tsang W, Voigt JU (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 16(3):233–270. https://​doi.​org/​10.​1093/​ehjci/​jev014 CrossRefPubMed
8.
go back to reference Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8(2):135–160CrossRefPubMed Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8(2):135–160CrossRefPubMed
10.
go back to reference Stritzke J, Linsel-Nitschke P, Markus MR, Mayer B, Lieb W, Luchner A, Doring A, Koenig W, Keil U, Hense HW, Schunkert H, Investigators MK (2009) Association between degenerative aortic valve disease and long-term exposure to cardiovascular risk factors: results of the longitudinal population-based KORA/MONICA survey. Eur Heart J 30(16):2044–2053. https://doi.org/10.1093/eurheartj/ehp287 CrossRefPubMed Stritzke J, Linsel-Nitschke P, Markus MR, Mayer B, Lieb W, Luchner A, Doring A, Koenig W, Keil U, Hense HW, Schunkert H, Investigators MK (2009) Association between degenerative aortic valve disease and long-term exposure to cardiovascular risk factors: results of the longitudinal population-based KORA/MONICA survey. Eur Heart J 30(16):2044–2053. https://​doi.​org/​10.​1093/​eurheartj/​ehp287 CrossRefPubMed
11.
go back to reference Colan SD, Shirali G, Margossian R, Gallagher D, Altmann K, Canter C, Chen S, Golding F, Radojewski E, Camitta M, Carboni M, Rychik J, Stylianou M, Tani LY, Selamet Tierney ES, Wang Y, Sleeper LA, Pediatric Heart Network I (2012) The ventricular volume variability study of the Pediatric Heart Network: study design and impact of beat averaging and variable type on the reproducibility of echocardiographic measurements in children with chronic dilated cardiomyopathy. J Am Soc Echocardiogr 25(8):842–854.e6. https://doi.org/10.1016/j.echo.2012.05.004 CrossRefPubMedPubMedCentral Colan SD, Shirali G, Margossian R, Gallagher D, Altmann K, Canter C, Chen S, Golding F, Radojewski E, Camitta M, Carboni M, Rychik J, Stylianou M, Tani LY, Selamet Tierney ES, Wang Y, Sleeper LA, Pediatric Heart Network I (2012) The ventricular volume variability study of the Pediatric Heart Network: study design and impact of beat averaging and variable type on the reproducibility of echocardiographic measurements in children with chronic dilated cardiomyopathy. J Am Soc Echocardiogr 25(8):842–854.e6. https://​doi.​org/​10.​1016/​j.​echo.​2012.​05.​004 CrossRefPubMedPubMedCentral
12.
go back to reference Otterstad JE, Froeland G, St John Sutton M, Holme I (1997) Accuracy and reproducibility of biplane two-dimensional echocardiographic measurements of left ventricular dimensions and function. Eur Heart J 18(3):507–513CrossRefPubMed Otterstad JE, Froeland G, St John Sutton M, Holme I (1997) Accuracy and reproducibility of biplane two-dimensional echocardiographic measurements of left ventricular dimensions and function. Eur Heart J 18(3):507–513CrossRefPubMed
Metadata
Title
Impact of acquisition and interpretation on total inter-observer variability in echocardiography: results from the quality assurance program of the STAAB cohort study
Authors
Caroline Morbach
Götz Gelbrich
Margret Breunig
Theresa Tiffe
Martin Wagner
Peter U. Heuschmann
Stefan Störk
Publication date
01-07-2018
Publisher
Springer Netherlands
Published in
The International Journal of Cardiovascular Imaging / Issue 7/2018
Print ISSN: 1569-5794
Electronic ISSN: 1875-8312
DOI
https://doi.org/10.1007/s10554-018-1315-3

Other articles of this Issue 7/2018

The International Journal of Cardiovascular Imaging 7/2018 Go to the issue