Skip to main content
Top
Published in: Abdominal Radiology 1/2019

01-01-2019

Reader agreement and accuracy of ultrasound features for hepatic steatosis

Authors: Cheng William Hong, Austin Marsh, Tanya Wolfson, Jeremy Paige, Soudabeh Fazeli Dekhordy, Alexandra N. Schlein, Elise Housman, Lisa H. Deiranieh, Charles Q. Li, Ashish P. Wasnik, Hyun-Jung Jang, Christoph F. Dietrich, Fabio Piscaglia, Giovanna Casola, Mary O’Boyle, Katherine M. Richman, Mark A. Valasek, Michael Andre, Rohit Loomba, Claude B. Sirlin

Published in: Abdominal Radiology | Issue 1/2019

Login to get access

Abstract

Purpose

The purpose of the study is to assess the reader agreement and accuracy of eight ultrasound imaging features for classifying hepatic steatosis in adults with known or suspected hepatic steatosis.

Methods

This was an IRB-approved, HIPAA-compliant prospective study of adult patients with known or suspected hepatic steatosis. All patients signed written informed consent. Ultrasound images (Siemens S3000, 6C1HD, and 4C1 transducers) were acquired by experienced sonographers following a standard protocol. Eight readers independently graded eight features and their overall impression of hepatic steatosis on ordinal scales using an electronic case report form. Duplicated images from the 6C1HD transducer were read twice to assess intra-reader agreement. Intra-reader, inter-transducer, and inter-reader agreement were assessed using intraclass correlation coefficients (ICC). Features with the highest intra-reader agreement were selected as predictors for dichotomized histological steatosis using Classification and Regression Tree (CART) analysis, and the accuracy of the decision rule was compared to the accuracy of the radiologists’ overall impression.

Results

45 patients (18 males, 27 females; mean age 56 ± 12 years) scanned from September 2015 to July 2016 were included. Mean intra-reader ICCs ranged from 0.430 to 0.777, inter-transducer ICCs ranged from 0.228 to 0.640, and inter-reader ICCs ranged from 0.014 to 0.561. The CART decision rule selected only large hepatic vein blurring and achieved similar accuracy to the overall impression (74% to 75% and 68% to 72%, respectively).

Conclusions

Large hepatic vein blurring, liver–kidney contrast, and overall impression provided the highest reader agreement. Large hepatic vein blurring may provide the highest classification accuracy for dichotomized grading of hepatic steatosis.
Literature
1.
2.
go back to reference Lazo M, Hernaez R, Eberhardt MS, et al. (2013) Prevalence of nonalcoholic fatty liver disease in the United States: the Third National Health and Nutrition Examination Survey, 1988–1994. Am J Epidemiol 178(1):38–45CrossRefPubMedPubMedCentral Lazo M, Hernaez R, Eberhardt MS, et al. (2013) Prevalence of nonalcoholic fatty liver disease in the United States: the Third National Health and Nutrition Examination Survey, 1988–1994. Am J Epidemiol 178(1):38–45CrossRefPubMedPubMedCentral
3.
go back to reference Williams CD, Stengel J, Asike MI, et al. (2011) Prevalence of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis among a largely middle-aged population utilizing ultrasound and liver biopsy: a prospective study. Gastroenterology 140(1):124–131CrossRef Williams CD, Stengel J, Asike MI, et al. (2011) Prevalence of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis among a largely middle-aged population utilizing ultrasound and liver biopsy: a prospective study. Gastroenterology 140(1):124–131CrossRef
4.
go back to reference Chalasani N, Younossi Z, Lavine JE, et al. (2012) The diagnosis and management of non-alcoholic fatty liver disease: practice guideline by the American Gastroenterological Association, American Association for the Study of Liver Diseases, and American College of Gastroenterology. Gastroenterology 142(7):1592–1609CrossRefPubMed Chalasani N, Younossi Z, Lavine JE, et al. (2012) The diagnosis and management of non-alcoholic fatty liver disease: practice guideline by the American Gastroenterological Association, American Association for the Study of Liver Diseases, and American College of Gastroenterology. Gastroenterology 142(7):1592–1609CrossRefPubMed
5.
go back to reference Loomba R, Sanyal AJ (2013) The global NAFLD epidemic. Nat Rev Gastroenterol Hepatol 10(11):686–690CrossRefPubMed Loomba R, Sanyal AJ (2013) The global NAFLD epidemic. Nat Rev Gastroenterol Hepatol 10(11):686–690CrossRefPubMed
6.
go back to reference Spengler EK, Loomba R (2015) Recommendations for diagnosis, referral for liver biopsy, and treatment of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis. Mayo Clin Proc 90(9):1233–1246CrossRefPubMedPubMedCentral Spengler EK, Loomba R (2015) Recommendations for diagnosis, referral for liver biopsy, and treatment of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis. Mayo Clin Proc 90(9):1233–1246CrossRefPubMedPubMedCentral
7.
go back to reference Strauss S, Gavish E, Gottlieb P, Katsnelson L (2007) Interobserver and intraobserver variability in the sonographic assessment of fatty liver. AJR Am J Roentgenol 189(6):W320–W323CrossRefPubMed Strauss S, Gavish E, Gottlieb P, Katsnelson L (2007) Interobserver and intraobserver variability in the sonographic assessment of fatty liver. AJR Am J Roentgenol 189(6):W320–W323CrossRefPubMed
8.
go back to reference Hamaguchi M, Kojima T, Itoh Y, et al. (2007) The severity of ultrasonographic findings in nonalcoholic fatty liver disease reflects the metabolic syndrome and visceral fat accumulation. Am J Gastroenterol 102(12):2708–2715CrossRefPubMed Hamaguchi M, Kojima T, Itoh Y, et al. (2007) The severity of ultrasonographic findings in nonalcoholic fatty liver disease reflects the metabolic syndrome and visceral fat accumulation. Am J Gastroenterol 102(12):2708–2715CrossRefPubMed
9.
go back to reference Fishbein M, Castro F, Cheruku S, et al. (2005) Hepatic MRI for fat quantitation: its relationship to fat morphology, diagnosis, and ultrasound. J Clin Gastroenterol 39(7):619–625CrossRefPubMed Fishbein M, Castro F, Cheruku S, et al. (2005) Hepatic MRI for fat quantitation: its relationship to fat morphology, diagnosis, and ultrasound. J Clin Gastroenterol 39(7):619–625CrossRefPubMed
10.
go back to reference Dasarathy S, Dasarathy J, Khiyami A, et al. (2009) Validity of real time ultrasound in the diagnosis of hepatic steatosis: a prospective study. J Hepatol 51(6):1061–1067CrossRefPubMedPubMedCentral Dasarathy S, Dasarathy J, Khiyami A, et al. (2009) Validity of real time ultrasound in the diagnosis of hepatic steatosis: a prospective study. J Hepatol 51(6):1061–1067CrossRefPubMedPubMedCentral
11.
go back to reference Saadeh S, Younossi ZM, Remer EM, et al. (2002) The utility of radiological imaging in nonalcoholic fatty liver disease. Gastroenterology 123(3):745–750CrossRefPubMed Saadeh S, Younossi ZM, Remer EM, et al. (2002) The utility of radiological imaging in nonalcoholic fatty liver disease. Gastroenterology 123(3):745–750CrossRefPubMed
12.
go back to reference Yajima Y, Ohta K, Narui T, et al. (1983) Ultrasonographical diagnosis of fatty liver: significance of the liver-kidney contrast. Tohoku J Exp Med 139(1):43–50CrossRefPubMed Yajima Y, Ohta K, Narui T, et al. (1983) Ultrasonographical diagnosis of fatty liver: significance of the liver-kidney contrast. Tohoku J Exp Med 139(1):43–50CrossRefPubMed
13.
go back to reference Ballestri S, Lonardo A, Romagnoli D, et al. (2012) Ultrasonographic fatty liver indicator, a novel score which rules out NASH and is correlated with metabolic parameters in NAFLD. Liver Int 32(8):1242–1252CrossRefPubMed Ballestri S, Lonardo A, Romagnoli D, et al. (2012) Ultrasonographic fatty liver indicator, a novel score which rules out NASH and is correlated with metabolic parameters in NAFLD. Liver Int 32(8):1242–1252CrossRefPubMed
14.
go back to reference Hirche TO, Ignee A, Hirche H, Schneider A, Dietrich CF (2007) Evaluation of hepatic steatosis by ultrasound in patients with chronic hepatitis C virus infection. Liver Int. 27(6):748–757CrossRefPubMed Hirche TO, Ignee A, Hirche H, Schneider A, Dietrich CF (2007) Evaluation of hepatic steatosis by ultrasound in patients with chronic hepatitis C virus infection. Liver Int. 27(6):748–757CrossRefPubMed
15.
go back to reference Caturelli E, Squillante MM, Andriulli A, et al. (1992) Hypoechoic lesions in the “bright liver”: a reliable indicator of fatty change. A prospective study. J Gastroenterol Hepatol 7(5):469–472CrossRefPubMed Caturelli E, Squillante MM, Andriulli A, et al. (1992) Hypoechoic lesions in the “bright liver”: a reliable indicator of fatty change. A prospective study. J Gastroenterol Hepatol 7(5):469–472CrossRefPubMed
16.
go back to reference Kleiner DE, Brunt EM, Van Natta M, et al. (2005) Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology 41(6):1313–1321CrossRefPubMed Kleiner DE, Brunt EM, Van Natta M, et al. (2005) Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology 41(6):1313–1321CrossRefPubMed
17.
go back to reference Noureddin M, Lam J, Peterson MR, et al. (2013) Utility of magnetic resonance imaging versus histology for quantifying changes in liver fat in nonalcoholic fatty liver disease trials. Hepatology 58(6):1930–1940CrossRefPubMedPubMedCentral Noureddin M, Lam J, Peterson MR, et al. (2013) Utility of magnetic resonance imaging versus histology for quantifying changes in liver fat in nonalcoholic fatty liver disease trials. Hepatology 58(6):1930–1940CrossRefPubMedPubMedCentral
18.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biom Int Biom Soc 33(1):159 Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biom Int Biom Soc 33(1):159
19.
go back to reference Searle SR (1971) A biometrics invited paper. Topics in variance component estimation. Biom Int Biom Soc 27(1):1 Searle SR (1971) A biometrics invited paper. Topics in variance component estimation. Biom Int Biom Soc 27(1):1
20.
go back to reference Marshall RH, Eissa M, Bluth EI, Gulotta PM, Davis NK (2012) Hepatorenal index as an accurate, simple, and effective tool in screening for steatosis. Am J Roentgenol 199(5):997–1002CrossRef Marshall RH, Eissa M, Bluth EI, Gulotta PM, Davis NK (2012) Hepatorenal index as an accurate, simple, and effective tool in screening for steatosis. Am J Roentgenol 199(5):997–1002CrossRef
21.
go back to reference Shiralkar K, Johnson S, Bluth EI, et al. (2015) Improved method for calculating hepatic steatosis using the hepatorenal index. J Ultrasound Med 34(6):1051–1059CrossRefPubMed Shiralkar K, Johnson S, Bluth EI, et al. (2015) Improved method for calculating hepatic steatosis using the hepatorenal index. J Ultrasound Med 34(6):1051–1059CrossRefPubMed
22.
go back to reference Lédinghen V, Vergniol J, Foucher J, Merrouche W, Bail B (2012) Non-invasive diagnosis of liver steatosis using controlled attenuation parameter (CAP) and transient elastography. Liver Int 32(6):911–918CrossRefPubMed Lédinghen V, Vergniol J, Foucher J, Merrouche W, Bail B (2012) Non-invasive diagnosis of liver steatosis using controlled attenuation parameter (CAP) and transient elastography. Liver Int 32(6):911–918CrossRefPubMed
23.
go back to reference Myers RP, Pollett A, Kirsch R, et al. (2012) Controlled attenuation parameter (CAP): a noninvasive method for the detection of hepatic steatosis based on transient elastography. Liver Int 32(6):902–910CrossRefPubMed Myers RP, Pollett A, Kirsch R, et al. (2012) Controlled attenuation parameter (CAP): a noninvasive method for the detection of hepatic steatosis based on transient elastography. Liver Int 32(6):902–910CrossRefPubMed
24.
go back to reference Park CC, Nguyen P, Hernandez C, et al. (2016) Magnetic resonance elastography vs transient elastography in detection of fibrosis and noninvasive measurement of steatosis in patients with biopsy-proven nonalcoholic fatty liver disease. Gastroenterology 152:598–607CrossRefPubMedPubMedCentral Park CC, Nguyen P, Hernandez C, et al. (2016) Magnetic resonance elastography vs transient elastography in detection of fibrosis and noninvasive measurement of steatosis in patients with biopsy-proven nonalcoholic fatty liver disease. Gastroenterology 152:598–607CrossRefPubMedPubMedCentral
25.
go back to reference Berzigotti A, Ferraioli G, Bota S, Gilja OH, Dietrich CF (2018) Novel ultrasound-based methods to assess liver disease: the game has just begun. Dig Liver Dis 50(2):107–112CrossRefPubMed Berzigotti A, Ferraioli G, Bota S, Gilja OH, Dietrich CF (2018) Novel ultrasound-based methods to assess liver disease: the game has just begun. Dig Liver Dis 50(2):107–112CrossRefPubMed
26.
go back to reference Lin SC, Heba E, Wolfson T, et al. (2015) Noninvasive diagnosis of nonalcoholic fatty liver disease and quantification of liver fat using a new quantitative ultrasound technique. Clin Gastroenterol Hepatol 13(7):1337–1345.e6CrossRefPubMed Lin SC, Heba E, Wolfson T, et al. (2015) Noninvasive diagnosis of nonalcoholic fatty liver disease and quantification of liver fat using a new quantitative ultrasound technique. Clin Gastroenterol Hepatol 13(7):1337–1345.e6CrossRefPubMed
27.
go back to reference Paige JS, Bernstein GS, Heba E, et al. (2017) A pilot comparative study of quantitative ultrasound, conventional ultrasound, and MRI for predicting histology-determined steatosis grade in adult nonalcoholic fatty liver disease. Am J Roentgenol 208(5):W168–W177CrossRef Paige JS, Bernstein GS, Heba E, et al. (2017) A pilot comparative study of quantitative ultrasound, conventional ultrasound, and MRI for predicting histology-determined steatosis grade in adult nonalcoholic fatty liver disease. Am J Roentgenol 208(5):W168–W177CrossRef
28.
go back to reference Bohte AE, van Werven JR, Bipat S, Stoker J (2011) The diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis compared with liver biopsy: a meta-analysis. Eur Radiol 21(1):87–97CrossRefPubMed Bohte AE, van Werven JR, Bipat S, Stoker J (2011) The diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis compared with liver biopsy: a meta-analysis. Eur Radiol 21(1):87–97CrossRefPubMed
29.
go back to reference Reeder SB, Hu HH, Sirlin CB (2012) Proton density fat-fraction: a standardized MR-based biomarker of tissue fat concentration. J Magn Reson Imaging 36(5):1011–1014CrossRefPubMedPubMedCentral Reeder SB, Hu HH, Sirlin CB (2012) Proton density fat-fraction: a standardized MR-based biomarker of tissue fat concentration. J Magn Reson Imaging 36(5):1011–1014CrossRefPubMedPubMedCentral
30.
go back to reference Yokoo T, Shiehmorteza M, Hamilton G, et al. (2011) Estimation of hepatic proton-density fat fraction by using MR imaging at 3.0 T. Radiology 258(3):749–759CrossRefPubMedPubMedCentral Yokoo T, Shiehmorteza M, Hamilton G, et al. (2011) Estimation of hepatic proton-density fat fraction by using MR imaging at 3.0 T. Radiology 258(3):749–759CrossRefPubMedPubMedCentral
31.
go back to reference Idilman IS, Aniktar H, Idilman R, et al. (2013) Hepatic steatosis: quantification by proton density fat fraction with MR imaging versus liver biopsy. Radiology 267(3):767–775CrossRefPubMed Idilman IS, Aniktar H, Idilman R, et al. (2013) Hepatic steatosis: quantification by proton density fat fraction with MR imaging versus liver biopsy. Radiology 267(3):767–775CrossRefPubMed
32.
go back to reference Dulai PS, Sirlin CB, Loomba R (2016) MRI and MRE for non-invasive quantitative assessment of hepatic steatosis and fibrosis in NAFLD and NASH: clinical trials to clinical practice. J Hepatol 65(5):1006–1016CrossRefPubMedPubMedCentral Dulai PS, Sirlin CB, Loomba R (2016) MRI and MRE for non-invasive quantitative assessment of hepatic steatosis and fibrosis in NAFLD and NASH: clinical trials to clinical practice. J Hepatol 65(5):1006–1016CrossRefPubMedPubMedCentral
33.
go back to reference Heller MT, Tublin ME (2014) The role of ultrasonography in the evaluation of diffuse liver disease. Radiol Clin North Am 52(6):1163–1175CrossRefPubMed Heller MT, Tublin ME (2014) The role of ultrasonography in the evaluation of diffuse liver disease. Radiol Clin North Am 52(6):1163–1175CrossRefPubMed
34.
go back to reference Bonekamp S, Kamel I, Solga S, Clark J (2009) Can imaging modalities diagnose and stage hepatic fibrosis and cirrhosis accurately? J Hepatol 50(1):17–35CrossRefPubMed Bonekamp S, Kamel I, Solga S, Clark J (2009) Can imaging modalities diagnose and stage hepatic fibrosis and cirrhosis accurately? J Hepatol 50(1):17–35CrossRefPubMed
35.
go back to reference Anvari A, Forsberg F, Samir AE (2015) A primer on the physical principles of tissue harmonic imaging. RadioGraphics 35(7):1955–1964CrossRefPubMed Anvari A, Forsberg F, Samir AE (2015) A primer on the physical principles of tissue harmonic imaging. RadioGraphics 35(7):1955–1964CrossRefPubMed
37.
go back to reference Shapiro RS, Wagreich J, Parsons RB, et al. (1998) Tissue harmonic imaging sonography: evaluation of image quality compared with conventional sonography. AJR Am J Roentgenol 171(5):1203–1206CrossRefPubMed Shapiro RS, Wagreich J, Parsons RB, et al. (1998) Tissue harmonic imaging sonography: evaluation of image quality compared with conventional sonography. AJR Am J Roentgenol 171(5):1203–1206CrossRefPubMed
Metadata
Title
Reader agreement and accuracy of ultrasound features for hepatic steatosis
Authors
Cheng William Hong
Austin Marsh
Tanya Wolfson
Jeremy Paige
Soudabeh Fazeli Dekhordy
Alexandra N. Schlein
Elise Housman
Lisa H. Deiranieh
Charles Q. Li
Ashish P. Wasnik
Hyun-Jung Jang
Christoph F. Dietrich
Fabio Piscaglia
Giovanna Casola
Mary O’Boyle
Katherine M. Richman
Mark A. Valasek
Michael Andre
Rohit Loomba
Claude B. Sirlin
Publication date
01-01-2019
Publisher
Springer US
Published in
Abdominal Radiology / Issue 1/2019
Print ISSN: 2366-004X
Electronic ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-018-1683-0

Other articles of this Issue 1/2019

Abdominal Radiology 1/2019 Go to the issue