Top

Published in:

01-07-2014 | Cardiac

Cardiac valve calcifications on low-dose unenhanced ungated chest computed tomography: inter-observer and inter-examination reliability, agreement and variability

Authors: Robbert W. van Hamersvelt, Martin J. Willemink, Richard A. P. Takx, Anouk L. M. Eikendal, Ricardo P. J. Budde, Tim Leiner, Christian P. Mol, Ivana Isgum, Pim A. de Jong

Published in: European Radiology | Issue 7/2014

Abstract

Objectives

To determine inter-observer and inter-examination variability for aortic valve calcification (AVC) and mitral valve and annulus calcification (MC) in low-dose unenhanced ungated lung cancer screening chest computed tomography (CT).

Methods

We included 578 lung cancer screening trial participants who were examined by CT twice within 3 months to follow indeterminate pulmonary nodules. On these CTs, AVC and MC were measured in cubic millimetres. One hundred CTs were examined by five observers to determine the inter-observer variability. Reliability was assessed by kappa statistics (κ) and intra-class correlation coefficients (ICCs). Variability was expressed as the mean difference ± standard deviation (SD).

Results

Inter-examination reliability was excellent for AVC (κ = 0.94, ICC = 0.96) and MC (κ = 0.95, ICC = 0.90). Inter-examination variability was 12.7 ± 118.2 mm³ for AVC and 31.5 ± 219.2 mm³ for MC. Inter-observer reliability ranged from κ = 0.68 to κ = 0.92 for AVC and from κ = 0.20 to κ = 0.66 for MC. Inter-observer ICC was 0.94 for AVC and ranged from 0.56 to 0.97 for MC. Inter-observer variability ranged from -30.5 ± 252.0 mm³ to 84.0 ± 240.5 mm³ for AVC and from -95.2 ± 210.0 mm³ to 303.7 ± 501.6 mm³ for MC.

Conclusions

AVC can be quantified with excellent reliability on ungated unenhanced low-dose chest CT, but manual detection of MC can be subject to substantial inter-observer variability. Lung cancer screening CT may be used for detection and quantification of cardiac valve calcifications.

Key points

• Low-dose unenhanced ungated chest computed tomography can detect cardiac valve calcifications.

• However, calcified cardiac valves are not reported by most radiologists.

• Inter-observer and inter-examination variability of aortic valve calcifications is sufficient for longitudinal studies.

• Volumetric measurement variability of mitral valve and annulus calcifications is substantial.

Gu D, Kelly TN, Wu X et al (2009) Mortality attributable to smoking in China. N Engl J Med 360:150–159PubMedCrossRef

Ezzati M, Lopez AD (2003) Estimates of global mortality attributable to smoking in 2000. Lancet 362:847–852PubMedCrossRef

Humphrey LL, Deffebach M, Pappas M et al (2013) Screening for lung cancer with low-dose computed tomography: a systematic review to update the US Preventive services task force recommendation. Ann Intern Med 159:411–420PubMedCrossRef

Mets OM, de Jong PA, Prokop M (2012) Computed tomographic screening for lung cancer: an opportunity to evaluate other diseases. JAMA 308:1433–1434PubMedCrossRef

Mets OM, Vliegenthart R, Gondrie MJ et al (2013) Lung cancer screening CT-based prediction of cardiovascular events. JACC Cardiovasc Imaging 6:899–907PubMedCrossRef

Jacobs PC, Prokop M, van der Graaf Y et al (2010) Comparing coronary artery calcium and thoracic aorta calcium for prediction of all-cause mortality and cardiovascular events on low-dose non-gated computed tomography in a high-risk population of heavy smokers. Atherosclerosis 209:455–462PubMedCrossRef

Xie X, Zhao Y, de Bock GH et al (2013) Validation and prognosis of coronary artery calcium scoring in nontriggered thoracic computed tomography: systematic review and meta-analysis. Circ Cardiovasc Imaging 6:514–521PubMedCrossRef

Benjamin EJ, Plehn JF, D'Agostino RB et al (1992) Mitral annular calcification and the risk of stroke in an elderly cohort. N Engl J Med 327:374–379PubMedCrossRef

Otto CM, Lind BK, Kitzman DW, Gersh BJ, Siscovick DS (1999) Association of aortic-valve sclerosis with cardiovascular mortality and morbidity in the elderly. N Engl J Med 341:142–147PubMedCrossRef

10.

Owens DS, Budoff MJ, Katz R et al (2012) Aortic valve calcium independently predicts coronary and cardiovascular events in a primary prevention population. JACC Cardiovasc Imaging 5:619–625PubMedCentralPubMedCrossRef

11.

Kizer JR, Gefter WB, deLemos AS, Scoll BJ, Wolfe ML, Mohler ER III (2001) Electron beam computed tomography for the quantification of aortic valvular calcification. J Heart Valve Dis 10:361–366PubMed

12.

Budoff MJ, Mao S, Takasu J, Shavelle DM, Zhao XQ, O'Brien KD (2002) Reproducibility of electron-beam CT measures of aortic valve calcification. Acad Radiol 9:1122–1127PubMedCrossRef

13.

Budoff MJ, Katz R, Wong ND et al (2007) Effect of scanner type on the reproducibility of extracoronary measures of calcification: the multi-ethnic study of atherosclerosis. Acad Radiol 14:1043–1049PubMedCrossRef

14.

Budoff MJ, Takasu J, Katz R et al (2006) Reproducibility of CT measurements of aortic valve calcification, mitral annulus calcification, and aortic wall calcification in the multi-ethnic study of atherosclerosis. Acad Radiol 13:166–172PubMedCrossRef

15.

Horeweg N, van der Aalst CM, Thunnissen E et al (2013) Characteristics of lung cancers detected by computer tomography screening in the randomized NELSON trial. Am J Respir Crit Care Med 187:848–854PubMedCrossRef

16.

van Iersel CA, de Koning HJ, Draisma G et al (2007) Risk-based selection from the general population in a screening trial: selection criteria, recruitment and power for the Dutch-Belgian randomised lung cancer multi-slice CT screening trial (NELSON). Int J Cancer 120:868–874PubMedCrossRef

17.

Isgum I, Prokop M, Niemeijer M, Viergever MA, van Ginneken B (2012) Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans Med Imaging 31:2322–2334PubMedCrossRef

18.

Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef

19.

Kottner J, Audige L, Brorson S et al (2011) Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol 64:96–106PubMedCrossRef

20.

Nunnally JC (1994) Psychometric theory, 3rd edn. Mc Graw-Hill, New York

21.

Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1:307–310PubMedCrossRef

22.

Jones M, Dobson A, O'Brian S (2011) A graphical method for assessing agreement with the mean between multiple observers using continuous measures. Int J Epidemiol 40:1308–1313PubMedCrossRef

23.

Brown SJ, Hayball MP, Coulden RA (2000) Impact of motion artefact on the measurement of coronary calcium score. Br J Radiol 73:956–962PubMed

24.

Wallin R, Wajih N, Greenwood GT, Sane DC (2001) Arterial calcification: a review of mechanisms, animal models, and the prospects for therapy. Med Res Rev 21:274–301PubMedCrossRef

25.

Gondrie MJ, van der Graaf Y, Jacobs PC, Oen AL, Mali WP (2011) The association of incidentally detected heart valve calcification with future cardiovascular events. Eur Radiol 21:963–973PubMedCentralPubMedCrossRef

26.

Pohle K, Maffert R, Ropers D et al (2001) Progression of aortic valve calcification: association with coronary atherosclerosis and cardiovascular risk factors. Circulation 104:1927–1932PubMedCrossRef

Title: Cardiac valve calcifications on low-dose unenhanced ungated chest computed tomography: inter-observer and inter-examination reliability, agreement and variability
Authors: Robbert W. van Hamersvelt
Martin J. Willemink
Richard A. P. Takx
Anouk L. M. Eikendal
Ricardo P. J. Budde
Tim Leiner
Christian P. Mol
Ivana Isgum
Pim A. de Jong
Publication date: 01-07-2014
Publisher: Springer Berlin Heidelberg
Published in: European Radiology / Issue 7/2014
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI: https://doi.org/10.1007/s00330-014-3191-0

At a glance: The STEP trials

Springer Medicine

Cardiac valve calcifications on low-dose unenhanced ungated chest computed tomography: inter-observer and inter-examination reliability, agreement and variability

Abstract

Objectives

Methods

Results

Conclusions

Key points

At a glance: The STEP trials

Springer Medicine

Abstract

Objectives

Methods

Results

Conclusions

Key points

Please log in to get access to this content

Other articles of this Issue 7/2014

Feasibility of in vivo diffusion tensor imaging of articular cartilage with coverage of all cartilage regions

CT colonography: effect of computer-aided detection of colonic polyps as a second and concurrent reader for general radiologists with moderate experience in CT colonography

Can single-phase dual-energy CT reliably identify adrenal adenomas?

Assessment of renal tissue elasticity by acoustic radiation force impulse quantification with histopathological correlation: preliminary experience in chronic kidney disease

Low tube voltage and low contrast material volume cerebral CT angiography

Clinical value of magnetic resonance imaging in patients with Mayer-Rokitansky-Küster-Hauser (MRKH) syndrome: diagnosis of associated malformations, uterine rudiments and intrauterine endometrium