Skip to main content
Top
Published in: Archives of Osteoporosis 1/2022

01-12-2022 | Osteoporosis | Original Article

Inter-observer agreement of vertebral fracture assessment with dual-energy x-ray absorptiometry equipment

Authors: Jacob M. Mostert, Stephan R. Romeijn, Petra Dibbets-Schneider, Daphne D. D. Rietbergen, Lenka M. Pereira Arias-Bouda, Christoph Götz, Matthew D. DiFranco, Hans Peter Dimai, Willem Grootjans

Published in: Archives of Osteoporosis | Issue 1/2022

Login to get access

Abstract

Purpose

To investigate the time and effort needed to perform vertebral morphometry, as well as inter-observer agreement for identification of vertebral fractures on vertebral fracture assessment (VFA) images.

Methods

Ninety-six images were retrospectively selected, and three radiographers independently performed semi-automatic 6-point morphometry. Fractures were identified and graded using the Genant classification. Time needed to annotate each image was recorded, and reader fatigue was assessed using a modified Simulator Sickness Questionnaire (SSQ). Inter-observer agreement was assessed per-patient and per-vertebra for detecting fractures of all grades (grades 1–3) and for grade 2 and 3 fractures using the kappa statistic. Variability in measured vertebral height was evaluated using the intraclass correlation coefficient (ICC).

Results

Per-patient agreement was 0.59 for grades 1–3 fracture detection, and 0.65 for grades 2–3 only. Agreement for per-vertebra fracture classification was 0.92. Vertebral height measurements had an ICC of 0.96. Time needed to annotate VFA images ranged between 91 and 540 s, with a mean annotation time of 259 s. Mean SSQ scores were significantly lower at the start of a reading session (1.29; 95% CI: 0.81–1.77) compared to the end of a session (3.25; 95% CI: 2.60–3.90; p < 0.001).

Conclusion

Agreement for detection of patients with vertebral fractures was only moderate, and vertebral morphometry requires substantial time investment. This indicates that there is a potential benefit for automating VFA, both in improving inter-observer agreement and in decreasing reading time and burden on readers.
Literature
1.
go back to reference Kanis JA on behalf of the World Health Organization Scientific Group (2007) Assessment of osteoporosis at the primary health-care level. Technical Report. World Health Organization Collaborating Centre for Metabolic Bone Diseases, University of Sheffield, UK. 2007 Kanis JA on behalf of the World Health Organization Scientific Group (2007) Assessment of osteoporosis at the primary health-care level. Technical Report. World Health Organization Collaborating Centre for Metabolic Bone Diseases, University of Sheffield, UK. 2007
16.
go back to reference Shuhart CR, Yeap SS, Anderson PA, Jankowski LG, Lewiecki EM, Morse LR, Rosen HN, Weber DR, Zemel BS, Shepherd JA (2019) Executive summary of the 2019 ISCD position development conference on monitoring treatment, DXA cross-calibration and least significant change, spinal cord injury, peri-prosthetic and orthopedic bone health, transgender medicine, and pediatrics. J Clin Densitom 22(4):453–471. https://doi.org/10.1016/j.jocd.2019.07.001CrossRefPubMed Shuhart CR, Yeap SS, Anderson PA, Jankowski LG, Lewiecki EM, Morse LR, Rosen HN, Weber DR, Zemel BS, Shepherd JA (2019) Executive summary of the 2019 ISCD position development conference on monitoring treatment, DXA cross-calibration and least significant change, spinal cord injury, peri-prosthetic and orthopedic bone health, transgender medicine, and pediatrics. J Clin Densitom 22(4):453–471. https://​doi.​org/​10.​1016/​j.​jocd.​2019.​07.​001CrossRefPubMed
19.
go back to reference Randolph JJ (2005) Free-Marginal Multirater Kappa (multirater K [free]): An alternative to Fleiss' fixed-marginal multirater kappa. Paper presented at the Joensuu University Learning and Instruction Symposium 2005, Joensuu, Finland, October 14–15th, 2005 Randolph JJ (2005) Free-Marginal Multirater Kappa (multirater K [free]): An alternative to Fleiss' fixed-marginal multirater kappa. Paper presented at the Joensuu University Learning and Instruction Symposium 2005, Joensuu, Finland, October 14–15th, 2005
26.
go back to reference Ferrar L, Jiang G, Schousboe JT, DeBold CR, Eastell R (2008) Algorithm-based qualitative and semiquantitative identification of prevalent vertebral fracture: agreement between different readers, imaging modalities, and diagnostic approaches. J Bone Miner Res 23(3):417–424. https://doi.org/10.1359/jbmr.071032CrossRefPubMed Ferrar L, Jiang G, Schousboe JT, DeBold CR, Eastell R (2008) Algorithm-based qualitative and semiquantitative identification of prevalent vertebral fracture: agreement between different readers, imaging modalities, and diagnostic approaches. J Bone Miner Res 23(3):417–424. https://​doi.​org/​10.​1359/​jbmr.​071032CrossRefPubMed
Metadata
Title
Inter-observer agreement of vertebral fracture assessment with dual-energy x-ray absorptiometry equipment
Authors
Jacob M. Mostert
Stephan R. Romeijn
Petra Dibbets-Schneider
Daphne D. D. Rietbergen
Lenka M. Pereira Arias-Bouda
Christoph Götz
Matthew D. DiFranco
Hans Peter Dimai
Willem Grootjans
Publication date
01-12-2022
Publisher
Springer London
Published in
Archives of Osteoporosis / Issue 1/2022
Print ISSN: 1862-3522
Electronic ISSN: 1862-3514
DOI
https://doi.org/10.1007/s11657-021-01046-w

Other articles of this Issue 1/2022

Archives of Osteoporosis 1/2022 Go to the issue