Skip to main content
Top
Published in: Journal of Digital Imaging 5/2017

01-10-2017

Online Studies on Variation in Orthopedic Surgery: Computed Tomography in MPEG4 Versus DICOM Format

Authors: Jos J. Mellema, Wouter H. Mallee, Thierry G. Guitton, C. Niek van Dijk, David Ring, Job N. Doornberg, Science of Variation Group & Traumaplatform Study Collaborative

Published in: Journal of Imaging Informatics in Medicine | Issue 5/2017

Login to get access

Abstract

The purpose of this study was to compare the observer participation and satisfaction as well as interobserver reliability between two online platforms, Science of Variation Group (SOVG) and Traumaplatform Study Collaborative, for the evaluation of complex tibial plateau fractures using computed tomography in MPEG4 and DICOM format. A total of 143 observers started with the online evaluation of 15 complex tibial plateau fractures via either the SOVG or Traumaplatform Study Collaborative websites using MPEG4 videos or a DICOM viewer, respectively. Observers were asked to indicate the absence or presence of four tibial plateau fracture characteristics and to rate their satisfaction with the evaluation as provided by the respective online platforms. The observer participation rate was significantly higher in the SOVG (MPEG4 video) group compared to that in the Traumaplatform Study Collaborative (DICOM viewer) group (75 and 43%, respectively; P < 0.001). The median observer satisfaction with the online evaluation was seven (range, 0–10) using MPEG4 video compared to six (range, 1–9) using DICOM viewer (P = 0.11). The interobserver reliability for recognition of fracture characteristics in complex tibial plateau fractures was higher for the evaluation using MPEG4 video. In conclusion, observer participation and interobserver reliability for the characterization of tibial plateau fractures was greater with MPEG4 videos than with a standard DICOM viewer, while there was no difference in observer satisfaction. Future reliability studies should account for the method of delivering images.
Literature
1.
go back to reference Bruinsma WE, Guitton T, Ring D: Radiographic loss of contact between radial head fracture fragments is moderately reliable. Clinical orthopaedics and related research, 2014 Bruinsma WE, Guitton T, Ring D: Radiographic loss of contact between radial head fracture fragments is moderately reliable. Clinical orthopaedics and related research, 2014
2.
go back to reference Bruinsma WE, Guitton TG, Warner JJ, Ring D: Interobserver reliability of classification and characterization of proximal humeral fractures: a comparison of two and three-dimensional CT. The Journal of bone and joint surgery American volume 95:1600–1604, 2013CrossRefPubMed Bruinsma WE, Guitton TG, Warner JJ, Ring D: Interobserver reliability of classification and characterization of proximal humeral fractures: a comparison of two and three-dimensional CT. The Journal of bone and joint surgery American volume 95:1600–1604, 2013CrossRefPubMed
3.
go back to reference Buijze GA, Guitton TG, van Dijk CN, Ring D: Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clinical orthopaedics and related research 470:2029–2034, 2012CrossRefPubMedPubMedCentral Buijze GA, Guitton TG, van Dijk CN, Ring D: Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clinical orthopaedics and related research 470:2029–2034, 2012CrossRefPubMedPubMedCentral
4.
go back to reference Buijze GA, Wijffels MM, Guitton TG, Grewal R, van Dijk CN, Ring D: Interobserver reliability of computed tomography to diagnose scaphoid waist fracture union. The Journal of hand surgery 37:250–254, 2012CrossRefPubMed Buijze GA, Wijffels MM, Guitton TG, Grewal R, van Dijk CN, Ring D: Interobserver reliability of computed tomography to diagnose scaphoid waist fracture union. The Journal of hand surgery 37:250–254, 2012CrossRefPubMed
5.
go back to reference Doornberg JN, Guitton TG, Ring D: Diagnosis of elbow fracture patterns on radiographs: interobserver reliability and diagnostic accuracy. Clinical orthopaedics and related research 471:1373–1378, 2013CrossRefPubMed Doornberg JN, Guitton TG, Ring D: Diagnosis of elbow fracture patterns on radiographs: interobserver reliability and diagnostic accuracy. Clinical orthopaedics and related research 471:1373–1378, 2013CrossRefPubMed
6.
go back to reference Gradl G, Neuhaus V, Fuchsberger T, Guitton TG, Prommersberger KJ, Ring D: Radiographic diagnosis of scapholunate dissociation among intra-articular fractures of the distal radius: interobserver reliability. The Journal of hand surgery, 2013 Gradl G, Neuhaus V, Fuchsberger T, Guitton TG, Prommersberger KJ, Ring D: Radiographic diagnosis of scapholunate dissociation among intra-articular fractures of the distal radius: interobserver reliability. The Journal of hand surgery, 2013
7.
go back to reference Tosti R, Ilyas AM, Mellema JJ, Guitton TG, Ring D: Interobserver variability in the treatment of little finger metacarpal neck fractures. The Journal of hand surgery 39:1722–1727, 2014CrossRefPubMed Tosti R, Ilyas AM, Mellema JJ, Guitton TG, Ring D: Interobserver variability in the treatment of little finger metacarpal neck fractures. The Journal of hand surgery 39:1722–1727, 2014CrossRefPubMed
8.
go back to reference Wijffels MM, Guitton TG, Ring D: Inter-observer variation in the diagnosis of coronal articular fracture lines in the lunate facet of the distal radius. Hand (New York, NY) 7:271–275, 2012CrossRef Wijffels MM, Guitton TG, Ring D: Inter-observer variation in the diagnosis of coronal articular fracture lines in the lunate facet of the distal radius. Hand (New York, NY) 7:271–275, 2012CrossRef
9.
go back to reference Neuhaus V, et al.: Scapula fractures: interobserver reliability of classification and treatment. Journal of orthopaedic trauma 28:124–129, 2014CrossRefPubMed Neuhaus V, et al.: Scapula fractures: interobserver reliability of classification and treatment. Journal of orthopaedic trauma 28:124–129, 2014CrossRefPubMed
10.
go back to reference van Kollenburg JA, Vrahas MS, Smith RM, Guitton TG, Ring D: Diagnosis of union of distal tibia fractures: accuracy and interobserver reliability. Injury 44:1073–1075, 2013CrossRefPubMed van Kollenburg JA, Vrahas MS, Smith RM, Guitton TG, Ring D: Diagnosis of union of distal tibia fractures: accuracy and interobserver reliability. Injury 44:1073–1075, 2013CrossRefPubMed
11.
go back to reference Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Tibial plateau fracture characteristics: reliability and diagnostic accuracy. Journal of orthopaedic trauma 30:e144–151, 2016CrossRefPubMed Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Tibial plateau fracture characteristics: reliability and diagnostic accuracy. Journal of orthopaedic trauma 30:e144–151, 2016CrossRefPubMed
12.
go back to reference Mallee WH, Mellema JJ, Guitton TG, Goslings JC, Ring D, Doornberg JN: 6-week radiographs unsuitable for diagnosis of suspected scaphoid fractures. Archives of orthopaedic and trauma surgery 136:771–778, 2016CrossRefPubMedPubMedCentral Mallee WH, Mellema JJ, Guitton TG, Goslings JC, Ring D, Doornberg JN: 6-week radiographs unsuitable for diagnosis of suspected scaphoid fractures. Archives of orthopaedic and trauma surgery 136:771–778, 2016CrossRefPubMedPubMedCentral
13.
go back to reference Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Interobserver reliability of the Schatzker and Luo classification systems for tibial plateau fractures. Injury 47:944–949, 2016CrossRefPubMed Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Interobserver reliability of the Schatzker and Luo classification systems for tibial plateau fractures. Injury 47:944–949, 2016CrossRefPubMed
14.
go back to reference Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Statistics in medicine 17:101–110, 1998CrossRefPubMed Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Statistics in medicine 17:101–110, 1998CrossRefPubMed
15.
go back to reference Brorson S, Bagger J, Sylvest A, Hrobjartsson A: Improved interobserver variation after training of doctors in the Neer system. A randomised trial. The Journal of bone and joint surgery British volume 84:950–954, 2002CrossRefPubMed Brorson S, Bagger J, Sylvest A, Hrobjartsson A: Improved interobserver variation after training of doctors in the Neer system. A randomised trial. The Journal of bone and joint surgery British volume 84:950–954, 2002CrossRefPubMed
16.
go back to reference Brunner A, Heeren N, Albrecht F, Hahn M, Ulmar B, Babst R: Effect of three-dimensional computed tomography reconstructions on reliability. Foot & ankle international 33:727–733, 2012CrossRef Brunner A, Heeren N, Albrecht F, Hahn M, Ulmar B, Babst R: Effect of three-dimensional computed tomography reconstructions on reliability. Foot & ankle international 33:727–733, 2012CrossRef
17.
go back to reference Bishop JY, Jones GL, Rerko MA, Donaldson C: 3-D CT is the most reliable imaging modality when quantifying glenoid bone loss. Clinical orthopaedics and related research 471:1251–1256, 2013CrossRefPubMed Bishop JY, Jones GL, Rerko MA, Donaldson C: 3-D CT is the most reliable imaging modality when quantifying glenoid bone loss. Clinical orthopaedics and related research 471:1251–1256, 2013CrossRefPubMed
18.
go back to reference Doornberg J, Lindenhovius A, Kloen P, van Dijk CN, Zurakowski D, Ring D: Two and three-dimensional computed tomography for the classification and management of distal humeral fractures. Evaluation of reliability and diagnostic accuracy. The Journal of bone and joint surgery American volume 88:1795–1801, 2006PubMed Doornberg J, Lindenhovius A, Kloen P, van Dijk CN, Zurakowski D, Ring D: Two and three-dimensional computed tomography for the classification and management of distal humeral fractures. Evaluation of reliability and diagnostic accuracy. The Journal of bone and joint surgery American volume 88:1795–1801, 2006PubMed
19.
go back to reference Lindenhovius A, Karanicolas PJ, Bhandari M, van Dijk N, Ring D: Interobserver reliability of coronoid fracture classification: two-dimensional versus three-dimensional computed tomography. The Journal of hand surgery 34:1640–1646, 2009CrossRefPubMed Lindenhovius A, Karanicolas PJ, Bhandari M, van Dijk N, Ring D: Interobserver reliability of coronoid fracture classification: two-dimensional versus three-dimensional computed tomography. The Journal of hand surgery 34:1640–1646, 2009CrossRefPubMed
20.
go back to reference Guitton TG, Ring D: Interobserver reliability of radial head fracture classification: two-dimensional compared with three-dimensional CT. The Journal of bone and joint surgery American volume 93:2015–2021, 2011CrossRefPubMed Guitton TG, Ring D: Interobserver reliability of radial head fracture classification: two-dimensional compared with three-dimensional CT. The Journal of bone and joint surgery American volume 93:2015–2021, 2011CrossRefPubMed
21.
go back to reference Siegel S, Castellan JN: Nonparametric statistics for the behavioral sciences, New York: McGraw-Hill, 1988 Siegel S, Castellan JN: Nonparametric statistics for the behavioral sciences, New York: McGraw-Hill, 1988
22.
go back to reference Landis JR, Koch GG: An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33:363–374, 1977CrossRefPubMed Landis JR, Koch GG: An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33:363–374, 1977CrossRefPubMed
23.
go back to reference Berkes MB, et al.: The impact of three-dimensional CT imaging on intraobserver and interobserver reliability of proximal humeral fracture classifications and treatment recommendations. The Journal of bone and joint surgery American volume 96:1281–1286, 2014CrossRefPubMed Berkes MB, et al.: The impact of three-dimensional CT imaging on intraobserver and interobserver reliability of proximal humeral fracture classifications and treatment recommendations. The Journal of bone and joint surgery American volume 96:1281–1286, 2014CrossRefPubMed
24.
go back to reference Laoutliev B, Havsteen I, Bech BH, Narvestad E, Christensen H, Christensen A: Interobserver agreement in fusion status assessment after instrumental desis of the lower lumbar spine using 64-slice multidetector computed tomography: impact of observer experience. European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society 21:2085–2090, 2012CrossRef Laoutliev B, Havsteen I, Bech BH, Narvestad E, Christensen H, Christensen A: Interobserver agreement in fusion status assessment after instrumental desis of the lower lumbar spine using 64-slice multidetector computed tomography: impact of observer experience. European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society 21:2085–2090, 2012CrossRef
Metadata
Title
Online Studies on Variation in Orthopedic Surgery: Computed Tomography in MPEG4 Versus DICOM Format
Authors
Jos J. Mellema
Wouter H. Mallee
Thierry G. Guitton
C. Niek van Dijk
David Ring
Job N. Doornberg
Science of Variation Group & Traumaplatform Study Collaborative
Publication date
01-10-2017
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 5/2017
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-016-9939-0

Other articles of this Issue 5/2017

Journal of Digital Imaging 5/2017 Go to the issue