Skip to main content
Top
Published in: Clinical Orthopaedics and Related Research® 12/2011

01-12-2011 | Clinical Research

Diagnostic Performance Tests for Suspected Scaphoid Fractures Differ with Conventional and Latent Class Analysis

Authors: Geert A. Buijze, MD, Wouter H. Mallee, MD, Frank J. P. Beeres, MD, PhD, Timothy E. Hanson, PhD, Wesley O. Johnson, PhD, David Ring, MD, PhD

Published in: Clinical Orthopaedics and Related Research® | Issue 12/2011

Login to get access

Abstract

Background

Evaluation of the diagnostic performance characteristics of radiographic tests for diagnosing a true fracture among suspected scaphoid fractures is hindered by the lack of a consensus reference standard. Latent class analysis is a statistical method that takes advantage of unobserved, or latent, classes in the data that can be used to determine diagnostic performance characteristics when there is no consensus reference (gold) standard.

Purposes

We therefore compared the diagnostic performance characteristics of MRI, CT, bone scintigraphy, and physical examination to identify true fractures among suspected scaphoid fractures.

Patients and Methods

We used data from two studies, one that prospectively studied 34 patients who had MRI and CT of the wrist, and a second that studied 78 patients who had MRI, bone scintigraphy, and structured physical examination. We compared the diagnostic performance characteristics calculated by latent class analysis with those calculated using formulas based on a reference standard.

Results

In the first cohort, the calculated sensitivity and specificity with latent class analysis were different than those with traditional reference standard-based calculations for the CT in the scaphoid planes (sensitivity, 0.78 versus 0.67; specificity, 1.0 versus 0.96) and the MRI (sensitivity, 0.80 versus 0.67; specificity, 0.93 versus 0.89). In the second cohort, the greatest differences were in the sensitivity of MRI (0.84 versus 0.75) and the sensitivities of physical examination maneuvers (range, 0.63–0.73 versus 1.0).

Conclusions

The diagnostic performance characteristics calculated using latent class analysis may differ from those calculated according to formulas based on a reference standard. We believe latent class analysis merits further study as an option for assessing diagnostic performance characteristics for orthopaedic conditions when there is no consensus reference standard.

Level of Evidence

Level II, prognostic study. See the Guidelines for Authors for a complete description of levels of evidence.
Appendix
Available only for authorised users
Literature
1.
go back to reference Adey L, Souer JS, Lozano-Calderon S, Palmer W, Lee SG, Ring D. Computed tomography of suspected scaphoid fractures. J Hand Surg Am. 2007;32:61–66.PubMedCrossRef Adey L, Souer JS, Lozano-Calderon S, Palmer W, Lee SG, Ring D. Computed tomography of suspected scaphoid fractures. J Hand Surg Am. 2007;32:61–66.PubMedCrossRef
2.
go back to reference Akdemir UO, Atasever T, Sipahioglu S, Turkolmez S, Kazimoglu C, Sener E. Value of bone scintigraphy in patients with carpal trauma. Ann Nucl Med. 2004;18:495–499.PubMedCrossRef Akdemir UO, Atasever T, Sipahioglu S, Turkolmez S, Kazimoglu C, Sener E. Value of bone scintigraphy in patients with carpal trauma. Ann Nucl Med. 2004;18:495–499.PubMedCrossRef
3.
go back to reference Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM. Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008;15:106–114.PubMedCrossRef Baughman AL, Bisgard KM, Cortese MM, Thompson WW, Sanden GN, Strebel PM. Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clin Vaccine Immunol. 2008;15:106–114.PubMedCrossRef
4.
go back to reference Bayes T. An essay towards solving a problem in the doctrine of chances. Phil Trans R Soc London. 1763;53:370–418.CrossRef Bayes T. An essay towards solving a problem in the doctrine of chances. Phil Trans R Soc London. 1763;53:370–418.CrossRef
5.
go back to reference Beeres FJ, Rhemrev SJ, den Hollander P, Kingma LM, Meylaerts SA, le Cessie S, Bartlema KA, Hamming JF, Hogervorst M. Early magnetic resonance imaging compared with bone scintigraphy in suspected scaphoid fractures. J Bone Joint Surg Br. 2008;90:1205–1209.PubMedCrossRef Beeres FJ, Rhemrev SJ, den Hollander P, Kingma LM, Meylaerts SA, le Cessie S, Bartlema KA, Hamming JF, Hogervorst M. Early magnetic resonance imaging compared with bone scintigraphy in suspected scaphoid fractures. J Bone Joint Surg Br. 2008;90:1205–1209.PubMedCrossRef
6.
go back to reference Breederveld RS, Tuinebreijer WE. Investigation of computed tomographic scan concurrent criterion validity in doubtful scaphoid fracture of the wrist. J Trauma. 2004;57:851–854.PubMedCrossRef Breederveld RS, Tuinebreijer WE. Investigation of computed tomographic scan concurrent criterion validity in doubtful scaphoid fracture of the wrist. J Trauma. 2004;57:851–854.PubMedCrossRef
7.
go back to reference Buijze GA, Hanson TE, Johnson W, Ring D. Latent class analysis to determine the accuracy of diagnostic tests in orthopaedics. Orthop J Harvard Med School. 2010;12:106–108. Buijze GA, Hanson TE, Johnson W, Ring D. Latent class analysis to determine the accuracy of diagnostic tests in orthopaedics. Orthop J Harvard Med School. 2010;12:106–108.
8.
go back to reference Butler JC, Bosshardt SC, Phelan M, Moroney SM, Tondella ML, Farley MM, Schuchat A, Fields BS. Classical and latent class analysis evaluation of sputum polymerase chain reaction and urine antigen testing for diagnosis of pneumococcal pneumonia in adults. J Infect Dis. 2003;187:1416–1423.PubMedCrossRef Butler JC, Bosshardt SC, Phelan M, Moroney SM, Tondella ML, Farley MM, Schuchat A, Fields BS. Classical and latent class analysis evaluation of sputum polymerase chain reaction and urine antigen testing for diagnosis of pneumococcal pneumonia in adults. J Infect Dis. 2003;187:1416–1423.PubMedCrossRef
9.
go back to reference Casella G, Berger RL. Statistical Inference. Ed 2. Pacific Grove, CA: Duxbury Press; 2001. Casella G, Berger RL. Statistical Inference. Ed 2. Pacific Grove, CA: Duxbury Press; 2001.
10.
go back to reference Christensen R, Johnson WO, Branscum A, Hanson TF. Bayesian Ideas and Data Analysis: An Introduction for Scientists and Statisticians. Ed 3. Boca Raton, FL: CRC Press; 2010. Christensen R, Johnson WO, Branscum A, Hanson TF. Bayesian Ideas and Data Analysis: An Introduction for Scientists and Statisticians. Ed 3. Boca Raton, FL: CRC Press; 2010.
11.
go back to reference De La Rosa GD, Valencia ML, Arango CM, Gomez CI, Garcia A, Ospina S, Osorno S, Henao A, Jaimes FA. Toward an operative diagnosis in sepsis: a latent class approach. BMC Infect Dis. 2008;8:18.PubMedCrossRef De La Rosa GD, Valencia ML, Arango CM, Gomez CI, Garcia A, Ospina S, Osorno S, Henao A, Jaimes FA. Toward an operative diagnosis in sepsis: a latent class approach. BMC Infect Dis. 2008;8:18.PubMedCrossRef
12.
go back to reference Dendukuri N, Joseph L. Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001;57:158–167.PubMedCrossRef Dendukuri N, Joseph L. Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics. 2001;57:158–167.PubMedCrossRef
13.
go back to reference Faraone SV, Tsuang MT. Measuring diagnostic accuracy in the absence of a “gold standard”. Am J Psychiatry. 1994;151:650–657.PubMed Faraone SV, Tsuang MT. Measuring diagnostic accuracy in the absence of a “gold standard”. Am J Psychiatry. 1994;151:650–657.PubMed
14.
go back to reference Fisher RA. On the mathematical foundations of theoretical statistics. Phil Trans R Soc A. 1922;222:309–368.CrossRef Fisher RA. On the mathematical foundations of theoretical statistics. Phil Trans R Soc A. 1922;222:309–368.CrossRef
15.
go back to reference Gabler C, Kukla C, Breitenseher MJ, Trattnig S, Vecsei V. Diagnosis of occult scaphoid fractures and other wrist injuries: are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–154.PubMedCrossRef Gabler C, Kukla C, Breitenseher MJ, Trattnig S, Vecsei V. Diagnosis of occult scaphoid fractures and other wrist injuries: are repeated clinical examinations and plain radiographs still state of the art? Langenbecks Arch Surg. 2001;386:150–154.PubMedCrossRef
16.
go back to reference Georgiadis MP, Johnson WO, Singh R, Gardner IA. Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. J Royal Stat Soc C. 2003;52:63–76.CrossRef Georgiadis MP, Johnson WO, Singh R, Gardner IA. Correlation-adjusted estimation of sensitivity and specificity of two diagnostic tests. J Royal Stat Soc C. 2003;52:63–76.CrossRef
17.
go back to reference Groves AM, Kayani I, Syed R, Hutton BF, Bearcroft PP, Dixon AK, Ell PJ. An international survey of hospital practice in the imaging of acute scaphoid trauma. AJR Am J Roentgenol. 2006;187:1453–1456.PubMedCrossRef Groves AM, Kayani I, Syed R, Hutton BF, Bearcroft PP, Dixon AK, Ell PJ. An international survey of hospital practice in the imaging of acute scaphoid trauma. AJR Am J Roentgenol. 2006;187:1453–1456.PubMedCrossRef
18.
19.
go back to reference Hunter JC, Escobedo EM, Wilson AJ, Hanel DP, Zink-Brody GC, Mann FA. MR imaging of clinically suspected scaphoid fractures. AJR Am J Roentgenol. 1997;168:1287–1293.PubMed Hunter JC, Escobedo EM, Wilson AJ, Hanel DP, Zink-Brody GC, Mann FA. MR imaging of clinically suspected scaphoid fractures. AJR Am J Roentgenol. 1997;168:1287–1293.PubMed
20.
go back to reference Johnson WO, Gastwirth JL, Pearson LM. Screening without a “gold standard”: the Hui-Walter paradigm revisited. Am J Epidemiol. 2001;153:921–924.PubMedCrossRef Johnson WO, Gastwirth JL, Pearson LM. Screening without a “gold standard”: the Hui-Walter paradigm revisited. Am J Epidemiol. 2001;153:921–924.PubMedCrossRef
21.
go back to reference Jones G, Johnson WO, Hanson TE, Christensen R. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics. 2010;66:855–863.PubMedCrossRef Jones G, Johnson WO, Hanson TE, Christensen R. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics. 2010;66:855–863.PubMedCrossRef
22.
go back to reference LaJoie AS, McCabe SJ, Thomas B, Edgell SE. Determining the sensitivity and specificity of common diagnostic tests for carpal tunnel syndrome using latent class analysis. Plast Reconstr Surg. 2005;116:502–507.PubMedCrossRef LaJoie AS, McCabe SJ, Thomas B, Edgell SE. Determining the sensitivity and specificity of common diagnostic tests for carpal tunnel syndrome using latent class analysis. Plast Reconstr Surg. 2005;116:502–507.PubMedCrossRef
23.
go back to reference Low G, Raby N. Can follow-up radiography for acute scaphoid fracture still be considered a valid investigation? Clin Radiol. 2005;60:1106–1110.PubMedCrossRef Low G, Raby N. Can follow-up radiography for acute scaphoid fracture still be considered a valid investigation? Clin Radiol. 2005;60:1106–1110.PubMedCrossRef
24.
go back to reference Lozano-Calderon S, Blazar P, Zurakowski D, Lee SG, Ring D. Diagnosis of scaphoid fracture displacement with radiography and computed tomography. J Bone Joint Surg Am. 2006;88:2695–2703.PubMedCrossRef Lozano-Calderon S, Blazar P, Zurakowski D, Lee SG, Ring D. Diagnosis of scaphoid fracture displacement with radiography and computed tomography. J Bone Joint Surg Am. 2006;88:2695–2703.PubMedCrossRef
25.
go back to reference Mallee W, Doornberg JN, Ring D, van Dijk CN, Maas M, Goslings JC. Comparison of CT and MRI for diagnosis of suspected scaphoid fractures. J Bone Joint Surg Am. 2011;93:20–28.PubMedCrossRef Mallee W, Doornberg JN, Ring D, van Dijk CN, Maas M, Goslings JC. Comparison of CT and MRI for diagnosis of suspected scaphoid fractures. J Bone Joint Surg Am. 2011;93:20–28.PubMedCrossRef
26.
go back to reference Memarsadeghi M, Breitenseher MJ, Schaefer-Prokop C, Weber M, Aldrian S, Gabler C, Prokop M. Occult scaphoid fractures: comparison of multidetector CT and MR imaging. Initial experience. Radiology. 2006;240:169–176. Memarsadeghi M, Breitenseher MJ, Schaefer-Prokop C, Weber M, Aldrian S, Gabler C, Prokop M. Occult scaphoid fractures: comparison of multidetector CT and MR imaging. Initial experience. Radiology. 2006;240:169–176.
27.
go back to reference Nielsen PT, Hedeboe J, Thommesen P. Bone scintigraphy in the evaluation of fracture of the carpal scaphoid bone. Acta Orthop Scand. 1983;54:303–306.PubMedCrossRef Nielsen PT, Hedeboe J, Thommesen P. Bone scintigraphy in the evaluation of fracture of the carpal scaphoid bone. Acta Orthop Scand. 1983;54:303–306.PubMedCrossRef
28.
go back to reference Rhemrev SJ, Beeres FJ, van Leerdam RH, Hogervorst M, Ring D. Clinical prediction rule for suspected scaphoid fractures: a prospective cohort study. Injury. 2010;41:1026–1030.PubMedCrossRef Rhemrev SJ, Beeres FJ, van Leerdam RH, Hogervorst M, Ring D. Clinical prediction rule for suspected scaphoid fractures: a prospective cohort study. Injury. 2010;41:1026–1030.PubMedCrossRef
29.
go back to reference Rice JP, Endicott J, Knesevich MA, Rochberg N. The estimation of diagnostic sensitivity using stability data: an application to major depressive disorder. J Psychiatr Res. 1987;21:337–345.PubMedCrossRef Rice JP, Endicott J, Knesevich MA, Rochberg N. The estimation of diagnostic sensitivity using stability data: an application to major depressive disorder. J Psychiatr Res. 1987;21:337–345.PubMedCrossRef
30.
go back to reference Sanders WE. Evaluation of the humpback scaphoid by computed tomography in the longitudinal axial plane of the scaphoid. J Hand Surg Am. 1988;13:182–187.PubMedCrossRef Sanders WE. Evaluation of the humpback scaphoid by computed tomography in the longitudinal axial plane of the scaphoid. J Hand Surg Am. 1988;13:182–187.PubMedCrossRef
31.
go back to reference Siegel S, Castellan JN. Nonparametric Statistics for the Behavioral Sciences. New York, NY: McGraw-Hill; 1988. Siegel S, Castellan JN. Nonparametric Statistics for the Behavioral Sciences. New York, NY: McGraw-Hill; 1988.
32.
go back to reference Symmons DP, Lunt M, Watkins G, Helliwell P, Jones S, McHugh N, Veale D. Developing classification criteria for peripheral joint psoriatic arthritis: Step I. Establishing whether the rheumatologist’s opinion on the diagnosis can be used as the “gold standard”. J Rheumatol. 2006;33:552–557.PubMed Symmons DP, Lunt M, Watkins G, Helliwell P, Jones S, McHugh N, Veale D. Developing classification criteria for peripheral joint psoriatic arthritis: Step I. Establishing whether the rheumatologist’s opinion on the diagnosis can be used as the “gold standard”. J Rheumatol. 2006;33:552–557.PubMed
33.
go back to reference Thorpe AP, Murray AD, Smith FW, Ferguson J. Clinically suspected scaphoid fracture: a comparison of magnetic resonance imaging and bone scintigraphy. Br J Radiol. 1996;69:109–113.PubMedCrossRef Thorpe AP, Murray AD, Smith FW, Ferguson J. Clinically suspected scaphoid fracture: a comparison of magnetic resonance imaging and bone scintigraphy. Br J Radiol. 1996;69:109–113.PubMedCrossRef
34.
go back to reference Tuyisenge L, Ndimubanzi CP, Ndayisaba G, Muganga N, Menten J, Boelaert M, Van den Ende J. Evaluation of latent class analysis and decision thresholds to guide the diagnosis of pediatric tuberculosis in a Rwandan reference hospital. Pediatr Infect Dis J. 2010;29:e11–e18.PubMedCrossRef Tuyisenge L, Ndimubanzi CP, Ndayisaba G, Muganga N, Menten J, Boelaert M, Van den Ende J. Evaluation of latent class analysis and decision thresholds to guide the diagnosis of pediatric tuberculosis in a Rwandan reference hospital. Pediatr Infect Dis J. 2010;29:e11–e18.PubMedCrossRef
35.
go back to reference Unay K, Gokcen B, Ozkan K, Poyanli O, Eceviz E. Examination tests predictive of bone injury in patients with clinically suspected occult scaphoid fracture. Injury. 2009;40:1265–1268.PubMedCrossRef Unay K, Gokcen B, Ozkan K, Poyanli O, Eceviz E. Examination tests predictive of bone injury in patients with clinically suspected occult scaphoid fracture. Injury. 2009;40:1265–1268.PubMedCrossRef
36.
go back to reference Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943–951.PubMedCrossRef Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943–951.PubMedCrossRef
37.
go back to reference Wilson AW, Kurer MH, Peggington JL, Grant DS, Kirk CC. Bone scintigraphy in the management of X-ray-negative potential scaphoid fractures. Arch Emerg Med. 1986;3:235–242.PubMed Wilson AW, Kurer MH, Peggington JL, Grant DS, Kirk CC. Bone scintigraphy in the management of X-ray-negative potential scaphoid fractures. Arch Emerg Med. 1986;3:235–242.PubMed
38.
go back to reference Yin ZG, Zhang JB, Kan SL, Wang XG. Diagnosing suspected scaphoid fractures: a systematic review and meta-analysis. Clin Orthop Relat Res. 2010;468:723–734.PubMedCrossRef Yin ZG, Zhang JB, Kan SL, Wang XG. Diagnosing suspected scaphoid fractures: a systematic review and meta-analysis. Clin Orthop Relat Res. 2010;468:723–734.PubMedCrossRef
Metadata
Title
Diagnostic Performance Tests for Suspected Scaphoid Fractures Differ with Conventional and Latent Class Analysis
Authors
Geert A. Buijze, MD
Wouter H. Mallee, MD
Frank J. P. Beeres, MD, PhD
Timothy E. Hanson, PhD
Wesley O. Johnson, PhD
David Ring, MD, PhD
Publication date
01-12-2011
Publisher
Springer-Verlag
Published in
Clinical Orthopaedics and Related Research® / Issue 12/2011
Print ISSN: 0009-921X
Electronic ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-011-2074-9

Other articles of this Issue 12/2011

Clinical Orthopaedics and Related Research® 12/2011 Go to the issue