Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Prediction of intracranial findings on CT-scans by alternative modelling techniques

Authors: Tjeerd van der Ploeg, Marion Smits, Diederik W Dippel, Myriam Hunink, Ewout W Steyerberg

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

Prediction rules for intracranial traumatic findings in patients with minor head injury are designed to reduce the use of computed tomography (CT) without missing patients at risk for complications. This study investigates whether alternative modelling techniques might improve the applicability and simplicity of such prediction rules.

Methods

We included 3181 patients with minor head injury who had received CT scans between February 2002 and August 2004. Of these patients 243 (7.6%) had intracranial traumatic findings and 17 (0.5%) underwent neurosurgical intervention. We analyzed sensitivity, specificity and area under the ROC curve (AUC-value) to compare the performance of various modelling techniques by 10 × 10 cross-validation. The techniques included logistic regression, Bayes network, Chi-squared Automatic Interaction Detection (CHAID), neural net, support vector machines, Classification And Regression Trees (CART) and "decision list" models.

Results

The cross-validated performance was best for the logistic regression model (AUC 0.78), followed by the Bayes network model and the neural net model (both AUC 0.74). The other models performed poorly (AUC < 0.70). The advantage of the Bayes network model was that it provided a graphical representation of the relationships between the predictors and the outcome.

Conclusions

No alternative modelling technique outperformed the logistic regression model. However, the Bayes network model had a presentation format which provided more detailed insights into the structure of the prediction problem. The search for methods with good predictive performance and an attractive presentation format should continue.
Appendix
Available only for authorised users
Literature
1.
go back to reference Smits M, Dippel DWJ, Steyerberg EW, De Haan GG, Dekker HM, Vos PE, Kool DR, Nederkoorn PJ, Hofman PAM, Twijnstra A, Tanghe HLJ, Hunink MGM: Predicting Intracranial Traumatic Findings on Computed Tomography in Patients with Minor Head Injury: The CHIP Prediction Rule. Annals of Internal Medicine. 2007, 146 (6): 397-405.CrossRefPubMed Smits M, Dippel DWJ, Steyerberg EW, De Haan GG, Dekker HM, Vos PE, Kool DR, Nederkoorn PJ, Hofman PAM, Twijnstra A, Tanghe HLJ, Hunink MGM: Predicting Intracranial Traumatic Findings on Computed Tomography in Patients with Minor Head Injury: The CHIP Prediction Rule. Annals of Internal Medicine. 2007, 146 (6): 397-405.CrossRefPubMed
2.
go back to reference Stiell IG, Wells GA, Vandemheen K, Clement C, Lesiuk H, Laupacis A, McKnight RD, Verbeek R, Brison R, Cass D, Eisenhauer ME, Greenberg G, Worthington J: The Canadian CT Head Rule for Patients with Minor Head Injury. The Lancet. 2001, 357 (9266): 1391-1396. 10.1016/S0140-6736(00)04561-X.CrossRef Stiell IG, Wells GA, Vandemheen K, Clement C, Lesiuk H, Laupacis A, McKnight RD, Verbeek R, Brison R, Cass D, Eisenhauer ME, Greenberg G, Worthington J: The Canadian CT Head Rule for Patients with Minor Head Injury. The Lancet. 2001, 357 (9266): 1391-1396. 10.1016/S0140-6736(00)04561-X.CrossRef
3.
go back to reference Stiell IG, Clement CM, Rowe BH, Schull MJ, Brison R, Cass D, Eisenhauer MA, McKnight RD, Bandiera G, Holroyd B, Lee JS, Dreyer J, Worthington JR, Reardon M, Greenberg G, Lesiuk H, MacPhail I, Wells GA: Comparison of the Canadian CT Head Rule and the New Orleans Criteria in Patients with Minor Head Injury. JAMA. 2005, 28;294 (12): 1511-8.CrossRef Stiell IG, Clement CM, Rowe BH, Schull MJ, Brison R, Cass D, Eisenhauer MA, McKnight RD, Bandiera G, Holroyd B, Lee JS, Dreyer J, Worthington JR, Reardon M, Greenberg G, Lesiuk H, MacPhail I, Wells GA: Comparison of the Canadian CT Head Rule and the New Orleans Criteria in Patients with Minor Head Injury. JAMA. 2005, 28;294 (12): 1511-8.CrossRef
4.
go back to reference Kuppermann N, Holmes JF, Dayan PS, Hoyle JD, Atabaki SM, Holubkov R, Nadel FM, Monroe D, Stanley RM, Borgialli DA, Badawy MK, Schunk JE, Quayle KS, Mahajan P, Lichenstein R, Lillis KA, Tunik MG, Jacobs ES, Callahan JM, Gorelick H, Glass TF, Lee LK, Bachman MC, Cooper A, Powell EC, Gerardi MJ, Melville KA, Muizelaar JP, Wisner DH, Zuspan SJ, Dean JM, Wootton-Gorges SL: Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. The Lancet. 2009, 374 (9696): 1160-1170. 10.1016/S0140-6736(09)61558-0.CrossRef Kuppermann N, Holmes JF, Dayan PS, Hoyle JD, Atabaki SM, Holubkov R, Nadel FM, Monroe D, Stanley RM, Borgialli DA, Badawy MK, Schunk JE, Quayle KS, Mahajan P, Lichenstein R, Lillis KA, Tunik MG, Jacobs ES, Callahan JM, Gorelick H, Glass TF, Lee LK, Bachman MC, Cooper A, Powell EC, Gerardi MJ, Melville KA, Muizelaar JP, Wisner DH, Zuspan SJ, Dean JM, Wootton-Gorges SL: Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. The Lancet. 2009, 374 (9696): 1160-1170. 10.1016/S0140-6736(09)61558-0.CrossRef
5.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ: Classification and regression trees. 1984, Boca Raton, Chapman & Hall/CRC Breiman L, Friedman JH, Olshen RA, Stone CJ: Classification and regression trees. 1984, Boca Raton, Chapman & Hall/CRC
6.
go back to reference Breiman L, Stone CJ: Parsimonious binary classification trees. 1978, Santa Monica, Technology Service Corporation Breiman L, Stone CJ: Parsimonious binary classification trees. 1978, Santa Monica, Technology Service Corporation
7.
go back to reference Clementine® 7.0 User's Guide. 2002, Integral Solutions Limited Clementine® 7.0 User's Guide. 2002, Integral Solutions Limited
8.
go back to reference Steyerberg EW: Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. 2008, New York, Springer Steyerberg EW: Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. 2008, New York, Springer
9.
go back to reference Zani S, Cerioli A, Riani M, Vichi M: Data analysis, classification and the forward search: proceedings of the Meeting of the Classification and Data Analysis Group (CLADAG) of the Italian Statistical Society, University of Parma, June 6-8, 2005. 2006, New York, SpringerCrossRef Zani S, Cerioli A, Riani M, Vichi M: Data analysis, classification and the forward search: proceedings of the Meeting of the Classification and Data Analysis Group (CLADAG) of the Italian Statistical Society, University of Parma, June 6-8, 2005. 2006, New York, SpringerCrossRef
10.
Metadata
Title
Prediction of intracranial findings on CT-scans by alternative modelling techniques
Authors
Tjeerd van der Ploeg
Marion Smits
Diederik W Dippel
Myriam Hunink
Ewout W Steyerberg
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-143

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue