Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2013

Open Access 01-12-2013 | Research article

Hip fracture risk assessment: artificial neural network outperforms conditional logistic regression in an age- and sex-matched case control study

Authors: Wo-Jan Tseng, Li-Wei Hung, Jiann-Shing Shieh, Maysam F Abbod, Jinn Lin

Published in: BMC Musculoskeletal Disorders | Issue 1/2013

Login to get access

Abstract

Background

Osteoporotic hip fractures with a significant morbidity and excess mortality among the elderly have imposed huge health and economic burdens on societies worldwide. In this age- and sex-matched case control study, we examined the risk factors of hip fractures and assessed the fracture risk by conditional logistic regression (CLR) and ensemble artificial neural network (ANN). The performances of these two classifiers were compared.

Methods

The study population consisted of 217 pairs (149 women and 68 men) of fractures and controls with an age older than 60 years. All the participants were interviewed with the same standardized questionnaire including questions on 66 risk factors in 12 categories. Univariate CLR analysis was initially conducted to examine the unadjusted odds ratio of all potential risk factors. The significant risk factors were then tested by multivariate analyses. For fracture risk assessment, the participants were randomly divided into modeling and testing datasets for 10-fold cross validation analyses. The predicting models built by CLR and ANN in modeling datasets were applied to testing datasets for generalization study. The performances, including discrimination and calibration, were compared with non-parametric Wilcoxon tests.

Results

In univariate CLR analyses, 16 variables achieved significant level, and six of them remained significant in multivariate analyses, including low T score, low BMI, low MMSE score, milk intake, walking difficulty, and significant fall at home. For discrimination, ANN outperformed CLR in both 16- and 6-variable analyses in modeling and testing datasets (p?<?0.005). For calibration, ANN outperformed CLR only in 16-variable analyses in modeling and testing datasets (p?=?0.013 and 0.047, respectively).

Conclusions

The risk factors of hip fracture are more personal than environmental. With adequate model construction, ANN may outperform CLR in both discrimination and calibration. ANN seems to have not been developed to its full potential and efforts should be made to improve its performance.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wehren L, Magaziner J: Hip fracture: risk factors and outcomes. Curr Osteoporos Rep. 2003, 1: 78-85. 10.1007/s11914-003-0013-8.CrossRefPubMed Wehren L, Magaziner J: Hip fracture: risk factors and outcomes. Curr Osteoporos Rep. 2003, 1: 78-85. 10.1007/s11914-003-0013-8.CrossRefPubMed
2.
go back to reference Magaziner J, Lydick E, Hawkes W, Fox KM, Zimmerman SI, Epstein RS, Hebel JR: Excess mortality attributable to hip fracture in white women aged 70 years and older. Am J Public Health. 1997, 87: 1630-1636. 10.2105/AJPH.87.10.1630.CrossRefPubMedPubMedCentral Magaziner J, Lydick E, Hawkes W, Fox KM, Zimmerman SI, Epstein RS, Hebel JR: Excess mortality attributable to hip fracture in white women aged 70 years and older. Am J Public Health. 1997, 87: 1630-1636. 10.2105/AJPH.87.10.1630.CrossRefPubMedPubMedCentral
3.
go back to reference Taylor BC, Schreiner PJ, Stone KL, Fink HA, Cummings SR, Nevitt MC, Bowman PJ, Ensrud KE: Long-term prediction of incident hip fracture risk in elderly white women: study of osteoporotic fractures. J Am Getri Soc. 2004, 52: 1479-1486. 10.1111/j.1532-5415.2004.52410.x.CrossRef Taylor BC, Schreiner PJ, Stone KL, Fink HA, Cummings SR, Nevitt MC, Bowman PJ, Ensrud KE: Long-term prediction of incident hip fracture risk in elderly white women: study of osteoporotic fractures. J Am Getri Soc. 2004, 52: 1479-1486. 10.1111/j.1532-5415.2004.52410.x.CrossRef
4.
5.
go back to reference Robbins J, Aragaki AK, Kooperberg C, Watts N, Wactawski-Wende J, Jackson RD, LeBoff MS, Lewis CE, Chen Z, Stefanick ML: Factors Associated With 5-Year Risk of Hip Fracture in Postmenopausal Women. JAMA-J Am Med Assoc. 2007, 298 (20): 2389-2398. 10.1001/jama.298.20.2389.CrossRef Robbins J, Aragaki AK, Kooperberg C, Watts N, Wactawski-Wende J, Jackson RD, LeBoff MS, Lewis CE, Chen Z, Stefanick ML: Factors Associated With 5-Year Risk of Hip Fracture in Postmenopausal Women. JAMA-J Am Med Assoc. 2007, 298 (20): 2389-2398. 10.1001/jama.298.20.2389.CrossRef
6.
go back to reference LAU EMC, SURIWONGPAISAL P, LEE JK, DE D, FESTIN MR, SAW SM, KHIR A, TORRALBA T, SHAM A, SAMBROOK P: Risk factors for hip fracture in asian men and women: the Asian osteoporosis study. J Bone Miner Res. 2001, 16: 572-580. 10.1359/jbmr.2001.16.3.572.CrossRefPubMed LAU EMC, SURIWONGPAISAL P, LEE JK, DE D, FESTIN MR, SAW SM, KHIR A, TORRALBA T, SHAM A, SAMBROOK P: Risk factors for hip fracture in asian men and women: the Asian osteoporosis study. J Bone Miner Res. 2001, 16: 572-580. 10.1359/jbmr.2001.16.3.572.CrossRefPubMed
7.
go back to reference Basheer IA, Hajmeer M: Artificial neural networks: fundamentals, computing, design, and application. J Microbiol Meth. 2000, 43: 3-31. 10.1016/S0167-7012(00)00201-3.CrossRef Basheer IA, Hajmeer M: Artificial neural networks: fundamentals, computing, design, and application. J Microbiol Meth. 2000, 43: 3-31. 10.1016/S0167-7012(00)00201-3.CrossRef
8.
go back to reference Patel JL, Goyal RK: Applications of artificial neural networks in medical science. Curr Clin Pharmacol. 2007, 2: 217-226. 10.2174/157488407781668811.CrossRefPubMed Patel JL, Goyal RK: Applications of artificial neural networks in medical science. Curr Clin Pharmacol. 2007, 2: 217-226. 10.2174/157488407781668811.CrossRefPubMed
9.
go back to reference Eller-Vainicher C, Chiodini I, Santi I, Massarotti M, Pietrogrande L, Cairoli E, Beck-Peccoz P, Longhi M, Galmarini V, Gandolini G, Bevilacqua M, Grossi E: Recognition of morphometric vertebral fractures by artificial neural networks: analysis from GISMO Lombardia Database. PLoS One. 2011, 6 (11): e27277-10.1371/journal.pone.0027277.CrossRefPubMedPubMedCentral Eller-Vainicher C, Chiodini I, Santi I, Massarotti M, Pietrogrande L, Cairoli E, Beck-Peccoz P, Longhi M, Galmarini V, Gandolini G, Bevilacqua M, Grossi E: Recognition of morphometric vertebral fractures by artificial neural networks: analysis from GISMO Lombardia Database. PLoS One. 2011, 6 (11): e27277-10.1371/journal.pone.0027277.CrossRefPubMedPubMedCentral
10.
go back to reference Lin CC, Ou YK, Chen SH, Liu YC, Lin J: Comparison of artificial neural network and logistic regression models for predicting mortality in elderly patients with hip fracture. Injury. 2010, 41 (8): 869-873. 10.1016/j.injury.2010.04.023.CrossRefPubMed Lin CC, Ou YK, Chen SH, Liu YC, Lin J: Comparison of artificial neural network and logistic regression models for predicting mortality in elderly patients with hip fracture. Injury. 2010, 41 (8): 869-873. 10.1016/j.injury.2010.04.023.CrossRefPubMed
11.
go back to reference Winham SJ, Slater AJ, Motsinger-Reif AA: A comparison of internal validation techniques for multifactor dimensionality reduction. BMC Bioinformatics. 2010, 11 (1): 394-10.1186/1471-2105-11-394.CrossRefPubMedPubMedCentral Winham SJ, Slater AJ, Motsinger-Reif AA: A comparison of internal validation techniques for multifactor dimensionality reduction. BMC Bioinformatics. 2010, 11 (1): 394-10.1186/1471-2105-11-394.CrossRefPubMedPubMedCentral
12.
go back to reference Lin CC, Bai YM, Chen JY, Hwang TJ, Chen TT, Chiu HW, Li YC: Easy and low-cost identification of metabolic syndrome in patients treated with second-generation antipsychotics. J Clin Psychiat. 2010, 71 (03): 225-234. 10.4088/JCP.08m04628yel.CrossRef Lin CC, Bai YM, Chen JY, Hwang TJ, Chen TT, Chiu HW, Li YC: Easy and low-cost identification of metabolic syndrome in patients treated with second-generation antipsychotics. J Clin Psychiat. 2010, 71 (03): 225-234. 10.4088/JCP.08m04628yel.CrossRef
13.
go back to reference Meiller MF: A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 1993, 6: 525-533. 10.1016/S0893-6080(05)80056-5.CrossRef Meiller MF: A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw. 1993, 6: 525-533. 10.1016/S0893-6080(05)80056-5.CrossRef
14.
go back to reference Matheny M, Ohnomachado L, Resnic F: Discrimination and calibration of mortality risk prediction models in interventional cardiology. J Biomed Inform. 2005, 38 (5): 367-375. 10.1016/j.jbi.2005.02.007.CrossRefPubMed Matheny M, Ohnomachado L, Resnic F: Discrimination and calibration of mortality risk prediction models in interventional cardiology. J Biomed Inform. 2005, 38 (5): 367-375. 10.1016/j.jbi.2005.02.007.CrossRefPubMed
15.
go back to reference Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002, 35 (5–6): 352-359.CrossRefPubMed Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002, 35 (5–6): 352-359.CrossRefPubMed
16.
go back to reference Parker MJ, Twemlow TR, Pryor GA: Environmental hazards and hip fractures. Age Ageing. 1996, 25: 322-325. 10.1093/ageing/25.4.322.CrossRefPubMed Parker MJ, Twemlow TR, Pryor GA: Environmental hazards and hip fractures. Age Ageing. 1996, 25: 322-325. 10.1093/ageing/25.4.322.CrossRefPubMed
17.
go back to reference LAU EMC, HONG A, LAM V, WOO J: Milk supplementation of the diet of postmenopausal Chinese women on a low calcium intake retards bone loss. J Bone Miner Res. 2001, 16: 1704-1709. 10.1359/jbmr.2001.16.9.1704.CrossRefPubMed LAU EMC, HONG A, LAM V, WOO J: Milk supplementation of the diet of postmenopausal Chinese women on a low calcium intake retards bone loss. J Bone Miner Res. 2001, 16: 1704-1709. 10.1359/jbmr.2001.16.9.1704.CrossRefPubMed
18.
go back to reference Ting G, Tan S, Chan S, Karuthan C, Zaitun Y, Suriah A, Chee W: A follow-up study on the effects of a milk supplement on bone mineral density of menopausal Chinese women in Malaysia. J Nutr Health Aging. 2007, 11: 69-73.PubMed Ting G, Tan S, Chan S, Karuthan C, Zaitun Y, Suriah A, Chee W: A follow-up study on the effects of a milk supplement on bone mineral density of menopausal Chinese women in Malaysia. J Nutr Health Aging. 2007, 11: 69-73.PubMed
19.
go back to reference Lofthus CM, Osnes EK, Meyer HE, Kristiansen IS, Nordsletten L, Falch JA: Young patients with hip fracture: a population-based study of bone mass and risk factors for osteoporosis. Osteoporosis Int. 2006, 17 (11): 1666-1672. 10.1007/s00198-006-0176-0.CrossRef Lofthus CM, Osnes EK, Meyer HE, Kristiansen IS, Nordsletten L, Falch JA: Young patients with hip fracture: a population-based study of bone mass and risk factors for osteoporosis. Osteoporosis Int. 2006, 17 (11): 1666-1672. 10.1007/s00198-006-0176-0.CrossRef
20.
go back to reference Kanis JA, Oden A, Johnell O, Johansson H, Laet C, Brown J, Burckhardt P, Cooper C, Christiansen C, Cummings S: The use of clinical risk factors enhances the performance of BMD in the prediction of hip and osteoporotic fractures in men and women. Osteoporosis Int. 2007, 18 (8): 1033-1046. 10.1007/s00198-007-0343-y.CrossRef Kanis JA, Oden A, Johnell O, Johansson H, Laet C, Brown J, Burckhardt P, Cooper C, Christiansen C, Cummings S: The use of clinical risk factors enhances the performance of BMD in the prediction of hip and osteoporotic fractures in men and women. Osteoporosis Int. 2007, 18 (8): 1033-1046. 10.1007/s00198-007-0343-y.CrossRef
21.
go back to reference Ayer T, Chhatwal J, Alagoz O, Kahn CE, Woods RW, Burnside ES: Comparison of logistic regression and artificial neural network models in breast cancer risk estimation. Radiographics. 2010, 30: 13-22. 10.1148/rg.301095057.CrossRefPubMedPubMedCentral Ayer T, Chhatwal J, Alagoz O, Kahn CE, Woods RW, Burnside ES: Comparison of logistic regression and artificial neural network models in breast cancer risk estimation. Radiographics. 2010, 30: 13-22. 10.1148/rg.301095057.CrossRefPubMedPubMedCentral
22.
go back to reference Sargent DJ: Comparison of artificial neural networks with other statistical approaches. Cancer. 2001, 91: 1636-1642. 10.1002/1097-0142(20010415)91:8+<1636::AID-CNCR1176>3.0.CO;2-D.CrossRefPubMed Sargent DJ: Comparison of artificial neural networks with other statistical approaches. Cancer. 2001, 91: 1636-1642. 10.1002/1097-0142(20010415)91:8+<1636::AID-CNCR1176>3.0.CO;2-D.CrossRefPubMed
23.
go back to reference Cunningham P, Carney J, Jacob S: Stability problems with artifcial neural networks and the ensemble solution. Artif Intell Med. 2000, 20: 217-225. 10.1016/S0933-3657(00)00065-8.CrossRefPubMed Cunningham P, Carney J, Jacob S: Stability problems with artifcial neural networks and the ensemble solution. Artif Intell Med. 2000, 20: 217-225. 10.1016/S0933-3657(00)00065-8.CrossRefPubMed
24.
go back to reference Santos-Garcı́a G, Varela G, Novoa N, Jiménez MF: Prediction of postoperative morbidity after lung resection using an artificial neural network ensemble. Artif Intell Med. 2004, 30 (1): 61-69. 10.1016/S0933-3657(03)00059-9.CrossRefPubMed Santos-Garcı́a G, Varela G, Novoa N, Jiménez MF: Prediction of postoperative morbidity after lung resection using an artificial neural network ensemble. Artif Intell Med. 2004, 30 (1): 61-69. 10.1016/S0933-3657(03)00059-9.CrossRefPubMed
25.
go back to reference Schwartzer G, Vach W, Schumacher M: On the misuses of artificial neural networks for pronostic and diagnostic classification in oncology. Stat Med. 2000, 19: 541-561. 10.1002/(SICI)1097-0258(20000229)19:4<541::AID-SIM355>3.0.CO;2-V.CrossRef Schwartzer G, Vach W, Schumacher M: On the misuses of artificial neural networks for pronostic and diagnostic classification in oncology. Stat Med. 2000, 19: 541-561. 10.1002/(SICI)1097-0258(20000229)19:4<541::AID-SIM355>3.0.CO;2-V.CrossRef
26.
go back to reference Fluss R, Faraggi D, Reiser B: Estimation of the Youden index and its associated cutoff point. Biom J. 2005, 47: 458-472. 10.1002/bimj.200410135.CrossRefPubMed Fluss R, Faraggi D, Reiser B: Estimation of the Youden index and its associated cutoff point. Biom J. 2005, 47: 458-472. 10.1002/bimj.200410135.CrossRefPubMed
27.
go back to reference Jimenez-valverde A, Lobo J: Threshold criteria for conversion of probability of species presence to either–or presence–absence. Acta Oecol. 2007, 31 (3): 361-369. 10.1016/j.actao.2007.02.001.CrossRef Jimenez-valverde A, Lobo J: Threshold criteria for conversion of probability of species presence to either–or presence–absence. Acta Oecol. 2007, 31 (3): 361-369. 10.1016/j.actao.2007.02.001.CrossRef
28.
go back to reference Sakai S, Kobayashi K, Akazawa K, Kanda T, Mandai N, Toyabe SI: Comparison of the levels of accuracy of an artificial neural network model and a logistic regression model for the diagnosis of acute appendicitis. J Med Syst. 2007, 31 (5): 357-364. 10.1007/s10916-007-9077-9.CrossRefPubMed Sakai S, Kobayashi K, Akazawa K, Kanda T, Mandai N, Toyabe SI: Comparison of the levels of accuracy of an artificial neural network model and a logistic regression model for the diagnosis of acute appendicitis. J Med Syst. 2007, 31 (5): 357-364. 10.1007/s10916-007-9077-9.CrossRefPubMed
Metadata
Title
Hip fracture risk assessment: artificial neural network outperforms conditional logistic regression in an age- and sex-matched case control study
Authors
Wo-Jan Tseng
Li-Wei Hung
Jiann-Shing Shieh
Maysam F Abbod
Jinn Lin
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2013
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-14-207

Other articles of this Issue 1/2013

BMC Musculoskeletal Disorders 1/2013 Go to the issue