Skip to main content
Top

Open Access 07-03-2025 | Osteoporosis | Original Article

Ensemble-learning approach improves fracture prediction using genomic and phenotypic data

Authors: Qing Wu, Jongyun Jung

Published in: Osteoporosis International

Login to get access

Abstract

Summary

This study presents an innovative ensemble machine learning model integrating genomic and clinical data to enhance the prediction of major osteoporotic fractures in older men. The Super Learner (SL) model achieved superior performance (AUC = 0.76, accuracy = 95.6%, sensitivity = 94.5%, specificity = 96.1%) compared to individual models. Ensemble machine learning improves fracture prediction accuracy, demonstrating the potential for personalized osteoporosis management.

Purpose

Existing fracture risk models have limitations in their accuracy and in integrating genomic data. This study developed and validated an innovative ensemble machine learning (ML) model that combines multiple algorithms and integrates clinical, lifestyle, skeletal, and genomic data to enhance prediction for major osteoporotic fractures (MOF) in older men.

Methods

This study analyzed data from 5130 participants in the Osteoporotic Fractures in Men cohort Study. The model incorporated 1103 individual genome-wide significant variants and conventional risk factors of MOF. The participants were randomly divided into training (80%) and testing (20%) sets. Seven ML algorithms were combined using the SL ensemble method with tenfold cross-validation MOF prediction. Model performance was evaluated on the testing set using the area under the curve (AUC), the area under the precision-recall curve, calibration, accuracy, sensitivity, specificity, negative predictive value (NPV), positive predictive value (PPV), and reclassification metrics. SL model performances were evaluated by comparison with baseline models and subgroup analyses by race.

Results

The SL model demonstrated the best performance with an AUC of 0.76, accuracy of 95.6%, sensitivity of 94.5%, specificity of 96.1%, NPV of 95.1%, and PPV of 94.7%. Among the individual ML, gradient boosting performed optimally. The SL model outperformed baseline models, and it also achieved accuracies of 93.1% for Whites and 91.6% for Minorities, outperforming single ML in subgroup analysis.

Conclusion

The ensemble learning approach significantly improved fracture prediction accuracy and model performance compared to individual ML. Integrating genomic and phenotypic data via the SL approach represents a promising advancement for personalized osteoporosis management.
Appendix
Available only for authorised users
Literature
1.
go back to reference Nguyen ND, Ahlborg HG, Center JR, Eisman JA, Nguyen TV (2007) Residual lifetime risk of fractures in women and men. J Bone Miner Res 22:781–788CrossRefPubMed Nguyen ND, Ahlborg HG, Center JR, Eisman JA, Nguyen TV (2007) Residual lifetime risk of fractures in women and men. J Bone Miner Res 22:781–788CrossRefPubMed
2.
go back to reference Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E (2008) FRAX™ and the assessment of fracture probability in men and women from the UK. Osteoporos Int 19:385–397CrossRefPubMedPubMedCentral Kanis JA, Johnell O, Oden A, Johansson H, McCloskey E (2008) FRAX™ and the assessment of fracture probability in men and women from the UK. Osteoporos Int 19:385–397CrossRefPubMedPubMedCentral
3.
go back to reference Hippisley-Cox J, Coupland C (2009) Predicting risk of osteoporotic fracture in men and women in England and Wales: prospective derivation and validation of QFractureScores. The BMJ 339:b4229CrossRefPubMedPubMedCentral Hippisley-Cox J, Coupland C (2009) Predicting risk of osteoporotic fracture in men and women in England and Wales: prospective derivation and validation of QFractureScores. The BMJ 339:b4229CrossRefPubMedPubMedCentral
4.
go back to reference Nguyen ND, Frost SA, Center JR, Eisman JA, Nguyen TV (2008) Development of prognostic nomograms for individualizing 5-year and 10-year fracture risks. Osteoporos Int 19:1431–1444CrossRefPubMed Nguyen ND, Frost SA, Center JR, Eisman JA, Nguyen TV (2008) Development of prognostic nomograms for individualizing 5-year and 10-year fracture risks. Osteoporos Int 19:1431–1444CrossRefPubMed
5.
go back to reference Force UPST, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB et al (2018) Screening for osteoporosis to prevent fractures: US Preventive Services Task Force recommendation statement. JAMA 319:2521–2531CrossRef Force UPST, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB et al (2018) Screening for osteoporosis to prevent fractures: US Preventive Services Task Force recommendation statement. JAMA 319:2521–2531CrossRef
6.
go back to reference Trajanoska K, Morris JA, Oei L, Zheng HF, Evans DM, Kiel DP et al (2018) Assessment of the genetic and clinical determinants of fracture risk: genome wide association and Mendelian randomisation study. The BMJ 362:1–14 Trajanoska K, Morris JA, Oei L, Zheng HF, Evans DM, Kiel DP et al (2018) Assessment of the genetic and clinical determinants of fracture risk: genome wide association and Mendelian randomisation study. The BMJ 362:1–14
7.
go back to reference Holloway-Kew KL, Zhang Y, Betson AG, Anderson KB, Hans D, Hyde NK et al (2019) How well do the FRAX (Australia) and Garvan calculators predict incident fractures? Data from the Geelong Osteoporosis Study. Osteoporos Int 30:2129–2139CrossRefPubMed Holloway-Kew KL, Zhang Y, Betson AG, Anderson KB, Hans D, Hyde NK et al (2019) How well do the FRAX (Australia) and Garvan calculators predict incident fractures? Data from the Geelong Osteoporosis Study. Osteoporos Int 30:2129–2139CrossRefPubMed
11.
go back to reference Shim J-G, Kim DW, Ryu K-H, Cho E-A, Ahn J-H, Kim J-I et al (2020) Application of machine learning approaches for osteoporosis risk prediction in postmenopausal women. Arch Osteoporos 15:169CrossRefPubMed Shim J-G, Kim DW, Ryu K-H, Cho E-A, Ahn J-H, Kim J-I et al (2020) Application of machine learning approaches for osteoporosis risk prediction in postmenopausal women. Arch Osteoporos 15:169CrossRefPubMed
12.
go back to reference Inui A, Nishimoto H, Mifune Y, Yoshikawa T, Shinohara I, Furukawa T et al (2023) Screening for osteoporosis from blood test data in elderly women using a machine learning approach. Bioengineering 10:277CrossRefPubMedPubMedCentral Inui A, Nishimoto H, Mifune Y, Yoshikawa T, Shinohara I, Furukawa T et al (2023) Screening for osteoporosis from blood test data in elderly women using a machine learning approach. Bioengineering 10:277CrossRefPubMedPubMedCentral
13.
go back to reference Wu Q, Nasoz F, Jung J, Bhattarai B, Han MV (2020) Machine learning approaches for fracture risk assessment: a comparative analysis of genomic and phenotypic data in 5130 older men. Calcif Tissue Int 107:353–61 Wu Q, Nasoz F, Jung J, Bhattarai B, Han MV (2020) Machine learning approaches for fracture risk assessment: a comparative analysis of genomic and phenotypic data in 5130 older men. Calcif Tissue Int 107:353–61
14.
go back to reference Wu Q, Nasoz F, Jung J, Bhattarai B, Han MV, Greenes RA et al (2021) Machine learning approaches for the prediction bone mineral density by using genomic and phenotypic data of 5,130 older men. Sci Rep 11:4482 Wu Q, Nasoz F, Jung J, Bhattarai B, Han MV, Greenes RA et al (2021) Machine learning approaches for the prediction bone mineral density by using genomic and phenotypic data of 5,130 older men. Sci Rep 11:4482
15.
go back to reference Orwoll E, Blank JB, Barrett-Connor E, Cauley J, Cummings S, Ensrud K et al (2005) Design and baseline characteristics of the osteoporotic fractures in men (MrOS) study - a large observational study of the determinants of fracture in older men. Contemp Clin Trials 26:569–585CrossRefPubMed Orwoll E, Blank JB, Barrett-Connor E, Cauley J, Cummings S, Ensrud K et al (2005) Design and baseline characteristics of the osteoporotic fractures in men (MrOS) study - a large observational study of the determinants of fracture in older men. Contemp Clin Trials 26:569–585CrossRefPubMed
16.
go back to reference Blank JB, Cawthon PM, Carrion-Petersen ML, Harper L, Johnson JP, Mitson E et al (2005) Overview of recruitment for the osteoporotic fractures in men study (MrOS). Contemp Clin Trials 26:557–568CrossRefPubMed Blank JB, Cawthon PM, Carrion-Petersen ML, Harper L, Johnson JP, Mitson E et al (2005) Overview of recruitment for the osteoporotic fractures in men study (MrOS). Contemp Clin Trials 26:557–568CrossRefPubMed
17.
go back to reference Orwoll E, Blank JB, Barrett-Connor E, Cauley J, Cummings S, Ensrud K et al (2005) Design and baseline characteristics of the osteoporotic fractures in men (MrOS) study — a large observational study of the determinants of fracture in older men. Contemp Clin Trials 26:569–585CrossRefPubMed Orwoll E, Blank JB, Barrett-Connor E, Cauley J, Cummings S, Ensrud K et al (2005) Design and baseline characteristics of the osteoporotic fractures in men (MrOS) study — a large observational study of the determinants of fracture in older men. Contemp Clin Trials 26:569–585CrossRefPubMed
18.
go back to reference Pincus T, Summey JA, Soraci JRSA, Wallston KA, Hummon NP (1983) Assessment of patient satisfaction in activities of daily living using a modified Stanford Health Assessment Questionnaire. Arthritis Rheum 26:1346–1353CrossRefPubMed Pincus T, Summey JA, Soraci JRSA, Wallston KA, Hummon NP (1983) Assessment of patient satisfaction in activities of daily living using a modified Stanford Health Assessment Questionnaire. Arthritis Rheum 26:1346–1353CrossRefPubMed
19.
go back to reference Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MAR, Bender D et al (2007) PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet 81:559–575CrossRefPubMedPubMedCentral Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MAR, Bender D et al (2007) PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet 81:559–575CrossRefPubMedPubMedCentral
20.
go back to reference Das S, Forer L, Schönherr S, Sidore C, Locke AE, Kwong A et al (2016) Next-generation genotype imputation service and methods. Nat Genet 48:1284–1287CrossRefPubMedPubMedCentral Das S, Forer L, Schönherr S, Sidore C, Locke AE, Kwong A et al (2016) Next-generation genotype imputation service and methods. Nat Genet 48:1284–1287CrossRefPubMedPubMedCentral
21.
go back to reference Loh PR, Danecek P, Palamara PF, Fuchsberger C, Reshef YA, Finucane HK et al (2016) Reference-based phasing using the Haplotype Reference Consortium panel. Nat Genet 48:1443–1448CrossRefPubMedPubMedCentral Loh PR, Danecek P, Palamara PF, Fuchsberger C, Reshef YA, Finucane HK et al (2016) Reference-based phasing using the Haplotype Reference Consortium panel. Nat Genet 48:1443–1448CrossRefPubMedPubMedCentral
22.
23.
go back to reference Morris JA, Kemp JP, Youlten SE, Laurent L, Logan JG, Chai RC et al (2019) An atlas of genetic influences on osteoporosis in humans and mice. Nat Genet 51:258–266CrossRefPubMed Morris JA, Kemp JP, Youlten SE, Laurent L, Logan JG, Chai RC et al (2019) An atlas of genetic influences on osteoporosis in humans and mice. Nat Genet 51:258–266CrossRefPubMed
24.
go back to reference Weir BS, Anderson AD, Hepler AB (2006) Genetic relatedness analysis: modern data and new challenges. Nat Rev Genet 710(7):771–80CrossRef Weir BS, Anderson AD, Hepler AB (2006) Genetic relatedness analysis: modern data and new challenges. Nat Rev Genet 710(7):771–80CrossRef
26.
go back to reference Truong VQ, Woerner JA, Cherlin TA, Bradford Y, Lucas AM, Okeh CC et al (2022) Quality control procedures for genome-wide association studies. Curr Protoc 2:e603CrossRefPubMed Truong VQ, Woerner JA, Cherlin TA, Bradford Y, Lucas AM, Okeh CC et al (2022) Quality control procedures for genome-wide association studies. Curr Protoc 2:e603CrossRefPubMed
28.
go back to reference Murphy KP (2003) Naive Bayes classifiers. Univ Br Columbia 18:1–8 Murphy KP (2003) Naive Bayes classifiers. Univ Br Columbia 18:1–8
29.
go back to reference Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29:1189–1232CrossRef Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29:1189–1232CrossRef
31.
32.
go back to reference MJ V der L, EC P, AE H (2007) Super Learner. Stat Appl Genet Mol Biol 6:1–23 MJ V der L, EC P, AE H (2007) Super Learner. Stat Appl Genet Mol Biol 6:1–23
33.
go back to reference Acuña E, Rodriguez C (2004) The treatment of missing values and its effect on classifier accuracy. In: Banks D, McMorris FR, Arabie P, Gaul W (eds) Classif Clust Data Min Appl. Springer, Berlin, Heidelberg, pp 639–647 Acuña E, Rodriguez C (2004) The treatment of missing values and its effect on classifier accuracy. In: Banks D, McMorris FR, Arabie P, Gaul W (eds) Classif Clust Data Min Appl. Springer, Berlin, Heidelberg, pp 639–647
34.
go back to reference Melton LJ III, Atkinson EJ, O’Fallon WM, Wahner HW, Riggs BL (1993) Long-term fracture prediction by bone mineral assessed at different skeletal sites. J Bone Miner Res 8:1227–1233CrossRefPubMed Melton LJ III, Atkinson EJ, O’Fallon WM, Wahner HW, Riggs BL (1993) Long-term fracture prediction by bone mineral assessed at different skeletal sites. J Bone Miner Res 8:1227–1233CrossRefPubMed
35.
go back to reference Kanis JA, Borgstrom F, De Laet C, Johansson H, Johnell O, Jonsson B et al (2005) Assessment of fracture risk. Osteoporos Int 16:581–589CrossRefPubMed Kanis JA, Borgstrom F, De Laet C, Johansson H, Johnell O, Jonsson B et al (2005) Assessment of fracture risk. Osteoporos Int 16:581–589CrossRefPubMed
36.
go back to reference Stone KL, Seeley DG, Lui L-Y, Cauley JA, Ensrud K, Browner WS et al (2003) BMD at multiple sites and risk of fracture of multiple types: long-term results from the Study of Osteoporotic Fractures. J Bone Miner Res 18:1947–1954CrossRefPubMed Stone KL, Seeley DG, Lui L-Y, Cauley JA, Ensrud K, Browner WS et al (2003) BMD at multiple sites and risk of fracture of multiple types: long-term results from the Study of Osteoporotic Fractures. J Bone Miner Res 18:1947–1954CrossRefPubMed
37.
go back to reference Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357CrossRef Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP (2002) SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16:321–357CrossRef
38.
go back to reference Raschka S (2018) Model evaluation, model selection, and algorithm selection in machine learning. arXiv preprint arXiv:1811.12808 Raschka S (2018) Model evaluation, model selection, and algorithm selection in machine learning. arXiv preprint arXiv:1811.12808
39.
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–30 Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–30
40.
go back to reference Ettinger B, Ensrud KE, Blackwell T, Curtis JR, Lapidus JA, Orwoll ES (2013) Performance of FRAX in a cohort of community-dwelling, ambulatory older men: the Osteoporotic Fractures in Men (MrOS) study. Osteoporos Int 24:1185–1193CrossRefPubMed Ettinger B, Ensrud KE, Blackwell T, Curtis JR, Lapidus JA, Orwoll ES (2013) Performance of FRAX in a cohort of community-dwelling, ambulatory older men: the Osteoporotic Fractures in Men (MrOS) study. Osteoporos Int 24:1185–1193CrossRefPubMed
41.
go back to reference Harvey NC, Odén A, Orwoll E, Lapidus J, Kwok T, Karlsson MK et al (2018) Falls predict fractures independently of FRAX probability: a meta-analysis of the Osteoporotic Fractures in Men (MrOS) study. J Bone Miner Res 33:510–516CrossRefPubMed Harvey NC, Odén A, Orwoll E, Lapidus J, Kwok T, Karlsson MK et al (2018) Falls predict fractures independently of FRAX probability: a meta-analysis of the Osteoporotic Fractures in Men (MrOS) study. J Bone Miner Res 33:510–516CrossRefPubMed
43.
go back to reference Ju C, Combs M, Lendle SD, Franklin JM, Wyss R, Schneeweiss S et al (2019) Propensity score prediction for electronic healthcare databases using super learner and high-dimensional propensity score methods. J Appl Stat 46:2216–2236CrossRefPubMed Ju C, Combs M, Lendle SD, Franklin JM, Wyss R, Schneeweiss S et al (2019) Propensity score prediction for electronic healthcare databases using super learner and high-dimensional propensity score methods. J Appl Stat 46:2216–2236CrossRefPubMed
44.
go back to reference Liu Q, Cui X, Chou YC, Abbod MF, Lin J, Shieh JS (2015) Ensemble artificial neural networks applied to predict the key risk factors of hip bone fracture for elders. Biomed Signal Process Control 21:146–156CrossRef Liu Q, Cui X, Chou YC, Abbod MF, Lin J, Shieh JS (2015) Ensemble artificial neural networks applied to predict the key risk factors of hip bone fracture for elders. Biomed Signal Process Control 21:146–156CrossRef
45.
go back to reference Chou PH, Jou TH, Wu HH, Yao YC, Lin HH, Chang MC et al (2022) Ground truth generalizability affects performance of the artificial intelligence model in automated vertebral fracture detection on plain lateral radiographs of the spine. Spine J 22:511–523CrossRefPubMed Chou PH, Jou TH, Wu HH, Yao YC, Lin HH, Chang MC et al (2022) Ground truth generalizability affects performance of the artificial intelligence model in automated vertebral fracture detection on plain lateral radiographs of the spine. Spine J 22:511–523CrossRefPubMed
46.
go back to reference Li YC, Chen HH, Horng-Shing LuH, Hondar Wu HT, Chang MC, Chou PH (2021) Can a deep-learning model for the automated detection of vertebral fractures approach the performance level of human subspecialists? Clin Orthop Relat Res 479:1598–1612CrossRefPubMedPubMedCentral Li YC, Chen HH, Horng-Shing LuH, Hondar Wu HT, Chang MC, Chou PH (2021) Can a deep-learning model for the automated detection of vertebral fractures approach the performance level of human subspecialists? Clin Orthop Relat Res 479:1598–1612CrossRefPubMedPubMedCentral
Metadata
Title
Ensemble-learning approach improves fracture prediction using genomic and phenotypic data
Authors
Qing Wu
Jongyun Jung
Publication date
07-03-2025
Publisher
Springer London
Published in
Osteoporosis International
Print ISSN: 0937-941X
Electronic ISSN: 1433-2965
DOI
https://doi.org/10.1007/s00198-025-07437-w