Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

Network or regression-based methods for disease discrimination: a comparison study

Authors: Xiaoshuai Zhang, Zhongshang Yuan, Jiadong Ji, Hongkai Li, Fuzhong Xue

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

In stark contrast to network-centric view for complex disease, regression-based methods are preferred in disease prediction, especially for epidemiologists and clinical professionals. It remains a controversy whether the network-based methods have advantageous performance than regression-based methods, and to what extent do they outperform.

Methods

Simulations under different scenarios (the input variables are independent or in network relationship) as well as an application were conducted to assess the prediction performance of four typical methods including Bayesian network, neural network, logistic regression and regression splines.

Results

The simulation results reveal that Bayesian network showed a better performance when the variables were in a network relationship or in a chain structure. For the special wheel network structure, logistic regression had a considerable performance compared to others. Further application on GWAS of leprosy show Bayesian network still outperforms other methods.

Conclusion

Although regression-based methods are still popular and widely used, network-based approaches should be paid more attention, since they capture the complex relationship between variables.
Appendix
Available only for authorised users
Literature
2.
go back to reference Nguyen-Nielsen M, Svensson E, Vogel I, Ehrenstein V, Sunde L. Existing data sources for clinical epidemiology: Danish registries for studies of medical genetic diseases. Clin Epidemiol. 2013;5:249.CrossRefPubMedPubMedCentral Nguyen-Nielsen M, Svensson E, Vogel I, Ehrenstein V, Sunde L. Existing data sources for clinical epidemiology: Danish registries for studies of medical genetic diseases. Clin Epidemiol. 2013;5:249.CrossRefPubMedPubMedCentral
3.
go back to reference St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Pankratz JJ, Brue SM, et al. Data resource profile: the Rochester Epidemiology Project (REP) medical records-linkage system. Int J Epidemiol. 2012;41(6):1614–24.CrossRefPubMedPubMedCentral St Sauver JL, Grossardt BR, Yawn BP, Melton LJ, Pankratz JJ, Brue SM, et al. Data resource profile: the Rochester Epidemiology Project (REP) medical records-linkage system. Int J Epidemiol. 2012;41(6):1614–24.CrossRefPubMedPubMedCentral
5.
go back to reference Tu JV. Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol. 1996;49(11):1225–31.CrossRefPubMed Tu JV. Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol. 1996;49(11):1225–31.CrossRefPubMed
6.
go back to reference Yonemori K, Tateishi U, Uno H, Yonemori Y, Tsuta K, Takeuchi M, et al. Development and validation of diagnostic prediction model for solitary pulmonary nodules. Respirology. 2007;12(6):856–62.CrossRefPubMed Yonemori K, Tateishi U, Uno H, Yonemori Y, Tsuta K, Takeuchi M, et al. Development and validation of diagnostic prediction model for solitary pulmonary nodules. Respirology. 2007;12(6):856–62.CrossRefPubMed
7.
go back to reference Hendriksen J, Geersing GJ, Moons K, Groot J. Diagnostic and prognostic prediction models. J Thromb Haemost. 2013;11(s1):129–41.CrossRefPubMed Hendriksen J, Geersing GJ, Moons K, Groot J. Diagnostic and prognostic prediction models. J Thromb Haemost. 2013;11(s1):129–41.CrossRefPubMed
8.
go back to reference Polit DF, Beck CT. Nursing research: Principles and methods. New York: Lippincott Williams & Wilkins; 2004. Polit DF, Beck CT. Nursing research: Principles and methods. New York: Lippincott Williams & Wilkins; 2004.
9.
go back to reference Bedogni G. Clinical Prediction Models—a Practical Approach to Development, Validation and Updating. J R Stat Soc A Stat Soc. 2009;172(4):944.CrossRef Bedogni G. Clinical Prediction Models—a Practical Approach to Development, Validation and Updating. J R Stat Soc A Stat Soc. 2009;172(4):944.CrossRef
12.
go back to reference Aloy P, Russell RB. Structural systems biology: modelling protein interactions. Nat Rev Mol Cell Bio. 2006;7(3):188–97.CrossRef Aloy P, Russell RB. Structural systems biology: modelling protein interactions. Nat Rev Mol Cell Bio. 2006;7(3):188–97.CrossRef
13.
go back to reference Visser H, le Cessie S, Vos K, Breedveld FC, Hazes JM. How to diagnose rheumatoid arthritis early: a prediction model for persistent (erosive) arthritis. Arthritis Rheum. 2002;46(2):357–65.CrossRefPubMed Visser H, le Cessie S, Vos K, Breedveld FC, Hazes JM. How to diagnose rheumatoid arthritis early: a prediction model for persistent (erosive) arthritis. Arthritis Rheum. 2002;46(2):357–65.CrossRefPubMed
14.
go back to reference Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology. 2010;21(1):128.CrossRefPubMedPubMedCentral Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology. 2010;21(1):128.CrossRefPubMedPubMedCentral
15.
go back to reference Guthrie W, Swineford LB, Nottke C, Wetherby AM. Early diagnosis of autism spectrum disorder: stability and change in clinical diagnosis and symptom presentation. J Child Psychol Psychiatry. 2013;54(5):582–90.CrossRefPubMedPubMedCentral Guthrie W, Swineford LB, Nottke C, Wetherby AM. Early diagnosis of autism spectrum disorder: stability and change in clinical diagnosis and symptom presentation. J Child Psychol Psychiatry. 2013;54(5):582–90.CrossRefPubMedPubMedCentral
16.
go back to reference Lee S, Abbott P, Johantgen M. Logistic regression and Bayesian networks to study outcomes using large data sets. Nurs Res. 2005;54(2):133–8.CrossRefPubMed Lee S, Abbott P, Johantgen M. Logistic regression and Bayesian networks to study outcomes using large data sets. Nurs Res. 2005;54(2):133–8.CrossRefPubMed
17.
go back to reference Hosmer Jr DW, Lemeshow S. Applied logistic regression. New York: John Wiley & Sons; 2004. Hosmer Jr DW, Lemeshow S. Applied logistic regression. New York: John Wiley & Sons; 2004.
18.
go back to reference Harrell Jr FE, Lee KL, Matchar DB, Reichert TA. Regression models for prognostic prediction: advantages, problems, and suggested solutions. Cancer Treat Rep. 1985;69(10):1071–7.PubMed Harrell Jr FE, Lee KL, Matchar DB, Reichert TA. Regression models for prognostic prediction: advantages, problems, and suggested solutions. Cancer Treat Rep. 1985;69(10):1071–7.PubMed
19.
go back to reference Khan J, Wei JS, Ringner M, Saal LH, Ladanyi M, Westermann F, et al. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat Med. 2001;7(6):673–9.CrossRefPubMedPubMedCentral Khan J, Wei JS, Ringner M, Saal LH, Ladanyi M, Westermann F, et al. Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks. Nat Med. 2001;7(6):673–9.CrossRefPubMedPubMedCentral
20.
go back to reference Briggs F, Ramsay PP, Madden E, Norris JM, Holers VM, Mikuls TR, et al. Supervised machine learning and logistic regression identifies novel epistatic risk factors with PTPN22 for rheumatoid arthritis. Genes Immun. 2010;11(3):199–208.CrossRefPubMedPubMedCentral Briggs F, Ramsay PP, Madden E, Norris JM, Holers VM, Mikuls TR, et al. Supervised machine learning and logistic regression identifies novel epistatic risk factors with PTPN22 for rheumatoid arthritis. Genes Immun. 2010;11(3):199–208.CrossRefPubMedPubMedCentral
21.
go back to reference Dybowski R, Gant V, Weller P, Chang R. Prediction of outcome in critically ill patients using artificial neural network synthesised by genetic algorithm. Lancet. 1996;347(9009):1146–50.CrossRefPubMed Dybowski R, Gant V, Weller P, Chang R. Prediction of outcome in critically ill patients using artificial neural network synthesised by genetic algorithm. Lancet. 1996;347(9009):1146–50.CrossRefPubMed
22.
go back to reference Dreiseitl S, Ohno-Machado L. Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002;35(5):352–9.CrossRefPubMed Dreiseitl S, Ohno-Machado L. Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002;35(5):352–9.CrossRefPubMed
23.
go back to reference Hastie T, Tibshirani R, Friedman J, Franklin J. The elements of statistical learning: data mining, inference and prediction. Math Intell. 2005;27(2):83–5. Hastie T, Tibshirani R, Friedman J, Franklin J. The elements of statistical learning: data mining, inference and prediction. Math Intell. 2005;27(2):83–5.
24.
go back to reference Nielsen TD, Jensen FV. Bayesian networks and decision graphs. New York: Springer; 2009. Nielsen TD, Jensen FV. Bayesian networks and decision graphs. New York: Springer; 2009.
25.
go back to reference Heckerman D. Bayesian networks for data mining. Data Min Knowl Disc. 1997;1(1):79–119.CrossRef Heckerman D. Bayesian networks for data mining. Data Min Knowl Disc. 1997;1(1):79–119.CrossRef
26.
go back to reference Uusitalo L. Advantages and challenges of Bayesian networks in environmental modelling. Ecol Model. 2007;203(3):312–8.CrossRef Uusitalo L. Advantages and challenges of Bayesian networks in environmental modelling. Ecol Model. 2007;203(3):312–8.CrossRef
27.
go back to reference Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn. 1997;30(7):1145–59.CrossRef Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn. 1997;30(7):1145–59.CrossRef
28.
go back to reference Faber NM, Rajko R. How to avoid over-fitting in multivariate calibration—The conventional validation approach and an alternative. Anal Chim Acta. 2007;595(1):98–106.CrossRefPubMed Faber NM, Rajko R. How to avoid over-fitting in multivariate calibration—The conventional validation approach and an alternative. Anal Chim Acta. 2007;595(1):98–106.CrossRefPubMed
29.
go back to reference Scheines R, Spirtes P, Glymour C, Meek C, Richardson T. The TETRAD project: Constraint based aids to causal model specification. Multivar Behav Res. 1998;33(1):65–117.CrossRef Scheines R, Spirtes P, Glymour C, Meek C, Richardson T. The TETRAD project: Constraint based aids to causal model specification. Multivar Behav Res. 1998;33(1):65–117.CrossRef
30.
go back to reference Zhang F, Huang W, Chen S, Sun L, Liu H, Li Y, et al. Genomewide association study of leprosy. New Engl J Med. 2009;361(27):2609–18.CrossRefPubMed Zhang F, Huang W, Chen S, Sun L, Liu H, Li Y, et al. Genomewide association study of leprosy. New Engl J Med. 2009;361(27):2609–18.CrossRefPubMed
31.
go back to reference Jensen F, Kjærulff U, Lang M, et al. HUGIN - The Tool for Bayesian Networks and Influence Diagrams. European Workshop on Probabilistic Graphical MODELS. 2002. Jensen F, Kjærulff U, Lang M, et al. HUGIN - The Tool for Bayesian Networks and Influence Diagrams. European Workshop on Probabilistic Graphical MODELS. 2002.
32.
go back to reference Roos T, Wettig H, Grünwald P, Myllymäki P, Tirri H. On discriminative Bayesian network classifiers and logistic regression. Mach Learn. 2005;59(3):267–96. Roos T, Wettig H, Grünwald P, Myllymäki P, Tirri H. On discriminative Bayesian network classifiers and logistic regression. Mach Learn. 2005;59(3):267–96.
Metadata
Title
Network or regression-based methods for disease discrimination: a comparison study
Authors
Xiaoshuai Zhang
Zhongshang Yuan
Jiadong Ji
Hongkai Li
Fuzhong Xue
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0207-2

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue