Skip to main content
Top
Published in: Journal of Medical Systems 5/2012

01-10-2012 | Original Paper

A Computer Aided Diagnosis System for Thyroid Disease Using Extreme Learning Machine

Authors: Li-Na Li, Ji-Hong Ouyang, Hui-Ling Chen, Da-You Liu

Published in: Journal of Medical Systems | Issue 5/2012

Login to get access

Abstract

In this paper, we present an effective and efficient computer aided diagnosis (CAD) system based on principle component analysis (PCA) and extreme learning machine (ELM) to assist the task of thyroid disease diagnosis. The CAD system is comprised of three stages. Focusing on dimension reduction, the first stage applies PCA to construct the most discriminative new feature set. After then, the system switches to the second stage whose target is model construction. ELM classifier is explored to train an optimal predictive model whose parameters are optimized. As we known, the number of hidden neurons has an important role in the performance of ELM, so we propose an experimental method to hunt for the optimal value. Finally, the obtained optimal ELM model proceeds to perform the thyroid disease diagnosis tasks using the most discriminative new feature set and the optimal parameters. The effectiveness of the resultant CAD system (PCA-ELM) has been rigorously estimated on a thyroid disease dataset which is taken from UCI machine learning repository. We compare it with other related methods in terms of their classification accuracy. Experimental results demonstrate that PCA-ELM outperforms other ones reported so far by 10-fold cross-validation method, with the mean accuracy of 97.73% and with the maximum accuracy of 98.1%. Besides, PCA-ELM performs much faster than support vector machines (SVM) based CAD system. Consequently, the proposed method PCA-ELM can be considered as a new powerful tools for diagnosing thyroid disease with excellent performance and less time.
Literature
1.
go back to reference Ozyilmaz, L., and Yildirim T., Diagnosis of thyroid disease using artificial neural network methods. In Proceedings of ICONIP’02 nineth international conference on neural information processing, Orchid Country Club, Singapore, pp. 2033–2036, 2002. Ozyilmaz, L., and Yildirim T., Diagnosis of thyroid disease using artificial neural network methods. In Proceedings of ICONIP’02 nineth international conference on neural information processing, Orchid Country Club, Singapore, pp. 2033–2036, 2002.
2.
go back to reference Serpen, G., Jiang, H., and Allred, L., Performance analysis of probabilistic potential function neural network classifier. In Proceedings of artificial neural networks in engineering conference, St. Louis, MO, Vol. 7, pp. 471–476, 1997. Serpen, G., Jiang, H., and Allred, L., Performance analysis of probabilistic potential function neural network classifier. In Proceedings of artificial neural networks in engineering conference, St. Louis, MO, Vol. 7, pp. 471–476, 1997.
3.
go back to reference Pasi, L., Similarity classifier applied to medical data sets, in international conference on soft computing. Helsinki, Finland & Gulf of Finland & Tallinn, Estonia, 2004. Pasi, L., Similarity classifier applied to medical data sets, in international conference on soft computing. Helsinki, Finland & Gulf of Finland & Tallinn, Estonia, 2004.
4.
go back to reference Polat, K., Sahan, S., and Gunes, S., A novel hybrid method based on artificial immune recognition system (AIRS) with fuzzy weighted pre-processing for thyroid disease diagnosis. Expert Syst. Appl. 32(4):1141–1147, 2007.CrossRef Polat, K., Sahan, S., and Gunes, S., A novel hybrid method based on artificial immune recognition system (AIRS) with fuzzy weighted pre-processing for thyroid disease diagnosis. Expert Syst. Appl. 32(4):1141–1147, 2007.CrossRef
5.
go back to reference Keles, A., and Keles, A., ESTDD: expert system for thyroid diseases diagnosis. Expert Syst. Appl. 34(1):242–246, 2008.MathSciNetCrossRef Keles, A., and Keles, A., ESTDD: expert system for thyroid diseases diagnosis. Expert Syst. Appl. 34(1):242–246, 2008.MathSciNetCrossRef
6.
go back to reference Temurtas, F., A comparative study on thyroid disease diagnosis using neural networks. Expert Syst. Appl. 36(1):944–949, 2009.CrossRef Temurtas, F., A comparative study on thyroid disease diagnosis using neural networks. Expert Syst. Appl. 36(1):944–949, 2009.CrossRef
7.
go back to reference Dogantekin, E., Dogantekin, A., and Avci, D., An expert system based on generalized discriminant analysis and wavelet support vector machine for diagnosis of thyroid diseases. Expert Syst. Appl. 38(1):146–150, 2011.CrossRef Dogantekin, E., Dogantekin, A., and Avci, D., An expert system based on generalized discriminant analysis and wavelet support vector machine for diagnosis of thyroid diseases. Expert Syst. Appl. 38(1):146–150, 2011.CrossRef
9.
go back to reference Hsu, C. W., and Lin, C. J., A comparison of methods for multi-class support vector machines. Neural Networks, IEEE Transactions on. 13(2):415–425, 2002.CrossRef Hsu, C. W., and Lin, C. J., A comparison of methods for multi-class support vector machines. Neural Networks, IEEE Transactions on. 13(2):415–425, 2002.CrossRef
10.
go back to reference Huang, G. B., Zhu, Q. Y., and Siew, C. K., Extreme learning machine: a new learning scheme of feed forward neural networks. IEEE Int. Jt. Conf. Neural Netw. 2:985–990, 2004. Huang, G. B., Zhu, Q. Y., and Siew, C. K., Extreme learning machine: a new learning scheme of feed forward neural networks. IEEE Int. Jt. Conf. Neural Netw. 2:985–990, 2004.
11.
go back to reference Chen, F. L., and Ou, T. Y., Sales forecasting system based on gray extreme learning machine with taguchi method in retail industry. Expert Syst. Appl. 38(3):1336–1345, 2011.CrossRef Chen, F. L., and Ou, T. Y., Sales forecasting system based on gray extreme learning machine with taguchi method in retail industry. Expert Syst. Appl. 38(3):1336–1345, 2011.CrossRef
12.
go back to reference Liu, N., Lin, Z., Koh, Z., Huang, G. B, Ser, W., Ong, M. E. H., Patient outcome prediction with heart rate variability and vital signs. J. Signal Proc. Syst. 1–14, 2010. Liu, N., Lin, Z., Koh, Z., Huang, G. B, Ser, W., Ong, M. E. H., Patient outcome prediction with heart rate variability and vital signs. J. Signal Proc. Syst. 1–14, 2010.
13.
go back to reference Han, F., et al., The forecast of the postoperative survival time of patients suffered from non-small cell lung cancer based on PCA and extreme learning machine. Int. J. Neural Syst. 16(1):39–46, 2006.CrossRef Han, F., et al., The forecast of the postoperative survival time of patients suffered from non-small cell lung cancer based on PCA and extreme learning machine. Int. J. Neural Syst. 16(1):39–46, 2006.CrossRef
14.
go back to reference Zhang, R., et al., Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Trans. Comput. Biol. Bioinforma. 4(3):485–494, 2007.CrossRef Zhang, R., et al., Multicategory classification using an extreme learning machine for microarray gene expression cancer diagnosis. IEEE/ACM Trans. Comput. Biol. Bioinforma. 4(3):485–494, 2007.CrossRef
15.
go back to reference Helmy, T., and Rasheed, Z., Multi-category bioinformatics dataset classification using extreme learning machine. in Evolutionary Computation, 2009. CEC '09. IEEE Congress on. 2009. Helmy, T., and Rasheed, Z., Multi-category bioinformatics dataset classification using extreme learning machine. in Evolutionary Computation, 2009. CEC '09. IEEE Congress on. 2009.
16.
go back to reference Gomathi, M., and Thangaraj, P., A computer aided diagnosis system for lung cancer detection using machine learning technique. Eur. J. Sci. Res. 51(2):260–275, 2011. Gomathi, M., and Thangaraj, P., A computer aided diagnosis system for lung cancer detection using machine learning technique. Eur. J. Sci. Res. 51(2):260–275, 2011.
17.
go back to reference Chen, H. L., Liu, D. Y., Yang, B., Liu, J., and Wang, G., A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Syst. Appl. 38(9):11796–11803, 2011.CrossRef Chen, H. L., Liu, D. Y., Yang, B., Liu, J., and Wang, G., A new hybrid method based on local fisher discriminant analysis and support vector machines for hepatitis disease diagnosis. Expert Syst. Appl. 38(9):11796–11803, 2011.CrossRef
18.
go back to reference Chen, H. L., Yang, B., Liu, J., and Liu, D. Y., A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis. Expert Syst. Appl. 38(7):9014–9022, 2011.CrossRef Chen, H. L., Yang, B., Liu, J., and Liu, D. Y., A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis. Expert Syst. Appl. 38(7):9014–9022, 2011.CrossRef
19.
go back to reference Polat, K., and Gunes, S., Computer aided medical diagnosis system based on principal component analysis and artificial immune recognition system classifier algorithm. Expert Syst. Appl. 34(1):773–779, 2008.MathSciNetCrossRef Polat, K., and Gunes, S., Computer aided medical diagnosis system based on principal component analysis and artificial immune recognition system classifier algorithm. Expert Syst. Appl. 34(1):773–779, 2008.MathSciNetCrossRef
20.
go back to reference Polat, K., and Gunes, S., An expert system approach based on principal component analysis and adaptive neuro-fuzzy inference system to diagnosis of diabetes disease. Digit. Signal Proc. 17(4):702–710, 2007.CrossRef Polat, K., and Gunes, S., An expert system approach based on principal component analysis and adaptive neuro-fuzzy inference system to diagnosis of diabetes disease. Digit. Signal Proc. 17(4):702–710, 2007.CrossRef
21.
go back to reference Pearson, K., On lines and planes of closest fit to systems of points in space. Philos. Mag. 2(6):559–572, 1901. Pearson, K., On lines and planes of closest fit to systems of points in space. Philos. Mag. 2(6):559–572, 1901.
22.
go back to reference Huang, G.-B., Zhu, Q. Y., and Siew, C.-K., Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501, 2006.CrossRef Huang, G.-B., Zhu, Q. Y., and Siew, C.-K., Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501, 2006.CrossRef
23.
go back to reference Huang, G. B., and Babri, H. A., Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. Neural Netw., IEEE Trans. on. 9(1):224–229, 1998.CrossRef Huang, G. B., and Babri, H. A., Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions. Neural Netw., IEEE Trans. on. 9(1):224–229, 1998.CrossRef
24.
go back to reference Huang, G. B., Learning capability and storage capacity of two-hidden-layer feedforward networks. Neural Netw., IEEE Trans. on. 14(2):274–281, 2003.CrossRef Huang, G. B., Learning capability and storage capacity of two-hidden-layer feedforward networks. Neural Netw., IEEE Trans. on. 14(2):274–281, 2003.CrossRef
25.
go back to reference Huang, G. B., Chen, L., and Siew, C. K., Universal approximation using incremental constructive feedforward networks with random hidden nodes. Neural Netw., IEEE Trans. on. 17(4):879–892, 2006.CrossRef Huang, G. B., Chen, L., and Siew, C. K., Universal approximation using incremental constructive feedforward networks with random hidden nodes. Neural Netw., IEEE Trans. on. 17(4):879–892, 2006.CrossRef
26.
go back to reference Salzberg, S. L., On comparing classifiers: pitfalls to avoid and a recommended approach. Data mining. Knowl. Discov. 1(3):317–328, 1997.CrossRef Salzberg, S. L., On comparing classifiers: pitfalls to avoid and a recommended approach. Data mining. Knowl. Discov. 1(3):317–328, 1997.CrossRef
27.
go back to reference Ron, K., A study of cross-validation and bootstrap for accuracy estimation and model selection, in Proceedings of the 14th international joint conference on Artificial intelligence—Vol2, 1995. Ron, K., A study of cross-validation and bootstrap for accuracy estimation and model selection, in Proceedings of the 14th international joint conference on Artificial intelligence—Vol2, 1995.
Metadata
Title
A Computer Aided Diagnosis System for Thyroid Disease Using Extreme Learning Machine
Authors
Li-Na Li
Ji-Hong Ouyang
Hui-Ling Chen
Da-You Liu
Publication date
01-10-2012
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 5/2012
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-012-9825-3

Other articles of this Issue 5/2012

Journal of Medical Systems 5/2012 Go to the issue