Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Journal of Medical Systems
Published in: Journal of Medical Systems 11/2018

01-11-2018 | Systems-Level Quality Improvement

Systematic Review of an Automated Multiclass Detection and Classification System for Acute Leukaemia in Terms of Evaluation and Benchmarking, Open Challenges, Issues and Methodological Aspects

Authors: M. A. Alsalem, A. A. Zaidan, B. B. Zaidan, M. Hashim, O. S. Albahri, A. S. Albahri, Ali Hadi, K. I. Mohammed

Published in: Journal of Medical Systems | Issue 11/2018

Login to get access

Abstract

This study aims to systematically review prior research on the evaluation and benchmarking of automated acute leukaemia classification tasks. The review depends on three reliable search engines: ScienceDirect, Web of Science and IEEE Xplore. A research taxonomy developed for the review considers a wide perspective for automated detection and classification of acute leukaemia research and reflects the usage trends in the evaluation criteria in this field. The developed taxonomy consists of three main research directions in this domain. The taxonomy involves two phases. The first phase includes all three research directions. The second one demonstrates all the criteria used for evaluating acute leukaemia classification. The final set of studies includes 83 investigations, most of which focused on enhancing the accuracy and performance of detection and classification through proposed methods or systems. Few efforts were made to undertake the evaluation issues. According to the final set of articles, three groups of articles represented the main research directions in this domain: 56 articles highlighted the proposed methods, 22 articles involved proposals for system development and 5 papers centred on evaluation and comparison. The other taxonomy side included 16 main and sub-evaluation and benchmarking criteria. This review highlights three serious issues in the evaluation and benchmarking of multiclass classification of acute leukaemia, namely, conflicting criteria, evaluation criteria and criteria importance. It also determines the weakness of benchmarking tools. To solve these issues, multicriteria decision-making (MCDM) analysis techniques were proposed as effective recommended solutions in the methodological aspect. This methodological aspect involves a proposed decision support system based on MCDM for evaluation and benchmarking to select suitable multiclass classification models for acute leukaemia. The said support system is examined and has three sequential phases. Phase One presents the identification procedure and process for establishing a decision matrix based on a crossover of evaluation criteria and acute leukaemia multiclass classification models. Phase Two describes the decision matrix development for the selection of acute leukaemia classification models based on the integrated Best and worst method (BWM) and VIKOR. Phase Three entails the validation of the proposed system.

Literature
  1. De Paz, J. F. et al., Biomedic Organizations: An intelligent dynamic architecture for KDD. Inf. Sci. 224:49–61, 2013.
  2. Chen, X. and Jian, C. A tumor classification model using least square regression. In: 2014 10th International Conference on Natural Computation (ICNC). 2014.
  3. Deegalla, S. and Boström, H. Improving Fusion of Dimensionality Reduction Methods for Nearest Neighbor Classification. In: 2009 International Conference on Machine Learning and Applications. 2009.
  4. Alsalem, M. A. et al., A review of the automated detection and classification of acute leukaemia: Coherent taxonomy, datasets, validation and performance measurements, motivation, open challenges and recommendations. Comput. Methods Prog. Biomed. 158:93–112, 2018.
  5. Fann, Y. C., Enhancing patient care and outcomes through innovative informatics systems and tools. Comput. Methods Prog. Biomed. 158:A1, 2018.
  6. Torkaman, A., et al. A recommender system for detection of leukemia based on cooperative game. In: 2009 17th Mediterranean Conference on Control and Automation. 2009.
  7. Zhiyong, Y., Jingcheng, L., and Zhang, T., Extreme Large Margin Distribution Machine and its applications for biomedical datasets. In: 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2016.
  8. Al-Sahaf, H., Song, A., and Zhang, M., Hybridisation of Genetic Programming and Nearest Neighbour for classification. In: 2013 IEEE Congress on Evolutionary Computation. 2013.
  9. Escalante, H. J. et al., Acute leukemia classification by ensemble particle swarm model selection. Artif. Intell. Med. 55(3):163–175, 2012.PubMed
  10. Labati, R.D., et al., ALL-IDB: The acute lymphoblastic leukemia image database for image processing. In: 2011 18th Ieee International Conference on Image Processing. 2011.
  11. Singhal, V. and Singh, P. Local Binary Pattern for automatic detection of Acute Lymphoblastic Leukemia. In: 2014 Twentieth National Conference on Communications (NCC). 2014.
  12. Cornet, E., Perol, J. P., and Troussard, X., Performance evaluation and relevance of the CellaVision (TM) DM96 system in routine analysis and in patients with malignant hematological diseases. Int. J. Lab. Hematol. 30(6):536–542, 2008.PubMedPubMed Central
  13. Bhattacharjee, R. and Saini, L.M. Detection of Acute Lymphoblastic Leukemia using watershed transformation technique. In: 2015 International Conference on Signal Processing, Computing and Control (ISPCC). 2015.
  14. Laosai, J. and Chamnongthai, K., Acute leukemia classification by using SVM and K-Means clustering. In: 2014 International Electrical Engineering Congress (iEECON). 2014.
  15. Goutam, D. and Sailaja, S., Classification of acute myelogenous leukemia in blood microscopic images using supervised classifier. In: 2015 IEEE International Conference on Engineering and Technology (ICETECH). 2015.
  16. Agaian, S., Madhukar, M., and Chronopoulos, A. T., Automated Screening System for Acute Myelogenous Leukemia Detection in Blood Microscopic Images. IEEE Syst. J. 8(3):995–1004, 2014.
  17. Mohapatra, S., et al., Fuzzy Based Blood Image Segmentation for Automated Leukemia Detection>. In: 2011 International Conference on Devices and Communications (ICDeCom). 2011.
  18. Mohapatra, S., Patra, D., and Satpathi, S., Image analysis of blood microscopic images for acute leukemia detection. In: 2010 International Conference on Industrial Electronics, Control and Robotics. 2010.
  19. Srisukkham, W. et al., Intelligent leukaemia diagnosis with bare-bones PSO based feature optimization. Appl. Soft Comput. 56:405–419, 2017.
  20. Snousy, M. B. A. et al., Suite of decision tree-based classification algorithms on cancer gene expression data. Egypt. Informatics J. 12(2):73–82, 2011.
  21. Mishra, S. et al., Gray level co-occurrence matrix and random forest based acute lymphoblastic leukemia detection. Biomed. Signal Process. Control. 33:272–280, 2017.
  22. Nguyen, T., and Nahavandi, S., Modified AHP for Gene Selection and Cancer Classification Using Type-2 Fuzzy Logic. IEEE Trans. Fuzzy Syst. 24(2):273–287, 2016.
  23. Lei, X., and Chen, Y., Multiclass Classification of Microarray Data Samples with Flexible Neural Tree. In: 2012 Spring Congress on Engineering and Technology. 2012.
  24. Soares, C., et al., Automating Microarray Classification Using General Regression Neural Networks. In: 2008 Seventh International Conference on Machine Learning and Applications. 2008.
  25. Wang, H.-Q. et al., A neural network-based biomarker association information extraction approach for cancer classification. J. Biomed. Inform. 42(4):654–666, 2009.PubMed
  26. Wang, X., and Wang, S., Enhanced algorithm for high-dimensional data classification. Appl. Soft Comput. 40:1–9, 2016.
  27. Huang, H.L., et al., Boosting Evolutionary Support Vector Machine for Designing Tumor Classifiers from Microarray Data. In: 2007 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology. 2007.
  28. Kumar, M., and Kumar Rath, S., Classification of microarray using MapReduce based proximal support vector machine classifier. Knowl.-Based Syst. 89:584–602, 2015.
  29. Nasir, A. S. A., Mashor, M. Y., and Hassan, R., Leukaemia screening based on fuzzy ARTMAP and simplified fuzzy ARTMAP neural networks. In: 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences. 2012.
  30. Qasem, M., and Nour, M., Improving Accuracy for Classifying Selected Medical Datasets with Weighted Nearest Neighbors and Fuzzy Nearest Neighbors Algorithms. In: 2015 International Conference on Cloud Computing (ICCC). 2015.
  31. Ludwig, S. A., Jakobovic, D., and Picek, S., Analyzing gene expression data: Fuzzy decision tree algorithm applied to the classification of cancer data. In: 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 2015.
  32. Supardi, N. Z., et al., Classification of blasts in acute leukemia blood samples using k-nearest neighbour. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications. 2012.
  33. Campos, L. M. d., et al., Bayesian networks classifiers for gene-expression data. In: 2011 11th International Conference on Intelligent Systems Design and Applications. 2011.
  34. Chunbao, Z., Liming, W., and Yanchun, L., A hybrid algorithm of minimum spanning tree and nearest neighbor for classifying human cancers. In: 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE). 2010.
  35. Wang, S.-L. et al., Tumor classification by combining PNN classifier ensemble with neighborhood rough set based gene reduction. Comput. Biol. Med. 40(2):179–189, 2010.PubMed
  36. Fan, Y., Hua-Zhen, W., and Hong, M., A novel classification method of microarray with reliability and confidence. In: 2008 International Conference on Machine Learning and Cybernetics. 2008.
  37. El-Nasser, A. A., Shaheen, M., and El-Deeb, H., Enhanced leukemia cancer classifier algorithm. In: 2014 Science and Information Conference. 2014.
  38. Ren, C. -X., Dai, D. -Q., and Yan, H., Robust classification using L 2,1 norm based regression model. Pattern Recogn. 45(7):2708–2718, 2012.
  39. Kim, S., Spectral Methods for Cancer Classification Using Microarray Data. In: 2009 International Joint Conference on Computational Sciences and Optimization. 2009.
  40. Salem, H., Attiya, G., and El-Fishawy, N., Gene expression profiles based Human cancer diseases classification. In: 2015 11th International Computer Engineering Conference (ICENCO). 2015.
  41. Lu, H. et al., A cost-sensitive rotation forest algorithm for gene expression data classification. Neurocomputing. 228:270–276, 2017.
  42. Zhang, L. et al., Similarity-balanced discriminant neighbor embedding and its application to cancer classification based on gene expression data. Comput. Biol. Med. 64:236–245, 2015.PubMed
  43. Chandra, B., and Gupta, M., Robust approach for estimating probabilities in Naïve–Bayes Classifier for gene expression data. Expert Syst. Appl. 38(3):1293–1298, 2011.
  44. Saengsiri, P., et al., Classification models based-on incremental learning algorithm and feature selection on gene expression data. In: The 8th Electrical Engineering/ Electronics, Computer, Telecommunications and Information Technology (ECTI) Association of Thailand - Conference 2011. 2011.
  45. Wang, H. -Q. et al., Extracting gene regulation information for cancer classification. Pattern Recogn. 40(12):3379–3392, 2007.
  46. Rajwa, B. et al., Automated Assessment of Disease Progression in Acute Myeloid Leukemia by Probabilistic Analysis of Flow Cytometry Data. IEEE Trans. Biomed. Eng. 64(5):1089–1098, 2017.PubMed
  47. He, Y., and Hui, S. C., Exploring ant-based algorithms for gene expression data analysis. Artif. Intell. Med. 47(2):105–119, 2009.PubMed
  48. Li, J. -T., and Jia, Y. -M., An Improved Elastic Net for Cancer Classification and Gene Selection. Acta Automat. Sin. 36(7):976–981, 2010.
  49. Krappe, S., et al., Automated morphological analysis of bone marrow cells in microscopic images for diagnosis of leukemia: Nucleus-plasma separation and cell classification using a hierarchical tree model of hematopoesis. In: Tourassi, G. D., and Armato, S. G., (Eds.), Medical Imaging 2016: Computer-Aided Diagnosis. 2015.
  50. Mohapatra, P., Chakravarty, S., and Dash, P. K., Microarray medical data classification using kernel ridge regression and modified cat swarm optimization based gene selection system. Swarm Evol. Comput. 28:144–160, 2016.
  51. Chakraborty, S., Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach. Comput. Stat. Data Anal. 53(4):1462–1474, 2009.
  52. Yongqiang, D., et al., Feature selection of high-dimensional biomedical data using improved SFLA for disease diagnosis. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2015.
  53. Tran, V. N., et al., An automated method for the nuclei and cytoplasm of Acute Myeloid Leukemia detection in blood smear images. In: 2016 World Automation Congress (WAC). 2016.
  54. Cui, Y. et al., Sparse maximum margin discriminant analysis for feature extraction and gene selection on gene expression data. Comput. Biol. Med. 43(7):933–941, 2013.PubMed
  55. Rashid, S., and Maruf, G. M., An adaptive feature reduction algorithm for cancer classification using wavelet decomposition of serum proteomic and DNA microarray data. In: 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW). 2011.
  56. Hasan, A., and Akhtaruzzaman, A. Md., High dimensional microarray data classification using correlation based feature selection. In: 2012 International Conference on Biomedical Engineering (ICoBE). 2012.
  57. Cao, J. et al., A fast gene selection method for multi-cancer classification using multiple support vector data description. J. Biomed. Inform. 53:381–389, 2015.PubMed
  58. Zhang, L., and Xiaojuan, H., Multiple SVM-RFE for multi-class gene selection on DNA Microarray data. In: 2015 International Joint Conference on Neural Networks (IJCNN). 2015.
  59. Paul, S., and Maji, P., Rough set based gene selection algorithm for microarray sample classification. In: 2010 International Conference on Methods and Models in Computer Science (ICM2CS-2010). 2010.
  60. Mohapatra, P., and Chakravarty, S., Modified PSO based feature selection for Microarray data classification. In: 2015 IEEE Power, Communication and Information Technology Conference (PCITC). 2015.
  61. Shi, T. W., et al., Random Forest and Gene Ontology for functional analysis of microarray data. In: 2014 IEEE 7th International Workshop on Computational Intelligence and Applications (IWCIA). 2014.
  62. Dash, S., Hill-climber based fuzzy-rough feature extraction with an application to cancer classification. In: 13th International Conference on Hybrid Intelligent Systems (HIS 2013). 2013.
  63. Yusen, Z., and Liangyun, R., Two feature selections for analysis of microarray data. In: 2010 IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA). 2010.
  64. Lu, X., et al., A novel feature selection method based on CFS in cancer recognition. In: 2012 IEEE 6th International Conference on Systems Biology (ISB). 2012.
  65. Rosa, J. L. D., et al., Cluster center genes as candidate biomarkers for the classification of Leukemia. In: IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications. 2014.
  66. Chiang, J. H., and Ho, S. H., A Combination of Rough-Based Feature Selection and RBF Neural Network for Classification Using Gene Expression Data. IEEE Trans. NanoBiosci. 7(1):91–99, 2008.
  67. Pisharady, P. K., Vadakkepat, P., and Poh, L. A., Fuzzy-rough discriminative feature selection and classification algorithm, with application to microarray and image datasets. Appl. Soft Comput. 11(4):3429–3440, 2011.
  68. Qizhong, Z., Gene selection and classification using non-linear kernel support vector machines based on gene expression data. In: 2007 IEEE/ICME International Conference on Complex Medical Engineering. 2007.
  69. Garro, B. A., Rodríguez, K., and Vazquez, R. A., Designing artificial neural networks using differential evolution for classifying DNA microarrays. In: 2017 IEEE Congress on Evolutionary Computation (CEC). 2017.
  70. Begum, S., Chakraborty, D., and Sarkar, R., Data Classification Using Feature Selection and kNN Machine Learning Approach. In: 2015 International Conference on Computational Intelligence and Communication Networks (CICN). 2015.
  71. Chen, T. C., et al., Feature selection and classification by using grid computing based evolutionary approach for the microarray data. In: 2010 3rd International Conference on Computer Science and Information Technology. 2010.
  72. Roy, A., Mackin, P. D., and Mukhopadhyay, S., Methods for pattern selection, class-specific feature selection and classification for automated learning. Neural Netw. 41:113–129, 2013.PubMed
  73. Maulik, U., Mukhopadhyay, A., and Chakraborty, D., Gene-Expression-Based Cancer Subtypes Prediction Through Feature Selection and Transductive SVM. IEEE Trans. Biomed. Eng. 60(4):1111–1117, 2013.PubMed
  74. Madhloom, H. T., Kareem, S. A., and Ariffin, H., A Robust Feature Extraction and Selection Method for the Recognition of Lymphocytes versus Acute Lymphoblastic Leukemia. In: 2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT). 2012.
  75. Nazlibilek, S. et al., Automatic segmentation, counting, size determination and classification of white blood cells. Measurement. 55:58–65, 2014.
  76. Rawat, J. et al., Computer Aided Diagnostic System for Detection of Leukemia Using Microscopic Images. Procedia Computer Science. 70:748–756, 2015.
  77. Bhattacharjee, R., and Saini, L. M., Robust technique for the detection of Acute Lymphoblastic Leukemia. In: 2015 IEEE Power, Communication and Information Technology Conference (PCITC). 2015.
  78. Dehghan Khalilabad, N., and Hassanpour, H., Employing image processing techniques for cancer detection using microarray images. Comput. Biol. Med. 81:139–147, 2017.PubMed
  79. Putzu, L., Caocci, G., and Di Ruberto, C., Leucocyte classification for leukaemia detection using image processing techniques. Artif. Intell. Med. 62(3):179–191, 2014.PubMed
  80. Shankar, V., et al., Automatic detection of acute lymphoblasitc leukemia using image processing. In: 2016 IEEE International Conference on Advances in Computer Applications (ICACA). 2016.
  81. Horng, J. -T., et al., An expert system to classify microarray gene expression data using gene selection by decision tree. Expert Syst. Appl. 36(5):9072–9081, 2009.
  82. Wang, Z., and Palade, V., A Comprehensive Fuzzy-Based Framework for Cancer Microarray Data Gene Expression Analysis. In: 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering. 2007.
  83. Ganesh Kumar, P., et al., Design of fuzzy expert system for microarray data classification using a novel Genetic Swarm Algorithm. Expert Syst. Appl. 39(2):1811–1821, 2012.
  84. Krappe, S., et al., Automated classification of bone marrow cells in microscopic images for diagnosis of leukemia: A comparison of two classification schemes with respect to the segmentation quality. In: Hadjiiski, L. M., and Tourassi, G. D., (Eds.), Medical Imaging 2015: Computer-Aided Diagnosis. 2015.
  85. Rota, P., Groeneveld-Krentz, S., and Reiter, M., On automated Flow Cytometric analysis for MRD estimation of Acute Lymphoblastic Leukaemia: A comparison among different approaches. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2015.
  86. Hossin, M., and Sulaiman, M., A review on evaluation metrics for data classification evaluations. Int. J. Data Min. Knowl. Manag. Process. 5(2):1, 2015.
  87. Tai, W.L., et al., Blood Cell Image Classification Based on Hierarchical SVM. In: 2011 IEEE International Symposium on Multimedia. 2011.
  88. Gul, M., et al., A state of the art literature review of VIKOR and its fuzzy extensions on applications. Appl. Soft Comput. 46:60–89, 2016.
  89. Sokolova, M., and Lapalme, G., A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4):427–437, 2009.
  90. Saritha, M., et al., Detection of blood cancer in microscopic images of human blood samples: A review. In: 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). 2016.
  91. Zhang, C., et al., An imbalanced data classification algorithm of improved autoencoder neural network. In: 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI). 2016.
  92. Zupan, B., and Demsar, J., Open-source tools for data mining. Clin. Lab. Med. 28(1):37–54, 2008.PubMed
  93. Daqqa, K. A. S. A., Maghari, A. Y. A., and Sarraj, W. F. M. A., Prediction and diagnosis of leukemia using classification algorithms. In: 2017 8th International Conference on Information Technology (ICIT), 2017.
  94. Dwivedi, S., Kasliwal P., and Soni, S., Comprehensive study of data analytics tools (RapidMiner, Weka, R tool, Knime). In: 2016 Symposium on Colossal Data Analysis and Networking (CDAN). 2016.
  95. Sharma, R., Singh, S. N., and Khatri, S., Medical Data Mining Using Different Classification and Clustering Techniques: A Critical Survey. In: 2016 Second International Conference on Computational Intelligence & Communication Technology (CICT). 2016.
  96. Cadenas, J. M., Garrido, M. C., and Martínez, R., A tool to manage low quality datasets. In: 2012 IEEE International Conference on Fuzzy Systems, 2012.
  97. Wahbeh, A.H., et al., A comparison study between data mining tools over some classification methods. Int. J. Adv. Comput. Sci. Appl. 2011. Special Issue on Artificial Intelligence: p. 18–26.
  98. Rangra, K., and Bansal, D. K. L., Comparative Study of Data Mining Tools, International Journal of Advanced Research in Computer Science and Software Engineering. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 4(6), 2014.
  99. Yas, Q. M., et al., Comprehensive insights into evaluation and benchmarking of real-time skin detectors: Review, open issues & challenges, and recommended solutions. Measurement. 114:243–260, 2018.
  100. Rawat, J., et al., Review of leukocyte classification techniques for microscopic blood images. In: 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom). 2015.
  101. Bagasjvara, R. G., et al., Automated detection and classification techniques of Acute leukemia using image processing: A review. In: 2016 2nd International Conference on Science and Technology-Computer (ICST). 2016.
  102. Singh, G., Bathla, G., and Kaur, S., A review to detect leukemia cancer in medical images. In: 2016 International Conference on Computing, Communication and Automation (ICCCA). 2016.
  103. Wahhab, H. T. A., Classification of acute leukemia using image processing and machine learning techniques. PhD thesis, University of Malaya, 2015.
  104. Shafique, S., and Tehsin, S., Computer-Aided Diagnosis of Acute Lymphoblastic Leukaemia. Comput. Math. Methods Med. 2018.
  105. Jadhav, A., and Sonar, R., Analytic hierarchy process (AHP), weighted scoring method (WSM), and hybrid knowledge based system (HKBS) for software selection: A comparative study. In: 2009 Second International Conference on Emerging Trends in Engineering & Technology. IEEE, 2009.
  106. Keeney, R. L., and Raiffa, H., Decisions with multiple objectives: Preferences and value trade-offs. Cambridge University Press, 1993
  107. Belton, V., and Stewart, T., Multiple criteria decision analysis: An integrated approach. Kluwer Academic Publishers: Boston, 2002.
  108. Petrovic-Lazarevic, S., and Abraham, A., Hybrid fuzzy-linear programming approach for multi criteria decision making problems. arXiv preprint cs/0405019, 2004.
  109. Malczewski, J., GIS and multicriteria decision analysis. John Wiley & Sons: New York, 1999.
  110. Zionts, S., MCDM-If not a Roman Numeral, then what? Interfaces. 9(4):94–101, 1979.
  111. Baltussen, R., and Niessen, L., Priority setting of health interventions: The need for multi-criteria decision analysis. Cost Eff Resour Allocation. 4(1):1, 2006.
  112. Thokala, P., et al., Multiple Criteria Decision Analysis for Health Care Decision Making—An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. Value Health. 19(1):1–13, 2016.
  113. Oliveira, M., Fontes, D. B., and Pereira, T., Multicriteria decision making: A case study in the automobile industry. Ann. Manag. Sci. 3(1):109, 2014.
  114. Whaiduzzaman, M., et al., Cloud service selection using multicriteria decision analysis. Sci. World J., 2014.
  115. Hwang, C., and Yoon, K., Multiple Attribute Decision Making: Methods and Applications: A State-of-the-art Survey.Lecture Notes in Economics and Mathematical Systems. Springer, 1981.
  116. Aruldoss, M., Lakshmi, T. M., and Venkatesan, V. P., A survey on multi criteria decision making methods and its applications. Am. J. Inf. Syst. 1(1):31–43, 2013.
  117. Guo, S., and Zhao, H., Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl.-Based Syst. 121(Supplement C):23–31, 2017.
  118. Rezaei, J., Best-worst multi-criteria decision-making method. Omega. 53(Supplement C):49–57, 2015.
  119. Tavana, M., and Hatami-Marbini, A., A group AHP-TOPSIS framework for human spaceflight mission planning at NASA. Expert Syst. Appl. 38(11):13588–13603, 2011.
  120. Jumaah, F. M., Zaidan, A. A., Zaidan, B. B., Bahbibi, R., Qahtan, M. Y., and Sali, A., Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers. Telecommun. Syst. :1–19, 2017.
  121. Azeez, D. et al., Comparison of adaptive neuro-fuzzy inference system and artificial neutral networks model to categorize patients in the emergency department. SpringerPlus. 2(1):416, 2013.PubMedPubMed Central
  122. Ashour, O. M., and Okudan, G. E., Fuzzy AHP and utility theory based patient sorting in emergency departments. Int. J. Collab. Enterp. 1(3–4):332–358, 2010.
  123. Salman, O., et al., Novel methodology for triage and prioritizing using “big data” patients with chronic heart diseases through telemedicine environmental. Int. J. Inf. Technol. Decis. Mak. 16(05):1211–1245, 2017.
  124. Mills, A. F., A simple yet effective decision support policy for mass-casualty triage. Eur. J. Oper. Res. 253(3):734–745, 2016.
  125. Adunlin, G., Diaby, V., and Xiao, H., Application of multicriteria decision analysis in health care: A systematic review and bibliometric analysis. Health Expect. 18(6):1894–1905, 2015.PubMed
  126. Jumaah, F., et al., Decision-making solution based multi-measurement design parameter for optimization of GPS receiver tracking channels in static and dynamic real-time positioning multipath environment. Measurement. 2018.
  127. Zaidan, B. B., and Zaidan, A. A., Comparative Study on the Evaluation and Benchmarking Information Hiding Approaches Based Multi-Measurement Analysis Using TOPSIS Method with Different Normalisation, Separation and Context Techniques. Measurement. 117:277–294, 2017.
  128. Zaidan, B., et al., A new approach based on multi-dimensional evaluation and benchmarking for data hiding techniques. Int. J. Inf. Technol. Decis. Mak. :1–42, 2017.
  129. Zaidan, B., and Zaidan, A., Software and hardware FPGA-based digital watermarking and steganography approaches: Toward new methodology for evaluation and benchmarking using multi-criteria decision-making techniques. J. Circuits Syst. Comput. 26(07):1750116, 2017.
  130. Abdullateef, B. N., et al., An evaluation and selection problems of OSS-LMS packages. SpringerPlus. 5(1):248, 2016.PubMedPubMed Central
  131. Opricovic, S., and Tzeng, G. -H., Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. Eur. J. Oper. Res. 156(2):445–455, 2004.
  132. Zaidan, A., et al., Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS. J. Biomed. Inform. 53:390–404, 2015.PubMed
  133. Nilsson, H., Nordström, E. -M., and Öhman, K., Decision support for participatory forest planning using AHP and TOPSIS. Forests. 7(5):100, 2016.
  134. Singh, A., Major MCDM Techniques and their application-A Review. 4:15–25, 2014.
  135. Kornyshova, E., and Salinesi, C., MCDM Techniques Selection Approaches: State of the Art. In: 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making, 2007.
  136. Yas, Q. M., Zadain, A. A., Zaidan, B. B., Lakulu, M. B., and Rahmatullah, B., Towards on Develop a Framework for the Evaluation and Benchmarking of Skin Detectors Based on Artificial Intelligent Models Using Multi-Criteria Decision-Making Techniques. Int. J. Pattern Recognit. Artif. Intell. 31(3):1759002, 2017.
  137. Kaya, İ., Çolak, M., and Terzi, F., Use of MCDM techniques for energy policy and decision-making problems: A review. Int. J. Energy Res. 42(7):2344–2372, 2018.
  138. Tian, Z. -P., Wang, J. -Q., and Zhang, H. -Y., An integrated approach for failure mode and effects analysis based on fuzzy best-worst, relative entropy, and VIKOR methods. Appl. Soft Comput. 2018.
  139. Zaidan, A., et al., A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: Coherent taxonomy, open issues and recommendation pathway solution. Health Technol. :1–16, 2018.
  140. Opricovic, S., and Tzeng, G. -H., Extended VIKOR method in comparison with outranking methods. Eur. J. Oper. Res. 178(2):514–529, 2007.
  141. Wan Ahmad, W. N. K., et al., Evaluation of the external forces affecting the sustainability of oil and gas supply chain using Best Worst Method. J. Clean. Prod. 153:242–252, 2017.
  142. Gupta, H., and Barua, M. K., Supplier selection among SMEs on the basis of their green innovation ability using BWM and fuzzy TOPSIS. J. Clean. Prod. 152:242–258, 2017.
  143. Rezaei, J., Best-worst multi-criteria decision-making method. Omega. 53:49–57, 2015.
  144. Rezaei, J., Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega. 64(Supplement C):126–130, 2016.
  145. Zaidan, A. A., et al., Multi-criteria analysis for OS-EMR software selection problem: A comparative study. Decis. Support. Syst. 78(Supplement C):15–27, 2015.
  146. Zavadskas, E. K., et al., Multi-Attribute Decision-Making Model by Applying Grey Numbers. Informatica. 20(2):305–320, 2009.
  147. Medineckienė, M., and Bjork, F., Owner preferences regarding renovation measures - The demonstration of using multi-criteria decision making. 17:284–295, 2011.
  148. Zaidan, B. B., et al., A new digital watermarking evaluation and benchmarking methodology using an external group of evaluators and multi-criteria analysis based on ‘large-scale data’. Software: Practice and Experience. 47(10):1365–1392, 2017.
  149. Mahjouri, M., et al., Optimal selection of Iron and Steel wastewater treatment technology using integrated multi-criteria decision-making techniques and fuzzy logic. Process Saf. Environ. Prot. 107(Supplement C):54–68, 2017.
  150. Karahalios, H., The application of the AHP-TOPSIS for evaluating ballast water treatment systems by ship operators. Transp. Res. Part D: Transp. Environ. 52(Part A):172–184, 2017.
  151. Behzadian, M., et al., A state-of the-art survey of TOPSIS applications. Expert Syst. Appl. 39(17):13051–13069, 2012.
  152. Shih, H. -S., Shyur, H. -J., and Lee, E. S., An extension of TOPSIS for group decision making. Math. Comput. Model. 45(7):801–813, 2007.
  153. Kaur, S., Sehra, S. K., and Sehra, S. S., A framework for software quality model selection using TOPSIS. In: 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT). 2016.
  154. Sutadian, A. D., et al., Using the Analytic Hierarchy Process to identify parameter weights for developing a water quality index. Ecol. Indic. 75(Supplement C):220–233, 2017.
  155. Sofuoglu, M. A., and Orak, S., A Novel Hybrid Multi Criteria Decision Making Model: Application to Turning Operations. Int. J. Intell. Syst. Appl. Eng. 5(3):124–131, 2017.
  156. Raviv, G., Shapira, A., and Fishbain, B., AHP-based analysis of the risk potential of safety incidents: Case study of cranes in the construction industry. Saf. Sci. 91(Supplement C):298–309, 2017.
  157. Zhao, H., Guo, S., and Zhao, H., Comprehensive benefit evaluation of eco-industrial parks by employing the best-worst method based on circular economy and sustainability. Environ. Dev. Sustain. :1–25, 2017.
  158. Chou, S. -Y., Chang, Y. -H., and Shen, C. -Y., A fuzzy simple additive weighting system under group decision-making for facility location selection with objective/subjective attributes. Eur. J. Oper. Res. 189(1):132–145, 2008.
  159. Jablonsky, J., MS Excel based Software Support Tools for Decision Problems with Multiple Criteria. Procedia Econ. Financ. 12(Supplement C):251–258, 2014.
  160. Rezaei, J., Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega. 64:126–130, 2016.
  161. Lo, H. -W., et al., An integrated model for solving problems in green supplier selection and order allocation. J. Clean. Prod. 190:339–352, 2018.
  162. Yang, Q., et al., Evaluation and Classification of Overseas Talents in China Based on the BWM for Intuitionistic Relations. Symmetry. 8(11):137, 2016.
  163. Ren, J., Selection of sustainable prime mover for combined cooling, heat, and power technologies under uncertainties: An interval multicriteria decision-making approach. Int. J. Energy Res. 2018.
  164. Gupta, H., Evaluating service quality of airline industry using hybrid best worst method and VIKOR. J. Air Transp. Manag. 68:35–47, 2018.
  165. Serrai, W., et al., An efficient approach for Web service selection. In: 2016 IEEE Symposium on Computers and Communication (ISCC), 2016.
  166. Shojaei, P., Seyed Haeri, S. A., and Mohammadi, S., Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique. J. Air Transp. Manag. 68:4–13, 2018.
  167. Serrai, W., et al., Towards an efficient and a more accurate web service selection using MCDM methods. J. Comput. Sci. 22:253–267, 2017.
  168. Pamučar, D., Petrović, I., and Ćirović, G., Modification of the Best–Worst and MABAC methods: A novel approach based on interval-valued fuzzy-rough numbers. Expert Syst. Appl. 91:89–106, 2018.
  169. Guo, S., and Zhao, H., Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl.-Based Syst. 121:23–31, 2017.
  170. Aboutorab, H., et al., ZBWM: The Z-number extension of Best Worst Method and its application for supplier development. Expert Syst. Appl. 107:115–125, 2018.
  171. Rezaei, J., van Roekel, W. S., and Tavasszy, L., Measuring the relative importance of the logistics performance index indicators using Best Worst Method. Transp. Policy. 68:158–169, 2018.
  172. Salimi, N., and Rezaei, J., Evaluating firms’ R&D performance using best worst method. Eval. Program Plann. 66:147–155, 2018.PubMed
  173. Chiu, W. -Y., Tzeng, G. -H., and Li, H. -L., A new hybrid MCDM model combining DANP with VIKOR to improve e-store business. Knowl.-Based Syst. 37:48–61, 2013.
  174. Ou Yang, Y. -P., Shieh, H. -M., and Tzeng, G. -H., A VIKOR technique based on DEMATEL and ANP for information security risk control assessment. Inf. Sci. 232:482–500, 2013.
  175. Jahan, A., et al., A comprehensive VIKOR method for material selection. Mater. Des. 32(3):1215–1221, 2011.
  176. Cavallini, C., et al., Integral aided method for material selection based on quality function deployment and comprehensive VIKOR algorithm. Mater. Des. 47:27–34, 2013.
  177. Liou, J. J. H., et al., A modified VIKOR multiple-criteria decision method for improving domestic airlines service quality. J. Air Transp. Manag. 17(2):57–61, 2011.
  178. Shojaei, P., Haeri, S. A. S., and Mohammadi, S., Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique. J. Air Transp. Manag. 68:4–13, 2018.
  179. Golub, T. R., et al., Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science. 286(5439):531–537, 1999.
  180. Huang, P. H., and Moh, T. -t., A non-linear non-weight method for multi-criteria decision making. Ann. Oper. Res. 248(1):239–251, 2017.
  181. Kalid, N., et al., Based on Real Time Remote Health Monitoring Systems: A New Approach for Prioritization “Large Scales Data” Patients with Chronic Heart Diseases Using Body Sensors and Communication Technology. J. Med. Syst. 42(4):69, 2018.PubMed
  182. Qader, M. A., et al., A methodology for football players selection problem based on multi-measurements criteria analysis. Measurement. 111:38–50, 2017.
  183. Zaidan, A. A., et al., A survey on communication components for IoT-based technologies in smart homes. Telecommun. Syst. :1–25, 2018.
  184. Alaa, M., Zaidan, A. A., Zaidan, B. B., Talal, M., and Kiah, M. L. M., A review of smart home applications based on Internet of Things. J. Netw. Comput. Appl. 97:48–65, 2017.
  185. Zaidan, A. A., Karim, H. A., Ahmad, N. N., Alam, G. M., and Zaidan, B. B., A new hybrid module for skin detector using fuzzy inference system structure and explicit rules. Int. J. Phys. Sci. 5(13):2084–2097, 2010.
  186. Zaidan, A. A., Karim, H. A., Ahmad, N. N., Zaidan, B. B., and Sali, A., An automated anti-pornography system using a skin detector based on artificial intelligence: A review. Int. J. Pattern Recognit. Artif. Intell. 27(04):1350012, 2013.
  187. Zaidan, A. A., Abdul Karim, H., Ahmad, N. N., Zaidan, B. B., and Sali, A., A four-phases methodology to propose anti-pornography system based on neural and bayesian methods of artificial intelligence. Int. J. Pattern Recognit. Artif. Intell. 28(01):1459001, 2014.
  188. Yas, Q. M., Zaidan, A. A., Zaidan, B. B., Hashim, M., and Lim, C. K., A systematic review on smartphone skin cancer apps: Coherent taxonomy, motivations, open challenges and recommendations, and new research direction. J. Circuits, Syst. Comput. 1830003, 2017.
  189. Zaidan, B. B., Haiqi, A., Zaidan, A. A., Abdulnabi, M., Mat Kiah, M. L., and Muzamel, H., A security framework for nationwide health information exchange based on telehealth strategy. J. Med. Syst. 39(5):1–19, 2015.
  190. Kiah, M. L. M., Haiqi, A., Zaidan, B. B., and Zaidan, A. A., Open source EMR software: Profiling, insights and hands-on analysis. Comput. Methods Prog. Biomed. 117(2):360–382, 2014.
  191. Salman, O. H., Zaidan, A. A., Zaidan, B. B., Kalid, N., and Hashim, M., Novel Methodology for Triage and Prioritizing Using ‘Big Data’ Patients with Chronic Heart Diseases Through Telemedicine Environmental. Int. J. Inf. Technol. Decis. Mak. 16(5):1211–1245, 2017.
  192. Kalid, N., Zaidan, A. A., Zaidan, B. B., Salman, O. H., Hashim, M., and Muzammil, H., Based Real Time Remote Health Monitoring Systems: A Review on Patients Prioritization and Related ‘Big Data’ Using Body Sensors information and Communication Technology. J. Med. Syst. 42(2):69, 2018.PubMed
  193. Zaidan, A.A., Zaidan, B. B., Al-Haiqi, A, Kiah, M. L. M., Hussain, M. Evaluation and selection of opensource EMR software packages. Elsevier. 53, 2014.
  194. Alanazi, H. O., Zaidan, A. A., Zaidan, B. B., Mat Kiah, M. L., and Al-Bakri, S. H., Meeting the security requirements of electronic medical records in the ERA of high-speed computing. J. Med. Syst. 39(1):1–14, 2015.
  195. Alanazi, H. O., Alam, G. M., Zaidan, B. B., and Zaidan, A. A., Securing electronic medical records transmissions over unsecured communications: An overview for better medical governance. J. Med. Plant Res. 4(19):2059–2074, 2010.
  196. Hussain, M., Al-Haiqi, A., Zaidan, A., Zaidan, B., Kiah, M. L. M., Anuar, N. B., and Abdulnabi, M., The landscape of research on smartphone medical apps: Coherent taxonomy, motivations, open challenges and recommendations. Comput. Methods Prog. Biomed. 122(3):393–408, 2015.
  197. Mat Kiah, M. L., Zaidan, B. B., Zaidan, A. A., Nabi, M., and Ibraheem, R., MIRASS: Medical informatics research activity support system using information mashup network. J. Med. Syst. 38(4):1–37, 2014a.
  198. Mat Kiah, M. L., Al-Bakri, S. H., Zaidan, A. A., Zaidan, B. B., and Hussain, M., Design and develop a video conferencing framework for real-time telemedicine applications using secure group-based communication architecture. J. Med. Syst. 38(10):1–13, 2014c.
  199. Mat Kiah, M. L., Nabi, M. S., Zaidan, B. B., and Zaidan, A. A., An enhanced security solution for electronic medical records based on AES hybrid technique with SOAP/XML and SHA-1. J. Med. Syst. 37(5):1–16, 2013.
  200. Abdulnabi, M., Al-Haiqi, A., Kiah, M. L. M., Zaidan, A. A., Zaidan, B. B., and Hussain, M., A distributed framework for health information exchange using smartphone technologies. J. Biomed. Inform. 69:230–250, 2017.PubMed
  201. Zaidan, B. B., Zaidan, A. A., and Mat Kiah, M. L., Impact of data privacy and confidentiality on developing telemedicine applications: A review participates opinion and expert concerns. Int. J. Pharm. 7(3):382–387, 2011.
  202. Zaidan, A. A. et al., Challenges, alternatives, and paths to sustainability: Better public health promotion using social networking pages as key tools. J. Med. Syst. 39(2):1–14, 2015.
  203. Hussain, M., Ahmed, A.-H., Zaidan, A. A., and Zaidan, B. B., M Kiah, Salman Iqbal, S Iqbal, Mohamed Abdulnabi "A security framework for mHealth apps on Android platform". Comput. Secur. 45:191–217, 2018.
  204. Hussain, M., Zaidan, A. A., Zidan, B. B., Iqbal, S., Ahmed, M. M., Albahri, O. S., and Albahri, A. S., Conceptual Framework for the Security of Mobile Health Applications on Android Platform. 35(3):1–32. 2018.
  205. Albahri, A. S., Zaidan, A. A., Albahri, O. S., Zaidan, B. B., and Alsalem, M. A., Real-Time Fault-Tolerant mHealth System: Comprehensive Review of Healthcare Services, Opens Issues, Challenges and Methodological Aspects. J. Med. Syst. 42(8):137, 2018.PubMed
  206. Albahri, O. S., Zaidan, A. A., Zaidan, B. B., Hashim, M., Albahri, A. S., and Alsalem, M. A., Real-Time Remote Health-Monitoring Systems in a Medical Centre: A Review of the Provision of Healthcare Services-Based Body Sensor Information, Open Challenges and Methodological Aspects. J. Med. Syst. 42(9):164, 2018.PubMed
  207. Kalid, N. et al., Based on Real Time Remote Health Monitoring Systems: A New Approach for Prioritization ‘Large Scales Data’ Patients with Chronic Heart Diseases Using Body Sensors and Communication Technology. J. Med. Syst. 42(4):69, 2018.PubMed
  208. Albahri, O. S. et al., Systematic Review of Real-time Remote Health Monitoring System in Triage and Priority-Based Sensor Technology: Taxonomy, Open Challenges, Motivation and Recommendations. J. Med. Syst. 42(5):80, 2018.PubMed
  209. Nabi, M. S. A., Kiah, M. M., Zaidan, B. B., Zaidan, A. A., and Alam, G. M., Suitability of using SOAP protocol to secure electronic medical record databases transmission. Int. J. Pharmacol. 6(6):959–964, 2010.
  210. Rahmatullah, B., Zaidan, A. A., Mohamed, F., and Sali, A., Multi-complex attributes analysis for optimum GPS baseband receiver tracking channels selection. In: 2017 4th International Conference on Control, Decision and Information Technologies, CoDIT 2017. Vol. 2017, pp. 1084–1088, 2017. https://​doi.​org/​10.​1109/​CoDIT.​2017.​8102743
  211. Hussain, M., Al-Haiqi, A., Zaidan, A. A., Zaidan, B. B., Kiah, M. M., Anuar, N. B., and Abdulnabi, M., The rise of keyloggers on smartphones: A survey and insight into motion-based tap inference attacks. Pervasive Mob. Comput. 25:1–25, 2016.
Metadata
Title
Systematic Review of an Automated Multiclass Detection and Classification System for Acute Leukaemia in Terms of Evaluation and Benchmarking, Open Challenges, Issues and Methodological Aspects
Authors
M. A. Alsalem
A. A. Zaidan
B. B. Zaidan
M. Hashim
O. S. Albahri
A. S. Albahri
Ali Hadi
K. I. Mohammed
Publication date
01-11-2018
Publisher
Springer US
Published in
Journal of Medical Systems / Issue 11/2018
Print ISSN: 0148-5598
Electronic ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-018-1064-9

Other articles of this Issue 11/2018

Journal of Medical Systems 11/2018 Go to the issue

Image & Signal Processing

Denoising Brain Images with the Aid of Discrete Wavelet Transform and Monarch Butterfly Optimization with Different Noises

Patient Facing Systems

An Investigation of Pharmacists’ Acceptance of NHI-PharmaCloud in Taiwan

Image & Signal Processing

Medical Image Analysis using Convolutional Neural Networks: A Review

Image & Signal Processing

Multilayered Deep Structure Tensor Delaunay Triangulation and Morphing Based Automated Diagnosis and 3D Presentation of Human Macula

Systems-Level Quality Improvement

Maximizing Patient Coverage Through Optimal Allocation of Residents and Scribes to Shifts in an Emergency Department

Systems-Level Quality Improvement

Privacy-Preserving and Efficient Truly Three-Factor Authentication Scheme for Telecare Medical Information Systems