A Hybrid Method of Sine Cosine Algorithm and Differential Evolution for Feature Selection

  • Mohamed E. Abd Elaziz
  • Ahmed A. Ewees
  • Diego Oliva
  • Pengfei Duan
  • Shengwu XiongEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10638)


The feature selection is an important step to improve the performance of classifier through reducing the dimension of the dataset, so the time complexity and space complexity are reduced. There are several feature selection methods are used the swarm techniques to determine the suitable subset of features. The sine cosine algorithm (SCA) is one of the recent swarm techniques that used as global optimization method to solve the feature selection, however, it can be getting stuck in local optima. In order to solve this problem, the differential evolution operators are used as local search method which helps the SCA to skip the local point. The proposed method is compared with other three algorithms to select the subset of features used eight UCI datasets. The experiments results showed that the proposed method provided better results than other methods in terms of performance measures and statistical test.


Feature selection (FS) Sine Cosine Algorithm (SCA) Differential evolution (DE) Metaheuristic (MH) 



This work was in part supported by national key Research & Development Program of China (No. 2016YFD0101903), Nature Science Foundation of Hubei Province (Grant No. 2015CFA059), Science & Technology Pillar Program of Hubei Province (Grant No. 2014BAA146), Science & Technology Cooperation Program of Henan Province (No. 152106000048) and Hubei Collaborative Innovation Center of Basic Education Information technology Services.


  1. 1.
    Hancer, E., Xue, B., Karaboga, D., Zhang, M.: A binary ABC algorithm based on advanced similarity scheme for feature selection. Appl. Soft Comput. 36, 334–348 (2015)CrossRefGoogle Scholar
  2. 2.
    Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of 6th International Symposium on book Micro Machine and Human Science, MHS 1995, pp. 39–43 (1995)Google Scholar
  3. 3.
    Storn, R., Price, K.: Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11(4), 341–359 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Basturk, B., Karaboga, D.: An artificial bee colony (ABC) algorithm for numeric function optimization. In: IEEE Swarm Intelligence Symposium, vol. 8, no. 1, pp. 687–697 (2006)Google Scholar
  5. 5.
    Cuevas, E., Cienfuegos, M., Zaldivar, D., Perez-Cisneros, M.: A swarm optimization algorithm inspired in the behavior of the social-spider. Expert Syst. Appl. 40(16), 6374–6384 (2013)CrossRefGoogle Scholar
  6. 6.
    Moradi, P., Rostami, M.: Integration of graph clustering with ant colony optimization for feature selection. Knowl.-Based Syst. 84, 144–161 (2015)CrossRefGoogle Scholar
  7. 7.
    Mirjalili, S., Mirjalili, S.M., Lewis, A.: Grey wolf optimizer. Adv. Eng. Softw. 69, 46–61 (2014)CrossRefGoogle Scholar
  8. 8.
    Mirjalili, S.: SCA: a sine cosine algorithm for solving optimization problems. Knowl.-Based Syst. 96, 120–133 (2016)CrossRefGoogle Scholar
  9. 9.
    Emary, E., Zawbaa, H.M., Hassanien, A.E.: Binary ant lion approaches for feature selection. Neurocomputing 213, 54–65 (2016)CrossRefGoogle Scholar
  10. 10.
    Sindhu, R., Ngadiran, R., Yacob, Y.M., Zahri, N.A.H., Hariharan, M.: Sine-cosine algorithm for feature selection with elitism strategy and new updating mechanism. Neural Comput. Appl. 1–12 (2017)Google Scholar
  11. 11.
    Wang, J., Xue, B., Gao, X., Zhang, M.: A differential evolution approach to feature selection and instance selection. In: Pacific Rim International Conference on Artificial Intelligence, pp. 588–602 (2016)Google Scholar
  12. 12.
    Yang, W.-A., Zhou, Q., Tsui, K.-L.: Differential evolution-based feature selection and parameter optimisation for extreme learning machine in tool wear estimation. Int. J. Prod. Res. 54(15), 4703–4721 (2016)CrossRefGoogle Scholar
  13. 13.
    Maheshwari, R., Kumar, M., Kumar, S.: Optimization of feature selection in face recognition system using differential evolution and genetic algorithm. In: Proceedings of 5th International Conference on Soft Computing for Problem Solving, pp. 363–374 (2016)Google Scholar
  14. 14.
    Chattopadhyay, S., Mishra, S., Goswami, S.: Feature selection using differential evolution with binary mutation scheme. In: 2016 International Conference on Microelectronics, Computing and Communications (MicroCom), pp. 1–6 (2016)Google Scholar
  15. 15.
    Sikdar, U.K., Ekbal, A., Saha, S., Uryupina, O., Poesio, M.: Differential evolution-based feature selection technique for anaphora resolution. Soft. Comput. 19(8), 2149–2161 (2015)CrossRefGoogle Scholar
  16. 16.
    Nakamura, R.Y.M., Pereira, L.A.M., Costa, K.A., Rodrigues, D., Papa, J.P., Yang, X.S.: BBA: a binary bat algorithm for feature selection. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 291–297 (2012)Google Scholar
  17. 17.
    Ewees, A.A., El Aziz, M.A., Hassanin, A.E.: Chaotic multi-verse optimizer-based feature selection. Neural Comput. Appl. 1–17 (2017)Google Scholar
  18. 18.
    El Aziz, M.A., Hassanien, A.E.: Modified cuckoo search algorithm with rough sets for feature selection. Neural Comput. Appl. 1–10 (2016)Google Scholar
  19. 19.
    Zorarpaci, E., Özel, S.A.: A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst. Appl. 62, 91–103 (2016)CrossRefGoogle Scholar
  20. 20.
    Balakrishnan, U., Venkatachalapathy, K., Girirajkumar, M.S.: A hybrid PSO-DEFS based feature selection for the identification of diabetic retinopathy. Curr. Diabetes Rev. 11(3), 182–190 (2015)CrossRefGoogle Scholar
  21. 21.
    Wang, X., Yang, J., Teng, X., Xia, W., Jensen, R.: Feature selection based on rough sets and particle swarm optimization. Pattern Recog. Lett. 28(4), 459–471 (2007)CrossRefGoogle Scholar
  22. 22.
    Asuncion, A., Newman, D.H.: UCI machine learning repository. School of Information and Computer Sciences, University of California, Irvine (2010).
  23. 23.
    El Aziz, M.A., Hassanien, A.E.: An improved social spider optimization algorithm based on rough sets for solving minimum number attribute reduction problem. Neural Comput. Appl. 1–12 (2017)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Mohamed E. Abd Elaziz
    • 1
    • 4
  • Ahmed A. Ewees
    • 2
  • Diego Oliva
    • 3
  • Pengfei Duan
    • 1
  • Shengwu Xiong
    • 1
    Email author
  1. 1.School of Computer Science and TechnologyWuhan University of TechnologyWuhanChina
  2. 2.Department of ComputerDamietta UniversityDamiettaEgypt
  3. 3.Departamento de Ciencias ComputacionalesUniversidad de GuadalajaraGuadalajaraMexico
  4. 4.Department of Mathematics, Faculty of ScienceZagazig UniversityZagazigEgypt

Personalised recommendations