Abstract
Feature selection has become the focus of much research in many areas where we can face the problem of big data or complex relationship among features. Metaheuristics have gained much attention in solving many practical problems, including feature selection. Our contribution in this paper is to propose a binary hybrid metaheuristic to minimize a fitness function representing a trade-off between the classification error of selecting the feature subset and the corresponding number of features. This algorithm combines particle swarm optimization (PSO) and gravitational search algorithm (GSA). Also, a mutation operator is integrated to enhance population diversity. Experimental results on ten benchmark dataset show that our proposed hybrid method for feature selection can achieve high performance when comparing with other metaheuristic algorithms and well-known feature selection approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Z. Beheshti, S.M. Shamsuddin, S. Hasan, Memetic binary particle swarm optimization for discrete optimization problems. Inf. Sci. 299, 58–84 (2015)
A.R. Behjat, A. Mustapha, H. Nezamabadi, M.N. Sulaiman, N. Mustapha, Feature subset selection using binary gravitational search algorithm for intrusion detection system, in Intelligent Information and Database Systems. Lecture Notes in Computer Science, vol. 7803 (Springer, Berlin/Heidelberg, 2013), pp. 377–386
G. Brown, A. Pocock, M.-J. Zhao, M. Lujan, Conditional likelihood maximisation: a unifying framework for information theoretic feature selection. J. Mach. Learn. Res. 13, 27–66 (2012)
T. Chakraborti, A. Chatterjee, A novel binary adaptive weight GSA based feature selection for face recognition using local gradient patterns, modified census transform and local binary patterns. Eng. Appl. Artif. Intel. 33, 80–90 (2014)
R. Diao, Q. Shen, Nature inspired feature selection meta-heuristics. Eng. Appl. Artif. Intel. 44(3), 311–340 (2015)
T. Ganesan, I.M. Elamvazuthi, K.Z. Ku Shaari, P. Vasant, Swarm intelligence and gravitational search algorithm for multi-objective optimization of synthesis gas production. Appl. Energy 103, 368–374 (2013)
J. Garca-Nieto, E. Alba, L. Jourdan, E. Talbi, Sensitivity and specificity based multiobjective approach for feature selection: application to cancer diagnosis. Inf. Process. Lett. 109, 887–896 (2009)
I. Guyon, A. Elisseeff, An introduction to variable and feature selection. J. Mach. Learn. Res. 3, 1157–1182 (2003)
X.H. Han, X.M. Chang, L. Quan, X.Y. Xiong, J.X. Li, Z.X. Zhang, Y. Liu, Feature subset selection by gravitational search algorithm optimization. Inf. Sci. 281, 128–146 (2014)
Z. Hu, Y. Bao, T. Xiong, Comprehensive learning particle swarm optimization based memetic algorithm for model selection in short-term load forecasting using support vector regression. Appl. Soft Comput. 25, 15–25 (2014)
S. Jiang, A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints. Electr. Power Energy Syst. 55, 628–644 (2014)
L. Jourdan, C. Dhaenens, E.-G. Talbi, Evolutionary feature selection for bioinformatics, in Computational Intelligence in Bioinformatics, Chap. 6 (IEEE Press, New York, 2007), pp. 117–139
J. Kennedy, R.C. Eberhart, A discrete binary version of the particle swarm optimization, in Proceedings on Conference on Systems, Man and Cybernetics, vol. 4 (1997), pp. 104–109
R. Kohavi, G.H. John, Wrappers for feature subset selection. Artif. Intell. 97(1–2), 273–324 (1997)
J. Krause, J. Cordeiro, R.S. Parpinelli, H.S. Lopes, A survey of swarm algorithms applied to discrete optimization problems, in Swarm Intelligence and Bio-Inspired Computation: Theory and Applications (Elsevier Science & Technology Books, London, 2013), pp. 169–191
J. Lee, D.-W. Kim, Memetic feature selection algorithm for multi-label classification. Inf. Sci. 293, 80–96 (2015)
Y. Lu, I. Cohen, X.S. Zhou, Q. Tian, Feature selection using principal feature analysis, in Proceedings of the 15th International Conference on Multimedia, MULTIMEDIA ’07 (ACM, New York, 2007), pp. 301–304
S. Mallick, S.P. Ghoshal, P. Acharjee, S.S. Thakur, Optimal static state estimation using improved particle swarm optimization and gravitational search algorithm. Electr. Power Energy Syst. 52, 254–265 (2013)
S. Mirjalili, G.-G. Wang, L.D. Coelho, Binary optimization using hybrid particle swarm optimization and gravitational search algorithm. Neural Comput. Appl. 25(6), 1423–1435 (2014)
M. Nikravesh, L.A. Zadeh, I. Guyon, S. Gunn, Feature Extraction, Foundations and Applications (Springer, Berlin, 2006)
S. Piramuthu, Evaluating feature selection methods for learning in data mining applications. Eur. J. Oper. Res. 156, 483–494 (2004)
J. Pohjalainen, O. Rsnen, S. Kadioglu, Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits. Comput. Speech Lang. 29, 145–171 (2015)
E. Rashedi, H. Nezamabadi-pour, S. Saryazdi, BGSA: binary gravitational search algorithm. Nat. Comput. 9(3), 727–745 (2010)
Y. Shi, R.C. Eberhart, A modified particle swarm optimizer, in Proceedings of the IEEE World Congress of Computational Intelligence (1997), pp. 69–73
E.-G. Talbi, L. Jourdan, J. Garcia-Nieto, E. Alba, Comparison of population based metaheuristics for feature selection: application to microarray data classification, in AICCSA’2008 IEEE/ACS International Conference on Computer Systems and Applications, Doha, Nov 2008, pp. 45–52
A. Unler, A. Murat, A discrete particle swarm optimization method for feature selection in binary classification problems. Eur. J. Oper. Res. 206, 528–539 (2010)
J.R. Vergara, P.A. Estvez, A review of feature selection methods based on mutual information. Neural Comput. Appl. 24(1), 175–186 (2014)
L. Vignolo, D. Milone, J. Scharcanski, Feature selection for face recognition based on multi-objective evolutionary wrapper. Expert Syst. Appl. 40, 5077–5084 (2013)
B. Xue, M. Zhang, W. Browne, Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl. Soft Comput. 18, 261–176 (2014)
Y. Zhang, S. Wang, P. Phillips, G. Ji, Binary PSO with mutation operator for feature selection using decision tree applied to spam detection. Knowl.-Based Syst. 64, 22–31 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Sarhani, M., Afia, A.E., Faizi, R. (2018). Facing the Feature Selection Problem with a Binary PSO-GSA Approach. In: Amodeo, L., Talbi, EG., Yalaoui, F. (eds) Recent Developments in Metaheuristics. Operations Research/Computer Science Interfaces Series, vol 62. Springer, Cham. https://doi.org/10.1007/978-3-319-58253-5_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-58253-5_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58252-8
Online ISBN: 978-3-319-58253-5
eBook Packages: Business and ManagementBusiness and Management (R0)