Abstract
In this chapter, a wrapper-based feature selection algorithm is designed and substantiated based on the binary variant of Dragonfly Algorithm (BDA). DA is a successful, well-established metaheuristic that revealed superior efficacy in dealing with various optimization problems including feature selection. In this chapter we are going first present the inspirations and methamatical modeds of DA in details. Then, the performance of this algorithm is tested on a special type of datasets that contain a huge number of features with low number of samples. This type of datasets makes the optimization process harder, because of the large search space, and the lack of adequate samples to train the model. The experimental results showed the ability of DA to deal with this type of datasets better than other optimizers in the literature. Moreover, an extensive literature review for the DA is provided in this chapter.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Abbassi, R., Abbassi, A., Heidari, A. A., & Mirjalili, S. (2019). An efficient salp swarm-inspired algorithm for parameters identification of photovoltaic cell models. Energy Conversion and Management, 179, 362–372.
An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. (2018). Knowledge-Based Systems, 154, 43–67.
Abdel-Basset, M., Luo, Q., Miao, F., & Zhou, Y. (2017). Solving 0-1 knapsack problems by binary dragonfly algorithm. In International Conference on Intelligent Computing (pp. 491–502). Springer.
Al-Madi, N., Aljarah, I., & Ludwig, S. (2014). Parallel glowworm swarm optimization clustering algorithm based on mapreduce. In IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2014). IEEE Xplore Digital Library.
Aljarah, I., AlaM, A. Z., Faris, H., Hassonah, M. A., Mirjalili, S., & Saadeh, H. (2018). Simultaneous feature selection and support vector machine optimization using the grasshopper optimization algorithm. Cognitive Computation, 1–18.
Aljarah, I., Faris, H., & Mirjalili, S. (2018). Optimizing connection weights in neural networks using the whale optimization algorithm. Soft Computing, 22(1), 1–15.
Aljarah, I., Faris, H., Mirjalili, S., & Al-Madi, N. (2018). Training radial basis function networks using biogeography-based optimizer. Neural Computing and Applications, 29(7), 529–553.
Aljarah, I., & Ludwig, S. A. (2012). Parallel particle swarm optimization clustering algorithm based on mapreduce methodology. In Proceedings of the Fourth World Congress on Nature and Biologically Inspired Computing (IEEE NaBIC12). IEEE Explore.
Aljarah, I., & Ludwig, S. A. (2013). A mapreduce based glowworm swarm optimization approach for multimodal functions. In IEEE Symposium Series on Computational Intelligence, IEEE SSCI 2013. IEEE Xplore.
Aljarah, I., & Ludwig, S. A. (2013). A new clustering approach based on glowworm swarm optimization. In Proceedings of 2013 IEEE Congress on Evolutionary Computation Conference (IEEE CEC13). Cancun, Mexico: IEEE Xplore.
Aljarah, I., & Ludwig, S. A. (2013). Towards a scalable intrusion detection system based on parallel PSO clustering using mapreduce. In Proceedings of Genetic and Evolutionary Computation Conference (ACM GECCO13). Amsterdam: ACM.
Aljarah, I., & Ludwig, S. A. (2016). A scalable mapreduce-enabled glowworm swarm optimization approach for high dimensional multimodal functions. International Journal of Swarm Intelligence Research (IJSIR), 7(1), 32–54.
Aljarah, I., Mafarja, M., Heidari, A. A., Faris, H., Zhang, Y., & Mirjalili, S. (2018). Asynchronous accelerating multi-leader salp chains for feature selection. Applied Soft Computing, 71, 964–979.
Altman, N. S. (1992). An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3), 175–185.
Amroune, M., Bouktir, T., & Musirin, I. (2018). Power system voltage stability assessment using a hybrid approach combining dragonfly optimization algorithm and support vector regression. Arabian Journal for Science and Engineering, 1–14.
Aminisharifabad, M., Yang, Q., & Wu, X. (2018). A penalized autologistic regression with application for modeling the microstructure of dual-phase high strength steel. Journal of Quality Technology, in-press.
Babayigit, B. (2018). Synthesis of concentric circular antenna arrays using dragonfly algorithm. International Journal of Electronics, 105(5), 784–793.
Barham, R., & Aljarah, I. (2017). Link prediction based on whale optimization algorithm. In The International Conference on new Trends in Computing Sciences (ICTCS2017). Amman: Jordan.
Bhesdadiya, R., Pandya, M. H., Trivedi, I. N., Jangir, N., Jangir, P., & Kumar, A. (2016). Price penalty factors based approach for combined economic emission dispatch problem solution using dragonfly algorithm. In 2016 International Conference on Energy Efficient Technologies for Sustainability (ICEETS) (pp. 436–441). IEEE.
Blum, A. L., & Langley, P. (1997). Selection of relevant features and examples in machine learning. Artificial Intelligence, 97(1–2), 245–271.
Branch, S. R., & Rey, S. (2018). Providing a load balancing method based on dragonfly optimization algorithm for resource allocation in cloud computing. International Journal of Networked and Distributed Computing, 6(1), 35–42.
Chen, Y., Li, L., Xiao, J., Yang, Y., Liang, J., & Li, T. (2018). Particle swarm optimizer with crossover operation. Engineering Applications of Artificial Intelligence, 70, 159–169.
Chitsaz, H., & Aminisharifabad, M. (2015). Exact learning of rna energy parameters from structure. Journal of Computational Biology, 22(6), 463–473.
Daely, P. T., & Shin, S. Y. (2016). Range based wireless node localization using dragonfly algorithm. In 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN) (pp. 1012–1015). IEEE.
Dorigo, M., & Birattari, M. (2011). Ant colony optimization. In Encyclopedia of machine learning (pp. 36–39). Springer.
Dorigo, M., & Di Caro, G. (1999). Ant colony optimization: a new meta-heuristic. In Proceedings of the 1999 Congress on Evolutionary Computation, 1999. CEC 99, vol. 2 (pp. 1470–1477). IEEE.
Eberhart, R., & Kennedy, J. (1995). A new optimizer using particle swarm theory. In Proceedings of the Sixth International Symposium on Micro Machine and Human Science, 1995. MHS’95 (pp. 39–43). IEEE.
Elhariri, E., El-Bendary, N., & Hassanien, A. E. (2016). Bio-inspired optimization for feature set dimensionality reduction. In 2016 3rd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA) (pp. 184–189). IEEE.
Faris, H., Aljarah, I., Al-Madi, N., & Mirjalili, S. (2016). Optimizing the learning process of feedforward neural networks using lightning search algorithm. International Journal on Artificial Intelligence Tools, 25(06), 1650033.
Faris, H., Aljarah, I., & Al-Shboul, B. (2016). A hybrid approach based on particle swarm optimization and random forests for e-mail spam filtering. International Conference on Computational Collective Intelligence (pp. 498–508). Cham: Springer.
Faris, H., Aljarah, I., & Mirjalili, S. (2017). Evolving radial basis function networks using moth–flame optimizer. In Handbook of Neural Computation (pp. 537–550).
Faris, H., Aljarah, I., et al. (2015). Optimizing feedforward neural networks using krill herd algorithm for e-mail spam detection. In 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT) (pp. 1–5). IEEE.
Faris, H., Ala’M, A. Z., Heidari, A. A., Aljarah, I., Mafarja, M., Hassonah, M. A., & Fujita, H. (2019). An intelligent system for spam detection and identification of the most relevant features based on evolutionary random weight networks. Information Fusion, 48, 67–83.
Faris, H., Mafarja, M. M., Heidari, A. A., Aljarah, I., AlaM, A. Z., Mirjalili, S., et al. (2018). An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowledge-Based Systems, 154, 43–67.
Fisher, L. (2009). The perfect swarm: The science of complexity in everyday life. Basic Books.
Ghatasheh, N., Faris, H., Aljarah, I., & Al-Sayyed, R. M. (2015). Optimizing software effort estimation models using firefly algorithm. Journal of Software Engineering and Applications, 8(03), 133.
Guha, K., Laskar, N., Gogoi, H., Borah, A., Baishnab, K., & Baishya, S. (2017). Novel analytical model for optimizing the pull-in voltage in a flexured mems switch incorporating beam perforation effect. Solid-State Electronics, 137, 85–94.
Guo, S., Dooner, M., Wang, J., Xu, H., & Lu, G. (2017). Adaptive engine optimisation using NSGA-II and MODA based on a sub-structured artificial neural network. In 2017 23rd International Conference on Automation and Computing (ICAC) (pp. 1–6). IEEE.
Hamdy, M., Nguyen, A. T., & Hensen, J. L. (2016). A performance comparison of multi-objective optimization algorithms for solving nearly-zero-energy-building design problems. Energy and Buildings, 121, 57–71.
Hariharan, M., Sindhu, R., Vijean, V., Yazid, H., Nadarajaw, T., Yaacob, S., et al. (2018). Improved binary dragonfly optimization algorithm and wavelet packet based non-linear features for infant cry classification. Computer Methods and Programs in Biomedicine, 155, 39–51.
Heidari, A. A., & Abbaspour, R. A. (2018). Enhanced chaotic grey wolf optimizer for real-world optimization problems: A comparative study. In Handbook of Research on Emergent Applications of Optimization Algorithms (pp. 693–727). IGI Global.
Heidari, A. A., Abbaspour, R. A., & Jordehi, A. R. (2017). An efficient chaotic water cycle algorithm for optimization tasks. Neural Computing and Applications, 28(1), 57–85.
Heidari, A. A., Abbaspour, R. A., & Jordehi, A. R. (2017). Gaussian bare-bones water cycle algorithm for optimal reactive power dispatch in electrical power systems. Applied Soft Computing, 57, 657–671.
Heidari, A. A., & Delavar, M. R. (2016). A modified genetic algorithm for finding fuzzy shortest paths in uncertain networks. In ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLI-B2 (pp. 299–304).
Heidari, A. A., Faris, H., Aljarah, I., & Mirjalili, S. (2018). An efficient hybrid multilayer perceptron neural network with grasshopper optimization. Soft Computing, 1–18.
Heidari, A. A., & Pahlavani, P. (2017). An efficient modified grey wolf optimizer with lévy flight for optimization tasks. Applied Soft Computing, 60, 115–134.
Hema, C., Sankar, S., et al. (2016). Energy efficient cluster based protocol to extend the RFID network lifetime using dragonfly algorithm. In 2016 International Conference on Communication and Signal Processing (ICCSP) (pp. 0530–0534). IEEE.
Hema, C., Sankar, S., et al. (2017). Performance comparison of dragonfly and firefly algorithm in the RFID network to improve the data transmission. Journal of Theoretical and Applied Information Technology, 95(1), 59.
Ibrahim, H. T., Mazher, W. J., Ucan, O. N., & Bayat, O. (2018). A grasshopper optimizer approach for feature selection and optimizing SVM parameters utilizing real biomedical data sets. Neural Computing and Applications.
Jafari, M., & Chaleshtari, M. H. B. (2017). Using dragonfly algorithm for optimization of orthotropic infinite plates with a quasi-triangular cut-out. European Journal of Mechanics-A/Solids, 66, 1–14.
Karaboga, D., & Basturk, B. (2007). A powerful and efficient algorithm for numerical function optimization: Artificial bee colony (ABC) algorithm. Journal of Global Optimization, 39(3), 459–471.
Kashef, S., & Nezamabadi-pour, H. (2015). An advanced ACO algorithm for feature subset selection, 147, 271–279.
Kennedy, J. (2006). Swarm intelligence. In Handbook of Nature-Inspired and Innovative Computing (pp. 187–219). Springer.
Khadanga, R. K., Padhy, S., Panda, S., & Kumar, A. (2018). Design and analysis of tilt integral derivative controller for frequency control in an islanded microgrid: A novel hybrid dragonfly and pattern search algorithm approach. Arabian Journal for Science and Engineering, 1–12.
Ks, S. R., & Murugan, S. (2017). Memory based hybrid dragonfly algorithm for numerical optimization problems. Expert Systems with Applications, 83, 63–78.
Kumar, C. A., Vimala, R., Britto, K. A., & Devi, S. S. (2018). FDLA: Fractional dragonfly based load balancing algorithm in cluster cloud model. Cluster Computing, 1–14.
Langley, P., et al. (1994). Selection of relevant features in machine learning. Proceedings of the AAAI Fall symposium on relevance, 184, 245–271.
Li, Q., Chen, H., Huang, H., Zhao, X., Cai, Z., Tong, C., et al. (2017). An enhanced grey wolf optimization based feature selection wrapped kernel extreme learning machine for medical diagnosis. Computational and Mathematical Methods in Medicine, 2017.
Li, Y., Li, T., & Liu, H. (2017). Recent advances in feature selection and its applications. Knowledge and Information Systems, 53(3), 551–577.
Liao, T., & Kuo, R. (2018). Five discrete symbiotic organisms search algorithms for simultaneous optimization of feature subset and neighborhood size of KNN classification models. Applied Soft Computing, 64, 581–595.
Liu, H., & Motoda, H. (2012). Feature selection for knowledge discovery and data mining, vol. 454. Springer Science & Business Media.
Liu, H., Setiono, R., et al. (1996). A probabilistic approach to feature selection-a filter solution. In Thirteenth International Conference on Machine Learning (ICML), vol. 96 (pp. 319–327). Citeseer.
Mafarja, M., & Abdullah, S. (2011). Modified great deluge for attribute reduction in rough set theory. In 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), vol. 3, (pp. 1464–1469). IEEE.
Mafarja, M., & Abdullah, S. (2013). Investigating memetic algorithm in solving rough set attribute reduction. International Journal of Computer Applications in Technology, 48(3), 195–202.
Mafarja, M., & Abdullah, S. (2013). Record-to-record travel algorithm for attribute reduction in rough set theory. Journal of Theoretical and Applied Information Technology, 49(2), 507–513.
Mafarja, M., & Abdullah, S. (2014). Fuzzy modified great deluge algorithm for attribute reduction. Recent Advances on Soft Computing and Data Mining (pp. 195–203). Cham: Springer.
Mafarja, M., & Abdullah, S. (2015). A fuzzy record-to-record travel algorithm for solving rough set attribute reduction. International Journal of Systems Science, 46(3), 503–512.
Mafarja, M., Aljarah, I., Heidari, A. A., Faris, H., Fournier-Viger, P., Li, X., & Mirjalili, S. (2018). Binary dragonfly optimization for feature selection using time-varying transfer functions. Knowledge-Based Systems, 161, 185–204.
Mafarja, M., Aljarah, I., Heidari, A. A., Hammouri, A. I., Faris, H., AlaM, A. Z., et al. (2018). Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowledge-Based Systems, 145, 25–45.
Mafarja, M., Eleyan, D., Abdullah, S., & Mirjalili, S. (2017). S-shaped vs. V-shaped transfer functions for ant lion optimization algorithm in feature selection problem. In Proceedings of the International Conference on Future Networks and Distributed Systems (p. 1). ACM.
Mafarja, M., Jaber, I., Eleyan, D., Hammouri, A., & Mirjalili, S. (2017). Binary dragonfly algorithm for feature selection. In 2017 International Conference on New Trends in Computing Sciences (ICTCS) (pp. 12–17).
Mafarja, M., & Mirjalili, S. (2017). Hybrid whale optimization algorithm with simulated annealing for feature selection. Neurocomputing.
Mafarja, M., & Mirjalili, S. (2017). Whale optimization approaches for wrapper feature selection. Applied Soft Computing, 62, 441–453.
Mirjalili, S. (2015). The ant lion optimizer. Advances in Engineering Software, 83, 80–98.
Mirjalili, S. (2016). Dragonfly algorithm: A new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Computing and Applications, 27(4), 1053–1073.
Mirjalili, S., Gandomi, A. H., Mirjalili, S. Z., Saremi, S., Faris, H., & Mirjalili, S. M. (2017). Salp swarm algorithm: A bio-inspired optimizer for engineering design problems. Advances in Engineering Software, 114, 163–191.
Mirjalili, S., & Lewis, A. (2013). S-shaped versus V-shaped transfer functions for binary particle swarm optimization. Swarm and Evolutionary Computation, 9, 1–14.
Mirjalili, S., & Lewis, A. (2016). The whale optimization algorithm. Advances in Engineering Software, 95, 51–67.
Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014). Grey wolf optimizer. Advances in Engineering Software, 69, 46–61.
Moradi, P., & Gholampour, M. (2016). A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. Applied Soft Computing, 43, 117–130.
Pathania, A. K., Mehta, S., & Rza, C. (2016). Economic load dispatch of wind thermal integrated system using dragonfly algorithm. In 2016 7th India International Conference on Power Electronics (IICPE) (pp. 1–6). IEEE.
Rajamohana, S., & Umamaheswari, K. (2018). Hybrid approach of improved binary particle swarm optimization and shuffled frog leaping for feature selection. Computers & Electrical Engineering.
Raman, G., Raman, G., Manickam, C., & Ganesan, S. I. (2016). Dragonfly algorithm based global maximum power point tracker for photovoltaic systems. In Y. Tan, Y. Shi, & B. Niu (Eds.), Advances in Swarm Intelligence (pp. 211–219). Cham: Springer International Publishing.
Reynolds, C. W. (1987). Flocks, herds and schools: A distributed behavioral model. In ACM SIGGRAPH Computer Graphics, vol. 21 (pp. 25–34). ACM.
Salam, M. A., Zawbaa, H. M., Emary, E., Ghany, K. K. A., & Parv, B. (2016). A hybrid dragonfly algorithm with extreme learning machine for prediction. In 2016 International Symposium on INnovations in Intelligent SysTems and Applications (INISTA) (pp. 1–6). IEEE.
Sambandam, R. K., & Jayaraman, S. (2016). Self-adaptive dragonfly based optimal thresholding for multilevel segmentation of digital images. Journal of King Saud University-Computer and Information Sciences.
Saremi, S., Mirjalili, S., & Lewis, A. (2017). Grasshopper optimisation algorithm: Theory and application. Advances in Engineering Software, 105, 30–47.
Shilaja, C., & Ravi, K. (2017). Optimal power flow using hybrid DA-APSO algorithm in renewable energy resources. Energy Procedia, 117, 1085–1092.
Sekhar, A. H., & Devi, A. L. (2016). Analysis of multi tcsc placement in transmission system by using firing angle control model with heuristic algorithms. ARPN Journal of Engineering and Applied Sciences, 11(21), 12743–12755.
Shukri, S., Faris, H., Aljarah, I., Mirjalili, S., & Abraham, A. (2018). Evolutionary static and dynamic clustering algorithms based on multi-verse optimizer. Engineering Applications of Artificial Intelligence, 72, 54–66.
Song, J., & Li, S. (2017). Elite opposition learning and exponential function steps-based dragonfly algorithm for global optimization. In 2017 IEEE International Conference on Information and Automation (ICIA) (pp. 1178–1183). IEEE.
Statnikov, A., Aliferis, C. F., Tsamardinos, I., Hardin, D., & Levy, S. (2004). A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics, 21(5), 631–643.
Sugave, S. R., Patil, S. H., & Reddy, B. E. (2017). DDF: Diversity dragonfly algorithm for cost-aware test suite minimization approach for software testing. In 2017 International Conference on Intelligent Computing and Control Systems (ICICCS) (pp. 701–707). IEEE.
Suresh, V., & Sreejith, S. (2017). Generation dispatch of combined solar thermal systems using dragonfly algorithm. Computing, 99(1), 59–80.
Surowiecki, J., Silverman, M. P., et al. (2007). The wisdom of crowds. American Journal of Physics, 75(2), 190–192.
Tharwat, A., Gabel, T., & Hassanien, A.E. (2017). Classification of toxicity effects of biotransformed hepatic drugs using optimized support vector machine. In A. E. Hassanien, K. Shaalan, T. Gaber, M. F. Tolba (Eds.), Proceedings of the International Conference on Advanced Intelligent Systems and Informatics 2017 (pp. 161–170). Cham: Springer International Publishing.
Tharwat, A., Gabel, T., & Hassanien, A.E. (2017). Parameter optimization of support vector machine using dragonfly algorithm. In International Conference on Advanced Intelligent Systems and Informatics (pp. 309–319). Springer.
Vanishree, J., & Ramesh, V. (2018). Optimization of size and cost of static var compensator using dragonfly algorithm for voltage profile improvement in power transmission systems. International Journal of Renewable Energy Research (IJRER), 8(1), 56–66.
VeeraManickam, M., Mohanapriya, M., Pandey, B. K., Akhade, S., Kale, S., Patil, R., et al. (2018). Map-reduce framework based cluster architecture for academic students performance prediction using cumulative dragonfly based neural network. Cluster Computing, 1–17.
Vikram, K. A., Ratnam, C., Lakshmi, V., Kumar, A. S., & Ramakanth, R. (2018). Application of dragonfly algorithm for optimal performance analysis of process parameters in turn-mill operations-a case study. In IOP Conference Series: Materials Science and Engineering, vol. 310 (p. 012154). IOP Publishing.
Wu, J., Zhu, Y., Wang, Z., Song, Z., Liu, X., Wang, W., et al. (2017). A novel ship classification approach for high resolution sar images based on the BDA-KELM classification model. International Journal of Remote Sensing, 38(23), 6457–6476.
Zorarpacı, E., & Özel, S. A. (2016). A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Systems with Applications, 62, 91–103.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Mafarja, M., Heidari, A.A., Faris, H., Mirjalili, S., Aljarah, I. (2020). Dragonfly Algorithm: Theory, Literature Review, and Application in Feature Selection. In: Mirjalili, S., Song Dong, J., Lewis, A. (eds) Nature-Inspired Optimizers. Studies in Computational Intelligence, vol 811. Springer, Cham. https://doi.org/10.1007/978-3-030-12127-3_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-12127-3_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-12126-6
Online ISBN: 978-3-030-12127-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)