A Combined Ant Colony and Differential Evolution Feature Selection Algorithm

  • Rami N. Khushaba
  • Ahmed Al-Ani
  • Akram AlSukker
  • Adel Al-Jumaily
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5217)


Feature selection is an important step in many pattern recognition systems that aims to overcome the so-called curse of dimensionality problem. Although Ant Colony Optimization (ACO) proved to be a powerful technique in different optimization problems, but it still needs some improvements when applied to the feature selection problem. This is due to the fact that it builds its solutions sequentially, where in feature selection this behavior will most likely not lead to the optimal solution. In this paper, a novel feature selection algorithm based on a combination of ACO and a simple, yet powerful, Differential Evolution (DE) operator is presented. The proposed combination enhances both the exploration and exploitation capabilities of the search procedure. The new algorithm is tested on two biosignal-driven applications. The performance of the proposed algorithm is compared with other dimensionality reduction techniques to prove its superiority.


Feature Selection Linear Discriminant Analysis Travelling Salesman Problem Feature Subset Feature Selection Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Liu, H., Motoda, H.: Computational Methods of Feature Selection. Taylor & Francis Group, Abington (2008)Google Scholar
  2. 2.
    Al-Ani, A.: Feature subset selection using ant colony optimization. Int. Journal of Computational Intelligence 2, 53–58 (2005)Google Scholar
  3. 3.
    Frohlich, H., Chapelle, O., Scholkopf, B.: Feature selection for support vector machines by means of genetic algorithms. In: 15th IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2003), pp. 142–148 (2003)Google Scholar
  4. 4.
    Dorigo, M., Stützle, T.: Ant Colony Optimization. MIT Press, London (2004)zbMATHGoogle Scholar
  5. 5.
    Kennedy, J., Eberhart, R.C., Shi, Y.: Swarm Intelligence. Morgan Kaufmann, London (2001)Google Scholar
  6. 6.
    Firpi, H., Goodman, E.: Swarmed feature selection. In: Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop (AIPR 2004), pp. 112–118 (2004)Google Scholar
  7. 7.
    Price, K., Storn, R., Lampinen, J.: Differential Evolution: A Practical Approach to Global Optimization. Springer, Heidelberg (2005)zbMATHGoogle Scholar
  8. 8.
    Zhang, C., Hu, H.: Feature selection using the hybrid of ant colony optimization and mutual information for the forecaster. In: Proceedings of International Conference on Machine Learning and Cybernetics, pp. 1728–1732 (2005)Google Scholar
  9. 9.
    Gao, H., Yang, H., Wang, X.: Ant colony optimization based network intrusion feature selection and detection. In: Proceedings of 2005 International Conference on Machine Learning and Cybernetics, pp. 3871–3875 (2005)Google Scholar
  10. 10.
    Jensen, R.: Combining Rough and Fuzzy Sets for Feature Selection. PhD thesis, University of Edinburgh (2005)Google Scholar
  11. 11.
    Kanan, H., Faez, K., Taheri, S.: Feature selection using ant colony optimization (aco): A new method and comparative study in the application of face recognition system. In: Perner, P. (ed.) ICDM 2007. LNCS (LNAI), vol. 4597, pp. 63–76. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  12. 12.
    Yan, Z., Yuan, C.: Ant colony optimization for feature selection in face recognition. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004. LNCS, vol. 3072, pp. 221–226. Springer, Heidelberg (2004)Google Scholar
  13. 13.
    Al-Ani, A., Deriche, M., Chebil, J.: A new mutual information based measure for feature selection. Intelligent Data Analysis 7, 43–47 (2003)Google Scholar
  14. 14.
    Al-Ani, A., Al-Sukker, A.: Effect of feature and channel selection on eeg classification. In: Proceedings of The 28th IEEE EMBS Annual International Conference, New York City, USA, pp. 2171–2174 (2006)Google Scholar
  15. 15.
    Englehart, K.: Signal Representation for Classification of The Transient Myoelectric Signal. PhD thesis, University of New Brunswick (1998)Google Scholar
  16. 16.
    Chu, J., Moon, I., Mun, M.: A real-time emg pattern recognition system based on linear-nonlinear feature projection for a multifunction myoelectric hand. IEEE Trans. on Biomedical Engineering 53(11), 2232–2239 (2006)CrossRefGoogle Scholar
  17. 17.
    Chu, J., Moon, I., Mun, M.: A supervised feature projection for real-time multifunction myoelectric hand control. In: Proceedings of The 28th IEEE EMBS Annual International Conference, New York City, USA, pp. 2417–2420 (2006)Google Scholar
  18. 18.
    Chan, A., Green, G.: Myoelectric control development toolbox. In: Proceedings of The 30’th Conference of the Canadian Medical & Biological Engineering Society, Toronto, ON (2007)Google Scholar
  19. 19.
    Goge, A., Chan, A.: Investigating classification parameters for continuous myoelectrically controlled prostheses. In: Proceedings of The 28th Conference of the Canadian Medical & Biological Engineering Society, Quebec City, Canada, pp. 141–144 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Rami N. Khushaba
    • 1
  • Ahmed Al-Ani
    • 1
  • Akram AlSukker
    • 1
  • Adel Al-Jumaily
    • 1
  1. 1.Faculty of EngineeringUniversity of TechnologySydneyAustralia

Personalised recommendations