Skip to main content

Multi-objective Differential Evolution Algorithm for Multi-label Feature Selection in Classification

  • Conference paper
  • First Online:
Advances in Swarm and Computational Intelligence (ICSI 2015)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9140))

Included in the following conference series:

Abstract

Multi-label feature selection is a multi-objective optimization problem in nature, which has two conflicting objectives, i.e., the classification performance and the number of features. However, most of existing approaches treat the task as a single objective problem. In order to meet different requirements of decision-makers in real-world applications, this paper presents an effective multi-objective differential evolution for multi-label feature selection. The proposed algorithm applies the ideas of efficient non-dominated sort, the crowding distance and the Pareto dominance relationship to differential evolution to find a Pareto solution set. The proposed algorithm was applied to several multi-label classification problems, and experimental results show it can obtain better performance than two conventional methods. abstract environment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Schapire, R., Singer, Y.: Boostexter: A boosting-based system for text categorization. Machine Learning. 39, 135–168 (2000)

    Article  MATH  Google Scholar 

  2. Sun, F.M., Tang, J.H., Li, H.J., Qi, G.J., Huang, S.: Multi-label image categorization with sparse factor representation. IEEE Transactions on Image Processing. 23, 1028–1037 (2014)

    Article  MathSciNet  Google Scholar 

  3. Xue, B., Zhang, M.J., Browne, W.N., Huang, S.: Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Transactions on cybernetic. 43, 1656–1671 (2013)

    Article  Google Scholar 

  4. Spolaor, N., Alvares Cherman, E., Carolina Monard, M., Lee, H.D.: A comparison of multi-label feature selection methods using the problem transformation approach. Electronic Notes in Theoretical Computer Science. 292, 135–151 (2013)

    Article  Google Scholar 

  5. Chen, W., Yan, J., Zhang, B., Chen, Z., Yang, Q.: Document transformation for multi-label feature selection in text categorization. In: 7th IEEE International on Data Mining, pp. 451–456. IEEE Press, Omaha NE (2007)

    Google Scholar 

  6. Doquire, Gauthier, Verleysen, Michel: Feature selection for multi-label classification problems. In: Cabestany, Joan, Rojas, Ignacio, Joya, Gonzalo (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 9–16. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  7. Sikdar, U.K., Ekbal, A., Saha, S., Uryupina, O., Poesio, M.: Differential evolution-based feature selection technique for anaphora resolution. Soft Computing (2014). doi:10.1007/s00500-014-1397-3

  8. Ani, A., Alsukker, A., Khushaba, R.N.: Feature subset selection using differential evolution and a wheel based search strategy. Swarm and Evolutionary Computation 9, 15–26 (2013)

    Article  Google Scholar 

  9. Unler, A., Murat, A.: A discrete particle swarm optimization method for feature selection in binary classification problems. European Journal of Operational Research 206, 528–539 (2010)

    Article  MATH  Google Scholar 

  10. Zhang, Y., Gong, D.W.: Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148, 150–157 (2015)

    Article  Google Scholar 

  11. Fieldsend, J., Everson, R.: Using unconstrained elite archives for multi-objective optimization. IEEE Transactions on Evolutionary Computation 7, 305–323 (2003)

    Article  Google Scholar 

  12. Kumar, P., Pant, M.: Enhanced mutation strategy for differential evolution. In: IEEE World Congress on Computational Intelligence, pp. 1–6. IEEE Press, Brisbane (2012)

    Google Scholar 

  13. Zhang, X., Tian, Y., Cheng, R., Jin, Y.C.: An efficient approach to non-dominated sorting for evolutionary multi-objective optimization. IEEE Transactions On Evolutionary Computation. (2015). doi:10.1109/TEVC.2014.2308305

  14. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions On Evolutionary Computation 6, 182–197 (2002)

    Article  Google Scholar 

  15. Englebrecht, A.P.: Computational Intelligence: An Intorduction(second edition). John Wiley and Sons, West Sussex (2007)

    Book  Google Scholar 

  16. Zhang, M.L., Zhou, Z.H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recognition 40, 2038–2048 (2007)

    Article  MATH  Google Scholar 

  17. A Java Library for Multi-Label Learning. http://mulan.sourceforge.net/datasets.html

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yong Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhang, Y., Gong, DW., Rong, M. (2015). Multi-objective Differential Evolution Algorithm for Multi-label Feature Selection in Classification. In: Tan, Y., Shi, Y., Buarque, F., Gelbukh, A., Das, S., Engelbrecht, A. (eds) Advances in Swarm and Computational Intelligence. ICSI 2015. Lecture Notes in Computer Science(), vol 9140. Springer, Cham. https://doi.org/10.1007/978-3-319-20466-6_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20466-6_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20465-9

  • Online ISBN: 978-3-319-20466-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics