Skip to main content

A Study on Mutual Information-Based Feature Selection in Classifiers

  • Conference paper
  • First Online:
Artificial Intelligence and Evolutionary Computations in Engineering Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 517))

  • 1431 Accesses

Abstract

Multilabel classification is a classification technique in which each sample may be related with more than one class labels. This paper deals with a comparative study of mutual information (MI) technique and other methods in different classifiers. MI is a technique in filter approach type feature selection. It is a fine indicator, which measures the information or data that common between two variables, it audits and evaluates how one of the variables reduces the uncertainty of the other. We consider other two classifiers for the study; they are Naïve Bayesian (NB) and ID3. The experiments were done using MI and compared with the two classifiers for different benchmark data set from UCI repository flag, music, and yeast. The results were verified using evaluation measures. An accurate precision and recall value can be obtained in MI technique rather than using the classifiers NB and ID3.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. B. Azhagusundari, Antony Selvadoss Thanamani “Feature Selection based on Information Gain” in International Journal of Innovative Technology and Exploring Engineering (IJITEE) ISSN: 2278-3075, Volume-2, Issue-2, January 2013.

    Google Scholar 

  2. Isabelle Guyon, Andr ́e Elisseeff “An Introduction to Variable and Feature Selection” in Journal of Machine Learning Research 3 (2003) 1157–1182.

    Google Scholar 

  3. Matthew Shardlow “An Analysis of Feature Selection Techniques”.

    Google Scholar 

  4. Mohammed M Mazid, A B M Shawkatali, Kevin S Tickle “Improved C4.5 Algorithm for Rule Based Classification” in Recent Advances in Artificial Intelligence, Knowledge Engineering and Databases, ISSN: 1790-5109.

    Google Scholar 

  5. Gauthier Doquire, Michel Verleysen “Mutual information-based feature selection for multilabel classification” in Sixth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS-2012), Volume 122.

    Google Scholar 

  6. Huawen Liua, Jigui Suna,b, Lei Liua, b, HuijieZhangc “Feature selection with dynamic mutual information” in journal Pattern Recognition archive, Volume 42 Issue 7, july 2009.

    Google Scholar 

  7. Andre de Carvalho, Alex Freitas “A Tutorial on Multi-label Classification Techniques” in Abraham et al.(Eds.): Foundations of Comput.Intel. Vol. 5, SCI 205, pp. 177–195.

    Google Scholar 

  8. Grigorios Tsoumakas, Ioannis Katakis, and Ioannis Vlahavas, “Mining Multi-label Data” in Data Mining and Knowledge Discovery Handbook, pp. 667-685, 2nd Edition.

    Google Scholar 

  9. L. Ladha, T. Deepa “Feature Selection Methods and Algorithms” in International Journal on Computer Science and Engineering (IJCSE), ISSN: 0975-3397 Vol. 3 No. 5 May 2011.

    Google Scholar 

  10. Binate Kumari, Tripti Swarnkar* “Filter versus Wrapper Feature Subset Selection in Large Dimensionality Micro array: A Review” in International Journal of Computer Science and Information Technologies, Vol. 2 (3), 2011, 1048–1053.

    Google Scholar 

  11. Mohammad S Sorower “A Literature Survey on Algorithms for Multi-label Learning”.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to B. Arundhathi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Arundhathi, B., Athira, A., Rajan, R. (2017). A Study on Mutual Information-Based Feature Selection in Classifiers. In: Dash, S., Vijayakumar, K., Panigrahi, B., Das, S. (eds) Artificial Intelligence and Evolutionary Computations in Engineering Systems. Advances in Intelligent Systems and Computing, vol 517. Springer, Singapore. https://doi.org/10.1007/978-981-10-3174-8_40

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3174-8_40

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3173-1

  • Online ISBN: 978-981-10-3174-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics