An Ensemble Feature Selection Framework of Sonar Targets Using Symmetrical Uncertainty and Multi-Layer Perceptron (SU-MLP)

Abstract

In Data Mining applications, feature selection methods has become popular area of investigation. It has become priority strategy to get significant knowledge about any chosen domain. In literature many ways are existed for feature selection (Filter, Wrapper, Embedded). With the availability of large characters of data, the feature selection has become necessary in the process of Data Mining. In this article, we presented and examined a new feature selection technique on the basis of Symmetrical Uncertainty (SU) and Multi-Layer Perceptron (MLP), then we estimated the performance of rule-based (Jrip), tree-based (J48), lazy (KNN) algorithm with ensembling techniques such as boosting, bagging on SONAR (sound navigation and ranging) data. In our proposed framework, we divided the most prominent features derived by SU into finite number of clusters. Each cluster formed by our technique has unique features. As an initial step, MLP is applied on all clusters and decided the foremost cluster as per classifier accuracy. The finest cluster of features are examined with Jrip, J48, KNN with ensembling approaches and compared with existing feature selection techniques Gain Ratio Attribute (GR), Information Gain(IG), Chi Squared Feature selection (CHI). Cluster of features originated by the proposed framework has recorded improvement with the most of the classifiers than traditional methods.