An Ensemble Feature Selection Framework of Sonar Targets Using Symmetrical Uncertainty and Multi-Layer Perceptron (SU-MLP)

  • Sai Prasad PotharajuEmail author
  • M. Sreedevi
  • Shanmuk Srinivas Amiripalli
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 768)


In Data Mining applications, feature selection methods has become popular area of investigation. It has become priority strategy to get significant knowledge about any chosen domain. In literature many ways are existed for feature selection (Filter, Wrapper, Embedded). With the availability of large characters of data, the feature selection has become necessary in the process of Data Mining. In this article, we presented and examined a new feature selection technique on the basis of Symmetrical Uncertainty (SU) and Multi-Layer Perceptron (MLP), then we estimated the performance of rule-based (Jrip), tree-based (J48), lazy (KNN) algorithm with ensembling techniques such as boosting, bagging on SONAR (sound navigation and ranging) data. In our proposed framework, we divided the most prominent features derived by SU into finite number of clusters. Each cluster formed by our technique has unique features. As an initial step, MLP is applied on all clusters and decided the foremost cluster as per classifier accuracy. The finest cluster of features are examined with Jrip, J48, KNN with ensembling approaches and compared with existing feature selection techniques Gain Ratio Attribute (GR), Information Gain(IG), Chi Squared Feature selection (CHI). Cluster of features originated by the proposed framework has recorded improvement with the most of the classifiers than traditional methods.


Bagging Boosting Multi-layer perceptron Symmetrical uncertainty SMOTE 


  1. 1.
    Kumar, V., Minz, S.: Feature selection: a literature review. Smart Comput. Rev. 4(3), 211–229 (2014)CrossRefGoogle Scholar
  2. 2.
    Saeys, Y., Inza, I., Larrañaga, P.: A review of feature selection techniques in bioinformatics. Bioinform. 23(19), 2507–2517 (2007)CrossRefGoogle Scholar
  3. 3.
    Akay, M.F.: Support vector machines combined with feature selection for breast cancer diagnosis. Expert Syst. Appl. 36(2), 3240–3247 (2009)CrossRefGoogle Scholar
  4. 4.
    Hariri, S., Yousif, M., Qu, G.: A New Dependency and Correlation Analysis for Features. IEEE Trans. Knowl. Data Eng. 17, 1199–1207 (2005)CrossRefGoogle Scholar
  5. 5.
    Park, C.H., Kim, S.B.: Sequential random k-nearest neighbor feature selection for high-dimensional data. Expert Syst. Appl. 42, 2336–2342 (2015)CrossRefGoogle Scholar
  6. 6.
    Song, Qinbao, Ni, Jingjie, Wang, Guangtao: A fast clustering-based feature subset selection algorithm for high-dimensional data. IEEE Trans. Knowl. Data Eng. 25, 1–14 (2013)CrossRefGoogle Scholar
  7. 7.
    Jalilvand, A., Salim, N.: Feature unionization: a novel approach for dimension reduction. Appl. Soft Comput. 52, 1253–1261 (2017)CrossRefGoogle Scholar
  8. 8.
    Latkowski, T., Osowski, S.: Data mining for feature selection in gene expression autism data. Expert Syst. Appl. 42, 864–872 (2015)CrossRefGoogle Scholar
  9. 9.
    Bharti, K.K., Singh, P.K.: Hybrid dimension reduction by integrating feature selection with feature extraction method for text clustering. Expert Syst. Appl. 42(6), 3105–3114 (2015)CrossRefGoogle Scholar
  10. 10.
    Prasad Potharaju, S., Sreedevi, M.: An improved prediction of kidney disease using SMOTE’. Indian J. Sci. Technol. 9. (2016)
  11. 11.
    Potharaju, S.P., Sreedevi, M.: Ensembled rule based classification algorithms for predicting imbalanced kidney disease data. J. Eng. Sci. Technol. Rev. 9, 201–207 (2016)Google Scholar
  12. 12.
    Ozcift, A., Gulten, A.: A robust multi-class feature selection strategy based on rotation forest ensemble algorithm for diagnosis of Erythemato-squamous diseases. J. Med. Syst. 36, 941–949 (2012)CrossRefGoogle Scholar
  13. 13.
    Kotaria, V., Changa, K.C.: Fusion and gaussian mixture based classifiers for SONAR data. In: SPIE defense, security, and sensing, pp. 80500U–80500U. International Society for Optics and Photonics (2011)Google Scholar
  14. 14.
    Chen, C.H., Lee, J.D., Lin, M.C.: Classification of underwater signals using neural networks. Tamkang J. Sci. Eng. 3(1), 31–48 (2000)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Sai Prasad Potharaju
    • 1
    Email author
  • M. Sreedevi
    • 1
  • Shanmuk Srinivas Amiripalli
    • 1
  1. 1.Department of Computer Science and EngineeringKL UniversityGunturIndia

Personalised recommendations