Improving the Accuracy of a Two-Stage Algorithm in Evolutionary Product Unit Neural Networks for Classification by Means of Feature Selection

  • Antonio J. Tallón-Ballesteros
  • César Hervás-Martínez
  • José C. Riquelme
  • Roberto Ruiz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6687)


This paper introduces a methodology that improves the accuracy of a two-stage algorithm in evolutionary product unit neural networks for classification tasks by means of feature selection. A couple of filters have been taken into consideration to try out the proposal. The experimentation has been carried out on seven data sets from the UCI repository that report test mean accuracy error rates about twenty percent or above with reference classifiers such as C4.5 or 1-NN. The study includes an overall empirical comparison between the models obtained with and without feature selection. Also several classifiers have been tested in order to illustrate the performance of the different filters considered. The results have been contrasted with nonparametric statistical tests and show that our proposal significantly improves the test accuracy of the previous models for the considered data sets. Moreover, the current proposal is much more efficient than a previous methodology developed by us; lastly, the reduction percentage in the number of inputs is above a fifty five, on average.


Feature Selection Feature Subset Feature Selection Method Feature Selector Subset Evaluation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Asuncion, A., Newman, D.J.: UCI Machine Learning Repository (2007)Google Scholar
  2. 2.
    Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Heidelberg (2006)zbMATHGoogle Scholar
  3. 3.
    Demsar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar
  4. 4.
    Durbin, R., Rumelhart, D.: Products units: A computationally powerful and biologically plausible extension to backpropagation networks. Neural Computation 1(1), 133–142 (1989)CrossRefGoogle Scholar
  5. 5.
    Hall, M.A.: Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the Seventeenth International Conference on Machine Learning (ICML 2000), pp. 359–366. Morgan Kaufmann, San Francisco (2000)Google Scholar
  6. 6.
    Landwehr, N., Hall, M., Frank, E.: Logistic model trees. Machine Learning 59(1-2), 161–205 (2005)CrossRefzbMATHGoogle Scholar
  7. 7.
    Liu, H., Setiono, R.: A probabilistic approach to feature selection - a filter solution. In: Proceedings of the Thirteenth International Conference on Machine Learning (ICML 1996), pp. 319–327. Morgan Kaufmann, San Francisco (1996)Google Scholar
  8. 8.
    Martínez-Estudillo F.J., Hervás-Martínez, C., Gutiérrez, P.A., Martínez-Estudillo, A. C.: Evolutionary product-unit neural networks classifiers. Neurocomputing 72(1-2), 548–561 (2008)Google Scholar
  9. 9.
    Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Projection-based measure for efficient feature selection. J. Intell. Fuzzy Syst. 12(3-4), 175–183 (2002)zbMATHGoogle Scholar
  10. 10.
    Ruiz, R., Riquelme, J.C., Aguilar-Ruiz, J.S.: Incremental wrapper-based gene selection from microarray expression data for cancer classification. Pattern Recognition 39(12), 2383–2392 (2006)CrossRefGoogle Scholar
  11. 11.
    Tallón-Ballesteros, A.J., Hervás-Martínez, C.: A two-stage algorithm in evolutionary product unit neural networks for classification. Expert Systems with Applications 38(1), 743–754 (2011)CrossRefGoogle Scholar
  12. 12.
    Vapnik, V.N.: The nature of Statistical Learning Theory. Springer, Heidelberg (1995)CrossRefzbMATHGoogle Scholar
  13. 13.
    Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques. Data Management Systems, 2nd edn., Morgan Kaufmann, San Francisco (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Antonio J. Tallón-Ballesteros
    • 1
  • César Hervás-Martínez
    • 2
  • José C. Riquelme
    • 1
  • Roberto Ruiz
    • 3
  1. 1.Department of Languages and Computer SystemsUniversity of SevilleSpain
  2. 2.Department of Computer Science and Numerical AnalysisUniversity of CórdobaSpain
  3. 3.Area of Computer SciencePablo de Olavide UniversitySevilleSpain

Personalised recommendations