Feature selection for a nonlinear classifier

  • M. Sato
  • M. Kudo
  • J. Toyama
  • M. Shimbo
Feature Selection and Extraction
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1451)


The nonlinear classifier is effective for many practical problems. We have already proposed a method for constructing a nonlinear classifier using Legendre polynomials and have obtained good results on many actual data. In this approach, a set of original features is first extended to a large number of new features in a nonlinear fashion and then some substantial features are chosen for the nonlinear classifier. In this study, we have improved the selection process in the second stage by using some conventional feature selection algorithms. In addition, important features were selected from the original features in the preprocessing stage. The reduction in the number of the original features permits the nonlinear classifier to use a higher degree of polynomials.


Feature Selection Training Sample Recognition Rate Legendre Polynomial Feature Selection Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Sato M., Kudo M., Toyama J., Shimbo M.: Construction of a nonlinear discrimination function based on the MDL criterion. In 1st International Workshop on Statistical Techniques in Pattern Recognition, Prague Czech Republic 1997 141–146Google Scholar
  2. 2.
    Rissanen J.: A Universal prior for integers and estimation by minimum description length. Ann. Stat. 11 (1983) 416–4311Google Scholar
  3. 3.
    Kittler J.: Feature set search algorithms. Pattern Recognition and Signal Processing (ed. by Chen C. H.), Sijthoff and Noordhoff, Netherlands 1978 41–60Google Scholar
  4. 4.
    Pudil P., Novovičová J., Kittler J.: Floating search methods in feature selection. Pattern Recognition Letters 15 (1994) 1119–1125CrossRefGoogle Scholar
  5. 5.
    Kudo M., Shimbo M.: Feature selection based on the structural indices of categories. Pattern Recognition 26 (1993) 891–901Google Scholar
  6. 6.
    Murphy P. M., AhaD. W.: UCI Repository of machine learning databases [Machine-readable data repository]. University of California, Irivne, Department of Information and Computation Science 1996Google Scholar
  7. 7.
    Stone M.: Cross-Validatory choice and assessment of statistical predictions. J. Roy. Stat. Soc. 36 (1974) 111–147Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • M. Sato
    • 1
  • M. Kudo
    • 1
  • J. Toyama
    • 1
  • M. Shimbo
    • 2
  1. 1.C's lab, Ltd.SapporoJapan
  2. 2.Division of Systems and Information Engineering Graduate School of EngineeringHokkaido UniversitySapporoJapan

Personalised recommendations