Feature selection expert — User oriented approach

Methodology and concept of the system
  • P. Pudil
  • J. Novovičovà
  • P. Somol
  • R. Vrňata
Feature Selection and Extraction
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1451)


The paper describes the methodology for feature selection and the concept of a user-oriented software package (FS Expert) for feature selction with a consulting system integrated into the package. It attempts to provide a guideline which approach to choose with respect to the extent of a priori knowledge of the problem. The methods implemented in FS Expert are based mostly on the methodology developed by the authors, though it is being built as an open system.


Feature Selection Feature Subset Subset Selection Finite Mixture Class Density 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    P.Devijver and J.Kittler. Pattern Recognition: A Statistical Approach. Prentice, 1982.Google Scholar
  2. 2.
    W.Siedlecki and J.Sklansky. “On automatic feature selection”, International Journal of Pattern Recognition and Artificial Intelligence, 2(2):197–220, June 1988.CrossRefGoogle Scholar
  3. 3.
    F.J.Ferri, P.Pudil, M.Hatef and J.Kittler. “Comparative study of techniques for large-scale feature selection”, In E. S. Gelsema, L. N. Kanal, eds, Pattern Recognition in Practice IV, pp.403–413. Elsevier, 1994.Google Scholar
  4. 4.
    A.Jain and D.Zongker. “Feature Selection: Evaluation, Application and Small Sample Performance”, IEEE Transactions on PAMI, 19(2): 153–158, 1997.Google Scholar
  5. 5.
    P.Pudil, J.Novoviôvá and J.Kittler. “Floating Search Methods in Feature Selection. Pattern Recognition Letters”, 15 (11), 1119–1125, 1994.CrossRefGoogle Scholar
  6. 6.
    Novovičová, J. and Pudil, P. (1997). Dealing With Complexity: Neural Network Approach, chapter Feature Selection and Classification by Modified Model with Latent Structure. Springer Verlag.Google Scholar
  7. 7.
    Novovičová, J., Pudil, P., and Kittler, J. (1996). Divergence based feature selection for multimodal class densities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18:218–223.CrossRefGoogle Scholar
  8. 8.
    Pudil, P. and Novovičová, J. (1998). Novel methods for subset selection with respect to problem knowledge. IEEE Intelligent Systems — Special Issue on Feature Transformation and Subset Selection,March/April 1998: 66–74.Google Scholar
  9. 9.
    Pudil, P., Novovičová, J., Choakjarernwanit, N., and Kittler, J. (1993). An analysis of the max-min approach to feature selection. Pattern Recognition Letters, 14(11):841–847.CrossRefGoogle Scholar
  10. 10.
    Pudil, P., Novovičová, J., Choakjarernwanit, N., and Kittler, J. (1995). Feature selection based on the approximation of class densities by finite mixtures of special type. Pattern Recognition, 28(9):1389–98.CrossRefGoogle Scholar
  11. 11.
    Pudil, P., Novovičová, J., and Kittler, J. (1994). Floating search methods in feature selection. Pattern Recognition Letters, 15:1119–1125.CrossRefGoogle Scholar
  12. 12.
    Redner, R. A. and Walker, H. F. (1984). Mixture densities, maximum likelihood and the EM algorithm. SIAM J. Appl. Math., 26(2):195–239.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • P. Pudil
    • 1
  • J. Novovičovà
    • 1
  • P. Somol
    • 1
  • R. Vrňata
    • 1
  1. 1.Department of Pattern RecognitionInst. of Information Theory and Automation Academy of Sciences of the Czech RepublicPrague 8Czech Republic

Personalised recommendations