Skip to main content
SpringerLink
Log in

A Region-Based Algorithm for Classifier-Independent Feature Selection

  • Chapter
Pattern Recognition and String Matching

Part of the book series: Combinatorial Optimization ((COOP,volume 13))

  • 447 Accesses

Abstract

Feature selection is an important subject in pattern recognition. So far, many studies have been devoted to develop its methodology [1–8], and also some comparative studies on these algorithms [9, 10].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J. Kittler, Feature set search algorithms. in C. H. Chen (ed.) Pattern Recognition and Signal Processing, (Sijthoff and Noordhoff, Alphen aan den Rijn, Netherlands, 1978 ) pp. 41–60.

    Google Scholar 

  2. M. Kudo and M. Shimbo, Feature Selection Based on the Structural Indices of Categories, Pattern RecognitionVol. 26 (1993) pp. 891–901.

    Article  Google Scholar 

  3. F. J. Ferri, P. Pudil, M. Hatef, and J. Kittler, Comparative study of techniques for large-scale feature selection, in E. S. Gelsema and L. N. Kanal (eds.) Pattern Recognition in Practice IV, (Elsevier Science B. V., 1994 ) pp. 403–413.

    Google Scholar 

  4. P. Pudil, J. Novovičová, and J. Kittler, Floating Search Methods in Feature Selection, Pattern Recognition Letters Vol. 15 (1994) pp. 1119–1125.

    Article  Google Scholar 

  5. J. Novovičová, P. Pudil, and J. Kittler, Divergence based feature selection for mulimodal class densities, IEEE Trans. Pattern Anal. Machine Intell. Vol. 18 (1996) pp. 218–223.

    Article  Google Scholar 

  6. P. Pudil, Novovičová, and J. Kittler, Feature selection based on the approximation of class densities by finite mixtures of special type, Pattern Recognition Vol. 28 (1995) pp. 1389–1397.

    Article  Google Scholar 

  7. H. J. Holz and M. H. Loew, Relative feature importance: A classifier-independent approach to feature selection. in E. S. Gelsema and L. N. Kanal (eds.) Pattern Recognition in Practice IV, ( Amsterdam, Elsevier, 1994 ) pp. 473–487.

    Google Scholar 

  8. M. Egmont-Petersen, W. R. M. Dassen and J. H. C. Reiber, Sequential Selection of Discrete Features for a Neural Networks - A Bayesian Approach to Building a Cascade, Pattern Recognition Letters Vol. 20 (1999) pp. 1439–1448.

    Article  Google Scholar 

  9. A. Jain and D. Zongker, Feature Selection: Evaluation, Application, and Small Sample Performance, IEEE Trans. Pattern Anal. Machine Intell. Vol. 19 (1997) pp. 153–157.

    Article  Google Scholar 

  10. M. Kudo and J. Sklansky, Comparison of Algorithms that Select Features for Pattern Classifiers, Pattern Recognition Vol. 33 (2000) pp. 25–41.

    Article  Google Scholar 

  11. L. Kanal, Patterns in Pattern Recognition: 1968–1974, IEEE Trans. Information TheoryVol. 20 (1974) pp. 697–722.

    Article  MATH  MathSciNet  Google Scholar 

  12. G. T. Toussaint, Bibliography on Estimation of Misclassification, IEEE Trans. Information TheoryVol. 20 (1974) pp. 472–479.

    Article  MATH  MathSciNet  Google Scholar 

  13. T. M. Cover, The Best Two Independent Measurements Are Not the Two Best, IEEE Trans. Information Theory Vol. 4 (1974) pp. 116–117.

    MATH  MathSciNet  Google Scholar 

  14. R. M. E. J. D. Elashoff and G. Goldman, On the Choice of Variables in Classification Problems with Dichotomous Variables. BiometrikaVol. 54 (1967) pp. 668–670.

    MathSciNet  Google Scholar 

  15. G. T. Toussaint, Note on Optimal Selection of Independent Binary-Valued Features for Pattern Recognition IEEE Trans. Information TheoryVol. 17 (1971), p. 618.

    Google Scholar 

  16. P. M. Narendra and K. Fukunaga, A Branch and Bound Algorithm for Feature Subset Selection, IEEE Transactions on Computers Vol. 26 (1977) pp. 917–922.

    Article  MATH  Google Scholar 

  17. B. Yu and B. Yuan, A More Efficient Branch and Bound Algorithm for Feature Selectionm Pattern Recognition, Vol. 26 (1993) pp. 883–889.

    Article  Google Scholar 

  18. P. Somol, P. Pudil, and J. Grim, Branch & bound algorithm with partial prediction for use with recursive and non-recursive criterion forms. in Advances in Pattern Recognition of Lecture Notes in Computer Science LNCS 2013 (Springer, 2001) pp. 230–239.

    Google Scholar 

  19. P. Pudil, F. J. Ferri, J. Novovičová, and J. Kittler, Floating Search Methods for Feature Selection with Nonmonotonic Criterion Functions, in Proceedings of 12th International Conference on Pattern Recognition(1994) pp. 279–283.

    Google Scholar 

  20. M. Kudo and J. Sklansky, Classifier-Independent Feature Selection for Two-stage Feature Selection. in Advances in Pattern Recognition ofLecture Notes in Computer Science LNCS 1451 (Springer, 1998) pp. 548–554.

    Google Scholar 

  21. M. Kudo and M Shimbo, Optimal Subclasses with Dichotomous Variables for Feature Selection and Discrimination, IEEE Trans. Systems, Man, and Cybern., Vol. 19 (1989) pp. 119–1199.

    Article  Google Scholar 

  22. M. Kudo, S. Yanagi and M. Shimbo, Construction of Class Regions by a Randomized Algorithm. A Randomized Subclass Method, Pattern RecognitionVol. 29 (1996) pp. 581–588.

    Article  Google Scholar 

  23. J. H. Friedman, A Recursive Partitioning Decision Rule for Nonparametric Classification, IEEE Transactions on Computers, Vol. 26 (1977) pp. 404–408.

    Article  MATH  Google Scholar 

  24. C. Blake and C. Merz, UCI Repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.html] (1998).

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Division of Systems and Information Engineering Graduate School of Engineering, Hokkaido University, Sapporo, 060-8628, Japan

    Mineichi Kudo

Authors
  1. Mineichi Kudo
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Wisconsin — Green Bay, Green Bay, WI, USA

    Dechang Chen

  2. The George Washington University, Washington DC, USA

    Xiuzhen Cheng

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Kluwer Academic Publishers

About this chapter

Cite this chapter

Kudo, M. (2003). A Region-Based Algorithm for Classifier-Independent Feature Selection. In: Chen, D., Cheng, X. (eds) Pattern Recognition and String Matching. Combinatorial Optimization, vol 13. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-0231-5_13

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-0231-5_13

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-7952-2

  • Online ISBN: 978-1-4613-0231-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation