Skip to main content
SpringerLink
Log in

Local Rejection Strategies for Learning Vector Quantization

  • Conference paper
Artificial Neural Networks and Machine Learning – ICANN 2014 (ICANN 2014)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8681))

Included in the following conference series:

Abstract

Classification with rejection is well understood for classifiers which provide explicit class probabilities. The situation is more complicated for popular deterministic classifiers such as learning vector quantisation schemes: albeit reject options using simple distance-based geometric measures were proposed [4], their local scaling behaviour is unclear for complex problems. Here, we propose a local threshold selection strategy which automatically adjusts suitable threshold values for reject options in prototype-based classifiers from given data. We compare this local threshold strategy to a global choice on artificial and benchmark data sets; we show that local thresholds enhance the classification results in comparison to global ones, and they better approximate optimal Bayesian rejection in cases where the latter is available.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bache, K., Lichman, M.: UCI machine learning repository (2013)

    Google Scholar 

  2. Biehl, M., Ghosh, A., Hammer, B.: Dynamics and generalization ability of LVQ algorithms. The Journal of Machine Learning Research 8, 323–360 (2007)

    MATH  MathSciNet  Google Scholar 

  3. Chow, C.K.: On Optimum Recognition Error and Reject Tradeoff. IEEE Transactions on Information Theory 16(1), 41–46 (1970)

    Article  MATH  Google Scholar 

  4. Fischer, L., Hammer, B., Wersing, H.: Rejection Strategies for Learning Vector Quantization. In: Proc. European Symposium on Artificial Neural Networks (ESANN), Bruges, pp. 41–46 (2014)

    Google Scholar 

  5. Fischer, L., Nebel, D., Villmann, T., Hammer, B., Wersing, H.: Rejection Strategies for Learning Vector Quantization – a Comparison of Probabilistic and Deterministic Approaches. In: Villmann, T., Schleif, F.-M., Kaden, M., Lange, M. (eds.) Advances in Self-Organizing Maps and Learning Vector Quantization. AISC, vol. 295, pp. 109–118. Springer, Heidelberg (2014)

    Google Scholar 

  6. Fumera, G., Roli, F., Giacinto, G.: Reject option with multiple thresholds. Pattern Recognition 33(12), 2099–2101 (2000)

    Article  Google Scholar 

  7. Herbei, R., Wegkamp, M.H.: Classification with reject option. Canadian Journal of Statistics 34(4), 709–721 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  8. Kirstein, S., Wersing, H., Gross, H.-M., Körner, E.: A Life-Long Learning Vector Quantization Approach for Interactive Learning of Multiple Categories. Neural Networks 28, 90–105 (2012)

    Article  Google Scholar 

  9. Kohonen, T.: Self-Organization and Associative Memory, 3rd edn. Springer Series in Information Sciences. Springer (1989)

    Google Scholar 

  10. Nadeem, M.S.A., Zucker, J.-D., Hanczar, B.: Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option. In: International Workshop on Machine Learning in Systems Biology, pp. 65–81 (2010)

    Google Scholar 

  11. Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Technical Report CUCS-005-96 (February 1996)

    Google Scholar 

  12. Sato, A., Yamada, K.: Generalized Learning Vector Quantization. In: Advances in Neural Information Processing Systems, vol. 7, pp. 423–429 (1995)

    Google Scholar 

  13. Schneider, P., Biehl, M., Hammer, B.: Adaptive Relevance Matrices in Learning Vector Quantization. Neural Computation 21(12), 3532–3561 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  14. Schneider, P., Bunte, K., Stiekema, H., Hammer, B., Villmann, T., Biehl, M.: Regularization in matrix relevance learning. IEEE Transactions on Neural Networks 21(5), 831–840 (2010)

    Article  Google Scholar 

  15. Seo, S., Obermayer, K.: Soft Learning Lector Quantization. Neural Computation 15(7), 1589–1604 (2003)

    Article  MATH  Google Scholar 

  16. Thodberg, H.H.: Tecator data set, contained in StatLib Datasets Archive (1995)

    Google Scholar 

  17. Vailaya, A., Jain, A.K.: Reject Option for VQ-Based Bayesian Classification. In: International Conference on Pattern Recognition (ICPR), pp. 2048–2051 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. HONDA Research Institute Europe GmbH, Carl-Legien-Str. 30, 63065, Offenbach, Germany

    Lydia Fischer & Heiko Wersing

  2. Bielefeld University, Universitätsstr. 25, 33615, Bielefeld, Germany

    Lydia Fischer & Barbara Hammer

Authors
  1. Lydia Fischer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Barbara Hammer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heiko Wersing
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Informatics, University of Hamburg, Vogt-Kölln-Straße 30, 22527, Hamburg, Germany

    Stefan Wermter , Cornelius Weber  & Sven Magg ,  & 

  2. Department of Informatics, Nicolaus Compernicus University, ul. Grudziądzka 5, 87-100, Torun, Poland

    Włodzisław Duch

  3. Department of Modern Languages, University of Helsinki, P.O. Box 24, 00014, Helsinki, Finland

    Timo Honkela

  4. Institute of Information and Communication Technologies, Bulgarian Academy of Sciences, Acad. G. Bonchev str. bl. 25A, 1113, Sofia, Bulgaria

    Petia Koprinkova-Hristova

  5. Institute of Neural Information Processing, University of Ulm, 89069, Oberer Eselsberg, Ulm, Germany

    Günther Palm

  6. Department of Information Systems, Quartier UNIL-Dorigny, Bâtiment Internef, University of Lausanne, 1015, Lausanne, Switzerland

    Alessandro E. P. Villa

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Fischer, L., Hammer, B., Wersing, H. (2014). Local Rejection Strategies for Learning Vector Quantization. In: Wermter, S., et al. Artificial Neural Networks and Machine Learning – ICANN 2014. ICANN 2014. Lecture Notes in Computer Science, vol 8681. Springer, Cham. https://doi.org/10.1007/978-3-319-11179-7_71

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11179-7_71

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11178-0

  • Online ISBN: 978-3-319-11179-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation