Abstract
Reject options in classification play a major role whenever the costs of a misclassification are higher than the costs to postpone the decision, prime examples being safety critical systems, medical diagnosis, or models which rely on user interaction and user acceptance. While optimum reject options can be computed analytically in case of a probabilistic generative classification model, it is not clear how to optimally integrate reject strategies into efficient deterministic counterparts, such as popular learning vector quantization (LVQ). Recently, first techniques propose promising a posteriori strategies for an efficient reject in such cases (Fischer et al. Neurocomputing, 2015 [7]). In this contribution, we take a different point of view and formalize optimum reject via an integrated cost function. We show that an efficient approximation of these costs together with a geometric reject rule leads to an extension of LVQ which not only aligns the classification model along the reject costs but also self-adjusts an optimum reject threshold while training.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arlt, W., Biehl, M., Taylor, A.E., Hahner, S., Libe, R., Hughes, B.A., Schneider, P., Smith, D.J., Stiekema, H., Krone, N., et al.: Urine steroid metabolomics as a biomarker tool for detecting malignancy in adrenal tumors. J. Clin. Endocrinol. Metab. 96(12), 3775–3784 (2011)
Bartlett, P.L., Wegkamp, M.H.: Classification with a reject option using a hinge loss. J. Mach. Learn. Res. 9, 1823–1840 (2008)
Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009)
Biehl, M., Sadowski, P., Bhanot, G., Bilal, E., Dayarian, A., Meyer, P., Norel, R., Rhrissorrakrai, K., Zeller, M.D., Hormoz, S.: Inter-species prediction of protein phosphorylation in the sbv IMPROVER species translation challenge. Bioinformatics 31(4), 453–461 (2015)
Chow, C.: On optimum recognition error and reject tradeoff. IEEE Trans. Inf. Theory 16(1), 41–46 (1970)
fan Wu, T., Lin, C.-J., Weng, R.C.: Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. 5, 975–1005 (2003)
Fischer, L., Hammer, B., Wersing, H.: Efficient rejection strategies for prototype-based classification. Neurocomputing, page to appear (2015)
Fischer, L., Hammer, B., Wersing, H.: Optimum reject options for prototype-based classification. CoRR, arXiv:1503.06549 (2015)
Giotis, I., Bunte, K., Petkov, N., Biehl, M.: Adaptive matrices and filters for color texture classification. J. Math. Imaging Vis. 47(1–2), 79–92 (2013)
Grandvalet, Y., Rakotomamonjy, A., Keshet, J., Canu, S.: Support vector machines with a reject option. In: Advances in Neural Information Processing Systems 21, Proceedings of the Twenty-Second Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December 8–11, pp. 537–544 (2008)
Herbei, R., Wegkamp, M.: Classification with reject option. Can. J. Stat. 34(4), 709–721 (2006)
Kaden, M., Hermann, W., Villmann, T.: Attention based classification learning in GLVQ and asymmetric classification error assessment. In: Villmann, T., Schleif, F.-M., Kaden, M., Lange, M. (eds.) Advances in Self-Organizing Maps and Learning Vector Quantization: Proceedings of 10th International Workshop WSOM 2014. Mittweida, Advances in Intelligent Systems and Computing, vol. 295, pp. 77–88. Springer, Berlin (2014)
Kaden, M., Lange, M., Nebel, D., Riedel, M., Geweniger, T., Villmann, T.: Aspects in classification learning—review of recent developments in learning vector quantization. Found. Comput. Decis. Sci. 39(2), 79–105 (2014)
Kirstein, S., Wersing, H., Gross, H., Körner, E.: A life-long learning vector quantization approach for interactive learning of multiple categories. Neural Netw. 28, 90–105 (2012)
Kohonen, T.: Learning vector quantization for pattern recognition. Report TKK-F-A601, Helsinki University of Technology, Espoo, Finland (1986)
Pillai, I., Fumera, G., Roli, F.: Multi-label classification with a reject option. Pattern Recognit. 46(8), 2256–2266 (2013)
Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers, pp. 61–74. MIT Press (1999)
Polikar, R., Alippi, C.: Guest editorial learning in nonstationary and evolving environments. IEEE Trans. Neural Netw. Learn. Syst. 25(1), 9–11 (2014)
de Stefano, C., Sansone, C., Vento, M.: To reject or not to reject: That is the question - an answer in case of neural classifiers. IEEE Trans. Syst. Man Cybern.—Part C: Appl. Rev. 30(1), 84–94 (2000)
Saralajew, S., Villmann, T., Söhner, S.: An application of the generalized matrix learning vector quantization method for cut-off-line classification of automobile-headlights. Machine Learning Reports 9(MLR-01-2015), 1–16 (2015). ISSN:1865–3960, http://www.techfak.uni-bielefeld.de/~fschleif/mlr/mlr_01_2015.pdf
Sato, A.S., Yamada, K.: Generalized learning vector quantization. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing Systems, vol. 7, pp. 423–429. MIT Press (1995)
Schleif, F., Villmann, T., Kostrzewa, M., Hammer, B., Gammerman, A.: Cancer informatics by prototype networks in mass spectrometry. Artif. Intell. Med. 45(2–3), 215–228 (2009)
Schneider, P., Hammer, B., Biehl, M.: Adaptive relevance matrices in learning vector quantization. Neural Comput. 21, 3532–3561 (2009)
Senge, R., Bösner, S., Dembczynski, K., Haasenritter, J., Hirsch, O., Donner-Banzhoff, N., Hüllermeier, E.: Learning classifiers that distinguish aleatoric and epistemic uncertainty: reliable classification. Inf. Sci. 255, 16–29 (2014)
de Vries, G., Pauws, S.C., Biehl, M.: Insightful stress detection from physiology modalities using learning vector quantization. Neurocomputing 151, 873–882 (2015)
Yuan, M., Wegkamp, M.H.: Classification methods with reject option based on convex risk minimization. J. Mach. Learn. Res. 11, 111–130 (2010)
Zhu, X., Schleif, F., Hammer, B.: Adaptive conformal semi-supervised vector quantization for dissimilarity data. Pattern Recognit. Lett. 49, 138–145 (2014)
Acknowledgments
This publication was supported by the LIFE—Leipzig Research Center for Civilization Diseases, University Leipzig. LIFE is funded by means of the European Union, by the European Regional Development Fund (ERDF) and by means of the Free State of Saxony within the framework of the excellence initiative.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Villmann, T. et al. (2016). Self-Adjusting Reject Options in Prototype Based Classification. In: Merényi, E., Mendenhall, M., O'Driscoll, P. (eds) Advances in Self-Organizing Maps and Learning Vector Quantization. Advances in Intelligent Systems and Computing, vol 428. Springer, Cham. https://doi.org/10.1007/978-3-319-28518-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-28518-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-28517-7
Online ISBN: 978-3-319-28518-4
eBook Packages: EngineeringEngineering (R0)