Abstract
Many pattern analysis problems require classification of examples into naturally ordered classes. In such cases nominal classification schemes will ignore the class order relationships, which can have detrimental effect on classification accuracy. This paper introduces a novel ordinal Learning Vector Quantization (LVQ) scheme, with metric learning, specifically designed for classifying data items into ordered classes. Unlike in nominal LVQ, in ordinal LVQ the class order information is utilized during training in selection of the class prototypes to be adapted, as well as in determining the exact manner in which the prototypes get updated. Prototype based models are in general more amenable to interpretations and can often be constructed at a smaller computational cost than alternative non-linear classification models. Experiments demonstrate that the proposed ordinal LVQ formulation compares favorably with its nominal counterpart. Moreover, our method achieves competitive performance against existing benchmark ordinal regression models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chu, W., Keerthi, S.S.: Support Vector Ordinal Regression. Neural Computation 19(3), 792–815 (2007)
Cardoso, J.S., Pinto da Costa, J.F., Cardoso, M.J.: Modelling Ordinal Relations with SVMs: An Application to Objective Aesthetic Evaluation of Breast Cancer Conservative Treatment. Neural Networks 18(5-6), 808–817 (2005)
Shashua, A., Levin, A.: Ranking with Large Margin Principle: Two Approaches. In: Becker, S., Thrun, S., Obermayer, K. (eds.) Advances in Neural Information Processing Systems 15, pp. 937–944. MIT Press, Vancouver (2002)
Li, L., Lin, H.: Ordinal Regression by Extended Binary Classification. In: Schölkopf, B., Platt, J.C., Hofmann, T. (eds.) Advances in Neural Information Processing Systems 19, pp. 865–872. MIT Press, Vancouver (2007)
Van Belle, V., Pelckmans, K., Suykens, J.A.K., Van Huffel, S.: MINLIP: Efficient Learning of Transformation Models. In: Alippi, C., Polycarpou, M., Panayiotou, C., Ellinas, G. (eds.) ICANN 2009, Part I. LNCS, vol. 5768, pp. 60–69. Springer, Heidelberg (2009)
Sun, B.Y., Li, J., Wu, D.D., Zhang, X.M., Li, W.B.: Kernel Discriminant Learning for Ordinal Regression. IEEE Transactions on Knowledge and Data Engineering 22(6), 906–910 (2010)
Kohonen, T.: Learning Vector Quantization for Pattern Recognition. Technical report, TKKF-A601, Laboratory of Computer and Information Science, Department of Technical Physics, Helsinki University of Technology. Espoo, Finland (1986)
Kohonen, T.: Learning Vector Quantization. The handbook of brain theory and neural networks. MIT Press, Cambridge (1998)
Schneider, P., Biehl, M., Hammer, B.: Adaptive Relevance Matrices in Learning Vector Quantization. Neural Computation 21(12), 3532–3561 (2009)
Schneider, P.: Advanced Methods for Prototype-based Classification. Doctoral Dissertation. University of Groningen (2010), http://irs.ub.rug.nl/ppn/327245379
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fouad, S., Tino, P. (2012). Prototype Based Modelling for Ordinal Classification. In: Yin, H., Costa, J.A.F., Barreto, G. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2012. IDEAL 2012. Lecture Notes in Computer Science, vol 7435. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32639-4_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-32639-4_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32638-7
Online ISBN: 978-3-642-32639-4
eBook Packages: Computer ScienceComputer Science (R0)