Abstract
This paper presents a novel method for generally adapting ordinal classification models. We essentially rely on the assumption that the ordinal structure of the set of class labels is also reflected in the topology of the instance space. Under this assumption, this paper proposes an algorithm in two phases that takes advantage of the ordinal structure of the dataset and tries to translate this ordinal structure in the total ordered real line and then to rank the patterns of the dataset. The first phase makes a projection of the ordinal structure of the feature space. Next, an evolutionary algorithm tunes the first projection working with the misclassified patterns near the border of their right class. The results obtained in seven ordinal datasets are competitive in comparison with state-of-the-art algorithms in ordinal regression, but with much less computational time in datasets with many patterns.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baccianella, S., Esuli, A., Sebastiani, F.: Evaluation Measures for Ordinal Regression. In: Proceedings of the Ninth International Conference on Intelligent Systems Design and Applications (ISDA 2009), pp. 283–287 (2009)
Cardoso, J.S., Pinto da Costa, J.F.: Learning to Classify Ordinal Data: The Data Replication Method. Journal of Machine Learning Research 8, 1393–1429 (2007)
Cardoso, J.S., Pinto da Costa, J.F., Cardoso, M.J.: Modelling Ordinal Relations with SVMs: an Application to Objective Aesthetic Evaluation of Breast Cancer Conservative Treatment. Neural Networks 18(5-6), 808–817 (2005)
Chu, W., Ghahramani, Z.: Gaussian Processes for Ordinal Regression. Journal of Machine Learning Research 6, 1019–1041 (2005)
Chu, W., Sathiya Keerthi, S.: New Approaches to Support Vector Ordinal Regression. In: ICML 2005: Proceedings of the 22nd International Conference on Machine Learning, pp. 145–152 (2005)
Chu, W., Sathiya Keerthi, S.: Support Vector Ordinal Regression. Neural Computation 19(3), 792–815 (2007)
Pinto da Costa, J.F., Alonso, H., Cardoso, J.S.: The Unimodal Model for the Classification of Ordinal Data. Neural Networks 21(1), 78–91 (2008)
Frank, A., Asuncion, A.: UCI Machine Learning Repository (2010), http://www.ncbi.nlm.nih.gov
Frank, E., Hall, M.: A Simple Approach to Ordinal Classification. In: Flach, P.A., De Raedt, L. (eds.) ECML 2001. LNCS (LNAI), vol. 2167, pp. 145–156. Springer, Heidelberg (2001)
Hawkes, R.K.: The Multivariate Analysis of Ordinal Measures. The American Journal of Sociology 76(5), 908–926 (1971)
Herbrich, R., Graepel, T., Obermayer, K.: Large Margin Rank Boundaries for Ordinal Regression. In: Smola, A.J., Bartlett, P.L., Schölkopf, B., Schuurmans, D. (eds.) Advances in Large Margin Classifiers, pp. 115–132. MIT Press, Cambridge (2000)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme Learning Machine: A New Learning Scheme of Feedforward Neural Networks. In: IEEE International Conference on Neural Networks - Conference Proceedings, pp. 985–990 (2004)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme Learning Machine: Theory and Applications. Neurocomputing 70(1-3), 489–501 (2006)
Hühn, J.C., Hüllermeier, E.: Is an Ordinal Class Structure Useful in Classifier Learning? International Journal of Data Mining, Modelling and Management 1(1), 45–67 (2008)
Kramer, S., Widmer, G., Pfahringer, B., de Groeve, M.: Prediction of Ordinal Classes Using Regression Trees. In: Ohsuga, S., Raś, Z.W. (eds.) ISMIS 2000. LNCS (LNAI), vol. 1932, pp. 426–434. Springer, Heidelberg (2000)
Li, L., Lin, H.-T.: Ordinal Regression by Extended Binary Classification. Advances in Neural Information Processing Systems 19, 865–872 (2007)
Sonnenburg, S.: Machine Learning Data Set Repository (2011), http://mldata.org/
Tutz, G., Hennevogl, W.: Random Effects in Ordinal Regression Models. Computational Statistics & Data Analysis 22(5), 537–557 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Becerra-Alonso, D., Carbonero-Ruz, M., Martínez-Estudillo, F.J., Martínez-Estudillo, A.C. (2012). Evolutionary Extreme Learning Machine for Ordinal Regression. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7665. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34487-9_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-34487-9_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34486-2
Online ISBN: 978-3-642-34487-9
eBook Packages: Computer ScienceComputer Science (R0)