Abstract
This work presents an approach to quantify the quality of panelist’s labeling by means of a soft-margin support vector machine formulation for a bi-class classifier, which is extended to multi-labeler analysis. This approach starts with a formulation of an objective function to determine a suitable hyperplane of decision for classification tasks. Then, this formulation is expressed in a soft-margin form by introducing some slack variables. Finally, we determine penalty factors for each panelist. To this end, a panelist’s effect term is incorporated in the primal soft-margin problem. Such problem is solved by deriving a dual formulation as a quadratic programming problem. For experiments, the well-known Iris database is employed by simulating multiple artificial labels. The obtained penalty factors are compared with standard supervised measures calculated from confusion matrix. The results show that penalty factors are related to the nature of data, allowing to properly quantify the concordance among panelists.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Raykar, V.C., Yu, S., Zhao, L.H., Valadez, G.H., Florin, C., Bogoni, L., Moy, L.: Learning from crowds. Journal of Machine Learning Research 11, 1297–1322 (2010)
Dekel, O., Shamir, O.: Vox populi: Collecting high-quality labels from a crowd. In: Proceedings of the 22nd Annual Conference on Learning Theory (2009)
Smyth, P., Fayyad, U.M., Burl, M.C., Perona, P., Baldi, P.: Inferring ground truth from subjective labelling of venus images. In: NIPS 1994, pp. 1085–1092 (1994)
Crammer, K., Kearns, M., Wortman, J., Bartlett, P.: Learning from multiple sources. In: Advances in Neural Information Processing Systems, vol. 19 (2007)
Dekel, O., Shamir, O.: Good learners for evil teachers. In: ICML, p. 30 (2009)
Frank, A., Asuncion, A.: UCI machine learning repository (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Murillo-Rendón, S., Peluffo-Ordóñez, D., Arias-Londoño, J.D., Castellanos-Domínguez, C.G. (2013). Multi-labeler Analysis for Bi-class Problems Based on Soft-Margin Support Vector Machines. In: Ferrández Vicente, J.M., Álvarez Sánchez, J.R., de la Paz López, F., Toledo Moreo, F.J. (eds) Natural and Artificial Models in Computation and Biology. IWINAC 2013. Lecture Notes in Computer Science, vol 7930. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-38637-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-38637-4_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-38636-7
Online ISBN: 978-3-642-38637-4
eBook Packages: Computer ScienceComputer Science (R0)