Abstract
In this work we study the behavior of the FARC-HD method when addressing multi-class classification problems using the One-vs-One (OVO) decomposition strategy. We will show that the confidences provided by FARC-HD (due to the use of the product in the inference process) are not suitable for this strategy. This problem implies that robust strategies like the weighted vote obtain poor results. For this reason, we propose two improvements: 1) the replacement of the product by greater aggregations whose output is independent of the number of elements to be aggregated and 2) the definition of a new aggregation strategy for the OVO methodology, which is based on the weighted vote, in which we only take into account the confidence of the predicted class in each base classifier. The experimental results show that the two proposed modifications have a positive impact on the performance of the classifier.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alcalá-Fdez, J., Fernandez, A., Luengo, J., Derrac, J., García, S., Sánchez, L., Herrera, F.: KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework. Journal of Multiple-Valued Logic and Soft Computing 17(2-3), 255–287 (2011)
Alcala-Fdez, J., Alcala, R., Herrera, F.: A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning. IEEE Transactions on Fuzzy Systems 19(5), 857–872 (2011)
Fernández, A., Calderón, M., Barrenechea, E., Bustince, H., Herrera, F.: Solving mult-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations. Fuzzy Sets and Systems 161(23), 3064–3080 (2010)
Friedman, J.H.: Another approach to polychotomous classification. Tech. rep., Department of Statistics, Stanford University (1996), http://www-stat.stanford.edu/~jhf/ftp/poly.ps.Z
Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes. Pattern Recognition 44(8), 1761–1776 (2011)
Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F.: Dynamic classifier selection for One-vs-One strategy: Avoiding non-competent classifiers. Pattern Recognition 46(12), 3412–3424 (2013)
Hüllermeier, E., Vanderlooy, S.: Combining predictions in pairwise classification: An optimal adaptive voting strategy and its relation to weighted voting. Pattern Recognition 43(1), 128–142 (2010)
Ishibuchi, H., Nakashima, T., Nii, M.: Classification and modeling with linguistic information granules: Advanced approaches to linguistic Data Mining. Springer, Berlin (2004)
Ishibuchi, H., Yamamoto, T.: Rule weight specification in fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 13(4), 428–435 (2005)
Lorena, A.C., Carvalho, A.C., Gama, J.M.: A review on the combination of binary classifiers in multiclass problems. Artificial Intelligence Review 30(1-4), 19–37 (2008)
Sheskin, D.: Handbook of parametric and nonparametric statistical procedures. Chapman & Hall/CRC (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Elkano, M., Galar, M., Sanz, J., Barrenechea, E., Herrera, F., Bustince, H. (2014). Improving the Performance of FARC-HD in Multi-class Classification Problems Using the One-Versus-One Strategy and an Adaptation of the Inference System. In: Laurent, A., Strauss, O., Bouchon-Meunier, B., Yager, R.R. (eds) Information Processing and Management of Uncertainty in Knowledge-Based Systems. IPMU 2014. Communications in Computer and Information Science, vol 444. Springer, Cham. https://doi.org/10.1007/978-3-319-08852-5_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-08852-5_31
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08851-8
Online ISBN: 978-3-319-08852-5
eBook Packages: Computer ScienceComputer Science (R0)