Abstract
The objective of this paper is to consider some properties of decisions produced by classifiers that are in consensus. Consensus allows strong classifiers to obtain very reliable classification on the objects on which consensus has been reached. For those ones where consensus is not reached the reclassification procedure should be applied based on other classification algorithms. Properties of different consensuses are described using algebraic approach and performance evaluation routine.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Basu, M., Ho, T.K.: Data Complexity in Pattern Recognition. Springer, London (2006)
Biau, G., Devroye, L.: Lectures on the Nearest Neighbor Method. Springer, Cham (2015)
Frank, A., Asuncion, A.: Uci repository of machine learning databases. Technical report, School of Information and Computer Sciences, University of California, Irvine, CA (2010)
Freund, Y., Schapire, R.E.: A desicion-theoretic generalization of on-line learning and an application to boosting. In: Vitányi, P. (ed.) EuroCOLT 1995. LNCS, vol. 904, pp. 23–37. Springer, Heidelberg (1995). doi:10.1007/3-540-59119-2_166
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, 2nd edn. Springer, New York (2009)
Ho, T.K., Basu, M.: Complexity measures of supervised classification problems. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 289–300 (2002)
Kapustii, B., Rusyn, B., Tayanov, V.: Classifier optimization in small sample size condition. Autom. Control Comput. Sci. 40(5), 17–22 (2006)
Koller, D., Friedman, N.: Probabilistic Graphical Models: Principles and Techniques. MIT Press, Cambridge (2009)
Kuncheva, L.: Combining Pattern Classifiers. Wiley, Hoboken (2014)
Kyrgyzov, I.O., Maitre, H., Campedel, M.: A method of clustering combination applied to satellite image analysis. In: 14th International IEEE Conference on Image Analysis and Processing, pp. 81–86 (2007)
Rokach, L.: Pattern Classification Using Ensemble Methods. World Scientific, Singapore (2009)
Rusyn, B., Tayanov, V., Lutsyka, O.: Upper-bound estimates for classifiers based on a dissimilarity function. Cybern. Syst. Anal. 48(4), 592–600 (2012)
Vapnik, V., Izmailov, R.: Statistical inference problems and their rigorous solutions. In: Gammerman, A., Vovk, V., Papadopoulos, H. (eds.) SLDS 2015. LNCS, vol. 9047, pp. 33–71. Springer, Cham (2015). doi:10.1007/978-3-319-17091-6_2
Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)
Vorontsov, K.V.: Splitting and similarity phenomena in the sets of classifiers and their effect on the probability of overfitting. Pattern Recogn. Image Anal. 19(3), 412–420 (2009)
Vorontsov, K.: Combinatorial probability and the tightness of generalization bounds. Pattern Recogn. Image Anal. 18(2), 243–259 (2008)
Wozniak, M.: Hybrid Classifiers: Methods of Data, Knowledge, and Classifier Combination. Springer, Heidelberg (2013)
Xu, L., Krzyżak, A., Suen, C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Syst. Man Cybern. 22(3), 418–435 (1992)
Zhuravlev, Y.I.: On an algebraic approach to solving recognition or classification problems. Prob. Cybern. 33, 5–68 (1978). (in Russian)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Tayanov, V., Krzyżak, A., Suen, C. (2018). Some Properties of Consensus-Based Classification. In: Kurzynski, M., Wozniak, M., Burduk, R. (eds) Proceedings of the 10th International Conference on Computer Recognition Systems CORES 2017. CORES 2017. Advances in Intelligent Systems and Computing, vol 578. Springer, Cham. https://doi.org/10.1007/978-3-319-59162-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-59162-9_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59161-2
Online ISBN: 978-3-319-59162-9
eBook Packages: EngineeringEngineering (R0)