Abstract
In this paper an on-line distance-based classifier is considered. The approach extends earlier proposed idea where a family of the online distance-based classifiers based on fuzzy C-means clustering followed by calculation of distances between cluster centroids and the incoming instance for which the class label is to be predicted, were suggested [8]. Now, instead of fuzzy C-means clustering we use kernel-based clustering method. The proposed algorithm works in rounds, where at each round a new instance is given and the algorithm makes a prediction. A portfolio of similarity or distance measures used to construct the ensemble of classifiers predicting the class of coming instances. The proposed approach is validated experimentally.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Asuncion, A., Newman, D.J.: UCI machine learning repository. http://www.ics.uci.edu/mlearn/MLRepository.html, University of California, School of Information and Computer Science (2007)
Bertini, J.R., Zhao, L., Lopes, A.: An incremental learning algorithm based on the K-associated graph for non-stationary data classification. Inf. Sci. 246, 52–68 (2013)
Bezdek, J. C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic Publishers (1981)
Chiang, J.H., Hao, P.Y.: A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE T. Fuzzy Syst. 11(4), 518–527 (2003)
Ditzler, G., Polikar, R.: Incremental learning of concept drift from streaming imbalanced data. IEEE Trans. Knowl. Data Eng. 25(10), 2283–2301 (2013)
Gaber, M.M., Zaslavsky, A., Krishnaswamy, S.: Data stream mining. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 759–787, Part 6 (2010)
Graves, D., Pedrycz, W.: Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study. Fuzzy Sets Syst. 161(4), 522–543 (2010)
Jȩdrzejowicz, J., Jȩdrzejowicz, P.: A family of the online distance-based classifiers. In: Nguyen, N.T. et al. (eds.) ACIIDS 2014, LNAI, vol. 8398, pp. 177–186. Springer, Heidelberg (2014)
Last, M.: Online classification of nonstationary data streams. Intell. Data Anal. 6, 129–147 (2002)
Li, Z., Tang, S., Xue, J., Jiang, J.: Modified FCM clustering based on kernel mapping. Proc. SPIE 4554, 241–245 (2001)
Machine learning data set repository. http://mldata.org/repository/tags/data/IDA_Benchmark_Repository/ (2013)
Moreno-Torres, J.G., Sáez, J.A., Herrera, F.: Study on the impact of partition-induced dataset shift on k -fold cross-validation. IEEE Trans. Neural Netw. Learn. Syst. 23(8), 1304–1312 (2012)
Murata, N., Kawanabe, N., Ziehe, A., Muller, K.R., Amari, S.: On-line learning in changing environments with application in supervised and unsupervised learning. Neural Netw. 15, 743–760 (2002)
Pramod, S., Vyas, O.P.: Data stream mining: A review on windowing approach. Global J. Comput. Sci. Technol. Softw. Data Eng. 12(11), 26–30 (2012)
Waikato.: http://moa.cms.waikato.ac.nz/datasets/ (2013)
Wang, L., Ji, H.-B., Jin, Y.: Fuzzy passive aggressive classification: A robust and efficient algorithm for online classification problems. Inf. Sci. 220, 46–63 (2013)
Widmar, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23, 69–101 (1996)
Zhang, D., Chen, S.: Clustering incomplete data using Kernel-based fuzzy C-means algorithm. Neural Process. Lett. 18(3), 155–162 (2003)
Zhang, D., Chen, S.: Fuzzy clustering using kernel method. In: Proceedings of the International Conference on Control and Automation ICCA, pp. 162–163. Xiamen, China (2002)
\(\check{Z}\)liobaite, I.: Controlled permutations for testing adaptive classifiers. In: Proceedings of the 14th International Conference on Discovery Science, Springer LNCS, vol. 6926, pp. 365–379 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Jȩdrzejowicz, J., Jȩdrzejowicz, P. (2015). Distance-Based Ensemble Online Classifier with Kernel Clustering. In: Neves-Silva, R., Jain, L., Howlett, R. (eds) Intelligent Decision Technologies. IDT 2017. Smart Innovation, Systems and Technologies, vol 39. Springer, Cham. https://doi.org/10.1007/978-3-319-19857-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-19857-6_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19856-9
Online ISBN: 978-3-319-19857-6
eBook Packages: EngineeringEngineering (R0)