Skip to main content

Distance-Based Ensemble Online Classifier with Kernel Clustering

  • Conference paper
  • First Online:

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 39))

Abstract

In this paper an on-line distance-based classifier is considered. The approach extends earlier proposed idea where a family of the online distance-based classifiers based on fuzzy C-means clustering followed by calculation of distances between cluster centroids and the incoming instance for which the class label is to be predicted, were suggested [8]. Now, instead of fuzzy C-means clustering we use kernel-based clustering method. The proposed algorithm works in rounds, where at each round a new instance is given and the algorithm makes a prediction. A portfolio of similarity or distance measures used to construct the ensemble of classifiers predicting the class of coming instances. The proposed approach is validated experimentally.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Asuncion, A., Newman, D.J.: UCI machine learning repository. http://www.ics.uci.edu/mlearn/MLRepository.html, University of California, School of Information and Computer Science (2007)

  2. Bertini, J.R., Zhao, L., Lopes, A.: An incremental learning algorithm based on the K-associated graph for non-stationary data classification. Inf. Sci. 246, 52–68 (2013)

    Article  MathSciNet  Google Scholar 

  3. Bezdek, J. C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic Publishers (1981)

    Google Scholar 

  4. Chiang, J.H., Hao, P.Y.: A new kernel-based fuzzy clustering approach: support vector clustering with cell growing. IEEE T. Fuzzy Syst. 11(4), 518–527 (2003)

    Article  Google Scholar 

  5. Ditzler, G., Polikar, R.: Incremental learning of concept drift from streaming imbalanced data. IEEE Trans. Knowl. Data Eng. 25(10), 2283–2301 (2013)

    Article  Google Scholar 

  6. Gaber, M.M., Zaslavsky, A., Krishnaswamy, S.: Data stream mining. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 759–787, Part 6 (2010)

    Google Scholar 

  7. Graves, D., Pedrycz, W.: Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study. Fuzzy Sets Syst. 161(4), 522–543 (2010)

    Google Scholar 

  8. Jȩdrzejowicz, J., Jȩdrzejowicz, P.: A family of the online distance-based classifiers. In: Nguyen, N.T. et al. (eds.) ACIIDS 2014, LNAI, vol. 8398, pp. 177–186. Springer, Heidelberg (2014)

    Google Scholar 

  9. Last, M.: Online classification of nonstationary data streams. Intell. Data Anal. 6, 129–147 (2002)

    MATH  Google Scholar 

  10. Li, Z., Tang, S., Xue, J., Jiang, J.: Modified FCM clustering based on kernel mapping. Proc. SPIE 4554, 241–245 (2001)

    Google Scholar 

  11. Machine learning data set repository. http://mldata.org/repository/tags/data/IDA_Benchmark_Repository/ (2013)

  12. Moreno-Torres, J.G., Sáez, J.A., Herrera, F.: Study on the impact of partition-induced dataset shift on k -fold cross-validation. IEEE Trans. Neural Netw. Learn. Syst. 23(8), 1304–1312 (2012)

    Article  Google Scholar 

  13. Murata, N., Kawanabe, N., Ziehe, A., Muller, K.R., Amari, S.: On-line learning in changing environments with application in supervised and unsupervised learning. Neural Netw. 15, 743–760 (2002)

    Article  Google Scholar 

  14. Pramod, S., Vyas, O.P.: Data stream mining: A review on windowing approach. Global J. Comput. Sci. Technol. Softw. Data Eng. 12(11), 26–30 (2012)

    Google Scholar 

  15. Waikato.: http://moa.cms.waikato.ac.nz/datasets/ (2013)

  16. Wang, L., Ji, H.-B., Jin, Y.: Fuzzy passive aggressive classification: A robust and efficient algorithm for online classification problems. Inf. Sci. 220, 46–63 (2013)

    Article  Google Scholar 

  17. Widmar, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23, 69–101 (1996)

    Google Scholar 

  18. Zhang, D., Chen, S.: Clustering incomplete data using Kernel-based fuzzy C-means algorithm. Neural Process. Lett. 18(3), 155–162 (2003)

    Article  Google Scholar 

  19. Zhang, D., Chen, S.: Fuzzy clustering using kernel method. In: Proceedings of the International Conference on Control and Automation ICCA, pp. 162–163. Xiamen, China (2002)

    Google Scholar 

  20. \(\check{Z}\)liobaite, I.: Controlled permutations for testing adaptive classifiers. In: Proceedings of the 14th International Conference on Discovery Science, Springer LNCS, vol. 6926, pp. 365–379 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joanna Jȩdrzejowicz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Jȩdrzejowicz, J., Jȩdrzejowicz, P. (2015). Distance-Based Ensemble Online Classifier with Kernel Clustering. In: Neves-Silva, R., Jain, L., Howlett, R. (eds) Intelligent Decision Technologies. IDT 2017. Smart Innovation, Systems and Technologies, vol 39. Springer, Cham. https://doi.org/10.1007/978-3-319-19857-6_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-19857-6_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-19856-9

  • Online ISBN: 978-3-319-19857-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics