Skip to main content

Incremental Spectral Clustering

  • Chapter
  • First Online:
Learning in Non-Stationary Environments

Abstract

In the present contribution, a novel algorithm for off-line spectral clustering algorithm is introduced and an online extension is derived in order to deal with sequential data. The proposed algorithm aims at dealing with nonconvex clusters having different forms. It relies on the notion of communicability that allows to handle the contiguity of data distribution. In the second part of the paper, an incremental extension of the fuzzy c-varieties is proposed to serve as a building block of the incremental spectral clustering algorithm (ISC). Initial simulations are presented towards the end of the contribution to show the performance of the ISC algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. F. Bach and M. Jordan. Spectral Clustering for Speech Separation, pages 221–250. John Wiley and Sons, Ltd. (2009)

    Google Scholar 

  2. J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press (1981)

    Google Scholar 

  3. J. Bezdek and R. Hathaway. Numerical Convergence and Interpretation of the Fuzzy C-shells Clustering Algorithm. IEEE Trans. on Neural Networks, 3, 787–793 (1992)

    Article  Google Scholar 

  4. B. Bollobas. Modern Graph Theroy. Springer, New York, USA (1998)

    Book  Google Scholar 

  5. A. Bouchachia. An evolving classification cascade with self-learning. Evolving Systems, 1(3), 143–160 (2010)

    Article  Google Scholar 

  6. A. Bouchachia. Fuzzy classification in dynamic environments. Soft Computing—A Fusion of Foundations, Methodologies and Applications, 15, 1009–1022 (2011)

    Google Scholar 

  7. A. Bouchachia. Incremental learning with multi-level adaptation. Neurocomputing, 74(11), 1785–1799 (2011)

    Article  Google Scholar 

  8. A. Bouchachia and W. Pedrycz. Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets and Systems, 157(13), 1733–1759 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  9. A. Bouchachia and M. Prossegger. A hybrid ensemble approach for the steiner tree problem in large graphs: a geographical application. Applied Soft Computing 11(8), 5745–5754 (2011)

    Google Scholar 

  10. H. Chang and D. Yeung. Robust path-based spectral clustering. Pattern Recognition, 41, 191–203 (2008)

    Article  MATH  Google Scholar 

  11. R. Dave. Validating fuzzy partitions obtained through c-shells clustering. Pattern Recognition Letters, 17(6), 613–623 (1996)

    Article  MathSciNet  Google Scholar 

  12. R. Dave and K. Bhaswan. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks, 3(5), 643–662 (1992)

    Article  Google Scholar 

  13. E. Estrada and J. Rodríguez-Velázquez. Subgraph centrality in complex networks. Phys. Rev. E, 71(5), 056103 (2005)

    Google Scholar 

  14. I. Fischer and I. Poland. New methods for spectral clustering. Technical Report IDSIA-12-04, IDSIA (2004)

    Google Scholar 

  15. H. Frigui and R. Krishnapuram. A comparison of fuzzy shell-clustering methods for the detection of ellipses. IEEE Transactions on Fuzzy Systems, 4(2), 193–199 (1996)

    Article  Google Scholar 

  16. I. Gath and D. Hoory. Fuzzy Clustering of Elliptic Ring-shaped Clusters. Pattern Recognition Letters, 16(7), 727–741 (1995)

    Article  Google Scholar 

  17. D. Gustafson and W. Kessel. Fuzzy Clustering with a Fuzzy Covariance Matrix. In Proc. of the IEEE Conf. on Decision and Control, pp. 761–766 (1979)

    Google Scholar 

  18. L. Hagen and A. Kahng. New spectral methods for ratio cut partitioning and clustering. IEEE Trans. Computer-Aided Design, 11(9), 1074–1085 (1992)

    Article  Google Scholar 

  19. F. Hoeppner. Fuzzy shell clustering algorithms in image processing: fuzzy c-rectangular and 2-rectangular shells. IEEE Transactions on Fuzzy Systems, 5(4), 599–613 (1997)

    Article  Google Scholar 

  20. R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. i. IEEE Transactions on Fuzzy Systems, 3(1), 29–43 (1995)

    Google Scholar 

  21. R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. ii. IEEE Transactions on Fuzzy Systems, 3(1), 44–60 (1995)

    Google Scholar 

  22. R. Krishnapuram, O. Nasraoui, and H. Frigui. The fuzzy c spherical shells algorithm: a new approach. IEEE Transactions on Neural Networks, 3(5), 663–671 (1992)

    Article  Google Scholar 

  23. J. Leski. Fuzzy c-varieties/elliptotypes clustering in reproducing kernel hilbert space. Fuzzy Sets and Systems, 141(2), 259–280 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  24. C. Lim, S. Bohacek, J. Hespanha, and K. Obraczka. Hierarchical max-flow routing. In IEEE Conference on Global Telecommunications Conference, pp. 550–556 (2005)

    Google Scholar 

  25. M. Meila and J. Shi. Learning segmentation by random walks. In Neural Information Processing Systems, NIPS, 873–879 (2001)

    Google Scholar 

  26. A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, 849–856. MIT Press (2001)

    Google Scholar 

  27. H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering by efficiently updating the eigen-system. Pattern Recognition, 43(1), 113–127 (2010)

    Article  MATH  Google Scholar 

  28. D. Niu, J. Dy, and M. Jordan. Multiple non-redundant spectral clustering views. In Proceedings of the 27th International Conference on Machine Learning, pp. 831–838 (2010)

    Google Scholar 

  29. M. Prossegger and A. Bouchachia. Ant colony optimization for steiner tree problems. In Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology, pp. 331–336. ACM (2008)

    Google Scholar 

  30. T. Runkler and R. Palm. Identification of nonlinear systems using regular fuzzy c-elliptotype clustering. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 2, pp. 1026–1030 (1996)

    Google Scholar 

  31. J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888–905 (2000)

    Article  Google Scholar 

  32. F. Tung, A. Wong, and D. Clausi. Enabling scalable spectral clustering for image segmentation. Pattern Recogn., 43, 4069–4076 (2010)

    Article  MATH  Google Scholar 

  33. C. Valgren, T. Duckett, and L. Lilienthal. Incremental spectral clustering and its application to topological mapping. In Proc. IEEE International Conference on Robotics and Automation, pp. 4283–4288 (2007)

    Google Scholar 

  34. C. Valgren and A. Lilienthal. Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp. 1856 –1861 (2008)

    Google Scholar 

  35. L. Wang, C. Leckie, R. Kotagiri, and J. Bezdek. Approximate pairwise clustering for large data sets via sampling plus extension. Pattern Recognition, 44, 222–235 (2011)

    Article  Google Scholar 

  36. D. Yan, L. Huang, and M. Jordan. Fast approximate spectral clustering. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 907–916. ACM (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdelhamid Bouchachia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media New York

About this chapter

Cite this chapter

Bouchachia, A., Prossegger, M. (2012). Incremental Spectral Clustering. In: Sayed-Mouchaweh, M., Lughofer, E. (eds) Learning in Non-Stationary Environments. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-8020-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-8020-5_4

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4419-8019-9

  • Online ISBN: 978-1-4419-8020-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics