Skip to main content

A Semi-supervised Three-Way Clustering Framework for Multi-view Data

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10314))

Abstract

A new semi-supervised clustering framework for uncertain multi-view data is proposed inspired by the theory of three-way decisions, which is an alternative formulation different from the ones used in the existing studies. A cluster is represented by three regions such as the core region, fringe region and trivial region. The three-way representation intuitively shows which objects are fringe to the cluster. The proposed method is an iterative processing which includes two parts: (1) the three-way spectral clustering algorithm which is devised to obtain the three-way representation result; and (2) the active learning strategy which is designed to obtain the prior supervision information from the fringe regions, and the pairwise constraints information is used to adjust the similarity matrix between objects. Experimental results show that the proposed method can cluster multi-view data effectively and is better in performances than the compared single-view clusterings and other semi-supervised clustering approaches.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/multiclass.html.

  2. 2.

    https://archive.ics.uci.edu/ml/datasets.html.

  3. 3.

    http://linqs.umiacs.umd.edu/projects//projects/lbc/index.html.

  4. 4.

    http://linqs.umiacs.umd.edu/projects//projects/lbc/index.html.

References

  1. Blum, A., Mitchell, T.: Combining labeled and unlabeled data with co-training. In: Proceeding of the Eleventh Annual Conference on Computational Learning Theory, pp. 92–100. ACM (1998)

    Google Scholar 

  2. Bickel, S., Scheffer, T.: Multi-view clustering. In: ICDM, vol. 4, pp. 19–26 (2004)

    Google Scholar 

  3. Chaudhuri, K., Kakade, S.M., Livescu, K., Sridharan, K.: Multi-view clustering via canonical correlation analysis. In: Proceedings of the 26th Annual International Conference on Machine Learning, pp. 129–136. ACM (2009)

    Google Scholar 

  4. Chen, W., Feng, G.: Spectral clustering: a semi-supervised approach. Neurocomputing 77(1), 229–242 (2012)

    Article  Google Scholar 

  5. Ding, S., Jia, H., Zhang, L., Jin, F.: Research of semi-supervised spectral clustering algorithm based on pairwise constraints. Neural Comput. Appl. 24(1), 211–219 (2014)

    Article  Google Scholar 

  6. Grira, N., Crucianu, M., Boujemaa, N.: Unsupervised and semi-supervised clustering: a brief survey (2005)

    Google Scholar 

  7. Klein, D., Kamvar, S.D., Manning, C.D.: From instrance-level constraints to space-level constraints: making the most of prior knowledge in data clustering. Stanford (2002)

    Google Scholar 

  8. Li, Y., Nie, F., Huang, H., Huang, J.: Large-scale multi-view spectral clustering via bipartite graph. In: AAAI, pp. 2750–2756 (2015)

    Google Scholar 

  9. Liang, D., Liu, D.: Systematic studies on three-way decisions with interval-valued decision-theoretic rough sets. Inf. Sci. 276, 186–203 (2014)

    Article  Google Scholar 

  10. Lingras, P., Yan, R.: Interval clustering using fuzzy and rough set theory. In: Proceedings 2004 IEEE Annual Meeting, Fuzzy Information, Banff, Alberta, pp. 780–784 (2004)

    Google Scholar 

  11. Lingras, P., West, C.: Interval set clustering of web users with rough k-means. J. Intell. Inf. Syst. 23(1), 5–16 (2004)

    Article  MATH  Google Scholar 

  12. Liu, J., Wang, C., Guo, J., Han, J.: Multi-view clustering via joint nonnegative matrix factorization. In: Proceeding of the 2013 SIAM International Conference on Data Mining, pp. 252–260. Society for Industrial and Applied Mathematics (2013)

    Google Scholar 

  13. Luxburg, U.: A tutorial on spectral clustering. Stat. Comput. 17(4), 395–416 (2007)

    Article  MathSciNet  Google Scholar 

  14. Wagstaff, K., Cardie, C.: Clustering with instance-level constraints. In: AAAI/IAAI, vol. 1097 (2000)

    Google Scholar 

  15. Wang, W., Zhou, Z.H.: On multi-view active learning and the combination with semi-supervised learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1152–1159. ACM (2008)

    Google Scholar 

  16. Wang, J., Wang, X., Tian, F., Liu, C.H., Yu, H., Liu, Y.: Adaptive multi-view semi-supervised nonnegative matrix factorization. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds.) ICONIP 2016. LNCS, vol. 9948, pp. 435–444. Springer, Cham (2016). doi:10.1007/978-3-319-46672-9_49

    Chapter  Google Scholar 

  17. Xia, T., Tao, D., Mei, T., Zhang, Y.: Multiview spectral embedding. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 40(6), 1438–1446 (2010)

    Article  Google Scholar 

  18. Xiong, S., Azimi, J., Fern, X.Z.: Active learning of constraints for semi-supervised clustering. IEEE Trans. Knowl. Data Eng. 26(1), 43–54 (2014)

    Article  Google Scholar 

  19. Xu, C., Tao, D., Xu, C.: A survey on multi-view learning. arXiv preprint arXiv:1304.5634 (2013)

  20. Yao, Y., Lingras, P., Wang, R., Miao, D.: Interval set cluster analysis: a re-formulation. In: Sakai, H., Chakraborty, M.K., Hassanien, A.E., Ślęzak, D., Zhu, W. (eds.) RSFDGrC 2009. LNCS, vol. 5908, pp. 398–405. Springer, Heidelberg (2009). doi:10.1007/978-3-642-10646-0_48

    Chapter  Google Scholar 

  21. Yao, Y.: An outline of a theory of three-way decisions. In: Yao, J.T., Yang, Y., Słowiński, R., Greco, S., Li, H., Mitra, S., Polkowski, L. (eds.) RSCTC 2012. LNCS, vol. 7413, pp. 1–17. Springer, Heidelberg (2012). doi:10.1007/978-3-642-32115-3_1

    Chapter  Google Scholar 

  22. Yao, Y.: Three-way decisions and cognitive computing. Cogn. Comput. 8(4), 543–554 (2016)

    Article  Google Scholar 

  23. Yao, J., Azam, N.: Web-based medical decision support systems for three-way medical decision making with game-theoretic rough sets. IEEE Trans. Fuzzy Syst. 23(1), 3–15 (2015)

    Article  Google Scholar 

  24. Ye, X., Sakurai, T.: Robust similairty measure for spectral clustering based on shared neighbors. ETRI J. 38(3), 540–550 (2016)

    Google Scholar 

  25. Yu, H., Wang, G.Y., Li, T.R., Liang, J.Y., Miao, D.Q., Yao, Y.Y.: Three-Way Decisions: Methods and Practices for Complex Problem Solving. Science Press, Beijing (2015). (in Chinese)

    Google Scholar 

  26. Yu, H., Zhang, C., Wang, G.: A tree-based incremental overlapping clustering method using the three-way decision theory. Knowl.-Based Syst. 91, 189–203 (2016)

    Article  Google Scholar 

  27. Yu, H., et al.: Methods and practices of three-way decisions for complex problem solving. In: Ciucci, D., Wang, G., Mitra, S., Wu, W.-Z. (eds.) RSKT 2015. LNCS, vol. 9436, pp. 255–265. Springer, Cham (2015). doi:10.1007/978-3-319-25754-9_23

    Chapter  Google Scholar 

  28. Zhang, X., Zhao, D.Y., Wei, S., Xiao, W.X.: Active semi-supervised clustering based on multi-view learning. In: WRI Global Congress on Intelligent Systems, GCIS 2009, vol. 3, pp. 495–499. IEEE (2009)

    Google Scholar 

  29. Zhou, B., Yao, Y., Luo, J.: Cost-sensitive three-way email spam fitering. J. Intell. Inf. Syst. 42(1), 19–45 (2014)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant Nos. 61379114 & 61533020.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hong Yu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Yu, H., Wang, X., Wang, G. (2017). A Semi-supervised Three-Way Clustering Framework for Multi-view Data. In: Polkowski, L., et al. Rough Sets. IJCRS 2017. Lecture Notes in Computer Science(), vol 10314. Springer, Cham. https://doi.org/10.1007/978-3-319-60840-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60840-2_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60839-6

  • Online ISBN: 978-3-319-60840-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics