Abstract
Nonnegative matrix factorizations (NMF) have recently assumed an important role in several fields, such as pattern recognition, automated image exploitation, data clustering and so on. They represent a peculiar tool adopted to obtain a reduced representation of multivariate data by using additive components only, in order to learn parts-based representations of data. All algorithms for computing the NMF are iterative, therefore particular emphasis must be placed on a proper initialization of NMF because of its local convergence. The problem of selecting appropriate starting initialization matrices becomes more complex when data possess special meaning, and this is the case of document clustering. In this paper, we present a new initialization method which is based on the fuzzy subtractive scheme and used to generate initial matrices for NMF algorithms. A preliminary comparison of the proposed initialization with other commonly adopted initializations is presented by considering the application of NMF algorithms in the context of document clustering.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Boutsidis, C., Gallopoulos, E.: Svd based initialization: ahead start for nonnegative matrix factorization. Pattern Recognition 41(4), 1350–1362 (2008)
Cichocki, A., Zdunek, R., Phan, A.H., Amari, S.I.: Alternating Least Squares and Related Algorithms for NMF and SCA Problems. In: Nonnegative Matrix and Tensor Factorizations. John Wiley & Sons, UK (2009)
Chiu, S.L.: Fuzzy Model Estimation based on Cluster Estimation. J. Intelligent and Fuzzy Systems 2, 267–278 (1994)
Choi, S.: Algorithms for orthogonal nonnegative matrix factorization. Proc. Intern. Joint Conf. Neural Networks (2008)
Davies, D.L., Bouldin, D.W.: A cluster separation measure. IEEE Trans. Pattern Anal. Machine Intell. 1(4), 224–227 (1979)
Del Buono, N., Lucarelli, M.: Comparative studies on initializations for nonnegative matrix factorization algorithms, Tech. Rep. 17/10, Univ. Bari, Italy (2010)
Hoyer, P.O.: Non-negative matrix factorization with sparseness constraints. J. Machine Learning Research 5, 1457–1469 (2004)
Lazar, C., Doncescu, A., Kabbaj, N.: Non Negative Matrix Factorization clustering capabilities; application on multivariate image segmentation. Int. J. of Business Intel. Data Mining 5(3), 285–296 (2010)
Lee, D.D., Seung, S.H.: Algorithms for non-negative matrix factorization. In: Proc. Adv. Neural Information Proc. Syst. Conf., vol. 13, pp. 556–562 (2000)
Shahnaz, F., Berry, M.W., Pauca, M.P., Plemmons, R.J.: Document clustering using nonnegative matrix factorization. Information Processing and Managements: Intern. J. 42(2), 373–386 (2006)
Xu, W., Liu, X., Gong, Y.: Document clustering based on nonnegative matrix factorization. In: Proc. SIGIR, pp. 267–273 (2003)
Xue, Y., Tong, C.S., Chen, Y., Chen, W.-S.: Clustering-based initialization for non-negative matrix factorization. Appl. Math. and Comp. 205, 525–536 (2008)
Zhenga, Z., Yang, J.: Initialization enhancer for non-negative matrix factorization. Eng. Appl. Art. Int. 20, 101–110 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Casalino, G., Del Buono, N., Mencar, C. (2011). Subtractive Initialization of Nonnegative Matrix Factorizations for Document Clustering. In: Fanelli, A.M., Pedrycz, W., Petrosino, A. (eds) Fuzzy Logic and Applications. WILF 2011. Lecture Notes in Computer Science(), vol 6857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23713-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-23713-3_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23712-6
Online ISBN: 978-3-642-23713-3
eBook Packages: Computer ScienceComputer Science (R0)