Abstract
Nonnegative Matrix Factorization (NMF) has received considerable attention due to its psychological and physiological interpretation of naturally occurring data whose representation may be parts-based in the human brain. However, when labeled and unlabeled images are sampled from different distributions, they may be quantized into different basis vector space and represented in different coding vector space, which may lead to low representation fidelity. In this paper, we investigate how to extend NMF to cross-domain scenario. We accomplish this goal through TNMF - a novel semi-supervised transfer learning approach. Specifically, we aim to minimize the distribution divergence between labeled and unlabeled images, and incorporate this criterion into the objective function of NMF to construct new robust representations. Experiments show that TNMF outperforms state-of-the-art methods on real datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
References
Luong, T.X., kyeong Kim, B., Lee, S.-Y.: Color image processing based on nonnegative matrix factorization with convolutional neural network. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp. 2130–2135 (2014)
Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788 (1999)
S. Z., Li, X., Hou, Zhang, H., Cheng, Q.: Learning spatially localized, parts-based representation. CVPR. IEEE Comput. Soc. 1, 207–212 (2001)
Kuang, D., Park, H., Ding, C.H.Q.: Symmetric nonnegative matrix factorization for graph clustering. SDM 12, 106–117 (2012)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Fox, D., Gomes, C.P. (eds.): In: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence, AAAI 2008. AAAI Press, Chicago, 13–17 July 2008
Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)
Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized non-negative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)
David, L.D., Carrie, G.: Hessian eigenmaps: new locally linear embedding techniques for high-dimensional data (2003)
Bengio, Y., Schuurmans, D., Lafferty, J.D., Williams, C.K.I., Culotta, A. (eds.): Advances in Neural Information Processing Systems 22. In: 23rd Annual Conference on Neural Information Processing Systems 2009. Proceedings of a meeting held 7–10 Dec 2009. Vancouver, British. Curran Associates Inc (2009)
Liu, W., Tao, D.: Multiview hessian regularization for image annotation. IEEE Trans. Image Process. 22(7), 2676–2687 (2013)
Tao, D., Jin, L., Liu, W., Li, X.: Hessian regularized support vector machines for mobile image annotation on the cloud. IEEE Trans. Multimedia 15(4), 833–844 (2013)
Liu, W., Liu, H., Tao, D., Wang, Y., Lu, K.: Multiview Hessian regularized logistic regression for action recognition. Signal Process. 110, 101–107 (2015)
Long, M., Wang, J., Ding, G., Pan, S.J., Yu, P.S.: Adaptation regularization: a general framework for transfer learning. IEEE Trans. Knowl. Data Eng. 26(5), 1076–1089 (2014)
Ding, C.H.Q., Li, T., Jordan, M.I.: Convex and semi-nonnegative matrix factorizations. IEEE Trans. Pattern Anal. Mach. Intell. 32(1), 45–55 (2010)
Ding, C., Li, T., Peng, W.: On the equivalence between non-negative matrix factorization and probabilistic latent semantic indexing. Comput. Stat. Data Anal. 52(8), 3913–3927 (2008)
Heiler, M., Schnörr, C.: Learning sparse representations by non-negative matrix factorization and sequential cone programming. J. Mach. Learn. Res. 7, 1385–1407 (2006)
Liu, H., Wu, Z., Cai, D., Huang, T.S.: Constrained non-negative matrix factorization for image representation. IEEE Trans. Pattern Anal. Mach. Intell. (2012). To appear
Quanz, B., Huan, J., Mishra, M.: Knowledge transfer with low-quality data: a feature extraction issue. IEEE Trans. Knowl. Data Eng. 24(10), 1789–1802 (2012)
Wang, J.J., Sun, Y., Bensmail, H.: Domain transfer nonnegative matrix factorization. In: 2014 International Joint Conference on Neural Networks, IJCNN, pp. 3605–3612. Beijing, 6–11 July 2014
Wang, C., Blei, D., Li, F.-F.: Simultaneous image classification and annotation (2009)
Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms. In: Proceedings of the International Conference on Multimedia, MM 2010, pp. 1469–1472. ACM, New York (2010)
Long, M., Wang, J., Ding, G., Sun, J., Yu, P.S.: Transfer feature learning with joint distribution adaptation. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 2200–2207. IEEE (2013)
Gong, B., Shi, Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: CVPR, pp. 2066–2073. IEEE (2012)
Gretton, A., Borgwardt, K.M., Rasch, M.J., Schölkopf, B., Smola, A.: A kernel two-sample test. J. Mach. Learn. Res. 13, 723–773 (2012)
Acknowledgements
The research was supported by the Irish Research Council (IRCSET) under Grant Number GOIPG/2013/330.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, T., Ye, T., Gurrin, C. (2016). Transfer Nonnegative Matrix Factorization for Image Representation. In: Tian, Q., Sebe, N., Qi, GJ., Huet, B., Hong, R., Liu, X. (eds) MultiMedia Modeling. MMM 2016. Lecture Notes in Computer Science(), vol 9517. Springer, Cham. https://doi.org/10.1007/978-3-319-27674-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-27674-8_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27673-1
Online ISBN: 978-3-319-27674-8
eBook Packages: Computer ScienceComputer Science (R0)