Abstract
Kernel principal component analysis (KPCA) is a widely-used statistical method for representation learning, where PCA is performed in reproducing kernel Hilbert space (RKHS) to extract nonlinear features from a set of training examples. Despite the success in various applications including face recognition, KPCA does not scale up well with the sample size, since, as in other kernel methods, it involves the eigen-decomposition of n ×n Gram matrix which is solved in \({\mathcal{O}}(n^3)\) time. Nyström method is an approximation technique, where only a subset of size m ≪ n is exploited to approximate the eigenvectors of n ×n Gram matrix. In this paper we consider Nyström method and its few modifications such as ’Nyström KPCA ensemble’ and ’Nyström + randomized SVD’ to improve the scalability of KPCA. We compare the performance of these methods in the task of learning face descriptors for face recognition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Halko, N., Martinsson, P.G., Tropp, J.A.: Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. Arxiv preprint arXiv:0909.4061 (2009)
Kumar, S., Mohri, M., Talwalkar, A.: Sampling techniques for the Nyström method. In: Proceedings of the International Conference on Artificial Intelligence and Statistics (AISTATS), Clearwater Beach, FL, pp. 304–311 (2009)
Lee, S., Choi, S.: Landmark MDS ensemble. Pattern Recognition 42(9), 2045–2053 (2009)
Li, M., Kwok, J.T., Lu, B.L.: Making large-scale Nyström approximation possible. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 631–638. Omnipress, Haifa (2010)
Messer, K., Matas, J., Kittler, J., Luettin, J., Maitre, G.: XM2VTSDB: The extended M2VTS database. In: Proceedings of the Second International Conference on Audio and Video-Based Biometric Person Authentification. Springer, New York (1999)
Schölkopf, B., Smola, A.J., Müller, K.R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10(5), 1299–1319 (1998)
Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)
Williams, C.K.I., Seeger, M.: Using the Nyström method to speed up kernel machines. In: Advances in Neural Information Processing Systems (NIPS), vol. 13, pp. 682–688. MIT Press (2001)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys 35(4), 399–458 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yun, JM., Choi, S. (2011). Nyström Approximations for Scalable Face Recognition: A Comparative Study. In: Lu, BL., Zhang, L., Kwok, J. (eds) Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7063. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24958-7_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-24958-7_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24957-0
Online ISBN: 978-3-642-24958-7
eBook Packages: Computer ScienceComputer Science (R0)