Skip to main content

Weighted Discriminant Analysis and Kernel Ridge Regression Metric Learning for Face Verification

  • Conference paper
  • First Online:
Book cover Neural Information Processing (ICONIP 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9948))

Included in the following conference series:

  • 2826 Accesses

Abstract

A new formulation of metric learning is introduced by assimilating the kernel ridge regression (KRR) and weighted side-information linear discriminant analysis (WSILD) to enjoy the best of both worlds for unconstrained face verification task. To be specific, we formulate a doublet constrained metric learning problem by means of a second degree polynomial kernel function. The said metric learning problem can be solved analytically for Mahalanobis distance metric due to simplistic nature of KRR in which we named KRRML. In addition, the WSILD further enhances the learned Mahalanobis distance metric by leveraging the within-class and between-class scatter matrix of doublets. We evaluate the proposed method with Labeled Faces in the Wild database, a large benchmark dataset targeted for unconstrained face verification. The promising result attests the robustness and feasibility of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ying, Y., Li, P.: Distance metric learning with eigenvalue optimization. J. Mach. Learn. Res. 13, 1–26 (2012)

    MathSciNet  MATH  Google Scholar 

  2. Huang, C., Zhu, S., Yu, K.: Large scale strongly supervised ensemble metric learning with applications to face verification and retrieval. NEC TR115 (2011)

    Google Scholar 

  3. Weinberger, K.Q., Blitzer, J., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. In: NIPS, pp. 1473–1480 (2005)

    Google Scholar 

  4. Balcan, M.F., Blum, A., Srebro, N.: A theory of learning with similarity functions. Mach. Learn. 72, 89–112 (2008)

    Article  Google Scholar 

  5. Kedem, D., Tyree, S., Weinberger, K., Sha, F., Lanckriet, G.: Non-linear metric learning. In: Advances in Neural Information Processing Systems, pp. 2582–2590 (2012)

    Google Scholar 

  6. Cao, Z., Yin, Q., Tang, X., Sun, J.: Face recognition with learning-based descriptor. In: Computer Vision and Pattern Recognition (CVPR) (2010)

    Google Scholar 

  7. Lei, Z., Pietikainen, M., Li, S.Z.: Learning discriminant face descriptor. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 36(2), 289–302 (2013)

    Google Scholar 

  8. Wang, F., Zuo, W., Zhang, L., Meng, D., Zhang, D.: A kernel classification framework for metric learning (2013) arXiv: 1309.5823

  9. Kan, M., Shan, S., Xu, D., Chen, X.: Side-information based linear discriminant analysis for face recognition. In: British Machine Vision Conference (2011)

    Google Scholar 

  10. Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning. Springer, Heidelberg (2001)

    Book  MATH  Google Scholar 

  11. Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeledfaces in the wild: a database for studying face recognition in unconstrained environments. University of Massachusetts, Amherst, Technical report 7–49 (2007)

    Google Scholar 

  12. Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge University Press, Cambridge (2000)

    MATH  Google Scholar 

  13. Kumar, M.P., Torr, P.H.S., Zisserman, A.: An invariant large margin nearest neighbor classifier. In: ICCV, pp. 1–8 (2007)

    Google Scholar 

  14. Davis, J., Kulis, B., Jain, P., Sra, S., Dhilon, I.: Information-theoretic metric learning. In: ICML (2007)

    Google Scholar 

  15. Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  16. Guillaumin, M., Verbeek, J., Schmid, C.: Is that you? Metric learning approaches for face identification. In: ICCV (2009)

    Google Scholar 

  17. Nguyen, H.V., Bai, L.: Cosine similarity metric learning for face verification. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part II. LNCS, vol. 6493, pp. 709–720. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  18. Cui, Z., Li, W., Xu, D., Shan, S., Chen, X.: Fusing robust face region descriptors via multiple metric learning for face recognition in the wild. In: CVPR (2013)

    Google Scholar 

  19. Etemad, K., Chellappa, R.: Discriminant analysis for recognition of human face images. J. Opt. Soc. Am 14, 1724–1733 (1997)

    Article  Google Scholar 

  20. Anila, S., Devarajan, N.: Preprocessing technique for face recognition applications under varying illumination conditions. Glob. J. Comput. Sci. Technol. Graph. Vis. 12(11) (2012)

    Google Scholar 

  21. Barkan, O., Weill, J., Wolf, L., Aronowitz, H.: Fast high dimensional vector multiplication face recognition. In: ICCV, pp. 1960–1967 (2013)

    Google Scholar 

  22. Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: CVPR (1991)

    Google Scholar 

  23. Nowak, E., Jurie, F.: Learning visual similarity measures for comparing never seen objects. In: CVPR (2007)

    Google Scholar 

  24. Sanderson, C., Lovell, B.C.: Multi-region probabilistic histograms for robust and scalable identity inference. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 199–208. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  25. Wolf, L., Hassner, T., Taigman, Y.: Descriptor based methods in the wild. In: ECCV (2008)

    Google Scholar 

  26. Arashloo, S.R., Kittler, J.: Efficient processing of MRFs for unconstrained-pose face recognition. In: Biometrics: Theory, Applications and Systems (2013)

    Google Scholar 

  27. Pinto, N., DiCarlo, J.J., Cox, D.D.: How far can you get with a modern face recognition test set using only simple features? In: CVPR (2009)

    Google Scholar 

  28. Li, H., Hua, G., Lin, Z., Brandt, J., Yang, J.: Probabilistic elastic matching for pose variant face verification. In: CVPR (2013)

    Google Scholar 

  29. Li, H., Hua, G.: Hierarchical-PEP model for real-world face recognition. In: CVPR (2015)

    Google Scholar 

  30. Simonyan, K., Parkhi, O.M., Vedaldi, A., Zisserman, A.: Fisher vector faces in the wild. In: BMVC (2013)

    Google Scholar 

  31. Felix, X., Luu, K., Savvides, M.: Spartans: single-sample periocular-based alignment-robust recognition technique applied to non-frontal scenarios. IP 24(12), 4780–4795 (2015)

    MathSciNet  Google Scholar 

  32. Arashloo, S.R., Kittler, J.: Class-specific kernel fusion of multiple descriptors for face verification using multiscale binarised statistical image features. IEEE Trans. Inf. Forensics Secur. 9(12), 2100–2109 (2014)

    Article  Google Scholar 

  33. Lee, W.H., Lee, R.B.: Implicit authentication for smartphone security. In: Camp, O., Weippl, E., Bidan, C., Aïmeur, E. (eds.) Information Systems Security and Privacy. CCIS, vol. 576, pp. 160–176. Springer, Heidelberg (2015)

    Chapter  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Malaysia’s Fundamental Research Grant Scheme for supporting the research under grants MMUE/140026.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Siew-Chin Chong .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Chong, SC., Teoh, A.B.J., Ong, TS. (2016). Weighted Discriminant Analysis and Kernel Ridge Regression Metric Learning for Face Verification. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9948. Springer, Cham. https://doi.org/10.1007/978-3-319-46672-9_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46672-9_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46671-2

  • Online ISBN: 978-3-319-46672-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics