Skip to main content
SpringerLink
Log in

Face verification with feature fusion of Gabor based and curvelet based representations

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Face verification has broad potential in varieties of multimedia applications, such as security access control, surveillance monitor, image retrieval and intelligent human machine interface. However, the existence of variable lighting, pose, facial expression, aging and other random factors often causes the occurrence of recognition errors. Further upgrading the performance of face verification systems is not only a challenging but also an urgent task. Information fusion had proved to be one of the promising approaches in upgrading verification performance since more cues and evidences were provided. Gabor feature face representation and Curvelet feature face representation were chosen for fusion processing, since both representations are good at depicting image intrinsic pattern but with different emphases. After calculating the Gabor features and Curvelet features of a face image, the mutually correlated projection pairs of these two individual mode features were first yielded by canonical correlation analysis (CCA) method. Then, an integrate projection set can be built by simply grouping these two mutual correlated projection sequences term by term correspondingly. The integrate projection set possesses most of the information contained in Gabor features and Curvelet features and is optimally reorganized in a correlation sense. To further enhance the discriminant capabilities, a linear discriminant analysis (LDA) post-processing is applied on the integrate projection set to yield the final fusion feature set. The experiment results testing on MBGC data set show that the proposed fusion approach does reduce the error rates significantly as compared with using individual mode feature alone. FRR100 and FAR1000 were reduced about 30% and more.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  Google Scholar 

  2. Borga M (1998) Learning Multidimensional Signal Processing, PhD thesis, Linkoping University, Sweden, SE-58183 Linkoping, Sweden, Dissertation No 531, ISBN 91-7219-202-X

  3. Candès EJ, Demanet L, Donoho DL, Ying L (2006) Fast discrete curvelet transforms. Multiscale Model Simul 5:861–899

    Article  MathSciNet  MATH  Google Scholar 

  4. Candès EJ, Donoho DL (2000) Curvelets—a surprisingly effective nonadaptive representationfor objects with edges. In: Rabut C, Cohen A, Schumaker LL (eds) Curves and Surfaces. Vanderbilt University Press, Nashville, pp 105–120

    Google Scholar 

  5. Candès EJ, Guo F (2002) New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction. Signal Process 82:1519–1543

    Article  MATH  Google Scholar 

  6. De la Torre Frade F, Gross R, Baker S, Kumar V (2005) Representational Oriented Component Analysis (ROCA) for face recognition with one sample image per training class, computer vision and pattern recognition. 266–273

  7. Garcia C, Zikos G, Tziritas G (2000) Wavelet packet analysis for face recognition. Image Vis Comput 18(4):289–297

    Article  Google Scholar 

  8. Hotelling H (1936) Relations between two sets of variates. Biometrika 28:321–377

    MATH  Google Scholar 

  9. Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37

    Article  Google Scholar 

  10. Jain A, Nandakumar K, Ross A (2005) Score normalization in multimodal biometric systems. Pattern Recognit 38:2270–2283

    Article  Google Scholar 

  11. Kittler J, Alkoot FM (2003) Sum versus vote fusion in multiple classifier systems. IEEE Trans Pattern Anal Mach Intell 25(1):10–115

    Article  Google Scholar 

  12. Kittler J, Hatef M, Duin RPW, Matas J (1998) On combining classifiers. IEEE Trans Pattern Anal Mach Intell 20(3):226–239

    Article  Google Scholar 

  13. Liu C (2002) Harry Wechsler: Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition. IEEE Trans Image Process 11(4):467–476

    Article  Google Scholar 

  14. Marcialis GL, Roli F (2002) Fusion of LDA and PCA for Face Verification. Proceedings of the International ECCV 2002 Workshop Copenhagen on Biometric Authentication. pp 30–38

  15. Ou F, Liu C (2010) Shadow Removed from a face image based on illumination compensation. Appl Res Comput 27(1):399–400, in Chinese

    Google Scholar 

  16. Phillips PJ “MBGC still face challenge problem version 2 preliminary results”. http://face.nist.gov/mbgc/2009/FACE_V2_FINAL.pdf

  17. Phillips PJ “Overview of the multiple biometric grand challenge”. http://face.nist.gov/mbgc/mbgc_presentations.htm

  18. Phillips P, Flynn P, Scruggs T, Bowyer KW, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. Comput Vis Pattern Recognit 1:947–954

    Google Scholar 

  19. Phillips PJ, Scruggs WT, O’Toole AJ, Flynn PJ, Bowyer KW, Schott CL, Sharpe M “FRVT 2006 and ICE 2006 Large-Scale Results.” NISTIR 7408, March 2007. http://face.nist.gov/frvt/frvt2006/frvt2006.htm

  20. Rahman Z, Jobson DJ, Woodell GA (2004) Retinex processing for automatic image enhancement. J Electron Imaging 13(1):100–110

    Article  Google Scholar 

  21. Ross A, Jain A (2003) Information fusion in biometrics. Pattern Recognit Lett 24(13):2115–2125

    Article  Google Scholar 

  22. Sun QS, Zeng SG, Liu Y, Heng PA, Xia DS (2005) A new method of feature fusion and its application in image recognition. Pattern Recognit 38(12):2437–2448

    Article  Google Scholar 

  23. Tan X, Triggs B (2007) Fusing Gabor and LBP feature sets for kernel-based face recognition, In: Proceedings of the 2007 IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG'07), LNCS 4778, pp. 235–249

  24. Tao Q, Veldhuis R (2009) Threshold-optimized decision-level fusion and its application to biometrics. Pattern Recognit 42:823–830

    Article  Google Scholar 

  25. Viola P, Jones M (2004) Robust real-time face detection. Int J Comput Vision 57(2):137–154

    Article  Google Scholar 

  26. Wiskott L, J-M Fellous, Kruger N, Von Malsburg CD (1997) Face recognition by elastic bunch graph matching. IEEE Trans Pattern Anal Mach Intell 19(7):775–779

    Article  Google Scholar 

  27. Zhang W, Shan S, Gao W, Chang Y, Cao B, Yang P (2004) Information fusion in face identification. Proceeding of International Conference on Pattern Recognition (ICPR2004). Cambridge, Vol. 1, pp. 950–953

Download references

Acknowledgement

The research work was supported by the joint research funds of Dalian University of Technology and Shenyang Institute of Automation, Chinese Academy of Science. The authors would like to thank to the MBGC Team and Sponsors for providing the MBGC still frontal face version 1.0 data set.

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Dalian University of Technology, Dalian, 116024, China

    Fan Ou, Zhaocui Han, Chong Liu & Zongying Ou

Authors
  1. Fan Ou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhaocui Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zongying Ou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zongying Ou.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ou, F., Han, Z., Liu, C. et al. Face verification with feature fusion of Gabor based and curvelet based representations. Multimed Tools Appl 57, 549–563 (2012). https://doi.org/10.1007/s11042-010-0658-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0658-0

Keywords

Search

Navigation