Multimedia Tools and Applications

, Volume 38, Issue 2, pp 271–291 | Cite as

Robust detection of outliers for projection-based face recognition methods

  • Sid-Ahmed Berrani
  • Christophe Garcia


In this paper, the impact of outliers on the performance of high-dimensional data analysis methods is studied in the context of face recognition. Most of the existing face recognition methods are based on PCA-like methods: faces are projected into a lower dimensional space in which similarity between faces is supposed to be more easily evaluated. These methods are, however, very sensitive to the quality of the face images used in the training and in the recognition phases. Their performance significantly drops when face images are not well centered or taken under variable illumination conditions. In this paper, we study this phenomenon for two face recognition methods, namely PCA and LDA2D, and we propose a filtering process that allows the automatic selection of noisy face images which are responsible for the performance degradation. This process uses two techniques. The first one is based on the recently proposed robust high-dimensional data analysis method called RobPCA. It is specific to the case of recognition from video sequences. The second technique is based on a novel and effective face classification technique. It allows isolating still face images that are not very precisely cropped, not well-centered or in a non-frontal pose. Experiments show that this filtering process significantly improves recognition rates by 10 to 30%.


High-dimensional data analysis Outliers Face recognition Dimensionality curse 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aggarwal CC, Yu PS (2001) Outlier detection for high dimensional data. In: proceedings of the ACM Sigmod international conference on management of Data, Santa Barbara, CA, USAGoogle Scholar
  2. 2.
    Aggrawal CC (2001) On the effects of dimensionality reduction on high dimensional similarity search. In: Symposium on principles of database systems, Santa Barbara, California, USAGoogle Scholar
  3. 3.
    Barnett V, Lewis T (1994) Outliers in statistical data, 3rd edn. WileyGoogle Scholar
  4. 4.
    Belhumeur P, Hespanha J, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. Special Theme Issue on Face and Gesture Recognition, IEEE Trans. on Pattern Anal Mach Intell 19(7):711–720Google Scholar
  5. 5.
    Bellman R (1961) Adaptive control processes: a guided tour. Princeton University PressGoogle Scholar
  6. 6.
    Berrani S-A, Amsaleg L, Gros P (2003) Approximate searches: k-neighbors+precision. In: Proceedings of the 12th ACM international conference on information and knowledge management, New Orleans, Louisiana, USAGoogle Scholar
  7. 7.
    Berrani S-A, Garcia C (2005) Enhancing face recognition from video sequences using robust statistics. In: Proceedings of the IEEE international conference on video and signal-based surveillance, Como, ItalyGoogle Scholar
  8. 8.
    Berrani S-A, Garcia C (2005) On the impact of outliers on high-dimensional data analysis methods for face recognition. In: proceedings of the international Workshop on Computer Vision Meets Databases, Baltimore, MD, USAGoogle Scholar
  9. 9.
    Blackburn D, Bone JM, Phillips JP (2001) Face recognition vendor test 2000: evaluation report. Technical report,
  10. 10.
    Garcia C, Delakis M (2004) Convolutional face finder: a neural architecture for fast and robust face detection. IEEE Trans Pattern Anal Mach Intell 26(11):1408–1423CrossRefGoogle Scholar
  11. 11.
    Hjelmas E, Low B (2001)Face detection: a survey. Comput Vis Image Underst 83(3): 236–274MATHCrossRefGoogle Scholar
  12. 12.
    Hodge VJ, Austin J (2004) A survey of outlier detection methodologies. Artif Intell Rev 22(2):85–126MATHCrossRefGoogle Scholar
  13. 13.
    Hubert M, Rousseeuw P, Branden KV (2005) ROBPCA: a new approach to robust principal component analysis. Technometrics 1(47):64–79CrossRefGoogle Scholar
  14. 14.
    John GH (1995) Robust decision trees: removing outliers from databases. In: Proceedings of the 1st international conference on knowledge discovery and data mining, Montreal, CanadaGoogle Scholar
  15. 15.
    Lin C, Fan K-C (2003) Pose classification of human faces by weighting mask function appraoch. Pattern Recogn Lett 24:1857–1869CrossRefGoogle Scholar
  16. 16.
    Messer K, Matas J, Kittler J, Lüettin J, Maitre (1999) XM2VTSDB: the extended M2VTS database. In: Proceedings of the internatinal conference on audio- and video-based biometric person authentication, Washington, USAGoogle Scholar
  17. 17.
    Pentland A, Moghaddam B, Starner T (1994) View-based and modular eigenspaces for face recognition. In: Proceedings of 13th IEEE conference on computer vision and pattern recognition, Seattle, Washington, USAGoogle Scholar
  18. 18.
    Phillips JP, Gother PJ, Micheals RJ, Blackburn D, Tabassi E, Bone JM (2003) Face recognition vendor test 2002: evaluation report. Technical report, NIST IR n 6965
  19. 19.
    Phillips PJ, Moon H, Rauss PJ, Rizvi S (2000) The FERET evaluation methodology for face recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104CrossRefGoogle Scholar
  20. 20.
    Phillips PJ, Wechsler H, Huang J, Rauss P (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306CrossRefGoogle Scholar
  21. 21.
    Rousseeuw P, Van Driessen K (1999) A fast algorithm for the minimum covariance determinant estimator. Technometrics 41:212–223CrossRefGoogle Scholar
  22. 22.
    Seo K, Cohen I, You S, Neumann U (2004) Face pose estimation system by combining hybrid ICA-SVM learning and re-registration. In: proceedings of the asian conferenve on computer vision, Jeju, KoreaGoogle Scholar
  23. 23.
    Sim T, Baker S, Bsat M (2002) The CMU pose, illumination, and expression (PIE) database. In: Proceedings of the 5th international conference on automatic face and gesture recognition, Washington DC, USAGoogle Scholar
  24. 24.
    Sirovitch L, Kirby M (1987) A low-dimensional procedure for the characterization of human faces. J Opt Soc Am 4(3):519–524CrossRefGoogle Scholar
  25. 25.
    Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRefGoogle Scholar
  26. 26.
    Verleysen M (2003) Learning high-dimensional data. In: Piuri SAV, Gori M, Goras L (eds) Limitations and future trends in neural computation. IOS Press, pp 141–162Google Scholar
  27. 27.
    Verleysen M, Francois D, Simon G, Wertz V (2003) On the effects of dimensionality on data analysis with neural networks. In: Proceedings of the 7th internatioanl work-conference on artificial and natural neural networks, Maó, Menorca, SpainGoogle Scholar
  28. 28.
    Viola PA, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154CrossRefGoogle Scholar
  29. 29.
    Visani M, Garcia C, Jolion J-M (2004) Two-dimensional-oriented linear discriminant analysis for face recognition. In: Proceedings of the international conference on computer vision and graphics, Warsaw, PolandGoogle Scholar
  30. 30.
    Yang J, Zhang D, Frangi AF, Yang J-Y (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRefGoogle Scholar
  31. 31.
    Yang M, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58CrossRefGoogle Scholar
  32. 32.
    Yao P, Evans G, Calway A (2001) Face tracking and pose estimation using affine motion parameters. In: Proceedings of the 12th scandinavian conference. on Image Analysis, Bergen, NorwayGoogle Scholar
  33. 33.
    Zhao W, Chellappa R, Phillips J, Rosenfeld A (2003) Face recognition: a literature survey. ACM Comput Surv 35(4):399–458CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Orange—France Telecom Division R&D—TECH/IRISCesson Sévigné CedexFrance

Personalised recommendations