Advertisement

Journal of Computer Science and Technology

, Volume 18, Issue 2, pp 241–246 | Cite as

Multi-cue-based face and facial feature detection on video segments

  • Zhen Yun Peng
  • HaiZhou Ai
  • Wei Hong
  • LuHong Liang
  • GuangYou Xu
Notes

Abstract

An approach is presented to detect faces and facial features on a video segment based on multi-cues, including gray-level distribution, color, motion, templates, algebraic features and so on. Faces are first detected across the frames by using color segmentation, template matching and artificial neural network. A PCA-based (Principal Component Analysis) feature detector for still images is then used to detect facial features on each single frame until the resulting features of three adjacent frames, named as base frames, are consistent with each other. The features of frames neighboring the base frames are first detected by the still-image feature detector, then verified and corrected according to the smoothness constraint and the planar surface motion constraint. Experiments have been performed on video segments captured under different environments, and the presented method is proved to be robust and accurate over variable poses, ages and illumination conditions.

Keywords

multi-cue facial feature detection face detection video segment motion constraint 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Ardizzone E, Cascia M. Automatic video database indexing and retrieval.Multimedia Tools and Applications, 1997, 4: 29–56.CrossRefGoogle Scholar
  2. [2]
    Mark Pickeringet al. A proposal for an automatic face extraction algorithm. ISO/MPEG M5399, Maui, 1999.Google Scholar
  3. [3]
    Reisfeld D, Yeshuran Y. Robust detection of facial features by generalized symmetry. InProc. 11th Int. Conf. Patt. Recog., 1992, pp.117–120.Google Scholar
  4. [4]
    Yuille A L, Cohen D S, Halinan P W. Feature extraction from faces using deformable templates. InProc. IEEE Computer Soc. Conf. on Computer Vision and Patt. Recog., 1989, pp.104–109.Google Scholar
  5. [5]
    Huang C L, Chen C W. Human facial feature extraction for face interpretation and recognition.Pattern Recognition, 1992, 25(12): 1435–1444.CrossRefGoogle Scholar
  6. [6]
    Ai Haizhou, Liang Luhong, Xu Guangyou. A general framework for face detection. InProc. 3rd Int. Conf. Multimodal Interfaces, 2000, 1948: 119–126.Google Scholar
  7. [7]
    Peng Zhenyun, Xu Guangyou, Zhang Hongjiang. Detecting facial features on images with multiple faces. InProc. 3rd Int. Conf. Multimodal Interfaces, 2000, 1948: 191–195.Google Scholar
  8. [8]
    Peng Zhenyun, You Suya, Xu Guangyou. Locating facial features using threshold images. InProc. the Third Int. Conf. Signal Processing, 1996, 2: 1162–1166.Google Scholar

Copyright information

© Science Press, Beijing China and Allerton Press Inc. 2003

Authors and Affiliations

  • Zhen Yun Peng
    • 1
  • HaiZhou Ai
    • 1
  • Wei Hong
    • 1
  • LuHong Liang
    • 1
  • GuangYou Xu
    • 1
  1. 1.Department of Computer Science and TechnologyTsinghua UniversityBeijingP.R. China

Personalised recommendations