Robust Real-Time Face Tracking Using an Active Camera

  • Paramveer S. Dhillon
Conference paper
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 63)


This paper addresses the problem of facial feature detection and tracking in real-time using a single active camera. The variable parameters of the camera (i.e. pan, tilt and zoom) are changed adaptively to track the face of the agent in successive frames and detect the facial features which may be used for facial expression analysis for surveillance or mesh generation for animation purposes, at a later stage. Our tracking procedure assumes planar motion of the face. It also detects invalid feature points i.e. those feature points which do not correspond to actual facial features, but are outliers. They are subsequently abandoned by our procedure in order to extract ‘high level’ information from the face for facial mesh generation or emotion recognition which might be helpful for Video Surveillance purposes. The only limitation on the performance of the procedure is imposed by the maximum pan/tilt range of the camera.


Facial Feature Emotion Recognition Image Space Mesh Generation Face Detector 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Comaniciu, D., Ramesh, V.: Robust Detection and Tracking of Human Faces with an Active Camera. In: VS 2000: Proceedings of the Third IEEE International Workshop on Visual Surveillance (VS’2000), vol. 02, p. 11 (2000)Google Scholar
  2. 2.
    Ukita, N., Matsuyama, T.: Real-time cooperative multi-target tracking by communicating active vision agents. icpr, vol. 02, pp. 2001-4 (2002)Google Scholar
  3. 3.
    Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1994) (June 1994)Google Scholar
  4. 4.
    Murray, D., Basu, A.: Motion tracking with an active camera. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(5), 449–459 (1994)CrossRefGoogle Scholar
  5. 5.
    Smith, P., Shah, M., da Vitoria Lobo, N.: Integrating multiple levels of zoom to enable activity analysis. Computer Vision and Image Understanding 103(1), 33–51 (2006)CrossRefGoogle Scholar
  6. 6.
    Viola, P., Jones, M.: Robust real-time object detection. International Journal of Computer Vision (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Paramveer S. Dhillon
    • 1
  1. 1.CIS DepartmentUniversity of PennsylvaniaPhiladelphiaU.S.A

Personalised recommendations