3D Tracking of Multiple People Using Their 2D Face Locations

  • Nikos Katsarakis
  • Aristodemos Pnevmatikakis
  • Michael Nechyba
Part of the IFIP The International Federation for Information Processing book series (IFIPAICT, volume 247)


In this paper, we address tracking of multiple people in complex 3D scenes, using multiple calibrated and synchronized far-field recordings. Our approach utilizes the faces detected in every camera view. Faces of the same person seen from the different cameras are associated by first finding all possible associations and then choosing the best option by means of a 3D stochastic tracker. The performance of the proposed system is evaluated by using the outputs of two grossly different 2D face detectors as input to our 3D algorithm. The multi-camera videos employed come from the CLEAR evaluation campaign. Even though the two 2D face detectors have very different performance, the 3D tracking performance of our system remains practically unchanged.


Fiducial Point Face Tracker Multiple People Panoramic Camera Smart Room 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Z. Zhang: A Flexible New Technique for Camera Calibration, Technical Report MSR-TR-98-71, Microsoft Research, (Aug. 2002).Google Scholar
  2. 2.
    R. Stiefelhagen, K. Bernardin, R. Bowers, J. Garofolo, D. Mostefa and P. Soundararajan: The CLEAR 2006 Evaluation, in R. Stiefelhagen and J. Garofolo (eds.) CLEAR 2006, Lecture Notes in Computer Science, 4122 (2007), 1–44.Google Scholar
  3. 3.
    www.clear-evaluation.orgGoogle Scholar
  4. 4.
    Stergiou, G. Karame, A. Pnevmatikakis and L. Polymenakos: The AIT 2D face detection and tracking system for CLEAR 2007, in R. Stiefelhagen, R. Bowers and J. Garofolo (eds.) CLEAR 2007, Lecture Notes in Computer Science, accepted.Google Scholar
  5. 5.
    G. Bradski: Computer Vision Face Tracking for Use in a Perceptual User Interface, Intel Technology Journal, 2, (1998).Google Scholar
  6. 6.
    M. Nechyba, L. Brandy and H. Schneiderman: PittPatt Face Detection and Tracking for the CLEAR 2007 Evaluation, in R. Stiefelhagen, R. Bowers and J. Garofolo (eds.) CLEAR 2007, Lecture Notes in Computer Science, accepted.Google Scholar
  7. 7.
    http://demo.pittpaftt.comGoogle Scholar
  8. 8.
    H. Schneiderman: Feature-Centric Evaluation for Efficient Cascaded Object Detection, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (June 2004).Google Scholar
  9. 9.
    S. Blackman: Multiple-Target Tracking with Radar Applications, Artech House, Dedham, MA (1986), chapter 14.Google Scholar
  10. 10.
    G. Bradski, A. Kaehler and V. Pisarevsky: Learning-Based Computer Vision with Intel’s Open Source Computer Vision Library, Intel Technology Journal, 9, (2005).Google Scholar
  11. 11.
    Pnevmatikakis and L. Polymenakos: Robust Estimation of Background for Fixed Cameras, in International Conference on Computing (CIC2006), (2006).Google Scholar

Copyright information

© International Federation for Information Processing 2007

Authors and Affiliations

  • Nikos Katsarakis
    • 1
  • Aristodemos Pnevmatikakis
    • 1
  • Michael Nechyba
    • 2
  1. 1.Athens Information TechnologyAutonomic and Grid Computing GroupPeaniaGreece
  2. 2.Pittsburgh Pattern RecognitionPittsburghUSA

Personalised recommendations