Multi-camera People Localization and Height Estimation Using Multiple Birth-and-Death Dynamics

  • Ákos Utasi
  • Csaba Benedek
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6468)


This paper presents a novel tool for localizing people in multi-camera environment using calibrated cameras. Additionally, we will estimate the height of each person in the scene. Currently, the presented method uses the human body silhouettes as input, but it can be easily modified to process other widely used object (e.g. head, leg, body) detection results. In the first step we project all the pixels of the silhouettes to the ground plane and to other parallel planes with different height. Then we extract our features, which are based on the physical properties of the 2-D image formation. The final configuration results (location and height) are obtained by an iterative stochastic optimization process, namely the multiple birth-and-death dynamics framework.


Ground Plane Camera View Multiple Camera Height Estimation Crowded Scene 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Yilmaz, A., Javed, O., Shah, M.: Object tracking: A survey. ACM Computing Surveys 38, 13 (2006)CrossRefGoogle Scholar
  2. 2.
    Mikic, I., Santini, S., Jain, R.: Video processing and integration from multiple cameras. In: Proc. of the Image Understanding Workshop, pp. 183–187 (1998)Google Scholar
  3. 3.
    Mittal, A., Davis, L.S.: M2tracker: A multi-view approach to segmenting and tracking people in a cluttered scene using region-based stereo. Int. J. of Computer Vision 51, 189–203 (2002)CrossRefzbMATHGoogle Scholar
  4. 4.
    Kang, J., Cohen, I., Medioni, G.: Tracking people in crowded scenes across multiple cameras. In: Proc. of the Asian Conf. on Computer Vision (2004)Google Scholar
  5. 5.
    Fleuret, F., Berclaz, J., Lengagne, R., Fua, P.: Multicamera people tracking with a probabilistic occupancy map. IEEE Trans. on Pattern Analysis and Machine Intelligence 30, 267–282 (2008)CrossRefGoogle Scholar
  6. 6.
    Khan, S.M., Shah, M.: Tracking multiple occluding people by localizing on multiple scene planes. IEEE Trans. on Pattern Analysis and Machine Intelligence 31, 505–519 (2009)CrossRefGoogle Scholar
  7. 7.
    Havasi, L., Szlávik, Z.: Using location and motion statistics for the localization of moving objects in multiple camera surveillance videos. In: Proc. of the IEEE Int. Workshop on Visual Surveillance (2009)Google Scholar
  8. 8.
    Benedek, C., Szirányi, T.: Bayesian foreground and shadow detection in uncertain frame rate surveillance videos. IEEE Trans. on Image Processing 17, 608–621 (2008)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Descombes, X., Minlos, R., Zhizhina, E.: Object extraction using a stochastic birth-and-death dynamics in continuum. J. of Math. Imaging and Vision 33, 347–359 (2009)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J. of Robotics and Automation 3, 323–344 (1987)CrossRefGoogle Scholar
  11. 11.
    Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. of Royal Statistical Society, Series B 39, 1–38 (1977)MathSciNetzbMATHGoogle Scholar
  12. 12.
    Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using real-time tracking. IEEE Trans. on Pattern Analysis and Machine Intelligence 22, 747–757 (2000)CrossRefGoogle Scholar
  13. 13.
    PETS: Dataset - Performance Evaluation of Tracking and Surveillance (2009),
  14. 14.
    Wu, B., Nevatia, R.: Detection and segmentation of multiple, partially occluded objects by grouping, merging, assigning part detection responses. Int. J. of Computer Vision 82, 185–204 (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ákos Utasi
    • 1
  • Csaba Benedek
    • 1
  1. 1.Computer and Automation Research Institute, Distributed Events Analysis Research GroupHungarian Academy of SciencesBudapestHungary

Personalised recommendations