Skip to main content

Real-Time Detection and Tracking of Multiple People in Laser Scan Frames

  • Chapter
  • 1947 Accesses

Part of the book series: Advances in Pattern Recognition ((ACVPR))

Abstract

This chapter presents an approach to detect and track multiple people ro bustly in real time using laser scan frames. The detection and tracking of people in real time is a problem that arises in a variety of different contexts. Examples in clude intelligent surveillance for security purposes, scene analysis for service robot, and crowd behavior analysis for human behavior study. Over the last several years, an increasing number of laser-based people-tracking systems have been developed in both mobile robotics platforms and fixed platforms using one or multiple laser scanners. It has been proved that processing on laser scanner data makes the tracker much faster and more robust than a vision-only based one in complex situations. In this chapter, we present a novel robust tracker to detect and track multiple people in a crowded and open area in real time. First, raw data are obtained that measures two legs for each people at a height of 16 cm from horizontal ground with multiple registered laser scanners. A stable feature is extracted using accumulated distribu tion of successive laser frames. In this way, the noise that generates split and merged measurements is smoothed well, and the pattern of rhythmic swinging legs is uti lized to extract each leg. Second, a probabilistic tracking model is presented, and then a sequential inference process using a Bayesian rule is described. A sequential inference process is difficult to compute analytically, so two strategies are presented to simplify the computation. In the case of independent tracking, the Kalman fil ter is used with a more efficient measurement likelihood model based on a region coherency property. Finally, to deal with trajectory fragments we present a concise approach to fuse just a little visual information from synchronized video camera to laser data. Evaluation with real data shows that the proposed method is robust and effective. It achieves a significant improvement compared with existing laser-based trackers.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Chapter's References

  1. Frank, O., Nieto, J., Guivant, J., Scheding, S.: Multiple target tracking using sequential monte carlo methods and statistical data association. In: Proc. 2003 IEEE/RSJ Int. Conf. Intell. Robots Syst. (2003)

    Google Scholar 

  2. Kluge, B., Koehler, C., Prassler, E.: Fast and robust tracking of multiple moving objects with a laser range finder. In: Proc. IEEE Int. Conf. Robot. Automation 1683– 1688 (2001)

    Google Scholar 

  3. Lindstrom, M., Eklundh, J.-O.: Detecting and tracking moving objects from a mobile platform using a laser range scanner. In: Proc. 2001 IEEE/RSJ Int. Conf. Intell. Robots Syst. 1364– 1369 (2001)

    Google Scholar 

  4. Montemerlo, M., Thrun, S., Whittaker, W.: Conditional particle filters for simultaneous mobile robot localization and people-tracking. In: Proc. IEEE Int. Conf. Robot. Automation (2002)

    Google Scholar 

  5. Prassler, E., Scholz, J., Schuster, M., Schwammkrug, D.: Tracking a large number of moving objects in a crowded environment. In: IEEE Workshop Perception Mobile Agents (1998)

    Google Scholar 

  6. Schulz, D., Burgard, W., Fox, D., Cremers, A.: Tracking multiple moving targets with a mobile robot. In: Proc. IEEE Comput. Soci. Conf. Comput. Vis. Pattern Recogn. (2001)

    Google Scholar 

  7. Zhao. H., Shibasaki, R.: A novel system for tracking pedestrians using multiple single-row laser range scanners. IEEE Trans. SMC. Part A: Syst. Humans. 35, 283– 291 (2005)

    Article  Google Scholar 

  8. Cui, J., Zha, H., Zhao, H., Shibasaki, R.: Tracking multiple people using laser and vision. In: Proc. 2005 IEEE/RSJ Int. Conf. Intell. Robots Syst. 1301–1306 (2005)

    Google Scholar 

  9. Fod, A., Howard, A., Mataric, M.J.: A laser-based people tracker. In: Proc. IEEE Int. Conf. Robot Automation 3024–3029 (2002)

    Google Scholar 

  10. Blanco, J., Burgard, W., Sanz, R., Fernandez, J.L.: Fast face detection for mobile robots by integrating laser range data with vision. In: Conf. Advanced Robotics (2003)

    Google Scholar 

  11. Byers, Z., Dixon, M., Goodier, K., Grimm, C.M., Smart, W.D.: An autonomous robot photog rapher. In: IEEE Conf. Robots Syst. (2003)

    Google Scholar 

  12. Scheutz, M., McRaven, J., Cserey, G.: Fast, reliable, adaptive bimodal people tracking for indoor environments. In: Proc. 2004 IEEE/RSJ Int. Conf. Intell. Robots Syst. (2004)

    Google Scholar 

  13. Zhao, H., Shibasaki, R.: A robust method for registering ground-based laser range images of urban outdoor environment. Photogram. Eng. Remote Sens. 67, 1143– 1153 (2001)

    Google Scholar 

  14. Mochon, S., McMahon, T. A. Ballistic walking. J. Biomech. 13, 49– 57 (1980)

    Article  Google Scholar 

  15. Parzen, E.: On estimation of a probability density function and mode. Ann. Math. Statistics. 33, 1065– 1076 (1962)

    Article  MATH  MathSciNet  Google Scholar 

  16. Khan, Z., Balch, T., Dellaert, F.: Multitarget tracking with split and merged measurements. In: IEEE Conf. Comput. Vis. Pattern Recog. (2005)

    Google Scholar 

  17. Sarkka, S., Vehtari, A., Lampinen, J.: Rao-Blackwellized Monte Carlo data association for multiple target tracking. In: The 7th Int. Conf. Inform. Fusion (2004)

    Google Scholar 

  18. Doucet, A., De Freitas, J.F.G., Gordon, N.J. (eds.) Sequential Monte Carlo Methods in Prac tice. Springer-Verlag, New York, 2001

    Google Scholar 

  19. Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robotics Automation 4(3), 323– 344 (1987)

    Article  Google Scholar 

  20. Nishimura, T., Hideo, I., Yoshiyuki N., Yoshinobu, Y., Hideyuki, N.: A compact battery-less information terminal (CoBIT) for location-based support systems. SPIE, Vol. 3001, 124– 139 (2004)

    Google Scholar 

  21. Comaniciu, D., Ramesh, V., Meer, P. Kernel based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003)

    Google Scholar 

  22. Reprinted from: Computer Vision and Image Understanding, Vol. 106, no 2, J. Cui, H. Zha, H. Zhao, R. Shibasaki, Laser-based detection and tracking of multiple people in crowds, 300– 312, Copyright (2007), with permission from Elsevier

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Cui, J., Song, X., Zhao, H., Zha, H., Shibasaki, R. (2009). Real-Time Detection and Tracking of Multiple People in Laser Scan Frames. In: Hammoud, R.I. (eds) Augmented Vision Perception in Infrared. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-84800-277-7_17

Download citation

  • DOI: https://doi.org/10.1007/978-1-84800-277-7_17

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84800-276-0

  • Online ISBN: 978-1-84800-277-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics