Abstract
This chapter presents an approach to detect and track multiple people ro bustly in real time using laser scan frames. The detection and tracking of people in real time is a problem that arises in a variety of different contexts. Examples in clude intelligent surveillance for security purposes, scene analysis for service robot, and crowd behavior analysis for human behavior study. Over the last several years, an increasing number of laser-based people-tracking systems have been developed in both mobile robotics platforms and fixed platforms using one or multiple laser scanners. It has been proved that processing on laser scanner data makes the tracker much faster and more robust than a vision-only based one in complex situations. In this chapter, we present a novel robust tracker to detect and track multiple people in a crowded and open area in real time. First, raw data are obtained that measures two legs for each people at a height of 16 cm from horizontal ground with multiple registered laser scanners. A stable feature is extracted using accumulated distribu tion of successive laser frames. In this way, the noise that generates split and merged measurements is smoothed well, and the pattern of rhythmic swinging legs is uti lized to extract each leg. Second, a probabilistic tracking model is presented, and then a sequential inference process using a Bayesian rule is described. A sequential inference process is difficult to compute analytically, so two strategies are presented to simplify the computation. In the case of independent tracking, the Kalman fil ter is used with a more efficient measurement likelihood model based on a region coherency property. Finally, to deal with trajectory fragments we present a concise approach to fuse just a little visual information from synchronized video camera to laser data. Evaluation with real data shows that the proposed method is robust and effective. It achieves a significant improvement compared with existing laser-based trackers.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
Chapter's References
Frank, O., Nieto, J., Guivant, J., Scheding, S.: Multiple target tracking using sequential monte carlo methods and statistical data association. In: Proc. 2003 IEEE/RSJ Int. Conf. Intell. Robots Syst. (2003)
Kluge, B., Koehler, C., Prassler, E.: Fast and robust tracking of multiple moving objects with a laser range finder. In: Proc. IEEE Int. Conf. Robot. Automation 1683– 1688 (2001)
Lindstrom, M., Eklundh, J.-O.: Detecting and tracking moving objects from a mobile platform using a laser range scanner. In: Proc. 2001 IEEE/RSJ Int. Conf. Intell. Robots Syst. 1364– 1369 (2001)
Montemerlo, M., Thrun, S., Whittaker, W.: Conditional particle filters for simultaneous mobile robot localization and people-tracking. In: Proc. IEEE Int. Conf. Robot. Automation (2002)
Prassler, E., Scholz, J., Schuster, M., Schwammkrug, D.: Tracking a large number of moving objects in a crowded environment. In: IEEE Workshop Perception Mobile Agents (1998)
Schulz, D., Burgard, W., Fox, D., Cremers, A.: Tracking multiple moving targets with a mobile robot. In: Proc. IEEE Comput. Soci. Conf. Comput. Vis. Pattern Recogn. (2001)
Zhao. H., Shibasaki, R.: A novel system for tracking pedestrians using multiple single-row laser range scanners. IEEE Trans. SMC. Part A: Syst. Humans. 35, 283– 291 (2005)
Cui, J., Zha, H., Zhao, H., Shibasaki, R.: Tracking multiple people using laser and vision. In: Proc. 2005 IEEE/RSJ Int. Conf. Intell. Robots Syst. 1301–1306 (2005)
Fod, A., Howard, A., Mataric, M.J.: A laser-based people tracker. In: Proc. IEEE Int. Conf. Robot Automation 3024–3029 (2002)
Blanco, J., Burgard, W., Sanz, R., Fernandez, J.L.: Fast face detection for mobile robots by integrating laser range data with vision. In: Conf. Advanced Robotics (2003)
Byers, Z., Dixon, M., Goodier, K., Grimm, C.M., Smart, W.D.: An autonomous robot photog rapher. In: IEEE Conf. Robots Syst. (2003)
Scheutz, M., McRaven, J., Cserey, G.: Fast, reliable, adaptive bimodal people tracking for indoor environments. In: Proc. 2004 IEEE/RSJ Int. Conf. Intell. Robots Syst. (2004)
Zhao, H., Shibasaki, R.: A robust method for registering ground-based laser range images of urban outdoor environment. Photogram. Eng. Remote Sens. 67, 1143– 1153 (2001)
Mochon, S., McMahon, T. A. Ballistic walking. J. Biomech. 13, 49– 57 (1980)
Parzen, E.: On estimation of a probability density function and mode. Ann. Math. Statistics. 33, 1065– 1076 (1962)
Khan, Z., Balch, T., Dellaert, F.: Multitarget tracking with split and merged measurements. In: IEEE Conf. Comput. Vis. Pattern Recog. (2005)
Sarkka, S., Vehtari, A., Lampinen, J.: Rao-Blackwellized Monte Carlo data association for multiple target tracking. In: The 7th Int. Conf. Inform. Fusion (2004)
Doucet, A., De Freitas, J.F.G., Gordon, N.J. (eds.) Sequential Monte Carlo Methods in Prac tice. Springer-Verlag, New York, 2001
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robotics Automation 4(3), 323– 344 (1987)
Nishimura, T., Hideo, I., Yoshiyuki N., Yoshinobu, Y., Hideyuki, N.: A compact battery-less information terminal (CoBIT) for location-based support systems. SPIE, Vol. 3001, 124– 139 (2004)
Comaniciu, D., Ramesh, V., Meer, P. Kernel based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003)
Reprinted from: Computer Vision and Image Understanding, Vol. 106, no 2, J. Cui, H. Zha, H. Zhao, R. Shibasaki, Laser-based detection and tracking of multiple people in crowds, 300– 312, Copyright (2007), with permission from Elsevier
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Cui, J., Song, X., Zhao, H., Zha, H., Shibasaki, R. (2009). Real-Time Detection and Tracking of Multiple People in Laser Scan Frames. In: Hammoud, R.I. (eds) Augmented Vision Perception in Infrared. Advances in Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-84800-277-7_17
Download citation
DOI: https://doi.org/10.1007/978-1-84800-277-7_17
Publisher Name: Springer, London
Print ISBN: 978-1-84800-276-0
Online ISBN: 978-1-84800-277-7
eBook Packages: Computer ScienceComputer Science (R0)