Abstract
The detection of moving pedestrians is of major importance for intelligent vehicles, since information about such persons and their tracks should be incorporated into reliable collision avoidance algorithms. In this paper, we propose a new approach to detect moving pedestrians aided by motion analysis. Our main contribution is to use motion information in two ways: on the one hand we localize blobs of moving objects for regions of interest (ROIs) selection by segmentation of an optical flow field in a pre-processing step, so as to significantly reduce the number of detection windows needed to be evaluated by a subsequent people classifier, resulting in a fast method suitable for real-time systems. On the other hand we designed a novel kind of features called Motion Self Difference (MSD) features as a complement to single image appearance features, e. g. Histograms of Oriented Gradients (HOG), to improve distinctness and thus classifier performance. Furthermore, we integrate our novel features in a two-layer classification scheme combining a HOG+Support Vector Machines (SVM) and a MSD+SVM detector. Experimental results on the Daimler mono moving pedestrian detection benchmark show that our approach obtains a log-average miss rate of 36 % in the FPPI range [10−2,100], which is a clear improvement with respect to the naive HOG+SVM approach and better than several other state-of-the-art detectors. Moreover, our approach also reduces runtime per frame by an order of magnitude.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Regulated ground truth annotations can be downloaded at http://www.iai.uni-bonn.de/∼zhangs
References
Benenson R, Mathias M, Timofte R, Van Gool L (2012) Pedestrian detection at 100 frames per second. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Bertozzi M, Broggi A, Chapuis R, Chausse F, Fascioli A, Tibaldi A (2003) Shape-based pedestrian detection and localization. In: Proceedings of the IEEE conference on intelligent transportation systems
Bertozzi M, Broggi A, Fascioli A, Tibaldi A, Chapuis R, Chausse F (2004) Pedestrian localization and tracking system with kalman filtering. In: Proceedings of the IEEE intelligent vehicles symposium
Bouchrika I, Carter JN, Nixon MS, Mörzinger R, Thallinger G (2010) Using gait features for improving walking people detection. In: Proceedings of the international conference on pattern recognition
Broggi A, Fascioli A, Fedriga I, Tibaldi A, Rose M (2003) Stereo-based preprocessing for human shape localization in unstructured environments. In: Proceedings of the IEEE intelligent vehicles symposium
Chen K, Wang L, Chi H (1997) Methods of combining multiple classifiers with different features and their applications to text-independent speaker identification. Int J Pattern Recog Artif Intell 11(3):417–445
Curio C, Edelbrunner J, Kalinke T, Tzomakas C, Von Seelen W (2000) Walking pedestrian recognition. IEEE Trans Intell Transport Syst 1(3):155–163
Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Dalal N, Triggs B, Schmid C (2006) Human detection using oriented histograms of flow and appearance. In: Proceedings of the European conference on computer vision
Ding J, Wang Y, Geng W (2013) An hog-ct human detector with histogram-based search. Multimed Tools Appl 63(3):791–807
Dollár P, Wojek C, Schiele B, Perona P (2011) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761
Elzein H, Lakshmanan S, Watta P (2003) A motion and shape-based pedestrian detection algorithm. In: Proceedings of the IEEE intelligent vehicles symposium
Enzweiler M, Gavrila DM (2009) Monocular pedestrian detection: survey and experiments, vol 31
Enzweiler M, Kanter P, Gavrila DM (2008) Monocular pedestrian recognition using motion parallax. In: Proceedings of the IEEE intelligent vehicles symposium
Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181
Felzenszwalb PF, McAllester D, Ramanan D (2008) A discriminatively trained, multiscale, deformable part model. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Franke U, Heinrich S (2002) Fast obstacle detection for urban traffic situations. IEEE Trans Intell Transp Syst 3(3):173–181
Gavrila DM, Munder S (2007) Multi-cue pedestrian detection and tracking from a moving vehicle. Int J Comput Vis 73(1):41–59
Gerónimo D, López AM, Sappa AD, Graf T (2010) Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans Pattern Anal Mach Intell 32(7):1239–1258
Gualdi G, Prati A, Cucchiara R (2010) Multi-stage sampling with boosting cascades for pedestrian detection in images and videos. In: Proceedings of the European conference on computer vision
Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259
Kamijo S, Fujimura K, Shibayama Y (2010) Pedestrian detection algorithm for on-board cameras of multi view angles. In: Proceedings of the IEEE intelligent vehicles symposium
Kamijo S, Matsushita Y, Ikeuchi K, Sakauchi M (2000) Occlusion robust tracking utilizing spatio-temporal markov random field model. In: Proceedings of the international conference on pattern recognition
Leibe B, Cornelis N, Cornelis K, Van Gool L (2007) Dynamic 3d scene analysis from a moving vehicle. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Lim J, Kim W (2013) Detecting and tracking of multiple pedestrians using motion, color information and the adaboost algorithm. Multimed Tools Appl 65(1):161–179
Liu C (2009) Beyond pixels: exploring new representations and applications for motion analysis. Ph.D. thesis, Massachusetts Institute of Technology
Maji S, Berg AC, Malik J (2008) Classification using intersection kernel support vector machines is efficient. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Park D, Zitnick CL, Ramanan D, Dollár P (2013) Exploring weak stabilization for motion feature extraction. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Sabzmeydani P, Mori G (2007) Detecting pedestrians by learning shapelet features. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57(2):137–154
Walk S, Majer N, Schindler K, Schiele B (2010) New features and insights for pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Wang X, Han TX (2009) An HOG-LBP human detector with partial occlusion handling. In: Proceedings of the international conference on computer vision
Wojek C, Schiele B (2008) A performance evaluation of single and multi-feature people detection. In: Proceedings of the symposium of the german association for pattern recognition (DAGM)
Wojek C, Walk S, Schiele B (2009) Multi-cue onboard pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Zhang S, Bauckhage C, Cremers A (2014) Informed haar-like features improve pedestrian detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Zhang S, Bauckhage C, Klein D, Cremers A (2013) Moving pedestrian detection based on motion segmentation. In: Proceedings of the IEEE workshop on robot vision (WoRV)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, S., Klein, D.A., Bauckhage, C. et al. Fast moving pedestrian detection based on motion segmentation and new motion features. Multimed Tools Appl 75, 6263–6282 (2016). https://doi.org/10.1007/s11042-015-2571-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2571-z