Abstract
Efficient detection and tracking of moving objects in real life conditions is a very challenging research issue, mainly due to occlusions, illumination variations, appearance (disappearance) of new (existing) objects and overlapping issues. In this paper, we address these difficulties by incorporating non-linear and recursive identification mechanisms in motion-based detection and tracking algorithms. Non-linearity allows correct identification of object of complex visual properties while the adaptability makes the proposed scheme able to update its behaviour to the dynamic environmental changes. In addition, in this paper, we introduce the concept of polar spectrum which is a measure for determining the deviation of a vehicle trajectory from an ideal trace. The proposed methods (object tracking and trajectory matching) are applied in survey engineering problems dealing with safe design road turns. In particular, the automatically detected trajectory of a moving vehicle is compared with the ideal trace, through the polar spectrum measure, to determine the safety of a road turn. This trace is also compared with the one manually derived using photogrammetric algorithms and a small error is obtained verifying the efficiency of the method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
We recall that we have ignored index i for simplicity.
References
Arulampalam S, Maskell S, Gordon N, Clapp T (2002) A tutorial on particle filters for on-line non-linear/non-Gaussian Bayesian tracking. IEEE Trans Signal Process 50(2):174–188
Chang S-F, Luo J, Maybank S, Schonfeld D, Xu D (2007) Special issue on event analysis in video. IEEE Trans Circuits Syst Video Technol (CSVT) 17(11):1663–1662
Chen T-H, Lin Y-F, Chen T-Y (2007) Intelligent vehicle counting method based on blob analysis in traffic surveillance. IEEE 2nd International Conference on Innovative Computing and Control, ICICIC, 238–241
Cristani M, Bicego M, Murino V (2007) Audio-visual event recognition in surveillance video sequences. IEEE Trans Multimedia 9(2):257–267
Doulamis A, Doulamis N, Maragos P (2001) Generalized multiscale connected operators with applications to granulometric image analysis, International Conference on Image Processing (ICIP). 3(7–10):684–687
Doulamis A, Doulamis N, Kollias S (2003) An adaptable neural-network model for recursive onlinear traffic prediction and modeling of MPEG video sources. IEEE Trans Neural Netw 14(1):150–166
Doulamis N, Vescoukis V, Georgopoulos A (2008) Angle spectrum for estimation of trajectory deviation using combined tracking and neural network labeling. 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams in conjustion with the ACM multimedia, Vancouver
Gupte S, Masoud O, Martin RFK, Papanikolopoulos NP (2002) Detection and classification of vehicles. IEEE Trans Intell Transp Syst 3(1):37–47
Haykin S (1994) Neural networks: a comprehensive foundation. Macmillan, New York
Hsieh J-W, Yu S-H, Chen Y-S, Hu W-F (2006) Automatic traffic surveillance system for vehicle tracking and classification. IEEE Trans On Intell Transp Systems 7(2):175–187
Hsu WL, Liao HY, Jeng BS, Fan KC (2004) Real-time traffic parameter extraction using entropy. Proc Inst Elect Eng—Vis Image Signal Process 151(3):194–202
Leibe B, Schindler K, Cornelis N, Van Gool L (2008) Coupled object detection and tracking from static cameras and moving vehicles. IEEE Trans Pattern Anal Mach Intell 30(10):1683–1698
Liu Z-F, You Z (2007) A real-time vision-based vehicle tracking and traffic surveillance. IEEE Inter. Conference on software Engineering, Artificial Intelligence, Networking and Parallel and Distributed Computing 1:174–179
Naphade M, Smith JR, Tesic J, Chang S-F, Hsu W, Kennedy L, Hauptmann A, Curtis J (2006) Large-scale concept ontology for multimedia. IEEE Multimed 13(3):86–91
Papaoulakis N, Doulamis N, Patrikakis C, Protonotarios E, Soldatos J (2008) Real-time context-aware and personalized media streaming environments for large scale broadcasting applications. IEEE International Symposium on Consumer Electronics (ISCE), Algarve, Portugal
Sadlier DA, O’Connor NE (2005) Event detection in field sports video using audio-visual features and a support vector machine. IEEE Trans Circuits Syst Video Technol, CSVT 15(10):1225–1233
Salvador S, Chan P (2007) Toward accurate dynamic time wrapping in linear time and space. Intelligent Data Analysis 11(5):561–580
Serra J (1982) Image analysis and mathematical morphology. Academic, New York
Soille P (1999) Morphological image analysis: principles and applications. Springer-Verlag
Sullivan GD, Baker KD, Worrall AD, Attwood CI, Remagnino PM (1997) Model-based vehicle detection and classification using orthographic approximations. Image Vis Comput 15(8):649–654
Tseng BL, Lin C-Y, Smith JR (2002) Real-time video surveillance for traffic monitoring using virtual line analysis. IEEE International Conference on Multimedia and Expo. 2:541–544
Varvarigou A, Addis M, Thallinger G, Leibe B, Ristol S, Dumortier J, Gomez O (2007) SCOVIS: self configurable cognitive video supervision. International Conference on Cognitive systems (CogSys), Karlsruhe, Germany
Vincent L (1993) Morphological grayscale reconstruction in image analysis: applications and efficient algorithms. IEEE Trans Image Process 2(2):176–201
Acknowledgement
This work is supported by the European Union funded project SCOVIS “Self Configurable Cognitive Video Supervision” supported by the Seventh Framework Programme (FP7/2007–2013) under grant agreement no 216465.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Doulamis, N.D. Coupled multi-object tracking and labeling for vehicle trajectory estimation and matching. Multimed Tools Appl 50, 173–198 (2010). https://doi.org/10.1007/s11042-009-0370-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-009-0370-0