Abstract
This work is concerned with real-time feature tracking for long video sequences. In order to achieve efficient and robust tracking, we propose two interrelated enhancements to the well-known Shi-Tomasi-Kanade tracker. Our first contribution is the integration of a linear illumination compensation method into the inverse compositional approach for affine motion estimation. The resulting algorithm combines the strengths of both components and achieves strong robustness and high efficiency at the same time. Our second enhancement copes with the feature drift problem, which is of special concern in long video sequences. Refining the initial frame-to-frame estimate of the feature position, our approach relies on the ability to robustly estimate the affine motion of every feature in every frame in real-time. We demonstrate the performance of our enhancements with experiments on real video sequences.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Oliensis, J.: A Critique of Structure-from-Motion Algorithms. Computer Vision and Image Understanding 84, 407–408 (2001)
Koch, R., Heigl, B., Pollefeys, M., Gool, L.V., Niemann, H.: Calibration of Handheld Camera Sequences for Plenoptic Modeling. In: Proceedings of the International Conference on Computer Vision, Corfu, Greece, pp. 585–591 (1999)
Ribo, M., Ganster, H., Brandner, M., Lang, P., Stock, C., Pinz, A.: Hybrid Tracking for Outdoor AR Applications. IEEE Computer Graphics and Applications Magazine 22, 54–63 (2002)
Lucas, B.D., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)
Tomasi, C., Kanade, T.: Detection and Tracking of Point Features. Technical Report CMU-CS-91-132, Carnegie Mellon University (1991)
Shi, J., Tomasi, C.: Good Features to Track. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, USA, pp. 593–600 (1994)
Fusiello, A., Trucco, E., Tommasini, T., Roberto, V.: Improving Feature Tracking with Robust Statistics. Pattern Analysis and Applications 2, 312–320 (1999)
Baker, S., Matthews, I.: Equivalence and Efficiency of Image Alignment Algorithms. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Kauai, USA, pp. 1090–1097 (2001)
Jin, H., Favaro, P., Soatto, S.: Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination. In: Proceedings of the International Conference on Computer Vision, Vancouver, Canada, pp. 684–689 (2001)
Matthews, I., Ishikawa, T., Baker, S.: The Template Update Problem. In: Proceedings of the British Machine Vision Conference (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zinßer, T., Gräßl, C., Niemann, H. (2004). Efficient Feature Tracking for Long Video Sequences. In: Rasmussen, C.E., Bülthoff, H.H., Schölkopf, B., Giese, M.A. (eds) Pattern Recognition. DAGM 2004. Lecture Notes in Computer Science, vol 3175. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28649-3_40
Download citation
DOI: https://doi.org/10.1007/978-3-540-28649-3_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22945-2
Online ISBN: 978-3-540-28649-3
eBook Packages: Springer Book Archive