Abstract
This paper presents a video-based camera tracker that combines mark- er-based and feature point-based cues in a particle filter framework. The framework relies on their complementary performance. Marker-based trackers can robustly recover camera position and orientation when a reference (marker) is available, but fail once the reference becomes unavailable. On the other hand, feature point tracking can still provide estimates given a limited number of feature points. However, these tend to drift and usually fail to recover when the reference reappears. Therefore, we propose a combination where the estimate of the filter is updated from the individual measurements of each cue. More precisely, the marker-based cue is selected when the marker is available whereas the feature point-based cue is selected otherwise. Feature points are dynamically found in scene and used for further tracking. Evaluations on real cases show that the fusion of these two approaches outperforms the individual tracking results. A critical aspect of the feature point-based cue is to robustly recognise the feature points depite rotations of the camera. A novelty of the proposed framework is the use of a rotation-discriminative method to match feature points.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Okuma, T., Kurata, T., Sakaue, K.: Fiducial-less 3-D object tracking in AR systems based on the integration of top-down and bottom-up approaches and automatic database addition. In: Proc. Intl. Symp. on Mixed and Augmented Reality (ISMAR), p. 260 (2003)
Zhang, X., Fronz, S., Navab, N.: Visual marker detection and decoding in AR systems: A comparative study. In: Proc. Intl. Symp. on Mixed and Augmented Reality (ISMAR), September–October 2002, pp. 97–106 (2002)
Davison, A.: Real-time simultaneous localisation and mapping with a single camera. In: Proc. Intl. Conf. on Computer Vision (ICCV) (2003)
Pupilli, M., Calway, A.: Real-time camera tracking using a particle filter. In: Proc. British Machine Vision Conference (BMVC), pp. 519–528 (September 2005)
Marimon, D., Ebrahimi, T.: Combination of video-based camera trackers using a dynamically adapted particle filter. In: 2nd Intl. Conf. on Computer Vision Theory and Applications (VISAPP 2007) (2007)
Marimon, D., Ebrahimi, T.: Efficient rotation-discriminative template matching. In: Rueda, L., Mery, D., Kittler, J. (eds.) CIARP 2007. LNCS, vol. 4756, pp. 221–230. Springer, Heidelberg (2007)
Allen, B., Bishop, G., Welch, G.: Tracking: Beyond 15 minutes of thought. In: Course Notes, Ann. Conf. Computer Graphics and Interactive Techniques (SIGGRAPH) (2001)
Kanbara, M., Fujii, H., Takemura, H., Yokoya, N.: A stereo vision-based augmented reality system with an inertial sensor. In: Proc. IEEE and ACM Intl. Symp. on Augmented Reality (ISAR), pp. 97–100 (October 2000)
You, S., Neumann, U.: Fusion of vision and gyro tracking for robust augmented reality registration. In: Proc. IEEE Virtual Reality (VR), pp. 71–78 (2001)
Claus, D., Fitzgibbon, A.: Reliable fiducial detection in natural scenes. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 469–480. Springer, Heidelberg (2004)
Fiala, M.: ARTag, a fiducial marker system using digital techniques. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA, vol. 2, pp. 590–596. IEEE Computer Society, Los Alamitos (2005)
Satoh, K., Uchiyama, S., Yamamoto, H., Tamura, H.: Robot vision-based registration utilizing bird’s-eye view with user’s view. In: Proc. Intl. Symp. on Mixed and Augmented Reality (ISMAR), pp. 46–55 (October 2003)
Sim, R., Elinas, P., Griffin, M., Little, J.J.: Vision-based SLAM using the Rao-Blackwellised particle filter. In: Proc. IJCAI Workshop on Reasoning with Uncertainty in Robotics (RUR), Edinburgh, Scotland, pp. 9–16 (2005)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Intl. Journal of Computer Vision 60(2), 91–110 (2004)
Chekhlov, D., Pupilli, M., Mayol-Cuevas, W., Calway, A.: Real-time and robust monocular slam using predictive multi-resolution descriptors. In: 2nd International Symposium on Visual Computing (November 2006)
Chai, L., Nguyen, K., Hoff, B., Vincent, T.: An adaptive estimator for registration in augmented reality. In: Proc. IEEE and ACM Intl. Workshop on Augmented Reality (IWAR), pp. 23–32 (1999)
Arulampalam, M., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Trans. on Signal Processing 50(2), 174–188 (2002)
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proc. Intl. Workshop on Augmented Reality (IWAR), pp. 85–94 (October 1999)
Marimon, D.: Advances in top-down and bottom-up approaches to video-based camera tracking. PhD thesis, EPFL (2007)
Ichimura, N.: Stochastic filtering for motion trajectory in image sequences using a monte carlo filter with estimation of hyper-parameters. In: Proc. Intl. Conf. on Pattern Recognition (ICPR), vol. 4, pp. 68–73 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marimon, D., Ebrahimi, T. (2008). Video-Based Camera Tracking Using Rotation-Discriminative Template Matching. In: Braz, J., Ranchordas, A., Araújo, H.J., Pereira, J.M. (eds) Computer Vision and Computer Graphics. Theory and Applications. VISIGRAPP 2007. Communications in Computer and Information Science, vol 21. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89682-1_17
Download citation
DOI: https://doi.org/10.1007/978-3-540-89682-1_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89681-4
Online ISBN: 978-3-540-89682-1
eBook Packages: Computer ScienceComputer Science (R0)