Abstract
This work proposes an optical-flow based feature tracking that is combined with region covariance matrix for dealing with tracking of an object undergoing considerable occlusions. The object is tracked using a set of key-points. The key-points are tracked via a computationally inexpensive optical flow algorithm. If the occlusion of the feature is detected the algorithm calculates the covariance matrix inside a region, which is located at the feature’s position just before the occlusion. The region covariance matrix is then used to detect the ending of the feature occlusion. This is achieved via comparing the covariance matrix based similarity measures in some window surrounding the occluded key-point. The outliers that arise in the optical flow at the boundary of the objects are excluded using RANSAC and affine transformation. Experimental results that were obtained on freely available image sequences show the feasibility of our approach to perform tracking of objects undergoing considerable occlusions. The resulting algorithm can cope with occlusions of faces as well as objects of similar colors and shapes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Yilmaz, A., Javed, O., Shah, M.: Object tracking: A survey. ACM Comput. Surv. 38, 13 (2006)
Shi, J., Tomasi, C.: Good features to track. In: Proc. of CVPR, pp. 593–600 (1994)
Schreiber, D.: Robust template tracking with drift correction. Pattern Recogn. Lett. 28, 1483–1491 (2007)
Gabriel, P.F., Verly, J.G., Piater, J.H., Genon, A.: The state of the art in multiple object tracking under occlusion in video sequences. In: Int. Conf. on Advanced Concepts for Intelligent Vision Systems, pp. 166–173 (2003)
Khan, S., Shah, M.: A multiview approach to tracking people in crowded scenes using a planar homography constraint. In: Proc. of the 10th European Conf. on Computer Vision, Graz, Austria, pp. 133–146 (2006)
Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated person tracking using stereo, color, and pattern detection. Int. J. Comput. Vision 37, 175–185 (2000)
Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. Int. J. of Computer Vision 29, 5–28 (1998)
Babenko, B., Yang, M.H., Belongie, S.: Visual tracking with online multiple instance learning. In: IEEE Comp. Society Conf. on Computer Vision and Pattern Recognition, Miami, Florida, USA, pp. 983–990 (2009)
Tuzel, O., Porikli, F., Meer, P.: Region covariance: A fast descriptor for detection and classification. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 589–600. Springer, Heidelberg (2006)
Ramanan, D., Forsyth, D.A.: Using temporal coherence to build models of animals. In: Proc. of the Ninth IEEE Int. Conf. on Computer Vision, Washington, DC, USA, pp. 338–345. IEEE Computer Society, Los Alamitos (2003)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. Journal of Computer Vision 60, 91–110 (2004)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1615–1630 (2005)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Proc. of Fourth Alvey Vision Conference, Manchester, UK, pp. 147–151 (1988)
Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. Int. Joint Conf. on Artificial Intell., pp. 674–679 (1981)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. ACM Commun. 24, 381–395 (1981)
Porikli, F., Tuzel, O., Meer, P.: Covariance tracking using model update based on lie algebra. In: Proc. Int. Conf. on Comp. Vision and Pattern Recognition, vol. 1, pp. 728–735 (2006)
Arsigny, V., Fillard, P., Pennec, X., Ayache, N.: Fast and simple calculus on tensors in the log-euclidean framework. In: Int. Conf. on Medical Image Computing and Computer Assisted Intervention, pp. 115–122 (2005)
Okuma, K., Little, J.J., Lowe, D.G.: Automatic rectification of long image sequences. In: Asian Conference on Computer Vision (ACCV), Jeju Island, Korea (2004)
Mardia, K., Dryden, I.: Statistical Shape Analysis. Wiley, Chichester (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Austvoll, I., Kwolek, B. (2010). Region Covariance Matrix-Based Object Tracking with Occlusions Handling. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds) Computer Vision and Graphics. ICCVG 2010. Lecture Notes in Computer Science, vol 6374. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15910-7_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-15910-7_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15909-1
Online ISBN: 978-3-642-15910-7
eBook Packages: Computer ScienceComputer Science (R0)