Abstract
In this paper, we propose a novel method to track non-rigid and/or articulated objects using superpixel matching and markov random field (MRF). Our algorithm consists of three stages. First, a superpixel dataset is constructed by segmenting training frames into superpixels, and each superpixel is represented by multiple features. The appearance information of target is encoded in the superpixel database. Second, each new frame is segmented into superpixels and then its object-background confidence map is derived by comparing its superpixels with k-nearest neighbors in superpixel dataset. Taking context information into account, we utilize MRF to further improve the accuracy of confidence map. In addition, the local context information is incorporated through a feedback to refine superpixel matching. In the last stage, visual tracking is achieved via finding the best candidate by maximum a posterior estimate based on the confidence map. Experiments show that our method outperforms several state-of-the-art trackers.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The surrounding region is a square area centered at the location of target \(X_{t}^{c}\), and its side length is equal to \(\lambda _{s}[X_{s}^{t}]^{\frac{1}{2}}\), where \(X_{t}^{c}\) represents the center location of target region \(X_{t}\) and \(X_{t}^{s}\) denotes its size. The parameter \(\lambda _{s}\) is a constant variable, which determines the size of this surrounding region.
References
Adam, A., Rivlin, E., Shimshoni, I.: Robust fragments based tracking using the integral histogram. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 798–805 (2006)
Avidan, S.: Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 29(2), 261–271 (2007)
Babenko, B., Yang, M.-H., Belongie, S.: Robust object tracking with online multiple instance learning. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(8), 1619–1632 (2011)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 23(11), 1222–1239 (2001)
Fan, H., Xiang, J.: Robust visual tracking with multitask joint dictionary learning. IEEE Trans. Circ. Syst. Video Technol. PP, 1 (2016)
Fan, H., Xiang, J., Zhao, L.: Robust visual tracking via bag of superpixels. Multimedia Tools Appl. 75, 8781 (2015)
Fan, H., Xiang, J., Liao, H., Du, X.: Robust tracking based on local structural cell graph. J. Vis. Commun. Image Represent. 31, 54–63 (2015)
Fan, H., Xiang, J., Ni, F.: Multilayer feature combination for visual tracking. In: Asian Conference on Pattern Recognition (ACPR), pp. 589–593 (2015)
Fan, H., Xiang, J.: Patch-based visual tracking with two-stage multiple Kernel learning. In: Zhang, Y.-J. (ed.) ICIG 2015. LNCS, vol. 9219, pp. 20–33. Springer, Heidelberg (2015). doi:10.1007/978-3-319-21969-1_3
Fan, H., Xiang, J., Xu, J., Liao, H.: Part-based visual tracking via online weighted P-N learning. Sci. World J. (2014)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph based image segmentation. Int. J. Comput. Vis. (IJCV) 59(2), 167–181 (2004)
Jia, X., Lu, H., Yang, M.-H.: Visual tracking via adaptive structural local sparse appearance model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1822–1829 (2012)
Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 34(7), 1409–1422 (2012)
Liang, P., Blasch, E., Ling, H.: Encoding color information for visual tracking: algorithms and benchmark. IEEE Trans. Image Process. (TIP) 24(12), 5630–5644 (2015)
Mei, X., Ling, H.: Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 33(11), 2259–2272 (2011)
Ross, D.A., Lim, J., Lin, R.S., Yang, M.-H.: Incremental learning for robust visual tracking. Int. J. Comput. Vis. (IJCV) 77(1), 125–141 (2008)
Wang, D., Lu, H.: Visual tracking via probability continuous outlier model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3478–3485 (2014)
Yang, F., Lu, H., Yang, M.-H.: Robust superpixel tracking. IEEE Trans. Image Process. (TIP) 23(4), 1639–1651 (2014)
Yang, J., Price, B., Cohen, S., Yang, M.-H.: Context driven scene parsing with attention to rare classes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3294–3301 (2014)
Zhang, K., Zhang, L., Yang, M.-H.: Fast compressive tracking. IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI) 36(10), 2002–2015 (2014)
Zhang, K., Zhang, L., Liu, Q., Zhang, D., Yang, M.-H.: Fast visual tracking via dense spatio-temporal context learning. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 127–141. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10602-1_9
Zhang, T., Ghanem, B., Liu, S., Ahuja, N.: Robust visual tracking via structured multi-task sparse learning. Int. J. Comput. Vis. (IJCV) 101, 367–383 (2013)
Zhong, W., Lu, H., Yang, M.-H.: Robust object tracking via sparsity-based collaborative model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1838–1845 (2012)
Acknowledgement
This work was primarily supported by Foundation Research Funds for the Central Universities (Program No. 2662016PY008 and Program No. 2662014PY052).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Fan, H., Xiang, J., Chen, Z. (2016). Visual Tracking by Local Superpixel Matching with Markov Random Field. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9916. Springer, Cham. https://doi.org/10.1007/978-3-319-48890-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-48890-5_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48889-9
Online ISBN: 978-3-319-48890-5
eBook Packages: Computer ScienceComputer Science (R0)