Abstract
In this work, we propose a graph-based superpixel segmentation technique to perform spatiotemporal oversegmentation of videos. The generated superpixels are post-processed by applying a straightforward threshold-based foreground separation model. These superpixels are used in a conditional random field, and a potential function is defined, which is solved using energy minimization techniques to produce a final segmentation. Experiments on two datasets containing over 24 videos demonstrate that our method produces competitive or better results for the video object segmentation task over the state-of-the-art algorithms.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bai, X., Wang, W.: Saliency-svm: an automatic approach for image segmentation. Neurocomputing 136, 243–255 (2014)
Banica, D., Agape, A., Ion, A., Sminchisescu, C.: Video object segmentation by salient segment chain composition. In: IEEE International Conference on Computer Vision Workshops, pp. 283–290 (2013)
Bhatti, A.H., Rahman, A., Butt, A.A.: Video segmentation using spectral clustering on superpixels. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 869–873 (2016)
Callet, P., Niebur, E.: Visual attention and applications in multimedia technologies. In: Proceedings of the IEEE, pp. 2058–2067 (2013)
Carreira, J., Sminchisescu, C.: Cpmc: automatic object segmentation using constrained parametric min-cuts. IEEE Trans. Pattern Anal. Mach. Intell. 34(7), 1312–1328 (2012)
Chang, J., Donglai, W., Fisher, J.W.: A video representation using temporal superpixels. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2051–2058 (2013)
Fukuchi, K., Miyazato, K., Kimura, A., Takagi, S., Yamato, J.: Saliency-based video segmentation with graph cuts and sequentially updated priors. In: IEEE International Conference on Multimedia and Expo, pp. 638–641 (2009)
Galasso, F., Cipolla, R., Schiele, B.: Video segmentation with superpixels. In: Asian Conference on Computer Vision, pp. 760–774. Springer, Berlin (2013)
Haller, E., Leordeanu, M.: Unsupervised object segmentation in video by efficient selection of highly probable positive features. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 5095–5103 (2017)
Lee, Y.J., Kim, J., Grauman, K.: Key-segments for video object segmentation. In: IEEE International Conference on Computer Vision, pp. 1995–2002. IEEE Computer Society, Washington, DC, USA (2011)
Li, F., Kim, T., Humayun, A., Tsai, D., Rehg, J.M.: Video segmentation by tracking many figure-ground segments. In: IEEE International Conference on Computer Vision, pp. 2192–2199 (2013)
Li, W.T., Chang, H.S., Lien, K.C., Chang, H.T., Wang, Y.C.: Exploring visual and motion saliency for automatic video object extraction. IEEE Trans. Image Process. 22(7), 2600–2610 (2013)
Li, Z., Chen, J.: Superpixel segmentation using linear spectral clustering. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1356–1363 (2015)
Li, Z., Wu, X.-M., Chang, S.-F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 789–796 (2012)
Liu, Z., Zhang, X., Luo, S., Le Meur, O.: Superpixel-based spatiotemporal saliency detection. IEEE Trans. Circuits Syst. Video Technol. 24(9), 1522–1540 (2014)
Luque, R.M., Domínguez, E., Palomo, E.J., Muñoz, J.: A neural network approach for video object segmentation in traffic surveillance. In: Image Analysis and Recognition, 5th International Conference, ICIAR 2008, Póvoa de Varzim, Portugal, June 25–27, 2008. Proceedings, pp. 151–158 (2008)
Masuda, M., Mochizuki, Y., Ishikawa, H.: Unsupervised video object segmentation by supertrajectory labeling. In: 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA), pp. 448–451. IEEE (2017)
Milan, A., Leal-Taixe, L., Schindler, K., Reid, I.: Joint tracking and segmentation of multiple targets. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5397–5406 (2015)
Shi, J.: Video segmentation by tracing discontinuities in a trajectory embedding. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’12, pp. 1846–1853 (2012)
Tsai, D., Flagg, M., Nakazawa, A., Rehg, J.: Motion coherent tracking using multi-label MRF optimization. Int. J. Comput. Vis. 100, 190–202 (2012)
Vasconcelos, M.J.M., Tavares, J.M.R.S.: Human motion segmentation using active shape models. In: Computational and Experimental Biomedical Sciences: Methods and Applications, pp. 237–246. Springer, Berlin (2015)
Wang, W., Shen, J., Porikli, F.: Saliency-aware geodesic video object segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3395–3402 (2015)
Xu, L., Li, H., Zeng, L., Ngan, K.N.: Saliency detection using joint spatial-color constraint and multi-scale segmentation. J. Vis. Comun. Image Represent. 24(4), 465–476 (2013)
Zhang, D., Javed, O., Shah, M.: Video object segmentation through spatially accurate and temporally dense extraction of primary object regions. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 628–635 (2013)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bhatti, A.H., Rahman, A.U. & Butt, A.A. Unsupervised video object segmentation using conditional random fields. SIViP 13, 9–16 (2019). https://doi.org/10.1007/s11760-018-1322-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-018-1322-9