Abstract
How to detect video saliency accurately is an very challenging problem in computer vision, and has gained great research and application values. A fast video saliency detection method, which based on spatio-temporal edge-preserving filter, was proposed in this paper. Firstly, object appearance features and motion features were extracted in video frames. Secondly, a new spatio-temporal edge-preserving filter was constructed by combining object temporal information in video. Then, the video saliency detection is formulated as an energy minimization problem, which fuses the appearance and motion features, and stand out salient object in video uniformly by using the spatio-temporal edge-preserving filter. Finally, extensive experiments, including comparisons analysis with three video saliency detection approaches and components analysis of the proposed approach, on three datasets suggest that the proposed approach nearly outperforms other approaches in both accuracy and efficiency.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, K.Z., Lin, L., et al.: PISA: pixelwise image saliency by aggregating complementary appearance contrast measures with edge-preserving coherence. IEEE Trans. Image Process. 24(10), 3019–3033 (2015)
Riche, N., Mancas, M., Culibrk, D., et al.: Dynamic saliency models and human attention: a comparative study on videos. In: Computer Vision–ACCV 2012, pp. 586–598. Springer, Berlin (2013)
Zhang, L., Tong, M.H., Marks, T.K., et al.: SUN: a Bayesian framework for saliency using natural statistics. J. Vis. 8(7), 32 (2008)
Seo, H.J., Milanfar, P.: Static and space-time visual saliency detection by self-resemblance. J. Vis. 9(12), 15 (2009)
Culibrk, D., Mirkovic, M., Zlokolica, V., et al.: Salient motion features for video quality assessment. IEEE Trans. Image Process. 20(4), 948–958 (2011)
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Advances in Neural Information Processing Systems, pp. 545–552 (2006)
Li, Q., Chen, S., Zhang, B.: Predictive video saliency detection. In: Pattern Recognition, pp. 178–185. Springer, Berlin (2012)
Zhong, S., Liu, Y., Ren, F., et al.: Video saliency detection via dynamic consistent spatio-temporal attention modelling. In: Proceedings of 27th AAAI International Conference on Artificial Intelligence (2013)
Bao, L., Yang, Q., Jin, H.: Fast edge-preserving patchmatch for large displacement optical flow. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3534–3541. IEEE (2014)
Lu, J.B., Shi, K.Y., Min, D., et al.: Cross-based local multipoint filtering. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 430–437. IEEE (2012)
Rudoy, D., Goldman, D.B., Shechtman, E., et al.: Learning video saliency from human gaze using candidate selection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1147–1154. IEEE (2013)
Peters, R.J., Iyer, A., Itti, L., et al.: Components of bottom-up gaze allocation in natural images. Vis. Res. 45(18), 2397–2416 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, Z. (2020). Fast Calculation Method of Video Saliency Based on Temporal and Spatial Edge-Preserving Filter. In: Abawajy, J., Choo, KK., Islam, R., Xu, Z., Atiquzzaman, M. (eds) International Conference on Applications and Techniques in Cyber Intelligence ATCI 2019. ATCI 2019. Advances in Intelligent Systems and Computing, vol 1017. Springer, Cham. https://doi.org/10.1007/978-3-030-25128-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-25128-4_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25127-7
Online ISBN: 978-3-030-25128-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)