Abstract
The panoramic images are widely used in many applications. Saliency detection is an important task for panoramic image processing. Traditional saliency detection algorithms that are originally designed for conventional flat-2D images are not efficient for panoramic images due to their particular viewing way. Based on this consideration, we propose a novel saliency detection algorithm for panoramic images by fusing visual frequency feature and viewing behavior pattern. By extracting the spatial frequency information in viewport domain and computing the center-surround contrast of them for the whole panoramic image, the visual frequency feature for saliency detection is accurately obtained. Further more, the context of user’s viewing behavior is integrated with visual frequency feature to generate the final saliency map. The experimental results show that the proposed algorithm is superior to the state-of-the-art algorithms when Pearson Correlation Coefficient (CC) is used as the evaluation metric.
This work was supported in part by National Natural Science Foundation of China under Grant 61771469 and Zhejiang Provincial Natural Science Foundation of China under Grant LY17F010001.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Serrano, A., Sitzmann, V., Ruiz-Borau, J., Wetzstein, G., Gutierrez, D., Masia, B.: Movie editing and cognitive event segmentation in virtual reality video. ACM Trans. Graph. 36(4), 47 (2017)
Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. V20(11), 1254–1259 (1998)
Cheng, M.M., Zhang, G.X., Mitra, N.J., Torr, P.H.S., Hu, S.M.: Global contrast based salient region detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 409–416 (2011)
Liu, T., Sun, J., Zhang, N., Tang, X., Shum, H.: Learning to detect a salient object. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 530–549 (2007)
Kienzle, W., Wichmann, F., Scholkopf, B., Franz, M.O.: A nonparametric approach to bottom-up visual saliency. In: NIPS, pp. 686–689 (2007)
Bogdanova, I., Bur, A., Hugli, H.: Visual attention on the sphere. IEEE Trans. Image Process. 17(11), 2000–2014 (2008)
Maugey, T., Meur, O.L., Liu, Z.: Saliency-based navigation in omnidirectional image. In: International Workshop on Multimedia Signal Processing, pp. 1–6. IEEE (2017)
Monroy, R., Lutz, S., Chalasani, T., Smolic, A.: SalNet360: saliency Maps for omni-directional images with CNN (2017)
Abreu, A.D., Ozcinar, C., Smolic, A.: Look around you: saliency maps for omnidirectional images in VR applications. In: Ninth International Conference on Quality of Multimedia Experience. IEEE (2017)
Upenik, E., Ebrahimi, T.: A simple method to obtain visual attention data in head mounted virtual reality. In: IEEE International Conference on Multimedia & Expo Workshops, pp. 73–78. IEEE (2017)
Sitzmann, V., et al.: Saliency in VR: how do people explore virtual environments? IEEE Trans. Vis. Comput. Graph., 1633–1642 (2018)
Rai, Y., Callet, P.L.: A dataset of head and eye movements for 360 degree images. In: ACM on Multimedia Systems Conference, pp. 205–210. ACM (2017)
Rai, Y., Callet, P.L., Guillotel, P.: Which saliency weighting for omni directional image quality assessment? In: Ninth International Conference on Quality of Multimedia Experience, pp. 1–6. IEEE (2017)
Rodieck, R.W.: Quantitative analysis of cat retinal ganglion cell response to visual stimuli. Vis. Res. 5(12), 583–601 (1965)
Bylinskii, Z., Judd, T., Oliva, A., Torralba, A., Durand, F.: What do different evaluation metrics tell us about saliency models? IEEE Trans. Pattern Anal. Mach. Intell., PP(99), 1 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Ding, Y., Liu, Y., Liu, J., Liu, K., Wang, L., Xu, Z. (2018). Panoramic Image Saliency Detection by Fusing Visual Frequency Feature and Viewing Behavior Pattern. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11165. Springer, Cham. https://doi.org/10.1007/978-3-030-00767-6_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-00767-6_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00766-9
Online ISBN: 978-3-030-00767-6
eBook Packages: Computer ScienceComputer Science (R0)