Abstract
VR technology is rapidly progressing in recent years with incremental consumption demand of immersive media. Transmission is one major challenge to be overcome for ultra high resolution 360 VR video streaming, requiring large throughput and strict latency. Conventional monolithic streaming scheme transfers the entire panorama and impose heavy burden to network load. Tiling based video streaming tackles such problem that it discriminates the FOV (field of view) and surrounded field out of sight then tiles are transmitted in appropriate quality according to viewing probability and network condition. Existing tiling method divides video frame into fixed-size uniform rectangles and encoding efficiency is inevitably decremented. The optimal mesh of video frame tiling is content dependent but typically tiling dimension is fixedly configured by service provider, without elasticity and content awareness. Several proposed optimization methods for tile dimension needs to enumerate all possibility and these offline manner requires specific transcoded samples to be prepared beforehand.
In this paper, a bandwidth-efficient mixed tiling scheme is proposed to improve the situation where diverse tiles are spliced into integral frame and tile selection is processed within multiple correlative meshes. We apply a graph algorithm to search the optimal case within multiple meshes and the online manner demands neither exhaustive enumeration nor intensive calculation.
We develop an adaptive VR video streaming system and mixed tiling scheme reflects advantage in bandwidth consumption and pixel overheads, compared to existing fixed size tiling scheme and traditional monolithic video streaming approach.
This paper is supported in part by National Natural Science Foundation of China (61650101), Scientific Research Plan of the Science and Technology Commission of Shanghai Municipality (16511104203), in part by the 111 Program (B07022).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Virtual Reality Market to 2022. https://www.marketsandmarkets.com/Market-Reports/reality-applications-market-458
HTC Vive. https://www.vive.com/
Oculus Rift. https://www.oculus.com/rift/
Inoue, M., Kimata, H., Fukazawa, K., Matsuura, N.: Interactive panoramic video streaming system over restricted bandwidth network. In: Proceedings of the 18th ACM International Conference on Multimedia (MM 2010) (2010)
Stockhammer, T.: Dynamic adaptive streaming over HTTP: standards and design principles. In: Proceedings of the Second Annual ACM Conference on Multimedia Systems (MMSys 2011) (2011)
Feuvre, J.L., Concolato, C.: Tiled-based adaptive streaming using MPEG-DASH. In: Proceedings of the 7th International Conference on Multimedia Systems (MMSys 2016) (2016)
Qian, F., Ji, L., Han, B., Gopalakrishnan, V.: Optimizing 360 video delivery over cellular networks. In: Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (ATC 2016) (2016)
Zare, A., Aminlou, A., Hannuksela, M.M., Gabbouj, M.: HEVC-compliant tile-based streaming of panoramic video for virtual reality applications. In: Proceedings of the 2016 ACM on Multimedia Conference (MM 2016) (2016)
Next-generation video encoding techniques for 360 video and VR. https://code.facebook.com/posts/1126354007399553/nextgeneration-video-encoding-techniques-for-360-video-and-vr/
Xiao, M., Zhou, C., Liu, Y., Chen, S.: OpTile: toward optimal tiling in 360-degree video streaming. In: Proceedings of the 2017 ACM on Multimedia Conference (MM 2017) (2017)
Sanchez, Y., Skupin, R., Hellge, C., Schierl, T.: Spatio-temporal activity based tiling for panorama streaming. In: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2017) (2017)
Bao, Y., Wu, H., Zhang, T., Ramli, A., Liu, X.: Shooting a moving target: motion-prediction-based transmission for 360-degree videos. In: 2016 IEEE International Conference on Big Data (Big Data), pp. 1161–1170 (2016)
Hosseini, M., Swaminathan, V.: Adaptive 360 VR video streaming: divide and conquer. In: 2016 IEEE International Symposium on Multimedia (ISM), pp. 107–110 (2016)
Ghosh, A., Aggarwal, V., Qian, F.: A rate adaptation algorithm for tile-based 360-degree video streaming. CoRR abs/1704.08215 (2017)
El-Ganainy, T., Hefeeda, M.: Streaming virtual reality content. CoRR abs/1612.08350 (2016)
FFmpeg. https://www.ffmpeg.org/
Boost.Beast. https://www.boost.org/doc/libs/1_66_0/libs/beast/
MessagePack. https://msgpack.org/
Unity Engine. https://unity3d.com/
Xie, L., Xu, Z., Ban, Y., Zhang, X., Guo, Z.: 360ProbDASH: improving QoE of 360 video streaming using tile-based HTTP adaptive streaming. In: Proceedings of the 2017 ACM on Multimedia Conference (MM 2017) (2017)
Fan, C.-L., Lee, J., Lo, W.-C., Huang, C.-Y., Chen, K.-T., Hsu, C.-H.: Fixation prediction for 360\(^\circ \) video streaming in head-mounted virtual reality. In: Proceedings of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2017) (2017)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, J., Xu, Y., Guan, Y., Zhang, W. (2019). Mixed Tiling Scheme for Adaptive VR Streaming. In: Zhai, G., Zhou, J., An, P., Yang, X. (eds) Digital TV and Multimedia Communication. IFTC 2018. Communications in Computer and Information Science, vol 1009. Springer, Singapore. https://doi.org/10.1007/978-981-13-8138-6_26
Download citation
DOI: https://doi.org/10.1007/978-981-13-8138-6_26
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-8137-9
Online ISBN: 978-981-13-8138-6
eBook Packages: Computer ScienceComputer Science (R0)