Abstract
Screen content is partly driven by the rapid development of screen applications such as wireless display, screen sharing, cloud computing and gaming, etc. Different from camera-captured content, screen content has relatively bad continuity in spatiotemporal domain and severe movements or sudden changes may occur in continuous pictures. Owing to the special characteristics of screen content, conventional coding tools including High Efficiency Video Coding (HEVC) standard are unsuitable for screen content coding (SCC). A SCC extension to HEVC was brought out and developed to meet the demand of screen content coding. This paper provides a brief survey on the main coding tools in the HEVC-SCC extension. Screen content sequences also pose challenges on transmission due to its discontinuity. The alternate presentation of moving and stationary pictures makes the exploitation of bandwidth a technical difficulty. This paper introduces the improvements of SCC rate control in HEVC with better transmission performance and more efficient bandwidth utilization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Advanced Video Coding for Generic Audiovisual Services, ITU-T and ISO/IEC JTC1, document ITU-T Rec. H.264 and ISO/IEC 14496-10, May 2003
Yu, H., McCann, K., Cohen, R., Amon, P.: Requirements for an Extension of HEVC for Coding of Screen Content, ISO/IEC JTC 1/SC 29/WG 11, document MPEG2014/N14174, San Jose, CA, USA, January 2014
Sullivan, G.J., Ohm, J., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)
Boyce, J., et al.: Edition 2 Draft Text of High Efficiency Video Coding (HEVC), Including Format Range (RExt), Scalability (SHVC), and Multi-View (MV-HEVC) Extensions, document JCTVC-R1013, Sapporo, Japan, July 2014
Narroschke, M.: Extending H.264/AVC by an adaptive coding of the prediction error. In: Proceedings of 25th Picture Coding Symposium (PCS), O5–3. Beijing, China, April 2006
Lan, C., Xu, J., Sullivan, G.J., Wu, F.: Intra Transform Skipping, document JCTVC-I0408, Geneva, Switzerland, April 2012
Peng, X., Lan, C., Xu, J., Sullivan, G. J.: Inter Transform Skipping, document JCTVC-I0408, Stockholm, Sweden, July 2012
Cohen, R., Vetro, A.: AHG8: Impact of Transform Skip on New Screen Content Material, document JCTVC-L0428, Geneva, Switzerland, January 2013
Peng, X., Xu, J., Guo, L., Sole, J., Karczewicz, M.: Non-RCE2: Transform Skip on Large TUs, document JCTVC-N0288, Vienna, Austria, July 2013
An, J., Zhao, L., Huang, Y.-W., Lei, S.: Residue Scan for Intra Transform Skip Mode, document JCTVC-J0053, Stockholm, Sweden, June 2012
He, D., Wang, J., Martin-Cocher, G.: Rotation of Residual Block for Transform Skipping, document JCTVC-J0093, Stockholm, Sweden, June 2012
Peng, X., Li, B., Xu, J.: On Residual Rotation for Inter and Intra BC Modes, document JCTVC-O0186, Geneva, Switzerland, October 2013
Lee, S., Kim, I.-K., Kim, C.: AHG7: Residual DPCM for HEVC Lossless coding, document JCTVC-L0117, Geneva, Switzerland, January 2013
Joshi, R., Sole, J., Karczewicz, M.: AHG8: Residual DPCM for Visually Lossless Coding, document JCTVC-M0351, Incheon, Korea, April 2013
Naccari, M., Mrak, M., Gabriellini, A., Blasi, S., Izquierdo, E.: Inter-Prediction Residual DPCM, Incheon, Korea, document JCTVC-M0442, April 2013
Nguyen, T., Khairat, A., Marpe, D.: Non-RCE1/Non- RCE2/AHG5/AHG8: Adaptive Inter-Plane Prediction for RGB Content, document JCTVC-M0230, Incheon, Korea, April 2013
Joshi, R., Xu, J.: HEVC Screen Content Coding Draft Text 1, document JCTVC-R1005, Sapporo, Japan, July 2014
Xu, X., Li, X., Liu, S.: Intra block copy for next generation video coding. In: ICMEW (2018)
Guo, L., Pu, W., Zou, F., Sole, J., Karczewicz, M., Joshi, R.: Color palette for screen content coding. In: 2014 IEEE International Conference on Image Processing (ICIP), 5556–5560 October 2014
Onno, P., Xiu, X., Huang, Y.-W., Joshi, R.: Suggested Combined Software and Text for Run-Based Palette Mode. JCTVC-R0348, July 2014
Liu, Y., Fang, C., Sun, J., Huang, X.: Fast Palette Mode Decision Methods for Coding Game Videos with HEVC-SCC. IEEE Trans. Circuits Syst. Video Technol. (2018)
Zhang, L., et al.: SCCE5 Test 3.2.1: In-Loop Color-Space Transform. JCTVC-R0147, July 2014
Henrique Malvar, S., Sullivan, G.J., Srinivasan, S.: Lifting-based reversible color transformations for image compression. In: SPIE Proceedings, 7073 (2008), https://doi.org/10.1117/12.797091
Li, B., Xu, J., Sullivan, G., Zhou, Y., Lin, B.: Adaptive Motion Vector Resolution for Screen Content. JCTVC-S0085, October 2014
Guo, Y., Li, B., Sun, S., Xu, J.: Rate control for screen content coding in HEVC. In: IEEE International Symposium on Circuits & Systems, September 2015
Wang, S., Li, J., Wang, S., Ma, S., Gao, W.: A frame level rate control algorithm for screen content coding. In: ISCAS, May 2018
Acknowledgment
This work is supported by National Natural Science Foundation of China (Project 61471066) and the open project fund (No. 201600017) of the National Key Laboratory of Electromagnetic Environment, China.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, B., Zou, J. (2019). Screen Content Coding: A Survey. In: Sun, S., Fu, M., Xu, L. (eds) Signal and Information Processing, Networking and Computers. ICSINC 2018. Lecture Notes in Electrical Engineering, vol 550. Springer, Singapore. https://doi.org/10.1007/978-981-13-7123-3_68
Download citation
DOI: https://doi.org/10.1007/978-981-13-7123-3_68
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-7122-6
Online ISBN: 978-981-13-7123-3
eBook Packages: EngineeringEngineering (R0)