Abstract
In many application scenarios, the use of Regions of Interest (ROIs) within video sequences is a useful concept. It is shown in this paper how Flexible Macroblock Ordering (FMO), defined in H.264/AVC as an error resilience tool, can be used for the coding arbitrary-shaped ROIs. In order to exploit the coding of ROIs in an H.264/AVC bitstream, a description-driven content adaptation framework is introduced that is able to extract the ROIs of a given bitstream.
The results of a series of tests indicate that the ROI extraction process significantly reduces the bit rate of the bitstreams and increases the decoding speed. In case of a fixed camera and a static background, the impact of this reduction on the visual quality of the video sequence is negligible. Regarding the adaptation framework itself, it is shown that in all cases, the framework operates in real time and that it is suited for streaming scenarios by design.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Taubman, D., Marcellin, M.: JPEG 2000: Image Compression Fundamentals, Standards and Practice. Kluwer Academic Publishers, Dordrecht (2002)
Li, W.: Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans. Circuits Syst. Video Technol. 11, 301–317 (2001)
Reichel, J., Schwarz, H., Wien, M.: Joint scalable video model JSVM-4. JVT-Q202 (2005), http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q202.zip
Yin, P., Boyce, J., Pandit, P.: FMO and ROI scalability. JVT-Q029 (2005), http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q029.doc
Thang, T.C., Kim, D., Bae, T.M., Kang, J.W., Ro, Y.M., Kim, J.G.: Show case of ROI extraction using scalability information SEI message. JVT-Q077 (2005), http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q077.doc
ISO/IEC JTC1/SC29/WG11: Applications and requirements for scalable video coding. N6880 (2005), http://www.chiariglione.org/mpeg/working_documents/mpeg-04/svc/requirements.zip
Wiegand, T., Sullivan, G.J., Bjøntegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 560–576 (2003)
Dhondt, Y., Lambert, P., Notebaert, S., Van de Walle, R.: Flexible macroblock ordering as a content adaptation tool in H.264/AVC. In: Proceedings of the SPIE/Optics East conference, Boston (2005)
De Neve, W., Van Deursen, D., De Schrijver, D., De Wolf, K., Van de Walle, R.: Using bitstream structure descriptions for the exploitation of multi-layered temporal scalability in H.264/AVC’s base specification. In: PCM 2005. LNCS, pp. 641–652. Springer, Heidelberg (2005)
Lambert, P., De Neve, W., Dhondt, Y., Van de Walle, R.: Flexible macroblock ordering in H.264/AVC. Journal of Visual Communication and Image Representation 17, 358–375 (2006)
Devillers, S., Timmerer, C., Heuer, J., Hellwagner, H.: Bitstream syntax description-based adaptation in streaming and constrained environments. IEEE Trans. Multimedia 7, 463–470 (2005)
De Schrijver, D., Poppe, C., Lerouge, S., De Neve, W., Van de Walle, R.: MPEG-21 bitstream syntax descriptions for scalable video codecs. Multimedia Systems 11, 403–421 (2006)
Hong, D., Eleftheriadis, A.: Xflavor: bridging bits and objects in media representation. In: Proceedings of the International Conference on Multimedia and Expo (ICME), Lausanne, Switzerland (2002)
Van Deursen, D., De Neve, W., De Schrijver, D., Van de Walle, R.: BFlavor: an optimized XML-based framework for multimedia content customization. In: Proceedings of the Picture Coding Symposium 2006 (PCS 2006) (accepted for publication, 2006)
Cimprich, P.: Streaming transformations for XML (STX) version 1.0 working draft (2004), http://stx.sourceforge.net/documents/spec-stx-20040701.html
De Neve, W., De Schrijver, D., Van de Walle, D., Lambert, P., Van de Walle, R.: Description-based substitution methods for emulating temporal scalability in state-of-the-art video coding formats. In: Proc. of WIAMIS, Korea (2006)
Hannuksela, M.M., Wang, Y.K., Gabbouj, M.: Isolated regions in video coding. IEEE Transactions on Multimedia 6, 259–267 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lambert, P., De Schrijver, D., Van Deursen, D., De Neve, W., Dhondt, Y., Van de Walle, R. (2006). A Real-Time Content Adaptation Framework for Exploiting ROI Scalability in H.264/AVC. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2006. Lecture Notes in Computer Science, vol 4179. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11864349_40
Download citation
DOI: https://doi.org/10.1007/11864349_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44630-9
Online ISBN: 978-3-540-44632-3
eBook Packages: Computer ScienceComputer Science (R0)