Multithreading Architecture for Real-Time MPEG-4 AVC/H.264 SVC Decoder

  • Yong-Hwan Kim
  • Jiho Park
  • Je-Woo Kim
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7088)


The inter-layer prediction (ILP) including intra, residual, and motion up-sampling operation in Scalable Video Coding (SVC) significantly increases the compression ratio compared to simulcast. The SVC Codec capable of processing the inter-layer prediction among multiple layers, however, requires much more memory and computational power than single-layer MPEG-4 AVC/H.264 Codec. This paper presents a fast and memory-efficient multithreading architecture for real-time MPEG-4 AVC/H.264 Scalable High profile decoder. Unlike existing approaches where multi-threaded video encoding and decoding have been performed within a frame or among frames, the designed algorithm utilizes inter-layer parallelism based on a group of macroblocks (GOM). Also, improved buffer management can be achieved by the proposed access unit (AU) based decoding architecture for enabling GOM-based inter-layer multithreading architecture. The proposed multithreading architecture has three properties: (1) scalable to the number of SVC layers, (2) no additional coding delay, and (3) no additional memory requirement. Experimental results show that the proposed multithreading architecture speeds up the decoding time of 3-layer extended spatial scalability sequences by about 36% on average, 3-layer coarse grain scalability 50%, and 5-layer medium grain scalability by about 102%, respectively, compared to a single-threaded SVC decoder.


Scalable Video Coding (SVC) Multithreading algorithm Access unit based decoding 


  1. 1.
    Wiegand, T., Noblet, L., Rovati, F.: Scalable Video Coding for IPTV services. IEEE Trans. Broadcasting 55(2), 527–538 (2009)CrossRefGoogle Scholar
  2. 2.
    Schierl, T., Stockhammer, T., Wiegand, T.: Mobile video transmission using Scalable Video Coding. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1204–1217 (2007)CrossRefGoogle Scholar
  3. 3.
    ATSC Mobile DTV Standard, Part 7 - AVC and SVC Video System Characteristics: A/153 Part7:2009, ATSC (2009)Google Scholar
  4. 4.
    Choi, H., Shin, I.H., Lim, J.-S., Hong, J.W.: SVC application in advanced T-DMB. IEEE Trans. Broadcasting 55(1), 51–61 (2009)CrossRefGoogle Scholar
  5. 5.
    Tan, P., Slevinsky, J.: Multi-screen IPTV enabling technologies and challenges. In: Proc. IEEE Int. Conf. Consumer Electronics, pp. 1–2 (2011)Google Scholar
  6. 6.
    Advanced video coding for generic audiovisual services: ITU-T Rec. H.264 and ISO/IEC 14496-10, ITU-T and ISO/IEC JTC 1 (2010)Google Scholar
  7. 7.
    Schwarz, H., Marpe, D., Wiegand, T.: Overview of the Scalable Video Coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17(9), 1103–1120 (2007)CrossRefGoogle Scholar
  8. 8.
    Generic Coding of Moving Pictures and Associated Audio Information Video: ITU-T Rec. H.262 and ISO/IEC 13818-2, ITU-T and ISO/IEC JTC 1 (2000)Google Scholar
  9. 9.
    Video Coding for Low Bit Rate Communication: ITU-T Rec. H.263, ITU-T (2005)Google Scholar
  10. 10.
    Coding of Audio-Visual Objects - Part 2 Visual: ISO/IEC 14496-2, ISO/IEC JTC 1 (2004)Google Scholar
  11. 11.
    Liu, H., Wang, Y.-K., Li, H.: A comparison between SVC and transcoding. IEEE Trans. Consumer Electronics 54(3), 1439–1446 (2008)CrossRefGoogle Scholar
  12. 12.
    Kim, Y.-H., Yi, J.-Y., Choi, B.: Fast and memory-efficient up-sampling methods for H.264/AVC SVC with extended spatial scalability. IEEE Trans. Consumer Electronics 56(2) (2010)Google Scholar
  13. 13.
    Yi, J.-Y., Kim, Y.-H., Choi, B.: Fast and memory-efficient AU-based decoding method for H.264/AVC SVC. In: Proc. CEWIT, Incheon, Korea (2010)Google Scholar
  14. 14.
    Chuang, T.-D., Tsung, P.-K., Lin, P.-C., Chang, L.-M., Ma, T.-C., Chen, Y.-H., Chen, L.-G.: Low bandwidth decoder framework for H.264/AVC Scalable Extension. In: Proc. IEEE Int. Symp. Circuits and Systems, pp. 2960–2963 (2010)Google Scholar
  15. 15.
    van der Tol, E.B., Jaspers, E.G.T., Gelderblom, R.H.: Mapping of H.264 decoding on a multiprocessor architecture. In: Proc. SPIE Conf. on Image and Video Communications and Processing, pp. 707–718 (2003)Google Scholar
  16. 16.
    Chong, J., Satish, N., Catanzaro, B., Ravindran, K., Keutzer, K.: Efficient parallelization of H.264 decoding with macro block level scheduling. In: Proc. IEEE ICME, pp. 1874–1877 (2007)Google Scholar
  17. 17.
    Yang, S.-S., Wang, S.-W., Wu, J.-L.: A parallel algorithm for H.264/AVC deblocking filter based on limited error propagation effect. In: Proc. IEEE ICME, pp. 1858–1861 (2007)Google Scholar
  18. 18.
    Nishihara, K., Hatabu, A., Moriyoshi, T.: Parallelization of H.264 video decoder for embedded multicore processor. In: Proc. IEEE ICME, pp. 329–332 (2008)Google Scholar
  19. 19.
    Sihn, K.-H., Baik, H., Kim, J.-T., Bae, S., Song, H.J.: Novel approaches to parallel H.264 decoder on symmetric multicore systems. In: Proc. IEEE ICASSP, pp. 2017–2020 (2009)Google Scholar
  20. 20.
    Kim, D., Lee, V.W., Chen, Y.-K.: Image processing on multicore x86 architecture. IEEE Signal Processing Magazine 27(2), 97–107 (2010)CrossRefGoogle Scholar
  21. 21.
    Su, Y.-C., Tsai, S.-F., Chuang, T.-D., Tsao, Y.-M., Chen, L.-G.: Mapping Scalable Video Coding decoder on multi-core stream processors. In: Proc. Picture Coding Symposium, pp. 1–4 (2009)Google Scholar
  22. 22.
    Reichel, J., Schwarz, H., Wien, M.: Joint Scalable Video Model 11 (JSVM 11): JVT, Geneva, CH, Doc. JVT-X202 (2007)Google Scholar
  23. 23.
    Lappalainen, V., Hallapuro, A., Hamalainen, T.D.: Complexity of optimized H.26L video decoder implementation. IEEE Trans. CSVT 13(7), 717–725 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Yong-Hwan Kim
    • 1
  • Jiho Park
    • 1
  • Je-Woo Kim
    • 1
  1. 1.Korea Electronics Technology InstituteSeongnam-siRepublic of Korea

Personalised recommendations