Skip to main content
SpringerLink
Log in

A flexible side information generation framework for distributed video coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

One of the most efficient approaches to generate the side information (SI) in distributed video codecs is through motion compensated frame interpolation where the current frame is estimated based on past and future reference frames. However, this approach leads to significant spatial and temporal variations in the correlation noise between the source at the encoder and the SI at the decoder. In such scenario, it would be useful to design an architecture where the SI can be more robustly generated at the block level, avoiding the creation of SI frame regions with lower correlation, largely responsible for some coding efficiency losses. In this paper, a flexible framework to generate SI at the block level in two modes is presented: while the first mode corresponds to a motion compensated interpolation (MCI) technique, the second mode corresponds to a motion compensated quality enhancement (MCQE) technique where a low quality Intra block sent by the encoder is used to generate the SI by doing motion estimation with the help of the reference frames. The novel MCQE mode can be overall advantageous from the rate-distortion point of view, even if some rate has to be invested in the low quality Intra coding blocks, for blocks where the MCI produces SI with lower correlation. The overall solution is evaluated in terms of RD performance with improvements up to 2 dB, especially for high motion video sequences and long Group of Pictures (GOP) sizes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Aaron A, Rane S, Girod B (2004) Wyner-Ziv video coding with hash-based motion compensation at the receiver, IEEE ICIP, Singapore, October

  2. Aaron A, Rane S, Girod B (2004) Transform-domain Wyner-Ziv codec for video. SPIE Visual Communications and Image Processing, Santa Clara

    Google Scholar 

  3. Artigas X, Ascenso J, Dalai M, Klomp S, Kubasov D, Ouaret M (2007) The DISCOVER codec: architecture, techniques and evaluation, Picture Coding Symposium, Lisbon, Portugal, November

  4. Ascenso J, Pereira F. Advanced side information creation techniques and framework for Wyner-Ziv video coding, Journal of Visual Communication and Image Representation, Special Issue Resource-aware Adaptive Video Streaming. doi:10.1016/j.jvcir.2008.06.001

  5. Ascenso J, Brites C, Pereira F (2005) Improving frame interpolation with spatial motion smoothing for pixel domain distributed video coding, 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Services, Slovak Republic, July

  6. Ascenso J, Brites C, Pereira F (2005) Motion compensated refinement for low complexity pixel based distributed video coding, IEEE International Conference on Advanced Video and Signal Based Surveillance, Como, Italy, September

  7. Ascenso J, Brites C, Pereira F (2006) Content adaptive Wyner-Ziv video coding driven by motion activity, IEEE ICIP, Atlanta, GA, USA, October

  8. Brites C (2005) Advances on distributed video coding, M.Sc. Thesis, Instituto Superior Técnico, Technical University of Lisbon, Portugal, December

  9. Brites C, Pereira F (2008) Correlation noise modeling for efficient pixel and transform domain Wyner-Ziv video coding. IEEE Trans Circ Syst Video Tech 18(9):1177–1190. doi:10.1109/TCSVT. 2008.924107

    Article  Google Scholar 

  10. Brites C, Ascenso J, Pereira F (2006) Improving transform domain Wyner-Ziv video coding performance, IEEE ICASSP, May, Toulouse, France

  11. Brites C, Ascenso J, Pedro J, Pereira F (2008) Evaluating a feedback channel based transform domain Wyner-Ziv video codec. EURASIP Signal Process Image Commun 23(4):269–297. doi:10.1016/j.image.2008.03.002

    Article  Google Scholar 

  12. Clerckx T, Munteaunu A, Cornelis J, Schelkens P (2007) Distributed video coding with shared encoder/decoder complexity, IEEE ICIP, San Antonio, TX, USA, September

  13. Information Technology: Coding of audio-visual objects, part 10: advanced video coding, ISO/IEC Std. 14496-10 (2003)

  14. Kubasov D, Lajnef K, Guillemot C (2007) A hybrid encoder/decoder rate control for Wyner-Ziv video coding with a feedback channel, IEEE International Workshop on Multimedia Signal Processing, Chania, Crete, Greece, October

  15. Kubasov D, Nayak J, Guillemot C (2007) Optimal reconstruction in Wyner-Ziv video coding with multiple side information, IEEE International Workshop on Multimedia Signal Processing, Chania, Crete, Greece, October

  16. Liu L, He D, Jagmohan A, Lu L, Delp EJ (2008) A low-complexity iterative mode selection algorithm for Wyner-Ziv video compression, IEEE ICIP, San Diego, CA, USA, October

  17. Martinian E, Vetro A, Yedidia JS, Ascenso J, Khisti A, Malioutov D (2006) Hybrid distributed video coding using sca codes. IEEE Multimedia Signal Processing Workshop, Victoria

    Google Scholar 

  18. Mukherjee D, Macchiavello B, Queiroz R (2007) A simple reversed-complexity Wyner-Ziv video coding mode. SPIE Visual Communications and Image Processing, San Jose

    Google Scholar 

  19. Puri R, Majumdar A, Ramchandran K (2007) PRISM: a video coding paradigm with motion estimation at the decoder. IEEE Trans Image Process 16(10):2436–2448. doi:10.1109/TIP.2007.904949

    Article  MathSciNet  Google Scholar 

  20. Slepian D, Wolf J (1973) Noiseless coding of correlated information sources. IEEE Trans Inf Theory 19(4):471–480. doi:10.1109/TIT.1973.1055037

    Article  MATH  MathSciNet  Google Scholar 

  21. Song BC, Chun KW (2004) Motion-compensated temporal filtering for denoising in video encoder. Electron Lett 40(13):802–804. doi:10.1049/el:20040550

    Article  Google Scholar 

  22. Tagliasacchi M, Trapanese A, Tubaro S, Ascenso J, Brites C, Pereira F (2006) Intra mode decision based on spatio-temporal cues in pixel domain Wyner-Ziv video coding, IEEE ICASSP, May, Toulouse, France

  23. Trapanese A, Tagliasacchi M, Tubaro S, Ascenso J, Brites C, Pereira F (2005) Embedding a block-based intra mode in frame-based pixel domain wyner-ziv video coding, International Workshop on Very Low Bitrate Video, Sardinia, Italy, September

  24. Tsai D-C, Lee C-M, Lie W-N (2007) Dynamic key block decision with spatio-temporal analysis for Wyner-Ziv video coding, IEEE ICIP, San Antonio, TX, USA, September

  25. Tseng IH, Ortega A (2005) Motion estimation at the decoder using maximum likelihood techniques for distributed video coding, Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, November

  26. Turaga DS, van der Schaar M, Andreopoulos Y, Munteanu A, Schelkens P (2005) Unconstrained motion compensated temporal filtering (UMCTF) for efficient and flexible interframe wavelet video coding. EURASIP Signal Process Image Commun J 20(1):1–19. doi:10.1016/j.image.2004.08.006

    Article  Google Scholar 

  27. Varodayan D, Chen D, Flierl M, Girod B (2008) Wyner-Ziv coding of video with unsupervised motion vector learning. EURASIP Signal Process Image Commun J Spec Issue Distrib Video Coding 23(5):369–378

    Google Scholar 

  28. Vo DT, Nguyen TQ (2008) Quality enhancement for motion JPEG using temporal redundancies. IEEE Trans Circ Syst Video Tech 18(5):609–619. doi:10.1109/TCSVT.2008.918807

    Article  Google Scholar 

  29. Wang H, Cheung N-M, Ortega A. A framework for adaptive scalable video coding using Wyner-Ziv techniques, EURASIP Journal on Applied Signal Processing, vol. 2006

  30. Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circ Syst Video Tech 13(7):560–576. doi:10.1109/TCSVT.2003.815165

    Article  Google Scholar 

  31. Wyner A, Ziv J (1976) The rate-distortion function for source coding with side information at the decoder. IEEE Trans Inf Theory 22(1):1–10. doi:10.1109/TIT.1976.1055508

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Instituto Superior de Engenharia de Lisboa, Instituto de Telecomunicações, Rua Conselheiro Emídio Navarro, 1, 1950-062, Lisboa, Portugal

    João Ascenso

  2. Instituto Superior Técnico, Instituto de Telecomunicações, Av. Rovisco Pais, 1049-001, Lisboa, Portugal

    Catarina Brites & Fernando Pereira

Authors
  1. João Ascenso
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Catarina Brites
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fernando Pereira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Ascenso.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ascenso, J., Brites, C. & Pereira, F. A flexible side information generation framework for distributed video coding. Multimed Tools Appl 48, 381–409 (2010). https://doi.org/10.1007/s11042-009-0316-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0316-6

Keywords

Search

Navigation