Abstract
Real-world video sequences coded at low bit rates suffer from compression artifacts, which are visually disruptive and can cause problems to computer vision algorithms. Unlike the denoising problem where the high frequency components of the signal are present in the noisy observation, most high frequency details are lost during compression and artificial discontinuities arise across the coding block boundaries. In addition to sparse spatial priors that can reduce the blocking artifacts for a single frame, temporal information is needed to recover the lost spatial details. However, establishing accurate temporal correspondences from the compressed videos is challenging because of the loss of high frequency details and the increase of false blocking artifacts. In this paper, we propose a non-causal temporal prior model to reduce video compression artifacts by propagating information from adjacent frames and iterating between image reconstruction and motion estimation. Experimental results on real-world sequences demonstrate that the deblocked videos by the proposed system have marginal statistics of high frequency components closer to those of the original ones, and are better input for standard edge and corner detectors than the coded ones.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
MPEG4 Verification Model, VM 18.0, pp. 271–275 (2001)
Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. IJCV 92(1), 1–31 (2011)
Bentley, J.L.: Multidimensional binary search trees used for associative searching. Commun. ACM 18, 509–517 (1975)
Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)
Buades, A., Coll, B., Morel, J.: A non-local algorithm for image denoising. In: CVPR (2005)
Dabov, K., Foi, A., Egiazarian, K.: Video denoising by sparse 3d transform-domain collaborative filtering. In: EUSIPCO (2007)
Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. In: SIGGRAPH, pp. 327–340 (2001)
Horn, B., Schunck, B.: Determining optical flow. AI 16, 185–203 (1981)
Jin, X., Goto, S., Ngan, K.-N.: Optical flow based DC surface compensation for artifacts reduction. In: Picture Coding Symposium (2009)
Li, Z., Delp, E.: MAP-based post processing of video sequences using 3-d huber-markov random field model. In: ICME (2002)
Liang, L., Liu, C., Xu, Y.-Q., Guo, B., Shum, H.-Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. 20(3), 127–150 (2001)
Liew, A., Yan, H.: Blocking artifacts suppression in block-coded images using overcomplete wavelet representation. IEEE TCSVT 14(4), 450–461 (2004)
Liu, C.: Beyond pixels: exploring new representations and applications for motion analysis. PhD thesis. MIT (2009)
Liu, C., Freeman, W.T.: A High-Quality Video Denoising Algorithm Based on Reliable Motion Estimation. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 706–719. Springer, Heidelberg (2010)
Liu, C., Sun, D.: A Bayesian approach to adaptive video super resolution. In: CVPR (2011)
Meier, T., Ngan, K., Crebbin, G.: Reduction of blocking artifacts in image and video coding. IEEE TCSVT 9(3), 490–500 (1999)
Minami, S., Zakhor, A.: An optimization approach for removing blocking effects in transform coding. IEEE TCSVT 5(2), 74–82 (1995)
Reddy, D., Veeraraghavan, A., Chellappa, R.: P2C2: Programmable pixel compressive camera for high speed imaging. In: CVPR (2011)
Richardson, I.E.: The H.264 Advanced Video Compression Standard. Addison-Wesley (2010)
Robertson, M.A., Stevenson, R.L.: Restoration of compressed video using temporal information. In: Proc. of SPIE (2001)
Roth, S., Black, M.: Fields of experts: a framework for learning image priors. In: CVPR (2005)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1-4), 259–268 (1992)
Sikora, T.: MPEG digital video-coding standards. IEEE Signal Processing Magazine 14(5), 82–100 (1997)
Sun, D., Cham, W.-K.: Postprocessing of low bit-rate block DCT coded images based on a fields of experts prior. IEEE TIP 16(11), 2743–2751 (2007)
Sun, D., Roth, S., Black, M.J.: Secrets of optical flow estimation and their principles. In: CVPR (2010)
Szeliski, R.: Locally adapted hierarchical basis preconditioning. In: SIGGRAPH (2006)
Wallace, G.K.: The JPEG still picture compression standard. Commun. ACM 34, 30–44 (1991)
Wiegand, T., Sullivan, G., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE TCSVT 13(7), 560–576 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sun, D., Liu, C. (2012). Non-causal Temporal Prior for Video Deblocking. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7576. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33715-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-33715-4_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33714-7
Online ISBN: 978-3-642-33715-4
eBook Packages: Computer ScienceComputer Science (R0)