Advertisement

Detecting Macroblocking in Images Caused by Transmission Error

  • Ganesh RajasekarEmail author
  • Zhou WangEmail author
Conference paper
  • 141 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12131)

Abstract

Macroblocking is a type of widely observed video artifact where severe block-shaped artifacts appear in video frames. Macroblocking may be produced by heavy lossy compression but is visually most annoying when transmission error such as packet loss occurs during network video transmission. Since receivers do not have access to the pristine-quality original videos, macroblocking detection needs to be performed using no-reference (NR) approaches. This paper presents our recent research progress on detecting macroblocking caused by packet loss. We build the first of its kind macroblocking database that contains approximately 150,000 video frames with labels. Using the database, We make initial attempts of using transfer learning based deep learning techniques to tackle this challenging problem with and without using the Apache Spark big data processing framework. Our results show that it is beneficiary to use Spark. We believe that the current work will help the future development of macroblocking detection methods.

Keywords

Macroblocking Packet loss Transmission artifacts No-reference image quality assessment Deep learning Apache Spark 

References

  1. 1.
    Reibman, A.R., Kanumuri, S., Vaishampayan, V., Cosman, P.C.: Visibility of individual packet losses in MPEG-2 video. In: 2004 International Conference on Image Processing, Singapore, vol. 1, pp. 171–174 (2004)Google Scholar
  2. 2.
    Nightingale, J., Wang, Q., Grecos, C., Goma, S.: Subjective evaluation of the effects of packet loss on HEVC encoded video streams. In: 2013 IEEE Third International Conference on Consumer Electronics Berlin (ICCE-Berlin), Berlin, pp. 358–359 (2013)Google Scholar
  3. 3.
    Greengrass, J., Evans, J., Begen, A.C.: Not all packets are equal, part 2: the impact of network packet loss on video quality. IEEE Internet Comput. 13(2), 74–82 (2009)CrossRefGoogle Scholar
  4. 4.
    Glavota, I., Vranješ, M., Herceg, M., Grbić, R.: Pixel-based statistical analysis of packet loss artifact features. In: 2016 Zooming Innovation in Consumer Electronics International Conference (ZINC), Novi Sad, pp. 16–19 (2016)Google Scholar
  5. 5.
    Vranjes, M., Herceg, M., Vranjes, D., Vajak, D.: Video transmission artifacts detection using no-reference approach. In: 2018 Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, pp. 72–77 (2018)Google Scholar
  6. 6.
    Talebi, H., Milanfar, P.: NIMA: neural image assessment. IEEE Trans. Image Process. 27(8), 3998–4011 (2018)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Brownlee, J.: Transfer Learning in Keras with Computer Vision Models, September 2019Google Scholar
  8. 8.

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Electrical and Computer EngineeringUniversity of WaterlooWaterlooCanada

Personalised recommendations