Advertisement

Real-Time HDTV-to-8K TV Hardware Upconverter

  • Seiichi GohshiEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 983)

Abstract

8K is the pinnacle of the video systems and 8K broadcasting service will be started in December 2018. However, the availability of content for 8K TV is still insufficient, a situation similar to that of HDTV in the 1990s. Upconverting analogue content to HDTV content was important to supplement the insufficient HDTV content. This upconverted content was also important for news coverage as HDTV equipment was heavy and bulky. The current situation for 8K TV is similar wherein covering news with 8K TV equipment is very difficult as this equipment is much heavier and bulkier than that required for HDTV in the 1990s. The HDTV content available currently is sufficient, and the equipment has also evolved to facilitate news coverage; therefore, an HDTV-to-8K TV upconverter can be a solution to the problems described above. However, upconversion from interlaced HDTV to 8K TV results in an enlargement of the images by a factor of 32, thus making the upconverted images very blurry. Super resolution (SR) is a technology to solve the enlargement blur issue. One of the most common SR technologies is super resolution image reconstruction (SRR). However, SRR has limitations to use for the HDTV-to-8K TV upconverter. In this paper an HDTV-to-8K TV upconverter with nonlinear processing SR has been proposed in this study in order to fix this issue.

Keywords

8KTV 4KTV HDTV Up-convert Super resolution with non-linear processing Super resolution image reconstruction Learning based super resolution Non-linear signal processing 

References

  1. 1.
    Bannore, V.: Iterative-Interpolation Super-Resolution Image Reconstruction (2010)Google Scholar
  2. 2.
    Duchon, C.E.: Lanczos filtering in one and two dimensions. J. Appl. Meteorol. 18, 1016–1022 (1979)CrossRefGoogle Scholar
  3. 3.
    Eekeren, A.W.M., Schutte, K., Vliet, L.J.: Multiframe super-resolution reconstruction of small moving objects. IEEE Trans. Image Process. 19(11), 2901–2912 (2010)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Fast and robust multi-frame super-resolution. IEEE Trans. Image Process. 13, 1327–1344 (2004)CrossRefGoogle Scholar
  5. 5.
    Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. International Conference on Computer Vision (ICCV) (2009)Google Scholar
  6. 6.
    Gohshi, S., Echizen, I.: Limitations of super resolution image reconstruction and how to overcome them for a single image. ICETE2013 (SIGMAP), Reykjavik, Iceland (2013)Google Scholar
  7. 7.
    Gohshi, S., Hiroi, T., Echizen, I.: Subjective assessment of hdtv with super resolution function. EURASIP J. Image Video Process. (2014)Google Scholar
  8. 8.
    Gohshi, S., Nakamura, S., Tabata, H.: Development of real-time HDTV-to-8K TV upconverter. In: VISIGRAPP 2017, VISAPP, vol. 4, pp. 52–59 (2017)Google Scholar
  9. 9.
    Houa, X., Liu, H.: Super-resolution image reconstruction for video sequence. IEEE Trans. Image Process. (2011)Google Scholar
  10. 10.
    Huang, J., Mingzhai Sun, J.M., Chi, Y.: Super-resolution image reconstruction for high-density three-dimensional single-molecule microscopy. IEEE Trans. Computat. Imag. 4(12), 763–773 (2017)MathSciNetCrossRefGoogle Scholar
  11. 11.
  12. 12.
  13. 13.
    Katsaggelos, A.K., Molina, R., Mateos, J.: Super Resolution of Images and Video. Morgan and Claypool Publishers, San Rafael (2007)CrossRefGoogle Scholar
  14. 14.
    Lee, J.S.: Digital image enhancement and noise filtering by use of local statistics. IEEE Trans. Pattern Anal. Mach. Intell. 2, 165–168 (1980)CrossRefGoogle Scholar
  15. 15.
    Lucy, L.B.: An iterative technique for the rectification of observed distributions. Astronom. J. 79(6), 745–754 (1974)CrossRefGoogle Scholar
  16. 16.
    Matsumoto, N., Ida, T.: Reconstruction based super-resolution using self-congruency around image edges (in Japanese). J. IEICE 93, 118–126 (2010)Google Scholar
  17. 17.
    Mertz, P., Gray, F.: A theory of scanning and its relation to the characteristics of the transmitted signal in telephotography and television. IEEE Trans. Image Process. (1934)Google Scholar
  18. 18.
    Panda, S., Prasad, R., Jena, G.: POCS based super-resolution image reconstruction using an adaptive regularization parameter. IEEE Trans. Image Process. (2011)Google Scholar
  19. 19.
    Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Process. Mag. 20, 21–36 (2003)CrossRefGoogle Scholar
  20. 20.
    Pratt, W.K.: Digital Image Processing, 3rd edn. Wiley, New York (2001)CrossRefGoogle Scholar
  21. 21.
    Protter, M., Elad, M., Takeda, H., Milanfar, P.: Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Trans. Image Process. 18, 36–51 (2009)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Richardson, W.H.: Bayesian-based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Sakata, H.: Assessment of tv noise and frequency characteristics. J. ITE (1980)Google Scholar
  24. 24.
    Sanchez-Beato, A., Pajares, G.: Noniterative interpolation-based super-resolution minimizing aliasing in the reconstructed image. IEEE Trans. Image Process. 17(10), 1817–1826 (2008)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Schreiber, W.F.: Wirephoto quality improvement by unsharp masking. J. Pattern Recogn. 2, 111–121 (1970)CrossRefGoogle Scholar
  26. 26.
    Shahar, O., Faktor, A., Irani, M.: Space-time superresolution from a single video. In: CVPR f11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, vol. 19, no. 11, pp. 3353–3360 (2011)Google Scholar
  27. 27.
    Toshiba (in Japanese). https://www.toshiba.co.jp/regza/function/10b/function09.html. Accessed 12 Sept 2016
  28. 28.
    van Eekeren, A.W.M., Schutte, K., van Vliet, L.J.: Multiframe super-resolution reconstruction of small moving objects. IEEE Trans. Image Process. 19, 2901–2912 (2010)MathSciNetCrossRefGoogle Scholar
  29. 29.
    Zhou, F., Xia, S., Liao, Q.: Nonlocal pixel selection for multisurface fitting-based super-resolution. IEEE Trans. Circ. Syst. Video Technol. 24(12), 2013–2017 (2011)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Kogakuin UniversityShinjuku-KuJapan

Personalised recommendations