Skip to main content
SpringerLink
Log in

Back-Projection Lightweight Network for Accurate Image Super Resolution

  • Conference paper
  • First Online:
Book cover Computer Vision – ACCV 2018 (ACCV 2018)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11365))

Included in the following conference series:

  • 2342 Accesses

Abstract

Recently, deep neural networks have led to tremendous advances in image super-resolution and achieved remarkable results. However, most deep learning methods attain appreciable performance by increasing model parameters and complexity. Consequently, they are difficult to utilize in common devices despite significant results. With respect to application in resource-limited devices, the goal of the present study involves designing a compact network that exhibits good scalability. We proposed a back projection network (BPnet) as we were inspired by a traditional image super-resolution technique, namely iterative back projection (IBP). Our proposed network is composed of different modules. Each module performs the enlarging function based on the result of the previous module, which is similar to an iteration in IBP. The input of each module network corresponds to the previous down-sampled output minus the low-resolution input image. Additionally, the output of the network is the residual between the ground truth high-resolution image and previous output. The non-linear property of a neural network is maximized through the sparsity of residual input/output. Thus, we can achieve a lightweight network without sacrificing the quality of the results. The experiments indicate that the number of parameters of the proposed BPnet can be less than quarter of those proposed in the state-of-the-art papers and still have comparable results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bae, W., Yoo, J., Ye, J.C.: Beyond deep residual learning for image restoration: persistent homology-guided manifold simplification. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 145–153 (2017)

    Google Scholar 

  2. Caballero, J., et al.: Real-time video super-resolution with spatio-temporal networks and motion compensation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2848–2857 (2017)

    Google Scholar 

  3. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016)

    Article  Google Scholar 

  4. Dong, C., Loy, C.C., Tang, X.: Accelerating the super-resolution convolutional neural network. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 391–407. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_25

    Chapter  Google Scholar 

  5. Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: IEEE International Conference on Computer Vision, pp. 349–356 (2009)

    Google Scholar 

  6. Guo, T., Mousavi, H.S., Monga, V.: Orthogonally regularized deep networks for image super-resolution. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (2018)

    Google Scholar 

  7. Guo, T., Mousavi, H.S., Vu, T.H., Monga, V.: Deep wavelet prediction for image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2017)

    Google Scholar 

  8. Haris, M., Shakhnarovich, G., Ukita, N.: Deep back-projection networks for super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition (2018)

    Google Scholar 

  9. He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)

    Google Scholar 

  10. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  11. Huang, G., Liu, Z., Weinberger, K.Q., van der Maaten, L.: Densely connected convolutional networks. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, p. 3 (2017)

    Google Scholar 

  12. Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2015)

    Google Scholar 

  13. Hui, Z., Wang, X., Gao, X.: Fast and accurate single image super-resolution via information distillation network. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 723–731 (2018)

    Google Scholar 

  14. Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: IEEE International Conference on Machine Learning, pp. 448–456 (2015)

    Google Scholar 

  15. Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP: Graph. Model. Image Process. 53(3), 231–239 (1991)

    Google Scholar 

  16. Jiao, J., Tu, W.C., He, S., Lau, R.W.: FormresNet: formatted residual learning for image restoration. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1034–1042 (2017)

    Google Scholar 

  17. Kim, J., Kwon Lee, J., Mu Lee, K.: Accurate image super-resolution using very deep convolutional networks. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1646–1654 (2016)

    Google Scholar 

  18. Kim, J., Kwon Lee, J., Mu Lee, K.: Deeply-recursive convolutional network for image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1637–1645 (2016)

    Google Scholar 

  19. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  20. Lai, W.S., Huang, J.B., Ahuja, N., Yang, M.H.: Deep Laplacian pyramid networks for fast and accurate super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 624–632 (2017)

    Google Scholar 

  21. Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: IEEE Conference on Computer Vision and Pattern Recognition (2017)

    Google Scholar 

  22. Liang, Y., Yang, Z., Zhang, K., He, Y., Wang, J., Zheng, N.: Single image super-resolution via a lightweight residual convolutional neural network. arXiv preprint arXiv:1703.08173 (2017)

  23. Lim, B., Son, S., Kim, H., Nah, S., Lee, K.M.: Enhanced deep residual networks for single image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, vol. 1, p. 3 (2017)

    Google Scholar 

  24. Mao, X., Shen, C., Yang, Y.B.: Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections. In: Advances in Neural Information Processing Systems, pp. 2802–2810 (2016)

    Google Scholar 

  25. Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscaling with super-resolution forests. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3791–3799 (2015)

    Google Scholar 

  26. Shi, W., et al.: Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1874–1883 (2016)

    Google Scholar 

  27. Tai, Y., Yang, J., Liu, X.: Image super-resolution via deep recursive residual network. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 1 (2017)

    Google Scholar 

  28. Tai, Y., Yang, J., Liu, X., Xu, C.: MemNet: a persistent memory network for image restoration. In: IEEE International Conference on Computer Vision, pp. 4539–4547 (2017)

    Google Scholar 

  29. Timofte, R., Agustsson, E., Van Gool, L., Ming-Hsuan, Y., et al.: NTIRE 2017 challenge on single image super-resolution: methods and results. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2017)

    Google Scholar 

  30. Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Asian Conference on Computer Vision, pp. 111–126 (2014)

    Google Scholar 

  31. Timofte, R., Rothe, R., Van Gool, L.: Seven ways to improve example-based single image super resolution. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 111–126 (2016)

    Google Scholar 

  32. Timofte, R., Shuhang, G., Jiqing, W., Van Gool, L., et al.: NTIRE 2018 challenge on single image super-resolution: methods and results. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2018)

    Google Scholar 

  33. Tong, T., Li, G., Liu, X., Gao, Q.: Image super-resolution using dense skip connections. In: IEEE International Conference on Computer Vision, pp. 4809–4817 (2017)

    Google Scholar 

  34. Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)

    Article  MathSciNet  Google Scholar 

  35. Zhang, K., Zuo, W., Chen, Y., Meng, D., Zhang, L.: Beyond a Gaussian denoiser: residual learning of deep cnn for image denoising. IEEE Trans. Image Process. 26(7), 3142–3155 (2017)

    Article  MathSciNet  Google Scholar 

  36. Zhang, K., Tao, D., Gao, X., Li, X., Xiong, Z.: Learning multiple linear mappings for efficient single image super-resolution. IEEE Trans. Image Process. 24(3), 846–861 (2015)

    Article  MathSciNet  Google Scholar 

  37. Zhang, Y., Tian, Y., Kong, Y., Zhong, B., Fu, Y.: Residual dense network for image super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Media IC and System Lab, Graduate Institute of Electronics Engineering, National Taiwan University, Taipei, Taiwan

    Chia-Yang Chang & Shao-Yi Chien

Authors
  1. Chia-Yang Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shao-Yi Chien
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chia-Yang Chang .

Editor information

Editors and Affiliations

  1. IIIT Hyderabad, Hyderabad, India

    C.V. Jawahar

  2. ANU, Canberra, ACT, Australia

    Hongdong Li

  3. Simon Fraser University, Burnaby, BC, Canada

    Greg Mori

  4. ETH Zurich, Zurich, Zürich, Switzerland

    Konrad Schindler

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chang, CY., Chien, SY. (2019). Back-Projection Lightweight Network for Accurate Image Super Resolution. In: Jawahar, C., Li, H., Mori, G., Schindler, K. (eds) Computer Vision – ACCV 2018. ACCV 2018. Lecture Notes in Computer Science(), vol 11365. Springer, Cham. https://doi.org/10.1007/978-3-030-20873-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-20873-8_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-20872-1

  • Online ISBN: 978-3-030-20873-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation