Advertisement

Single-Image Super-Resolution: A Benchmark

  • Chih-Yuan Yang
  • Chao Ma
  • Ming-Hsuan Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8692)

Abstract

Single-image super-resolution is of great importance for vision applications, and numerous algorithms have been proposed in recent years. Despite the demonstrated success, these results are often generated based on different assumptions using different datasets and metrics. In this paper, we present a systematic benchmark evaluation for state-of-the-art single-image super-resolution algorithms. In addition to quantitative evaluations based on conventional full-reference metrics, human subject studies are carried out to evaluate image quality based on visual perception. The benchmark evaluations demonstrate the performance and limitations of state-of-the-art algorithms which sheds light on future research in single-image super-resolution.

Keywords

Single-image super-resolution performance evaluation metrics Gaussian blur kernel width 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Supplementary material

978-3-319-10593-2_25_MOESM1_ESM.pdf (15.6 mb)
Electronic Supplementary Material(15,991 KB)

References

  1. 1.
    Aly, H.A., Dubois, E.: Image up-sampling using total-variation regularization with a new observation model. TIP 14(10), 1647–1659 (2005)MathSciNetGoogle Scholar
  2. 2.
    Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: CVPR (2004)Google Scholar
  3. 3.
    Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y.: Soft edge smoothness prior for alpha channel super resolution. In: CVPR (2007)Google Scholar
  4. 4.
    Damera-Venkata, N., Kite, T.D., Geisler, W.S., Evans, B.L., Bovik, A.C.: Image quality assessment based on a degradation model. TIP 9(4), 636–650 (2000)Google Scholar
  5. 5.
    Dong, W., Zhang, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. TIP 20(7), 1838–1857 (2011)MathSciNetGoogle Scholar
  6. 6.
    Efrat, N., Glasner, D., Apartsin, A., Nadler, B., Levin, A.: Accurate blur models vs. image priors in single image super-resolution. In: ICCV (2013)Google Scholar
  7. 7.
    Elad, M., Zeyde, R., Protter, M.: Single image super-resolution using sparse representation. In: SIAM Imaging Science (2010)Google Scholar
  8. 8.
    Fattal, R.: Image upsampling via imposed edge statistics. In: SIGGRAPH (2007)Google Scholar
  9. 9.
    Freedman, G., Fattal, R.: Image and video upscaling from local self-examples. TOG 30(2), 1–11 (2011)CrossRefGoogle Scholar
  10. 10.
    Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Computer Graphics and Applications, pp. 56–65 (March/April 2002)Google Scholar
  11. 11.
    Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: ICCV (2009)Google Scholar
  12. 12.
    HaCohen, Y., Fattal, R., Lischinski, D.: Image upsampling via texture hallucination. In: ICCP (2010)Google Scholar
  13. 13.
    He, H., Siu, W.C.: Single image super-resolution using Gaussian process regression. In: CVPR (2011)Google Scholar
  14. 14.
    He, L., Qi, H., Zaretzki, R.: Beta process joint dictionary learning for coupled feature spaces with application to single image super-resolution. In: CVPR (2013)Google Scholar
  15. 15.
    Huang, J., Mumford, D.: Statistics of natural images and models. In: CVPR (1999)Google Scholar
  16. 16.
    Irani, M., Peleg, S.: Improving resolution by image registration. CGVIP 53(3), 231–239 (1991)Google Scholar
  17. 17.
    Kim, K.I., Kwon, Y.: Single-image super-resolution using sparse regression and natural image prior. PAMI 32(6), 1127–1133 (2010)CrossRefMathSciNetGoogle Scholar
  18. 18.
    Kopf, J., Lischinski, D.: Depixelizing pixel art. In: SIGGRAPH (2011)Google Scholar
  19. 19.
    Lu, X., Yuan, H., Yan, P., Yuan, Y., Li, X.: Geometry constrained sparse coding for single image super-resolution. In: CVPR (2012)Google Scholar
  20. 20.
    Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: ICCV (2001)Google Scholar
  21. 21.
    Michaeli, T., Irani, M.: Nonparametric blind super-resolution. In: ICCV (2013)Google Scholar
  22. 22.
    Moore, D., McCabe, G.P., Craig, B.: Introduction to the Practice of Statistics, 7th edn. W.H. Freeman (2005)Google Scholar
  23. 23.
    Ni, K., Nguyen, T.: Image superresolution using support vector regression. TIP 16(6), 1596–1610 (2007)MathSciNetGoogle Scholar
  24. 24.
    Purkait, P., Chanda, B.: Image upscaling using multiple dictionaries of natural image patches. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part III. LNCS, vol. 7726, pp. 284–295. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  25. 25.
    Robson, J.G.: Spatial and temporal contrast-sensitivity functions of the visual system. Journal of the Optical Society of America (1966)Google Scholar
  26. 26.
    Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: A natural scene statistics approach in the DCT domain. TIP 21(8), 3339–3352 (2012)MathSciNetGoogle Scholar
  27. 27.
    Shan, Q., Li, Z., Jia, J., Tang, C.K.: Fast image/video upsampling. In: SIGGRAPH Asia (2008)Google Scholar
  28. 28.
    Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. TIP 15(11), 3340–3451 (2006)Google Scholar
  29. 29.
    Sheikh, H.R., Bovik, A.C., de Veciana, G.: An information fidelity criterion for image quality assessment using natural scene statistics. TIP 14(12), 2117–2128 (2005)Google Scholar
  30. 30.
    Sun, J., Sun, J., Xu, Z., Shum, H.Y.: Image super-resolution using gradient profile prior. In: CVPR (2008)Google Scholar
  31. 31.
    Sun, J., Zheng, N.N., Tao, H., Shum, H.Y.: Image hallucination with primal sketch priors. In: CVPR (2003)Google Scholar
  32. 32.
    Sun, J., Zhu, J., Tappen, M.F.: Context-constrained hallucination for image super-resolution. In: CVPR (2010)Google Scholar
  33. 33.
    Sun, L., Hays, J.: Super-resolution from internet-scale scene matching. In: ICCP (2012)Google Scholar
  34. 34.
    Tai, Y.W., Liu, S., Brown, M.S., Lin, S.: Super resolution using edge prior and single image detail synthesis. In: CVPR (2010)Google Scholar
  35. 35.
    Tappen, M.F., Liu, C.: A Bayesian approach to alignment-based image hallucination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VII. LNCS, vol. 7578, pp. 236–249. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  36. 36.
    Timofte, R., Smet, V.D., Gool, L.V.: Anchored neighborhood regression for fast example-based super-resolution. In: ICCV (2012)Google Scholar
  37. 37.
    Wainwright, M.J., Simoncelli, E.P., Willsky, A.S.: Random cascades on wavelet trees and their use in analyzing and modeling natural images. Applied and Computational Harmonic Analysis 11, 89–123 (2001)CrossRefzbMATHMathSciNetGoogle Scholar
  38. 38.
    Wang, Q., Tang, X., Shum, H.: Patch based blind image super resolution. In: ICCV (2005)Google Scholar
  39. 39.
    Wang, S., Zhang, L., Liang, Y., Pan, Q.: Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis. In: CVPR (2012)Google Scholar
  40. 40.
    Wang, Z., Simoncelli, E., Bovik, A.C.: Multi-scale structural similarity for image quality assessment. In: IEEE Conference Record of the Thirty-Seventh Asilomar Conference on Signals, Systems, and Computers (2003)Google Scholar
  41. 41.
    Xiong, X., Sun, X., Wu, F.: Robust web image/video super-resolution. TIP 19(8), 2017–2028 (2010)MathSciNetGoogle Scholar
  42. 42.
    Yang, C.Y., Liu, S., Yang, M.H.: Structured face hallucination. In: CVPR (2013)Google Scholar
  43. 43.
    Yang, C.Y., Yang, M.H.: Fast direct super-resolution by simple functions. In: ICCV (2013)Google Scholar
  44. 44.
    Yang, J., Lin, Z., Cohen, S.: Fast image super-resolution based on in-place example regression. In: CVPR (2013)Google Scholar
  45. 45.
    Yang, J., Wang, Z., Lin, Z., Shu, X., Huang, T.: Bilevel sparse coding for coupled feature spaces. In: CVPR (2012)Google Scholar
  46. 46.
    Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. TIP (2010)Google Scholar
  47. 47.
    Yang, S., Wang, M., Chen, Y., Sun, Y.: Single-image super-resolution reconstruction via learned geometric dictionaries and clustered sparse coding. TIP 21(9), 4016–4028 (2012)MathSciNetGoogle Scholar
  48. 48.
    Zhang, H., Yang, J., Zhang, Y., Huang, T.S.: Non-local kernel regression for image and video restoration. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 566–579. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  49. 49.
    Zontak, M., Irani, M.: Internal statistics of a single natural image. In: CVPR (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Chih-Yuan Yang
    • 1
  • Chao Ma
    • 1
    • 2
  • Ming-Hsuan Yang
    • 1
  1. 1.University of California at MercedUSA
  2. 2.Shanghai Jiao Tong UniversityChina

Personalised recommendations