Abstract
The multi-frame super resolution (SR) problem is to generate high resolution (HR) images by referring to a sequence of low resolution (LR) images. However, traditional multi-frame SR methods fail to take full advantage of the redundancy in LR images. In this paper, we present a novel algorithm using a refined example-based SR framework to cope with this problem. The refined framework includes two innovative points. First, based upon a thorough study of multi-frame and single frame statistics, we extend the single frame example-based scheme to multi-frame. Instead of training an external dictionary, we search for examples in the image pyramids of the LR inputs, i.e., a set of multi-resolution images derived from the input LRs. Second, we propose a new metric to find similar image patches, which not only considers the intensity and structure features of a patch but also adaptively balances between these two parts. With the refined framework, we are able to make the utmost of the redundancy in LR images to facilitate the SR process. As can be seen from the experiments, it is efficient in preserving structural features. Experimental results also show that our algorithm outperforms state-of-the-art methods on test sequences, achieving the average PSNR gain by up to 1.2dB.
This work was supported by National Natural Science Foundation of China under contract No.61071082, National Basic Research Program (973 Program) of China under contract No.2009CB320907 and Doctoral Fund of Ministry of Education of China under contract No.20110001120117.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tsai, R., Huang, T.: Multiple frame image restoration and registration. In: Advances in Computer Vision and Image Processing, vol. 1, pp. 317–339 (1984)
Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Fast and robust multi-frame super-resolution. IEEE Transactions on Image Processing 13, 1327–1344 (2003)
Freeman, W., Jones, T., Pasztor, E.: Example-based super-resolution. IEEE Computer Graphics and Applications 22(2), 56–65 (2002)
Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: IEEE International Conference on Computer Vision, pp. 349–356 (2009)
Zhuo, Y., Liu, J., Ren, J., Guo, Z.: Nonlocal based super resolution with rotation invariance and search window relocation. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 853–856 (2012)
Su, H., Tang, L., Wu, Y., Tretter, D., Zhou, J.: Spatially adaptive block-based super-resolution. IEEE Trans. on Image Processing 21(3), 1031–1045 (2012)
Takeda, H., Milanfar, P., Protter, M., Elad, M.: Super-resolution without explicit subpixel motion estimation. IEEE Transactions on Image Processing 18(9) (2009)
Jurio, A., Pagola, M., Mesiar, R., Beliakov, G., Bustince, H.: Image magnification using interval information. IEEE Trans. on Image Processing 20(11), 3112–3123 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bai, W., Liu, J., Li, M., Guo, Z. (2013). Multi-frame Super Resolution Using Refined Exploration of Extensive Self-examples. In: Li, S., et al. Advances in Multimedia Modeling. MMM 2013. Lecture Notes in Computer Science, vol 7732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35725-1_37
Download citation
DOI: https://doi.org/10.1007/978-3-642-35725-1_37
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35724-4
Online ISBN: 978-3-642-35725-1
eBook Packages: Computer ScienceComputer Science (R0)