Abstract
In the mixed resolution coding approach, one type of scalable video coding, a mixed resolution video sequence contains low-resolution (LR) nonkey video frames at high frame rate and periodic high-resolution (HR) key video frames at low frame rate in order to reduce bit rate and encoding complexity. At the decoder, LR nonkey video frames can be upsampled to the corresponding HR video frames by neighboring HR key video frames via video super-resolution. In this study, a video super-resolution reconstruction approach for mixed resolution videos using key frames and adaptive detail warping is proposed. Resolution enhancement is realized by incorporating the high-frequency details into the HR nonkey video frames that are directly upsampled by same conventional spatial interpolation method. The corresponding high-frequency details of each nonkey frame are derived by adaptive detail warping of the high-frequency details extracted from two (forward and backward) neighboring HR key frames, using the non-local-means concept and motion estimation. Based on the experimental results obtained in this study, the performance of the proposed approach is better than those of three comparison approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hung EM et al. (2012) Video super-resolution using codebooks derived from key-frames. IEEE Trans on Circuits Syst Video Technol 22(9):1321–1331
Lehmann T, Gonner C, Spitzer K (1999) Servey: interpolation methods in medical image processing. IEEE Trans Med Imaging 18(11):1049–1075
Freeman WT, Jones TR, Pasztor EC (2002) Example-based super-resolution. Comput Graphics Appl 22(2):56–65
Yang J, Wright J, Huang T, Ma Y (2008) Image super-resolution as sparse representation of raw image patches. In: 2008 IEEE international conference on computer vision and pattern recognition, pp 1–8
Yang X, Su GD, Chen J, Moon YS (2010) Restoration of low resolution car plate images using PCA based image super-resolution. In: 17th IEEE international conference on image processing, pp 2789–2792
Mudenagudi U, Banerjee S, Kalra PK (2011) Space-time super-resolution using graph-cut optimization. IEEE Trans Pattern Anal Mach Intell 33(5):995–1008
Hsieh CC, Huang YP, Chen YY, Fuh CS (2011) Video super-resolution by motion compensated iterative back-projection approach. J Inf Sci Eng 27(3):1107–1122
Keller SH, Lauze F, Nielsen M (2011) Video super-resolution using simultaneous motion and intensity calculations. IEEE Trans Image Proc 20(7):1870–1884
Watanabe K, Iwai Y, Haga T, Yachida M (2008) A fast algorithm of video super-resolution using dimensionality reduction by DCT and example selection. In: 19th international conference on pattern recognition, pp 1–5
Ancuti C, Ancuti CO, Bekaert P (2010) Video super-resolution using high quality photographs. In: 2010 IEEE international conference on acoustics, speech, and signal processing, pp 862–865
Brandi F, Queiroz R, Mukherjee D (2008) Super-resolution of video using key frames and motion estimation. In: 15th IEEE international conference on image processing, pp 321–324
Basavaraja SV, Bopardikar AS, Velusamy S (2010) Detail warping based video super-resolution using image guides. In: 17th IEEE international conference on image processing, 2009–2012
Song BC, Jeong SC, Choi Y (2011) Video super-resolution algorithm using bi-directional overlapped block motion compensation and on-the-fly dictionary training. IEEE Trans Circuits Syst Video Technol 21(3):274–285
Protter M et al (2009) Generalizing the nonlocal-means to super-resolution reconstruction. IEEE Trans Image Proc 18(1):36–51
Acknowledgments
This work was supported in part by National Science Council, Taiwan, Republic of China under Grants NSC 102-2221-E-194-028-MY2 and NSC 102-2221-E-194-041-MY3.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, YJ., Leou, JJ., Hsiao, HH. (2014). Super-Resolution Reconstruction for Mixed Resolution Videos Using Key Frames and Adaptive Detail Warping. In: Farag, A., Yang, J., Jiao, F. (eds) Proceedings of the 3rd International Conference on Multimedia Technology (ICMT 2013). Lecture Notes in Electrical Engineering, vol 278. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41407-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-41407-7_26
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41406-0
Online ISBN: 978-3-642-41407-7
eBook Packages: EngineeringEngineering (R0)