Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion
- 51 Downloads
Motion-compensated frame-rate up-conversion (MC-FRUC) often exploits either bilateral motion estimation (ME) or unidirectional ME with a fixed block size, which constrains the perceptual quality of up-converted video. In this paper, an advanced MC-FRUC approach is proposed by exploiting hierarchical prediction-based motion vector refinement. To reduce block mismatching in texture regions and color areas, an adaptive multi-layered block matching criterion is designed to extract color and edge information, which is integrated with motion information as constraint term. A hierarchical prediction-based motion vector refinement approach is proposed to obtain more accurate and dense motion vector fields (MVFs). To eliminate the outliers of MVFs, a robust dual-weighted motion vector smoothing scheme is adopted by using both spatial correlation and reliability of neighboring blocks. Experimental results show that the proposed approach has low computational complexity and outperforms state-of-the-art works in both objective and subjective qualities of interpolated frames.
KeywordsFrame-rate up-conversion Adaptive multi-layered block matching criterion Hierarchical prediction-based motion vector refinement Robust dual-weighted motion vector smoothing
This work is supported in part by the National Natural Science Foundation of China (61572183, 61379143, 61232016, U1405254).
- 12.Zhai, J., Yu, K., Li, J., et al.: A low complexity motion compensated frame interpolation method. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp. 4927–4930. IEEE (2005)Google Scholar
- 15.Jeong, S.G., Lee, C., Kim, C.S.: Exemplar-based frame rate up-conversion with congruent segmentation. In: IEEE International Conference on Image Processing (ICIP), pp. 845–848 (2012)Google Scholar
- 20.Bayer, B.E.: Color imaging array: U.S. Patent 3,971,065[P]. 1976-7-20Google Scholar
- 23.Choi, B.T., Lee, S.H., Park, Y.J., et al.: Frame rate up-conversion using the wavelet transform. In: IEEE International Conference on Consumer Electronics (ICCE), pp. 172–173 (2000)Google Scholar