Abstract
As we have seen in Chap. 2, existing video codecs anchor motion information at the frame that is to be predicted. In this thesis, we part from this conventional wisdom and investigate new motion anchoring strategies for highly scalable video compression, where motion fields are anchored at reference frames instead. As it turns out, this has a number of advantages over the traditional way of anchoring motion at reference frames. One of the main challenges using such a reference-based motion anchoring is that in order to be used for predicting the target frames, motion fields need to be warped to the target frames. This process leads to holes in disoccluding regions, as well as double mappings in the warped motion fields.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
We remind the reader that the motion discontinuity information in the target frame \(f_j\) was mapped using the hierarchical spatio-temporal breakpoint induction (HST-BPI) procedure explained in Sect. 4.1.
- 3.
The example uses a static background for ease of explanation; we note that the method remains valid for moving backgrounds.
- 4.
- 5.
References
D. Rüfenacht, R. Mathew, D. Taubman, Bidirectional, occlusion-aware temporal frame interpolation in a highly scalable video setting, Pict. Cod. Symp. (2015)
D. Rüfenacht, R. Mathew, D. Taubman, Occlusion-aware temporal frame interpolation in a highly scalable video coding setting. APSIPA Trans. Signal Inf. Proc. 5 (2016)
E. Herbst, S. Seitz, S. Baker, Occlusion Reasoning for Temporal Interpolation using Optical Flow. Department of Computer Science and Engineering, University of Washington, Technical report UW-CSE-09- 08-01, 2009
L. Xu, J. Jia, Y. Matsushita, Motion detail preserving optical flow estimation. IEEE Trans. Patt. Anal. Mach. Intell. 1744–1757 (2012)
S.-G. Jeong, C. Lee, C.-S. Kim, Motion-compensated frame interpolation based on multihypothesis motion estimation and texture optimization. IEEE Trans. Image Proc. 4497–4509 (2013)
A. Veselov, M. Gilmutdinov, Iterative hierarchical true motion estimation for temporal frame interpolation, IEEE International Workshop on Multimedia Signal Processing (2014)
Q. Lu, N. Xu, X. Fang, Motion-compensated frame interpolation with multiframe based occlusion handling. IEEE J. Disp. Technol. 11(4) (2015)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Rüfenacht, D. (2018). Motion-Discontinuity-Aided Motion Field Operations. In: Novel Motion Anchoring Strategies for Wavelet-based Highly Scalable Video Compression. Springer Theses. Springer, Singapore. https://doi.org/10.1007/978-981-10-8225-2_4
Download citation
DOI: https://doi.org/10.1007/978-981-10-8225-2_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8224-5
Online ISBN: 978-981-10-8225-2
eBook Packages: EngineeringEngineering (R0)