Motion-Compensated Filtering of Time-Varying Images
This paper presents the theory of motion-compensated spatiotemporal filtering of time-varying imagery. The properties of motion trajectories and their relation to displacement fields and velocity fields are presented. The constraints that image motion places on the time-varying image in both the spatiotemporal domain and in the frequency domain are described, along with the implications of these results on motion-compensated filtering and on sampling. An iterative method for estimating motion which generalizes many pixel-oriented and block-oriented methods is presented. Motion-compensated filtering is then applied to the problems of prediction, interpolation, and smoothing.
Key WordsMotion estimation motion compensation spatiotemporal filtering adaptive filtering
Unable to display preview. Download preview PDF.
- 6.B. Girod and R. Thoma, “Motion-Compensating Field Interpolation from Interlaced and Non-interlaced Grids,” in SPIE Vol. 594 Image Coding, 1985, pp. 186–193.Google Scholar
- 8.J. Konrad and E. Dubois, “Estimation of Image Motion Fields: Bayesian Formulation and Stochastic Solution,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 1988, pp. 1072–1075.Google Scholar
- 9.J. Konrad and E. Dubois, “Bayesian Estimation of Discontinuous Motion in Images Using Simulated Annealing,” in Proceedings on Vision Interface, 1989, pp. 354–363.Google Scholar
- 14.T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, “Motion-Compensated Interframe Coding for Video Conferencing,” in Conf. Rec. National Telecommunications Conference, 1981, pp. G5.3.1–G5.3.5.Google Scholar
- 18.P. Anandan, “A Unified Perspective on Computational Techniques for the Measurement of Visual Motion,” in Proceedings of the IEEE International Conference on Computer Vision ICCV ′87, 1987, pp. 219–230.Google Scholar
- 19.F. Glazer, G. Reynolds, and P. Anandan, “Scene Matching by Hierarchical Correlation,” in Proceedings of the IEEE Conference on Computer Vision Pattern Recognition CVPR ′83, 1983, pp. 432–441.Google Scholar
- 21.F. Glazer, Hierarchical Motion Detection, Ph.D. thesis, University of Massachusetts, 1987.Google Scholar
- 22.C. Cafforio and F. Rocca, “Methods for Measuring Small Displacements of Television Images,” IEEE Transactions on Information Theory, vol. IT-22, 1976, pp. 573–579.Google Scholar
- 24.H. Nguyen and E. Dubois, “Representation of Motion Fields for Image Coding,” in Proceedings of the 1990 Picture Coding Symposium, 1990, pp. 8.4–1–8.4–5.Google Scholar
- 26.R. Depommier, “Estimation de Mouvement Considérant les Phénomènes d’Occlusion pour le Codage Inter-polatif des Séquences d’Images,” Master’s thesis, INRS-Telecommunications, 1990.Google Scholar