Motion-Compensated Filtering of Time-Varying Images

  • Eric Dubois
Part of the The Springer International Series in Engineering and Computer Science book series (SECS, volume 171)


This paper presents the theory of motion-compensated spatiotemporal filtering of time-varying imagery. The properties of motion trajectories and their relation to displacement fields and velocity fields are presented. The constraints that image motion places on the time-varying image in both the spatiotemporal domain and in the frequency domain are described, along with the implications of these results on motion-compensated filtering and on sampling. An iterative method for estimating motion which generalizes many pixel-oriented and block-oriented methods is presented. Motion-compensated filtering is then applied to the problems of prediction, interpolation, and smoothing.

Key Words

Motion estimation motion compensation spatiotemporal filtering adaptive filtering 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E. Dubois, “The Sampling and Reconstruction of Time-Varying Imagery with Application in Video Systems,” Proceedings of the IEEE, vol.73, 1985, pp. 502–522.CrossRefGoogle Scholar
  2. 2.
    B. Horn and B. Schunck, “Determining Optical Flow,” Artificial Intelligence, vol.17, 1981, pp. 185–203.CrossRefGoogle Scholar
  3. 3.
    R. Paquin and E. Dubois, “A Spatiotemporal Gradient Method for Estimating the Displacement Field in Time-Varying Imagery,” Computer Vision, Graphics and Image Processing, vol.21, 1983, pp. 205–221.CrossRefGoogle Scholar
  4. 4.
    L. Jacobson and H. Wechsler, “Derivation of Optical Flow using a Spatiotemporal-Frequency Approach,” Computer Vision, Graphics and Image Processing, vol.38, 1987, pp. 29–65.CrossRefGoogle Scholar
  5. 5.
    L. Cohen, “Time-Frequency Distributions—A Review,” Proceedings of the IEEE, vol.77,1989, pp. 941–981.CrossRefGoogle Scholar
  6. 6.
    B. Girod and R. Thoma, “Motion-Compensating Field Interpolation from Interlaced and Non-interlaced Grids,” in SPIE Vol. 594 Image Coding, 1985, pp. 186–193.Google Scholar
  7. 7.
    M. Bertero, T. Poggio, and V. Torre, “Ill-Posed Problems in Early Vision,” Proceedings of the IEEE, vol.76, 1990, pp. 869–889.CrossRefGoogle Scholar
  8. 8.
    J. Konrad and E. Dubois, “Estimation of Image Motion Fields: Bayesian Formulation and Stochastic Solution,” in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 1988, pp. 1072–1075.Google Scholar
  9. 9.
    J. Konrad and E. Dubois, “Bayesian Estimation of Discontinuous Motion in Images Using Simulated Annealing,” in Proceedings on Vision Interface, 1989, pp. 354–363.Google Scholar
  10. 10.
    C. Bergeron and E. Dubois, “Gradient-Based Algorithms for Block-Oriented Map Estimation of Motion and Application to Motion-Compensated Temporal Interpolation,” IEEE Transactions on Circuits and Systems for Video Technology, vol.1, 1991, pp. 72–85.CrossRefGoogle Scholar
  11. 11.
    J. Jain and A. Jain, “Displacement Measurement and its Application in Interframe Image Coding,” IEEE Transactions on Communications, vol. COM-29, 1981, pp. 1799–1808.CrossRefGoogle Scholar
  12. 12.
    S. Geman and D. Geman, “Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-6, 1984, pp. 721–741.CrossRefGoogle Scholar
  13. 13.
    J. Konrad and E. Dubois “Comparison of Stochastic and Deterministic Solution Methods in Bayesian Estimation of 2D Motion,” Image and Vision Computing, vol.8, 1990, pp. 304–317.CrossRefGoogle Scholar
  14. 14.
    T. Koga, K. Iinuma, A. Hirano, Y. Iijima, and T. Ishiguro, “Motion-Compensated Interframe Coding for Video Conferencing,” in Conf. Rec. National Telecommunications Conference, 1981, pp. G5.3.1–G5.3.5.Google Scholar
  15. 15.
    P. Gill, W. Murray, and M. Wright, Practical Optimization, New York: Academic Press, 1981.zbMATHGoogle Scholar
  16. 16.
    R. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-29, 1981, pp. 1153–1160.MathSciNetCrossRefGoogle Scholar
  17. 17.
    G. Golub and C. van Loan, Matrix Computations, Baltimore, MD: The Johns Hopkins University Press, 1985.zbMATHGoogle Scholar
  18. 18.
    P. Anandan, “A Unified Perspective on Computational Techniques for the Measurement of Visual Motion,” in Proceedings of the IEEE International Conference on Computer Vision ICCV ′87, 1987, pp. 219–230.Google Scholar
  19. 19.
    F. Glazer, G. Reynolds, and P. Anandan, “Scene Matching by Hierarchical Correlation,” in Proceedings of the IEEE Conference on Computer Vision Pattern Recognition CVPR ′83, 1983, pp. 432–441.Google Scholar
  20. 20.
    W. Enkelmann, “Investigations of Multigrid Algorithms for the Estimation of Optical flow Fields in Image Sequences,” Computer Vision, Graphics, and Image Processing, vol.43, 1988, pp. 150–177.CrossRefGoogle Scholar
  21. 21.
    F. Glazer, Hierarchical Motion Detection, Ph.D. thesis, University of Massachusetts, 1987.Google Scholar
  22. 22.
    C. Cafforio and F. Rocca, “Methods for Measuring Small Displacements of Television Images,” IEEE Transactions on Information Theory, vol. IT-22, 1976, pp. 573–579.Google Scholar
  23. 23.
    A. Netravali and J. Robbins, “Motion-Compensation Television Coding: Part I,” Bell System Technical Journal, vol.58, 1979, pp. 631–670.zbMATHGoogle Scholar
  24. 24.
    H. Nguyen and E. Dubois, “Representation of Motion Fields for Image Coding,” in Proceedings of the 1990 Picture Coding Symposium, 1990, pp. 8.4–1–8.4–5.Google Scholar
  25. 25.
    T. Reuter, “Standards Conversion Using Motion Compensation,” Signal Processing, vol.16, 1989, pp. 73–82.CrossRefGoogle Scholar
  26. 26.
    R. Depommier, “Estimation de Mouvement Considérant les Phénomènes d’Occlusion pour le Codage Inter-polatif des Séquences d’Images,” Master’s thesis, INRS-Telecommunications, 1990.Google Scholar
  27. 27.
    E. Dubois and S. Sabri, “Noise Reduction in Image Sequences Using Motion-Compensated Temporal Filtering,” IEEE Transactions on Communications, vol. COM-32, 1984, pp. 826–831.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1992

Authors and Affiliations

  • Eric Dubois
    • 1
  1. 1.INRS—TelecommunicationsVerdunCanada

Personalised recommendations