Recursive Motion Compensation: A Review

  • J. D. Robbins
  • A. N. Netravali
Part of the NATO ASI Series book series (volume 2)

Abstract

We present algorithms for estimating frame-to-frame changes in intensity of a television scene. The changes can be a result of object motion in a TV scene or variation of illumination. By a gradient search technique, which seeks to minimize a functional of the interframe intensity prediction error, we estimate two parameters associated with these intensity changes — translational displacement of objects and a scaling factor associated with illumination changes. Algorithms for the parameter estimation are given in both the picture element and transform domain. Using the estimates of these parameters, we also develop, for motion compensated interframe coding, adaptive predictors and a segmenter to determine which pels need to be transmitted. We describe several coder variations and compare them by computer simulations using several scene sequences. Simulations indicate that motion compensation reduces the bit rates by 30 to 70 percent compared to conditional replenishment.

Keywords

Entropy Candy 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    F. W. Mounts, “A Video Encoding System Using Conditional Picture-Element Replenishment,” B.S.T.J.,48,No. 7 (September 1969), pp. 2545–2554.Google Scholar
  2. [2]
    B. G. Haskell, F. W. Mounts, and J. C. Candy, “Interframe Coding of Videotelephone Pictures,” Proc. IEEE,60,No. 7 (July 1972), pp. 792–800.CrossRefGoogle Scholar
  3. [3]
    J. O. Limb, R. F. W. Pease, and K. A. Walsh, “Combining Intraframe and Frame-to-Frame Coding for Television,” B.S.T.J.,53,No. 6 (August 1974), pp. 1137–1173.Google Scholar
  4. [4]
    T. Ishiguro, K. Iinuma, Y. Iijima, T. Koga, S. Azami, and T. Mune, “Composite Interframe Coding of NTSC Television Signals,” 1976 National Telecommunications Conference Record, Vol. 1, Dallas, Texas, (November 1976), pp. 6.4–1 to 6.4–5.Google Scholar
  5. [5]
    B. G. Haskell, P. L. Gordon, R. L. Schmidt, and J. V. Scattaglia, “Interframe Coding of 525-Line Monochrome Television at 1.5 Mbs,” IEEE Trans. Commun. COM-25 (October 1977), pp. 1461–1467.Google Scholar
  6. [6]
    F. Rocca, “Television Bandwidth Compression Utilizing Frame-to-Frame Correlation and Movement Compensation,” Symposium on Picture Bandwidth Compression, (M.I.T., Cambridge, Mass., 1969), Gordon and Breach, 1972.Google Scholar
  7. [7]
    B. G. Haskell and J. O. Limb, “Predictive Video Encoding Using Measured Subject Velocity,” January 1972, U.S. Patent 3,632,865.Google Scholar
  8. [8]
    C. Cafforio and F. Rocca, “Methods for Measuring Small Displacements of Television Images,” IEEE Trans. Inform. Theory, IT-22, No. 5 (September 1976), pp. 573–579.CrossRefGoogle Scholar
  9. [9]
    B. G. Haskell, “Entropy Measurements for Nonadaptive and Adaptive, Frame-to-Frame, Linear Predictive Coding of Video Telephone Signals,” B.S.T.J.,54,No. 6 (August 1975), pp. 1155–1174.Google Scholar
  10. [10]
    A. N. Netravali and J. D. Robbins, “Motion-Compensated Television Coding, Part-I,” B.S.T.J.,58,No. 3 (March 1979), pp. 629–668.Google Scholar
  11. [11]
    J. D. Robbins and A. N. Netravali, “Interframe Television Coding Using Movement Compensation,” International Conference on Communications, Boston, Mass., June 1979.Google Scholar
  12. [12]
    J. A. Stuller and A. N. Netravali, “Transform Domain Motion Estimation,” B.S.T.J.,58,No. 7 (September 1979), pp. 1673–1702.MathSciNetGoogle Scholar
  13. [13]
    A. N. Netravali and J. A. Stuller, “Motion-Compensated Transform Coding,” B.S.T.J.,58,No. 7 (September 1979), pp. 1703–1718.MathSciNetGoogle Scholar
  14. [14]
    J. A. Stuller, A. N. Netravali and J. D. Robbins, “Interframe Television Coding Using Gain and Displacement Compensation,” B.S.T.J.,59,No. 7, September 1980, pp. 1227–1240.Google Scholar
  15. [15]
    K. A. Prabhu and A. N. Netravali, “Pel-Recursive Motion Compensated Color Coding,” International Conference on Communications, Philadelphia, PA, June 1982.Google Scholar
  16. [16]
    K. A. Prabhu and A. N. Netravali, “Motion Compensated Component Color Coding,” IEEE Transactions on Communications (to appear).Google Scholar
  17. [17]
    K. A. Prabhu and A. N. Netravali, “Motion Compensated Composite Color Coding,” IEEE Transactions on Communications (to appear).Google Scholar
  18. [18]
    A. N. Netravali and J. D. Robbins, “Spatial Subsampling in Motion Compensated Television,” B.S.T.J., (to appear).Google Scholar
  19. [19]
    A. N. Netravali and J. D. Robbins, “Motion Compensated Temporal Interpolation,” Picture Coding Symposium, Montreal, 1981.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1983

Authors and Affiliations

  • J. D. Robbins
    • 1
  • A. N. Netravali
    • 1
  1. 1.Bell LaboratoriesHolmdelUSA

Personalised recommendations