Dense Non-Rigid Motion Estimation in Sequences of 3D Images Using Differential Constraints

  • Serge Benayoun
  • Chahab Nastar
  • Nicholas Ayache
Part of the Lecture Notes in Computer Science book series (LNCS, volume 905)


We describe a new method for computing the displacement vector field in time sequences of 3D images (4D data). The method is an energy-minimizing method; the energy is splitted into two terms, with one term matching differential singularities in the images, and the other constraining the regularity of the field. In order to reduce the computational time, we introduce an adaptive volume mesh the resolution of which depends on the presence of high gradient. We next perform a modal analysis, which allows a compact representation of the deformation by a reduced number of parameters. We present experimental results on synthetic data and on medical images.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A.A. Amini, R.L. Owen, P. Anandan, and J.S. Duncan. Non-rigid motion models for tracking the left-ventrical wall. In Proceedings IPMI ‘82, 1992.Google Scholar
  2. 2.
    N. Ayache. Volume Image Processing, Results and Research Challenges. September 1993. INRIA Research Report (2050).Google Scholar
  3. 3.
    Ruzena Bajcsy and Stane Kovacic. Multiresolution elastic matching. Computer Vision Graphics and Image Processing, 46: 1–21, 1989.CrossRefGoogle Scholar
  4. 4.
    Klaus-Jurgen Bathe. Finite Element Procedures in Engineering Analysis. Prentice-Hall, 1982.Google Scholar
  5. 5.
    S. Benayoun. Calcul Local du Mouvement, applications l’imagerie médicale multidimensionnelle. PhD thesis, Université Paris Dauphine, Décembre 1994.Google Scholar
  6. 6.
    S. Benayoun, N. Ayache, and I. Cohen. Adaptive meshes and nonrigid motion computation. In International Conference on Pattern Recognition, Jerusalem, Israel, October 1994.Google Scholar
  7. 7.
    Isaac Cohen, Nicholas Ayache, and Patrick Sulger. Tracking points on deformable objects using curvature information. In Proceedings of the Second European Conference on Computer Vision 1992,pages 458–466, Santa Margherita Ligure, Italy, May 1992. In Lecture Notes in Computer Science: Computer Vision - ECCV92, Vol. 588 Springer-Verlag.Google Scholar
  8. 8.
    C. Nastar and N. Ayache. Classification of nonrigid motion in 3d images using physics-based vibration analysis. In IEEE Workshop on Biomedical Image Analysis, Seattle, Washington, June 1994.Google Scholar
  9. 9.
    Chahab Nastar. Vibration modes for nonrigid motion analysis in 3D images. In Proceedings of the Third European Conference on Computer Vision (ECCV ‘84), Stockholm, May 1994.Google Scholar
  10. 10.
    Chahab Nastar and Nicholas Ayache. Spatio-temporal analysis of nonrigid motion from 4D data. In Proceedings of the IEEE Workshop on Nonrigid and articulate motion, Austin, Texas, November 1994.Google Scholar
  11. 11.
    B. Palmério and A. Dervieux. 2D and 3D unstructured mesh adaption relying on physical analogy. September 1988. Université de Nice Research Report (207).Google Scholar
  12. 12.
    A. Pentland and S. Sclaroff. Closed-form solutions for physically based shape modelling and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13 (7): 715–729, July 1991.CrossRefGoogle Scholar
  13. 13.
    L.A. Tang and T.S. Huang. Quantifying facial expressions: smiles. In Proceedings of the Workshop Journee INRIA Analyse/Synthèse d’Images, pages 22–27, Paris, France, Janvier 1994.Google Scholar
  14. 14.
    D. Terzopoulos and M. Vasilescu. Sampling and reconstruction with adaptive meshes. In Proceedings CVPR ‘81, Lahaina, Maui, Hawai, pages 70–75. IEEE, June 1991.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1995

Authors and Affiliations

  • Serge Benayoun
    • 1
  • Chahab Nastar
    • 2
  • Nicholas Ayache
    • 1
  1. 1.Epidaure Project, INRIASophia Antipolis CedexFrance
  2. 2.Perceptual Computing Section, The Media LaboratoryMITCambridgeUSA

Personalised recommendations