Skip to main content

Physically-Based Fusion of Visual Data over Space, Time, and Scale

  • Conference paper
Multisensor Fusion for Computer Vision

Part of the book series: NATO ASI Series ((NATO ASI F,volume 99))

Abstract

This paper surveys an approach to data fusion that makes use of computational physics. Partial, noisy, multisensory data acquired at different spatial positions, at different instants in time, and/or at different scales of resolution are transformed into nonlinear force fields. The force fields act on deformable models, whose physical behaviors are governed by the continuum mechanical equations of deformable bodies. Reacting dynamically to the net external forces, deformable models integrate, interpolate, and regularize all the incoming data into a globally consistent interpretation. Physically-based fusion has seen successful application to several vision problems: image contour extraction, stereo and motion matching, visual surface reconstruction, and the recovery of 3D shape and nonrigid motion from dynamic stereo imagery.

The author is a Fellow of the Canadian Institute for Advanced Research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Terzopoulos, D., and Fleischer, K., “Deformable Models,” The Visual Computer, 4, 1988, 306–331.

    Article  Google Scholar 

  2. Terzopoulos, D., “Integrating visual information from multiple sources,” From Pixels to Predicates, A.P. Pentland (ed.), Ablex, Norwood, NJ, 1986.

    Google Scholar 

  3. Terzopoulos, D., “On matching deformable models to images,” Topical Meeting on Machine Vision, Technical Digest Series, Vol. 12., Optical Society of America, Washington, DC, 1987, 160–167; also TR No. 60, Schlumberger Palo Alto Research, Nov., 1986.

    Google Scholar 

  4. Terzopoulos, D., “Multilevel computational processes for visual surface reconstruction,” Computer Vision, Graphics, and Image Processing, 24, 1983, 52–96.

    Google Scholar 

  5. Terzopoulos, D., “The role of constraints and discontinuities in visible-surface reconstruction,” Proc. 8th Int. J. Conf. AI, Karlsruhe, W. Germany, 1983, 1073–1077.

    Google Scholar 

  6. Terzopoulos, D., “The computation of visible-surface representations,” IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-10, 1988, 417–438.

    Google Scholar 

  7. Terzopoulos, D., “Regularization of inverse visual problems involving discontinuities,” IEEE Transactions on Pattern Analysis and Machine Intelligence,PAMI-8, 1986, 413424.

    Google Scholar 

  8. Terzopoulos, D., Witkin, A., and Kass, M., “Stereo matching as constrained optimization using scale continuation methods,” Optical and Digital Pattern Recognition (Proc. SPIE 754), 1I-K. Liu and P.S. Schenker (ed.), 1987, 92–99.

    Google Scholar 

  9. Witkin, A., Terzopoulos, D., and Kass, M., “Signal matching through scale space,” International Journal of Computer Vision, 1, 1987, 133–144.

    Article  Google Scholar 

  10. Terzopoulos, D., Witkin, A., and Kass, M., “Symmetry-seeking models and 3D object reconstruction,” International Journal of Computer Vision, 1, 1987, 211–221.

    Article  Google Scholar 

  11. Kass, M., Witkin, A., and Terzopoulos, D., “Snakes: Active contour models,” International Journal of Computer Vision, 1, 1987, 321–331.

    Article  Google Scholar 

  12. Terzopoulos, D., Witkin, A., and Kass, M., “Constraints on deformable models: Recovering 3D shape and nonrigid motion,” Artificial Intelligence, 35, 1988, 91–123.

    Article  Google Scholar 

  13. Terzopoulos, D., “Image analysis using multigrid relaxation methods,” IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8, 1986, 129–139.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1993 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Terzopoulos, D. (1993). Physically-Based Fusion of Visual Data over Space, Time, and Scale. In: Aggarwal, J.K. (eds) Multisensor Fusion for Computer Vision. NATO ASI Series, vol 99. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-02957-2_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-02957-2_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-08135-4

  • Online ISBN: 978-3-662-02957-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics