Skip to main content

The Empirical Study of Structure from Motion

  • Chapter

Part of the book series: The Kluwer International Series in Engineering and Computer Science ((SECS,volume 44))

Abstract

There have been important accomplishments in the computational analysis of the recovery of information about three-dimensional relationships in the environment from dynamic two-dimensional images. As an achievement in artificial intelligence and as a significant application to robotics, these results stand by themselves. There has been increasing interest, however, in applying these analyses to the study of human visual perception. The question of applicability of a particular computational analysis to human vision is an empirical one, and one that can only be answered through rigorous empirical research. In this chapter, I will review the current status of empirical research that addresses four issues of relevance to motion understanding. The first issue is whether there are two paths to the recovery of three-dimensional structure from motion: (a) one that proceeds from the primal sketch to a viewer-centered 2 1/2 dimensional sketch to an object-centered 3-dimensional model as proposed by Marr (1982), and (b) a direct path from the primal sketch to an object-centered representation, with viewer-centered information added from separate sources. The second issue is whether the solution to the correspondence problem must precede the extraction of structure from motion. The third issue is the now familiar controversy in the perception literature about whether a rigidity constraint plays a central role in the recovery of structure from motion.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Andersen, G.J., (1986) ‘The perception of self-motion: Psychophysical and computational approaches,’ Psychological Bulletin, vol. 99, pp. 52–65.

    Article  Google Scholar 

  • Andersen, G.J., and Braunstein, M.L., (1983a) ‘Dynamic occlusion in the perception of rotation in depth,’ Perception and Psychophysics, vol. 34, pp. 356–362.

    Article  Google Scholar 

  • Andersen, G.J., and Braunstein, M.L., (1983b) ‘The perception of self-motion from stimulation of the central visual field,’ Investigative Ophthalmology and Visual Science, vol. 24, (Sup. 3), pp. 278.

    Google Scholar 

  • Andersen, G.J., and Braunstein, M.L., (1985) ‘Induced self-motion in central vision,’ J. of Experimental Psychology: Human Perception and Performance, vol. 11, pp. 122–132.

    Article  Google Scholar 

  • Bennett, B. and Hoffman, D., (1985) ‘The computation of structure from fixed axis motion: Nonrigid structures,’ Biological Cybernetics,vol. 51, pp. 293–300.

    Article  MathSciNet  MATH  Google Scholar 

  • Braunstein, M.L., (1966) ‘Sensitivity of the observer to transformations of the visual field,’ J. of Experimental Psychology, vol. 72, pp. 683–687.

    Article  Google Scholar 

  • Braunstein, M.L., (1968) ‘Motion and texture as sources of slant information,’ J. of Experimental Psychology, vol. 78, pp. 247–253.

    Article  Google Scholar 

  • Braunstein, M.L., (1977a) ‘Minimal conditions for the perception of rotary motion,’ Scandinavian J. of Psychology, vol. 18, pp. 216–223.

    Article  Google Scholar 

  • Braunstein, M.L., (1977b) ‘Perceived direction of rotation of simulated three-dimensional patterns,’ Perception and Psychophysics, vol. 21, pp. 553–557.

    Article  Google Scholar 

  • Braunstein, M.L., (1986) ‘Dynamic stereo displays for research on the recovery of three-dimensional structure,’ Behavior Research Methods, Instruments, and Computers, vol. 18, pp. 522–530.

    Article  Google Scholar 

  • Braunstein, M.L., and Andersen, G.J., (1981) ‘Velocity gradients and relative depth perception,’ Perception and Psychophysics, vol. 29, pp. 145–155.

    Article  Google Scholar 

  • Braunstein, M.L., and Andersen, G.J., (1984a) ‘A counterexample to the rigidity assumption in the perception of structure from motion,’ Perception, vol. 13, pp. 213–217.

    Article  Google Scholar 

  • Braunstein, M.L., and Andersen, G.J., (1984b) ‘Shape and depth perception from parallel projections of three-dimensional motion,’ J. of Experimental Psychology: Human Perception and Performance, vol. 10, pp. 749–760.

    Article  Google Scholar 

  • Braunstein, M.L., and Andersen, G.J., (1986) ‘Testing the rigidity assumption: A reply to Ullman,’ Perception, vol. 15, pp. 641–644.

    Google Scholar 

  • Braunstein, M.L., Andersen, G.J., and Riefer, D.M., (1982) ‘The use of occlusion to resolve ambiguity in parallel projections,’ Perception and Psychophysics, vol. 31, pp. 261–267.

    Article  Google Scholar 

  • Duncan, F., (1975) ‘Kinetic art: On my psychokinematic objects,’ Leonardo, vol. 8, pp. 97–101.

    Article  Google Scholar 

  • Farber, J.M., and McConkie, A.B., (1979) ‘Optical motion as information for unsigned depth,’ J. of Experimental Psychology: Human Perception and Performance, vol. 5, pp. 494–500.

    Article  Google Scholar 

  • Flock, H. R., (1964) ‘Some conditions sufficient for accurate monocular perceptions of moving surfaces slants,’ J. of Experimental Psychology, vol. 67, pp. 560–572.

    Article  Google Scholar 

  • Gibson, E.J., Gibson, J.J., Smith, O.W., and Flock, H., (1959) ‘Motion parallax as a determinant of perceived depth,’ J. of Experimental Psychologyvol. 58, pp. 40–51.

    Article  Google Scholar 

  • Gibson, J.J., (1950) The Perception of the Visual World, Houghton Mifflin, Boston.

    Google Scholar 

  • Gibson, J.J., (1966) The Senses Considered as Perceptual Systems, Houghton Mifflin Company, Boston.

    Google Scholar 

  • Gibson, J.J., (1979) An Ecological Approach to Perception, Houghton Mifflin, Boston.

    Google Scholar 

  • Hildreth, E.C., (1984) The Measurement of Visual Motion, MIT Press, Cambridge, MA.

    Google Scholar 

  • Hoffman, D., and Bennett, B., (1985) ‘Inferring the relative 3-D positions of two moving points,’ J. of the Optical Society of America,vol. 75, pp. 350–533.

    MathSciNet  Google Scholar 

  • Hoffman, D., and Bennett, B., (in press) ‘Visual representations: Meaning and truth conditions,’ in S. Steele and S. Schiffer (eds.)The Second Arizona Colloquia on Cognitive Science,University of Arizona Press.

    Google Scholar 

  • Horn, B.K.P., and Schunck, B.G., (1981) ‘Determining optical flow,’ Artificial Intelligence, vol. 7, pp. 185–203.

    Article  Google Scholar 

  • Jansson, G., and Johansson, G., (1973) ‘Visual perception of bending motion,’ Perception, vol. 2, pp. 321–326.

    Article  Google Scholar 

  • Johansson, G., (1964) ‘Perception of motion and changing form,’ Scandinavian J. of Psychology, vol. 5, pp. 171–208.

    Article  Google Scholar 

  • Koenderink,J., and van Doorn,A.,(1976)’The singularities of the visual mapping,’ Biological Cyberneticsvol. 24, pp. 51–59.

    Article  MATH  Google Scholar 

  • Koenderink, J., and van Doom, A., (1980) ‘Photometric invariants related to solid shape,’ Optica Acta, vol. 7, pp. 981–996.

    Google Scholar 

  • Koenderink, J., and van Doom, A., (1982) ‘Perception of solid shape and lay-out through photometric invariants,’ in R. Trappl (ed.), Cybernetics and Systems Research, North-Holland, Amsterdam, pp. 943–948.

    Google Scholar 

  • Marr, D., (1982) Vision, Freeman, San Francisco.

    Google Scholar 

  • Marr, D., and Nishihara, H.K., (1978) ‘Representation and recognition of the spatial organization of three-dimensional shapes,’ Proc. Royal Society of London, vol. B 200, pp. 269–294.

    Article  Google Scholar 

  • Prazdny, K., (1983) ‘A sketch of a (computational) theory of visual kinesthesis,’ in J. Beck, B. Hope, and A. Rosenfeld (eds.), Human and Machine Vision, Academic Press, New York, pp. 413–423.

    Google Scholar 

  • Proffitt, D.R., Bertenthal, B.I., and Roberts, R.J., (1984) ‘The role of occlusion in reducing multistability in moving point-light displays,’ Perception and Psychophysics, vol. 36, pp. 315–323.

    Article  Google Scholar 

  • Rogers, B., and Graham, M., (1979) ‘Motion parallax as an independent cue for depth perception,’ Perception, vol. 8, pp. 125–134.

    Article  Google Scholar 

  • Schwartz, B.J., and Sperling, G., (1983) ‘Nonrigid 3D percepts from 2D representations of rigid objects,’ Investigative Ophthamology and Visual Science, vol. 24, (Sup. 3), pp. 239.

    Google Scholar 

  • Sedgwick, H.A., (1983) ‘Environment-centered representation of spatial layout: Available visual information from texture and perspective,’ in J. Beck, B. Hope, and A. Rosenfeld (eds.), Human and Machine Vision, Academic Press, New York, pp. 425–458.

    Google Scholar 

  • Sperling, G., Pavel, M., Cohen, Y., Landy, M.S., and Schwartz, B.J., (1983) ‘Image processing in perception and cognition,’ in O.J. Brad-dick and A.C. Sleigh (eds.), Physical and Biological Processing of Images, Springer-Verlag, Berlin, pp. 359–378.

    Google Scholar 

  • Todd, J., (1982) ‘Visual information about rigid and nonrigid motion: A geometric analysis,’ J. of Experimental Psychology: Human Perception and Performance, vol. 8, pp. 238–252.

    Article  Google Scholar 

  • Todd, J., (1984) ‘The perception of three-dimensional structure from rigid and nonrigid motion,’ Perception and Psychophysics, vol. 36, pp. 97–103.

    Article  Google Scholar 

  • Todd, J., (1985) ‘The perception of structure from motion: Is projective correspondence of moving elements a necessary condition?,’ J. of Experimental Psychology: Human Perception and Performance, vol. 11, pp. 689–710.

    Article  Google Scholar 

  • Ullman, S., (1979) The Interpretation of Visual Motion, MIT Press, Cambridge, MA.

    Google Scholar 

  • Ullman, S.,(1984) ‘Rigidity and misperceived motion,’ Perception,vol. 13, pp. 218–219.

    Google Scholar 

  • Wallach, H., and O’Connell, D.N., (1953) ‘The kinetic depth effect,’ J. of Experimental Psychology, vol. 45, pp. 205–217.

    Article  Google Scholar 

  • Webb, J.A., and Aggarwal, J.K., (1981) ‘Visually interpreting the motion of objects in space,’ Computer, vol. 14, no. 8, pp. 40–46.

    Article  Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Kluwer Academic Publishers

About this chapter

Cite this chapter

Braunstein, M.L. (1988). The Empirical Study of Structure from Motion. In: Martin, W.N., Aggarwal, J.K. (eds) Motion Understanding. The Kluwer International Series in Engineering and Computer Science, vol 44. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1071-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-1071-6_4

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4612-8413-0

  • Online ISBN: 978-1-4613-1071-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics