Abstract
There have been important accomplishments in the computational analysis of the recovery of information about three-dimensional relationships in the environment from dynamic two-dimensional images. As an achievement in artificial intelligence and as a significant application to robotics, these results stand by themselves. There has been increasing interest, however, in applying these analyses to the study of human visual perception. The question of applicability of a particular computational analysis to human vision is an empirical one, and one that can only be answered through rigorous empirical research. In this chapter, I will review the current status of empirical research that addresses four issues of relevance to motion understanding. The first issue is whether there are two paths to the recovery of three-dimensional structure from motion: (a) one that proceeds from the primal sketch to a viewer-centered 2 1/2 dimensional sketch to an object-centered 3-dimensional model as proposed by Marr (1982), and (b) a direct path from the primal sketch to an object-centered representation, with viewer-centered information added from separate sources. The second issue is whether the solution to the correspondence problem must precede the extraction of structure from motion. The third issue is the now familiar controversy in the perception literature about whether a rigidity constraint plays a central role in the recovery of structure from motion.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Andersen, G.J., (1986) ‘The perception of self-motion: Psychophysical and computational approaches,’ Psychological Bulletin, vol. 99, pp. 52–65.
Andersen, G.J., and Braunstein, M.L., (1983a) ‘Dynamic occlusion in the perception of rotation in depth,’ Perception and Psychophysics, vol. 34, pp. 356–362.
Andersen, G.J., and Braunstein, M.L., (1983b) ‘The perception of self-motion from stimulation of the central visual field,’ Investigative Ophthalmology and Visual Science, vol. 24, (Sup. 3), pp. 278.
Andersen, G.J., and Braunstein, M.L., (1985) ‘Induced self-motion in central vision,’ J. of Experimental Psychology: Human Perception and Performance, vol. 11, pp. 122–132.
Bennett, B. and Hoffman, D., (1985) ‘The computation of structure from fixed axis motion: Nonrigid structures,’ Biological Cybernetics,vol. 51, pp. 293–300.
Braunstein, M.L., (1966) ‘Sensitivity of the observer to transformations of the visual field,’ J. of Experimental Psychology, vol. 72, pp. 683–687.
Braunstein, M.L., (1968) ‘Motion and texture as sources of slant information,’ J. of Experimental Psychology, vol. 78, pp. 247–253.
Braunstein, M.L., (1977a) ‘Minimal conditions for the perception of rotary motion,’ Scandinavian J. of Psychology, vol. 18, pp. 216–223.
Braunstein, M.L., (1977b) ‘Perceived direction of rotation of simulated three-dimensional patterns,’ Perception and Psychophysics, vol. 21, pp. 553–557.
Braunstein, M.L., (1986) ‘Dynamic stereo displays for research on the recovery of three-dimensional structure,’ Behavior Research Methods, Instruments, and Computers, vol. 18, pp. 522–530.
Braunstein, M.L., and Andersen, G.J., (1981) ‘Velocity gradients and relative depth perception,’ Perception and Psychophysics, vol. 29, pp. 145–155.
Braunstein, M.L., and Andersen, G.J., (1984a) ‘A counterexample to the rigidity assumption in the perception of structure from motion,’ Perception, vol. 13, pp. 213–217.
Braunstein, M.L., and Andersen, G.J., (1984b) ‘Shape and depth perception from parallel projections of three-dimensional motion,’ J. of Experimental Psychology: Human Perception and Performance, vol. 10, pp. 749–760.
Braunstein, M.L., and Andersen, G.J., (1986) ‘Testing the rigidity assumption: A reply to Ullman,’ Perception, vol. 15, pp. 641–644.
Braunstein, M.L., Andersen, G.J., and Riefer, D.M., (1982) ‘The use of occlusion to resolve ambiguity in parallel projections,’ Perception and Psychophysics, vol. 31, pp. 261–267.
Duncan, F., (1975) ‘Kinetic art: On my psychokinematic objects,’ Leonardo, vol. 8, pp. 97–101.
Farber, J.M., and McConkie, A.B., (1979) ‘Optical motion as information for unsigned depth,’ J. of Experimental Psychology: Human Perception and Performance, vol. 5, pp. 494–500.
Flock, H. R., (1964) ‘Some conditions sufficient for accurate monocular perceptions of moving surfaces slants,’ J. of Experimental Psychology, vol. 67, pp. 560–572.
Gibson, E.J., Gibson, J.J., Smith, O.W., and Flock, H., (1959) ‘Motion parallax as a determinant of perceived depth,’ J. of Experimental Psychologyvol. 58, pp. 40–51.
Gibson, J.J., (1950) The Perception of the Visual World, Houghton Mifflin, Boston.
Gibson, J.J., (1966) The Senses Considered as Perceptual Systems, Houghton Mifflin Company, Boston.
Gibson, J.J., (1979) An Ecological Approach to Perception, Houghton Mifflin, Boston.
Hildreth, E.C., (1984) The Measurement of Visual Motion, MIT Press, Cambridge, MA.
Hoffman, D., and Bennett, B., (1985) ‘Inferring the relative 3-D positions of two moving points,’ J. of the Optical Society of America,vol. 75, pp. 350–533.
Hoffman, D., and Bennett, B., (in press) ‘Visual representations: Meaning and truth conditions,’ in S. Steele and S. Schiffer (eds.)The Second Arizona Colloquia on Cognitive Science,University of Arizona Press.
Horn, B.K.P., and Schunck, B.G., (1981) ‘Determining optical flow,’ Artificial Intelligence, vol. 7, pp. 185–203.
Jansson, G., and Johansson, G., (1973) ‘Visual perception of bending motion,’ Perception, vol. 2, pp. 321–326.
Johansson, G., (1964) ‘Perception of motion and changing form,’ Scandinavian J. of Psychology, vol. 5, pp. 171–208.
Koenderink,J., and van Doorn,A.,(1976)’The singularities of the visual mapping,’ Biological Cyberneticsvol. 24, pp. 51–59.
Koenderink, J., and van Doom, A., (1980) ‘Photometric invariants related to solid shape,’ Optica Acta, vol. 7, pp. 981–996.
Koenderink, J., and van Doom, A., (1982) ‘Perception of solid shape and lay-out through photometric invariants,’ in R. Trappl (ed.), Cybernetics and Systems Research, North-Holland, Amsterdam, pp. 943–948.
Marr, D., (1982) Vision, Freeman, San Francisco.
Marr, D., and Nishihara, H.K., (1978) ‘Representation and recognition of the spatial organization of three-dimensional shapes,’ Proc. Royal Society of London, vol. B 200, pp. 269–294.
Prazdny, K., (1983) ‘A sketch of a (computational) theory of visual kinesthesis,’ in J. Beck, B. Hope, and A. Rosenfeld (eds.), Human and Machine Vision, Academic Press, New York, pp. 413–423.
Proffitt, D.R., Bertenthal, B.I., and Roberts, R.J., (1984) ‘The role of occlusion in reducing multistability in moving point-light displays,’ Perception and Psychophysics, vol. 36, pp. 315–323.
Rogers, B., and Graham, M., (1979) ‘Motion parallax as an independent cue for depth perception,’ Perception, vol. 8, pp. 125–134.
Schwartz, B.J., and Sperling, G., (1983) ‘Nonrigid 3D percepts from 2D representations of rigid objects,’ Investigative Ophthamology and Visual Science, vol. 24, (Sup. 3), pp. 239.
Sedgwick, H.A., (1983) ‘Environment-centered representation of spatial layout: Available visual information from texture and perspective,’ in J. Beck, B. Hope, and A. Rosenfeld (eds.), Human and Machine Vision, Academic Press, New York, pp. 425–458.
Sperling, G., Pavel, M., Cohen, Y., Landy, M.S., and Schwartz, B.J., (1983) ‘Image processing in perception and cognition,’ in O.J. Brad-dick and A.C. Sleigh (eds.), Physical and Biological Processing of Images, Springer-Verlag, Berlin, pp. 359–378.
Todd, J., (1982) ‘Visual information about rigid and nonrigid motion: A geometric analysis,’ J. of Experimental Psychology: Human Perception and Performance, vol. 8, pp. 238–252.
Todd, J., (1984) ‘The perception of three-dimensional structure from rigid and nonrigid motion,’ Perception and Psychophysics, vol. 36, pp. 97–103.
Todd, J., (1985) ‘The perception of structure from motion: Is projective correspondence of moving elements a necessary condition?,’ J. of Experimental Psychology: Human Perception and Performance, vol. 11, pp. 689–710.
Ullman, S., (1979) The Interpretation of Visual Motion, MIT Press, Cambridge, MA.
Ullman, S.,(1984) ‘Rigidity and misperceived motion,’ Perception,vol. 13, pp. 218–219.
Wallach, H., and O’Connell, D.N., (1953) ‘The kinetic depth effect,’ J. of Experimental Psychology, vol. 45, pp. 205–217.
Webb, J.A., and Aggarwal, J.K., (1981) ‘Visually interpreting the motion of objects in space,’ Computer, vol. 14, no. 8, pp. 40–46.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1988 Kluwer Academic Publishers
About this chapter
Cite this chapter
Braunstein, M.L. (1988). The Empirical Study of Structure from Motion. In: Martin, W.N., Aggarwal, J.K. (eds) Motion Understanding. The Kluwer International Series in Engineering and Computer Science, vol 44. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1071-6_4
Download citation
DOI: https://doi.org/10.1007/978-1-4613-1071-6_4
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4612-8413-0
Online ISBN: 978-1-4613-1071-6
eBook Packages: Springer Book Archive