Visual Observation of a Moving Agent
We address the problem of observing a moving agent. In particular, we propose a system for observing a manipulation process, where a robot hand manipulates an object. A discrete event dynamic system (DEDS) frame work is developed for the hand/object interaction over time and a stabilizing observer is constructed. Low-level modules are developed for recognizing the “events” that causes state transitions within the dynamic manipulation system. The work examines closely the possibilities for errors, mistakes and uncertainties in the manipulation system, observer construction process and event identification mechanisms. The system utilizes different tracking techniques in order to observe and recognize the task in an active, adaptive and goal-directed manner.
KeywordsImage Flow Displacement Error Manipulation System Robot Hand Manipulation Action
Unable to display preview. Download preview PDF.
- P. Anandan, “A Unified Perspective on Computational Techniques for the Measurement of Visual Motion”. In Proceedings of the l St International Conference on Computer Vision, 1987.Google Scholar
- R. Bajcsy and T. M. Sobh, A Framework for Observing a Manipulation Process. Technical Report MS-CIS-90–34 and GRASP Lab. TR 216, University of Pennsylvania, June 1990.Google Scholar
- R. Bajcsy and T. M. Sobh, Observing a Moving Agent. Technical Report MSCIS-91–01 and GRASP Lab. TR 247, Computer Science Dept., School of Engineering and Applied Science, University of Pennsylvania, January 1991.Google Scholar
- P. J. Burt, et al., “Object Tracking with a Moving Camera”, IEEE Workshop on Visual Motion, March 1989.Google Scholar
- Y. Li and W. M. Wonham, “Controllability and Observability in the State-Feedback Control of Discrete-Event Systems”, Proc. 27th Conf. on Decision and Control, 1988.Google Scholar
- H. C. Longuet-Higgins and K. Prazdny, The interpretation of a moving Retinal Image, Proc. Royal Society of London B, 208, 385–397.Google Scholar
- C. M. Ozveren, Analysis and Control of Discrete Event Dynamic Systems: A State Space Approach, Ph.D. Thesis, Massachusetts Institute of Technology, August 1989.Google Scholar
- P. J. Ramadge and W. M. Wonham, “Modular Feedback Logic for Discrete Event Systems”, SIAM Journal of Control and Optimization, September 1987.Google Scholar
- T. M. Sobh and K. Wohn, “Recovery of 3-D Motion and Structure by Temporal Fusion”. In Proceedings of the 2nd SPIE Conference on Sensor Fusion, November 1989.Google Scholar
- M. Subbarao and A. M. Waxman, On The Uniqueness of Image Flow Solutions for Planar Surfaces in Motion, CAR—TR-113, Center for Automation Research, University of Maryland, April 1985.Google Scholar
- S. Ullman, “Analysis of Visual Motion by Biological and Computer Systems”, IEEE Computer, August 1981.Google Scholar
- S. Ullman, Maximizing Rigidity: The incremental recovery of 3-D structure from rigid and rubbery motion, AI Memo 721, MIT AI lab. 1983.Google Scholar