In this paper we present the first implementation of a new medium for telecollaboration. The realized testbed consists of two tele-cubicles at two Internet nodes. At each telecubicle a stereo-rig is used to provide an accurate dense 3D-reconstruction of a person in action. The two real dynamic worlds are transmitted over the network and visualized stereoscopically. The full-3D information facilitates interaction with any virtual object, demonstrating in an optimal way the confluence of graphics, vision, and communication.
In particular, the remote communication and the dynamic nature of telecollaboration put the challenge of optimal representation for graphics and vision. We treat the issues of limited bandwidth, latency, and processing power with a tunable 3D-representation where the user can choose the trade-off between delay and 3D-resolution by tuning the spatial resolution, the size of the working volume, and the uncertainty of reconstruction. Due to the limited number of cameras and displays our system can not provide the user with a surround-immersive feeling. However, it is the first system that uses 3D-real-data that are reconstructed online at another site. The system has been implemented with low-cost off-the-shelf hardware and has been successfully demonstrated in a local area network.
KeywordsAugmented Reality Stereo Vision Stereo Match Epipolar Line Correlation Window
Unable to display preview. Download preview PDF.
- N. Ayache and C. Hansen. Rectification of images for binocular and trinocular stereovision. In Proc. of 9th International Conference on Pattern Recognition, volume 1, pages 11–16, 1988.Google Scholar
- E. Chen and L. Williams. View interpolation for image synthesis. In ACM SIGGRAPH, pages 279–288, 1993.Google Scholar
- F. Devernay. Computing differential properties of 3-D shapes from stereoscopic images without 3-D models. Technical Report RR-2304, INRIA, Sophia Antipolis, 1994.Google Scholar
- O. Faugeras. Three-dimensional Computer Vision. MIT Press, Cambridge, MA, 1993.Google Scholar
- K. Konolige. Small vision system: Hardware and implementation. In Eighth International Symposium on Robotics Research, Hayama, Japan, pages 203–212, 1997.Google Scholar
- K. Kutulakos and J. Vallino. Calibration-free augmented reality. IEEE Trans, on Visualization and Computer Graphics, 4(l):l–20, 1998.Google Scholar
- M. Macedonia and S. Noll. Real-time 60hz distortion correction on a silicon graphics IG. IEEE Computer Graphics and Applications, 5:76–82, 1998.Google Scholar
- S. Maybank and O. Faugeras. A theory of self-calibration of a moving camera. Intl. J. of Computer Vision, 8(2):123—151, 1992.Google Scholar
- H. Moravec. Robot rover visual navigation. Computer Science: Artificial Intelligence, pages 105–108, 1980/1981.Google Scholar
- P. Narayanan, P. Ränder, and T. Kanade. Constructing virtual worlds using dense stereo. In Proc, Intl. Conf. Computer Vision ICCV98, pages 3–10, 1998.Google Scholar
- D. Scharstein and R. Szeliski. Stereo matching with non-linear diffusion. In Proc. Int. Conf. Computer Vision and Pattern Recognition, pages 343–350. IEEE Computer Society, 1996.Google Scholar
- S. M. Seitz and C. R. Dyer. View morphing. In ACM SIGGRAPH, pages 21–30, 1996.Google Scholar
- C. Tomasi and R. Manduchi. Stereo without search. In Proc. European Conf. Computer Vision, pages 452–465, Cambridge, UK, 1996.Google Scholar
- J. Woodfill and B. Von Herzen. Real time stereo vision on the PARTS reconfigurable computer. In IEEE Workshop on FPGAs for Custom Computing Machines, pages 201–210, 1997.Google Scholar
- A. Yuille and T. Poggio. A generalized ordering constraint for stereo correspondence. AI Lab Memo 777, MIT, 1984.Google Scholar