Providing Immersive Virtual Experience with First-Person Perspective Omnidirectional Movies and Three Dimensional Sound Field
Providing high immersive feeling to audiences has proceeded with growing up of techniques about video and acoustic medias. In our proposal, we record and reproduce omnidirectional movies captured at a perspective of an actor and three dimensional sound field around him, and try to reproduce more impressive feeling. We propose a sequence of techniques to archive it, including a recording equipment, video and acoustic processing, and a presentation system. Effectiveness and demand of our system has been demonstrated by ordinary people through evaluation experiments.
KeywordsFirst-person Perspective Omnidirectional Vision Three Dimensional Sound Reproduction Boundary Surface Control Principle
Unable to display preview. Download preview PDF.
- 1.Cruz-Neria, C., Sandin, D.J., DeFanti, T.A.: Surround-Screen Projectorion-Based Virtual Reality: The Design and Implementation of the CAVE. In: Proc. of Int. Conf. on Computer Graphics and Interactive Techniques (SIGGRAPH 1993), pp. 135–142 (1993)Google Scholar
- 2.Ise, S.: A principle of active control of sound based on the Kirchhoff-Helmholtz integral equation and the inverse system theory. The Journal of Acoustical Society of Japan 53(9), 706–713 (1997)Google Scholar
- 3.Hashimoto, W., Iwata, H.: Ensphered vision: Spherical immersive display using convex mirror. Trans. of the Virtual Reality Society of Japan 4(3), 479–486 (1999)Google Scholar
- 4.Kaminuma, A., Ise, S., Shikano, K.: Sound reproduction-system design considering head movement. Trans. of the Virtual Reality Society of Japan 5(3), 957–964 (2000) (in Japanese)Google Scholar
- 5.Yamazawa, K., Takemura, H., Yokoya, N.: Telepresence system with an omnidirectional HD camera. In: Proc. of Fifth Asian Conference on Computer Vision (ACCV 2002), vol. II, pp. 533–538 (2002)Google Scholar
- 6.Swaminathan, R., Nayar, S.K., Grossberg, M.D.: Designing of Mirrors for catadioptric systems that minimize image error. In: Proc. of IEEE Workshop on Omnidirectional Vision, OMNIVIS (2004)Google Scholar
- 7.Ikeda, S., Sato, T., Kanbara, M., Yokoya, N.: Immersive telepresence system with a locomotion interface using high-resolution omnidirectional videos. In: Proc. of IAPR Conf. on Machine Vision Applications (MVA), pp. 602–605 (2005)Google Scholar
- 8.Enomoto, S., Ikeda, Y., Ise, S., Nakamura, S.: Three-dimensional sound field reproduction and recording system based on the boundary surface control principle. In: The 14th Int. Conf. on Auditory Display, pp. o_16 (2008)Google Scholar
- 9.Azuma, H., Mukaigawa, Y., Yagi, Y.: Spatio-Temporal Lifelog Using a Wearable Compound Omnidirectional Sensor. In: Proc. of the Eighth Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras, ONIVIS 2008 (2008)Google Scholar
- 10.Kondo, K., Mukaigawa, Y., Yagi, Y.: Wearable Imaging System for Capturing Omnidirectional Movies from a First-person Perspective. In: Proc. of The 16th ACM Symposium on Virtual Reality Software and Technology, VRST 2009 (2009)Google Scholar