Advertisement

Providing Immersive Virtual Experience with First-Person Perspective Omnidirectional Movies and Three Dimensional Sound Field

  • Kazuaki Kondo
  • Yasuhiro Mukaigawa
  • Yusuke Ikeda
  • Seigo Enomoto
  • Shiro Ise
  • Satoshi Nakamura
  • Yasushi Yagi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6773)

Abstract

Providing high immersive feeling to audiences has proceeded with growing up of techniques about video and acoustic medias. In our proposal, we record and reproduce omnidirectional movies captured at a perspective of an actor and three dimensional sound field around him, and try to reproduce more impressive feeling. We propose a sequence of techniques to archive it, including a recording equipment, video and acoustic processing, and a presentation system. Effectiveness and demand of our system has been demonstrated by ordinary people through evaluation experiments.

Keywords

First-person Perspective Omnidirectional Vision Three Dimensional Sound Reproduction Boundary Surface Control Principle 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Cruz-Neria, C., Sandin, D.J., DeFanti, T.A.: Surround-Screen Projectorion-Based Virtual Reality: The Design and Implementation of the CAVE. In: Proc. of Int. Conf. on Computer Graphics and Interactive Techniques (SIGGRAPH 1993), pp. 135–142 (1993)Google Scholar
  2. 2.
    Ise, S.: A principle of active control of sound based on the Kirchhoff-Helmholtz integral equation and the inverse system theory. The Journal of Acoustical Society of Japan 53(9), 706–713 (1997)Google Scholar
  3. 3.
    Hashimoto, W., Iwata, H.: Ensphered vision: Spherical immersive display using convex mirror. Trans. of the Virtual Reality Society of Japan 4(3), 479–486 (1999)Google Scholar
  4. 4.
    Kaminuma, A., Ise, S., Shikano, K.: Sound reproduction-system design considering head movement. Trans. of the Virtual Reality Society of Japan 5(3), 957–964 (2000) (in Japanese)Google Scholar
  5. 5.
    Yamazawa, K., Takemura, H., Yokoya, N.: Telepresence system with an omnidirectional HD camera. In: Proc. of Fifth Asian Conference on Computer Vision (ACCV 2002), vol. II, pp. 533–538 (2002)Google Scholar
  6. 6.
    Swaminathan, R., Nayar, S.K., Grossberg, M.D.: Designing of Mirrors for catadioptric systems that minimize image error. In: Proc. of IEEE Workshop on Omnidirectional Vision, OMNIVIS (2004)Google Scholar
  7. 7.
    Ikeda, S., Sato, T., Kanbara, M., Yokoya, N.: Immersive telepresence system with a locomotion interface using high-resolution omnidirectional videos. In: Proc. of IAPR Conf. on Machine Vision Applications (MVA), pp. 602–605 (2005)Google Scholar
  8. 8.
    Enomoto, S., Ikeda, Y., Ise, S., Nakamura, S.: Three-dimensional sound field reproduction and recording system based on the boundary surface control principle. In: The 14th Int. Conf. on Auditory Display, pp. o_16 (2008)Google Scholar
  9. 9.
    Azuma, H., Mukaigawa, Y., Yagi, Y.: Spatio-Temporal Lifelog Using a Wearable Compound Omnidirectional Sensor. In: Proc. of the Eighth Workshop on Omnidirectional Vision, Camera Networks and Non-classical Cameras, ONIVIS 2008 (2008)Google Scholar
  10. 10.
    Kondo, K., Mukaigawa, Y., Yagi, Y.: Wearable Imaging System for Capturing Omnidirectional Movies from a First-person Perspective. In: Proc. of The 16th ACM Symposium on Virtual Reality Software and Technology, VRST 2009 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Kazuaki Kondo
    • 1
  • Yasuhiro Mukaigawa
    • 2
  • Yusuke Ikeda
    • 3
  • Seigo Enomoto
    • 3
  • Shiro Ise
    • 4
  • Satoshi Nakamura
    • 3
  • Yasushi Yagi
    • 2
  1. 1.Academic Center for Computing and Media studiesKyoto UniversityKyotoJapan
  2. 2.The Institute of Scientific and Industrial ResearchOsaka UniversityIbaraki-shiJapan
  3. 3.Spoken Language Communication GroupNational Institute of Information and Communications TechnologyKeihanna Science CityJapan
  4. 4.Graduate school of engineering, Department of Architecture and architectural engineeringKyoto UniversityKyotoJapan

Personalised recommendations