Generation of Animated Stereo Panoramic Images for Image-Based Virtual Reality Systems

  • Fay Huang
  • Chih-Kai Chang
  • Zi-Xuan Lin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8333)


Panoramic image-based representation of real world environments has received much attention in virtual/augmented reality applications due to advantages such as shorter generation times, faster rendering speeds, higher photorealism, and less storage needed when compared to the 3D modeling approaches. In this paper, a novel approach is proposed for generating animated stereo panoramic images based on a single video sequence captured by a panning camera. The techniques involved include generating seamless stereo video textures, inpainting the unsatisfactory regions, and embedding video textures into stereo panoramic images. A player is also developed to provide user stereo visualization and real-time navigation of the image-based virtual environment that are featured with seamlessly-looping animated scenes. The quality of the generated animated stereo panoramic image is satisfactory for virtual reality applications and the computation time is acceptable for practical use.


Image-based virtual reality stereo panoramic imaging video inpainting video textures 


  1. 1.
    Agarwala, A., Zheng, C., Pal, C., Agrawala, M., Cohen, M., Curless, B., Salesin, D., Szeliski, R.: Panoramic video textures. In: Proc. SIGGRAPH 2005, Los Angeles, USA, pp. 821–827 (August 2005)Google Scholar
  2. 2.
    Chen, S.E.: QuickTimeVR - an image-based approach to virtual environment navigation. In: Proc. SIGGRAPH 1995, Los Angeles, California, USA, pp. 29–38 (August 1995)Google Scholar
  3. 3.
    Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. EEE Trans. Image Process. 13 (2004)Google Scholar
  4. 4.
    Finkelstein, A., Jacobs, C., Salesin, D.: Multiresolution video. In: Proc. SIGGRAPH 1996, New Orleans, Louisiana, USA, pp. 281–290 (August 1996)Google Scholar
  5. 5.
    Huang, F., Klette, R.: Astereo panorama acquisition and automatic image disparity adjustment for stereoscopic visualization. Multimedia Tools and Applications 47(3), 353–377 (2010)CrossRefGoogle Scholar
  6. 6.
    Huang, F., Yang, K.-M., Wei, Z.-J., Tsai, A., Tsai, J.-Y.: Animated Panorama from a Panning Video Sequence. In: Proc. IVCNZ 2010, Queenstown, New Zealand (November 2010)Google Scholar
  7. 7.
    Huang, F., Klette, R., Scheibe, K.: Panoramic Imaging: Sensor-Line Cameras and Laser Range-Finders. Wiley, West Sussex (2008)CrossRefGoogle Scholar
  8. 8.
    Irani, M., Anandan, P.: Video indexing based on mosaic representation. In: Proc. IEEE 1986 (1986)Google Scholar
  9. 9.
    Kimber, D., Foote, J., Lertsithichai, S.: Flyabout: spatially indexed panoramic video. In: Proc. ACM MULTIMEDIA 2001, New York, NY, USA, pp. 339–347 (2001)Google Scholar
  10. 10.
    Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. In: Proc. SIGGRAPH 2003, San Diego, California, USA, pp. 277–286 (July 2003)Google Scholar
  11. 11.
    Nayar, S.: Catadioptic omnidirectional cameras. In: Proc. CVPR 1997, San Jaun, Puerto Rico, USA, pp. 482–488 (June 1997)Google Scholar
  12. 12.
    Neumann, U., Pintaric, T., Rizzo, A.: Immersive panoramic video. In: Proc. ACM MULTIMEDIA 2000, New York, NY, USA, pp. 493–494 (2000)Google Scholar
  13. 13.
    Peleg, S., Ben-Ezra, M.: Stereo panorama with a single camera. In: Proc. CVPR 1999, Fort Collins, Colorado, USA, pp. 395–401 (June 1999)Google Scholar
  14. 14.
    Schödl, A., Szeliski, R., Salesin, D.H., Essa, I.: Video textures. In: Proc. SIGGRAPH 2000, New Orleans, Louisiana, USA, pp. 489–498 (July 2000)Google Scholar
  15. 15.
    Shum, H.-Y., He, L.-W.: Rendering with concentric mosaics. In: Proc. SIGGRAPH 1999, Los Angeles, California, USA, pp. 299–306 (August 1999)Google Scholar
  16. 16.
    Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Fay Huang
    • 1
  • Chih-Kai Chang
    • 1
  • Zi-Xuan Lin
    • 1
  1. 1.Department of Computer Science and Information EngineeringNational Ilan UniversityYi-LanTaiwan, R.O.C.

Personalised recommendations