Abstract
This paper describes a method of stereoscopic view generation by image-based rendering in wide outdoor environments. The stereoscopic view can be generated from an omnidirectional image sequence by a light field rendering approach which generates a novel view image from a set of images. The conventional methods of novel view generation have a problem such that the generated image is distorted because the image is composed of parts of several omnidirectional images captured at different points. To overcome this problem, we have to consider the distances between the novel viewpoint and observed real objects in the rendering process. In the proposed method, in order to reduce the image distortion, stereoscopic images are generated considering depth values estimated by dynamic programming (DP) matching using the images that are observed from different points and contain the same ray information in the real world. In experiments, stereoscopic images in wide outdoor environments are generated and displayed.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full chapter text
Chapter PDF
References
Moezzi, S. (ed.): Special Issue on Immersive Telepresence, IEEE MultiMedia 4(1), 17–56 (1997)
El-Hakim, S.F., Brenner, C., Roth, G.: A Multi-sensor Approach to Creating Accurate Virtual Environments. Journal of Photogrammetry & Remote Sensing 53, 379–391 (1998)
Zhao, H., Shibasaki, R.: Reconstruction of Textured Urban 3D Model by Fusing Ground-Based Laser Range and CCD Images. IEICE Trans. Inf. & Syst. E-83-D(7), 1429–1440 (2000)
Asai, T., Kanbara, M., Yokoya, N.: 3D Modeling of Outdoor Environments by Integrating Omnidirectional Range and Color Images. In: Proc. Int. Conf. on 3-D Digital Imaging and Modeling (3DIM), pp. 447–454 (2005)
Adelson, E.H., Bergen, J.R.: The Plenoptic Function and the Elements of Early Vision. In: Landy, M., Movshon, J. (eds.) Computer Models of Visual Processing, pp. 3–20. MIT Press, Cambridge (1991)
McMillan, L., Bergen, J.: Plenoptic Modeling: An Image-Based Rendering System. In: Proc. SIGGRAPH’95, pp. 39–46 (1995)
Gortler, S., Grzeszczuk, R., Szeliski, R., Cohen, M.: The Lumigraph. In: Proc. SIGGRAPH’96, pp. 43–54. ACM Press, New York (1996)
Shum, H.Y., He, L.W.: Rendering with Concentric Mosaics. In: Proc. SIGGRAPH’99, pp. 299–306 (1999)
Chen, E.: QuickTime VR -An Image-Based Approach to Virtual Environment Navigation. In: Proc. SIGGRAPH’95, pp. 29–38. ACM, New York (1995)
Ikeda, S., Sato, T., Kanbara, M., Yokoya, N.: Immersive Telepresence System with a Locomotion Interface Using High-Resolution Omnidirectional Videos. In: Proc. IAPR Conf. on Machine Vision Applications, pp. 602–605 (2005)
Yamaguchi, K., Yamazawa, K., Takemura, H., Yokoya, N.: Real-Time Generation and Presentation of View-Dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images. In: Proc. 15th IAPR Int. Conf. on Pattern Recognition (ICPR2000), vol. IV, pp. 589–593 (2000)
Ono, S., Ogawara, K., Kagesawa, M., Kawasaki, H., Onuki, M., Honda, K., Ikeuchi, K.: Driving View Simulation Synthesizing Virtual Geometry and Real Images in an Experimental Mixed-Reality Traffic Space. In: Int. Sympo. on Mixed and Augmented Reality, pp. 214–215 (2005)
Levoy, M., Hanrahan, P.: Light Field Rendering. In: Proc. SIGGRAPH’96, pp. 31–42. ACM, New York (1996)
Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
Bellman, R., Dreyfus, S.: Applied Dynamic Programming. Princeton University Press, Princeton (1962)
Sakoe, H., Chida, S.: A Dynamic Programming Algorithm Optimization for Spoken Word Recognition. IEEE Trans. on Acoust. Speech and Signal Proc. 26(1), 43–49 (1978)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Hori, M., Kanbara, M., Yokoya, N. (2007). Novel Stereoscopic View Generation by Image-Based Rendering Coordinated with Depth Information. In: Ersbøll, B.K., Pedersen, K.S. (eds) Image Analysis. SCIA 2007. Lecture Notes in Computer Science, vol 4522. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73040-8_20
Download citation
DOI: https://doi.org/10.1007/978-3-540-73040-8_20
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73039-2
Online ISBN: 978-3-540-73040-8
eBook Packages: Computer ScienceComputer Science (R0)