Abstract
This paper generalizes the parameterized image variety approach to image-based rendering proposed in [5] so it can handle both points and lines in a unified setting. We show that the set of all images of a rigid set of m points and n lines observed by a weak perspective camera forms a six-dimensional variety embedded in ℝ2(m+n). A parameterization of this variety by the image positions of three reference points is constructed via least squares techniques from point and line correspondences established across a sequence of images. It is used to synthesize new pictures without any explicit 3D model. Experiments with real image sequences are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S. Avidan and A. Shashua. Novel view synthesis in tensor space. In Proc. CVPR, pp. 1034–1040, 1997.
E.B. Barrett, M.H. Brill, N.N. Haag, and P.M. Payton. Invariant linear models in photogrammetry and model-matching. In J. Mundy and A. Zisserman, eds., Geometric Invariance in Computer Vision, pp. 277–292. MIT Press, 1992.
S.E. Chen. Quicktime VR: An image-based approach to virtual environment navigation. In SIGGRAPH, pp. 29–38, 1995.
O.D. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. ECCV, pp. 563–578, 1992.
Y. Genc and J. Ponce. Parameterized image varieties: A novel approach to the analysis and synthesis of image sequences. In Proc. ICCV, pp. 11–16, 1998.
Y. Genc, J. Ponce, Y. Leedan, and P. Meer. Parameterized image varieties and estimation with bilinear constraints. In Proc. CVPR, 1999.
Yakup Genc. Weak Calibration and Image-Based Rendering Algorithms. PhD thesis, University of Illinois at Urbana-Champaign, September 1999.
S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph. In SIGGRAPH, pp. 43–54, 1996.
R.I. Hartley. A linear method for reconstruction from lines and points. In Proc. ICCV, pp. 882–887, 1995.
R.I. Hartley, R. Gupta, and T. Chang. Stereo from uncalibrated cameras. In Proc. CVPR, pp. 761–764, 1992.
J.J. Koenderink and A.J. Van Doorn. Affine structure from motion. J. Opt. Soc. Am. A, 8:377–385, 1990.
K.N. Kutulakos and J. Vallino. Calibration-free augmented reality. IEEE Trans. Vis. Comp. Gr., 4(1):1–20, 1998.
S. Laveau and O.D. Faugeras. 3D scene representation as a collection of images and fundamental matrices. Tech. Rep. 2205, INRIA, 1994.
M. Levoy and P. Hanrahan. Light field rendering. In SIGGRAPH, pp. 31–42, 1996.
F.S. Macaulay. The Algebraic Theory of Modular Systems. Cambridge Univ. Press, 1916.
C.J. Poelman and T. Kanade. A paraperspective factorization method for shape and motion recovery. PAMI, 19(3):206–218, 1997.
L. Quan and T. Kanade. Affine structure from line correspondences with uncalibrated affine cameras. PAMI, 19(8):834–845, 1997.
S.M. Seitz and C.R. Dyer. Physically-valid view synthesis by image interpolation. In Work. on Representation of Visual Scenes, 1995.
A. Shashua. Trilinearity in visual recognition by alignment. In Proc. ECCV, pp. 479–484, 1994.
J.R. Shewchuk. Triangle: Engineering a 2D quality mesh generator and Delaunay triangulator. In ACM Work. Applied Computational Geometry, pp. 124–133, 1996.
C.J. Taylor and D.J. Kriegman. Structure and motion from line segments in multiple images. PAMI, 17(10):1021–1032, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Genc, Y., Ponce, J. (2000). Point- and Line-Based Parameterized Image Varieties for Image-Based Rendering. In: Triggs, B., Zisserman, A., Szeliski, R. (eds) Vision Algorithms: Theory and Practice. IWVA 1999. Lecture Notes in Computer Science, vol 1883. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44480-7_9
Download citation
DOI: https://doi.org/10.1007/3-540-44480-7_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67973-8
Online ISBN: 978-3-540-44480-0
eBook Packages: Springer Book Archive