Point- and Line-Based Parameterized Image Varieties for Image-Based Rendering

  • Yakup Genc
  • Jean Ponce
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1883)


This paper generalizes the parameterized image variety approach to image-based rendering proposed in [5] so it can handle both points and lines in a unified setting. We show that the set of all images of a rigid set of m points and n lines observed by a weak perspective camera forms a six-dimensional variety embedded in ℝ2(m+n). A parameterization of this variety by the image positions of three reference points is constructed via least squares techniques from point and line correspondences established across a sequence of images. It is used to synthesize new pictures without any explicit 3D model. Experiments with real image sequences are presented.


Texture Mapping Coordinate Vector Image Position Epipolar Line World Coordinate System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    S. Avidan and A. Shashua. Novel view synthesis in tensor space. In Proc. CVPR, pp. 1034–1040, 1997.Google Scholar
  2. 2.
    E.B. Barrett, M.H. Brill, N.N. Haag, and P.M. Payton. Invariant linear models in photogrammetry and model-matching. In J. Mundy and A. Zisserman, eds., Geometric Invariance in Computer Vision, pp. 277–292. MIT Press, 1992.Google Scholar
  3. 3.
    S.E. Chen. Quicktime VR: An image-based approach to virtual environment navigation. In SIGGRAPH, pp. 29–38, 1995.Google Scholar
  4. 4.
    O.D. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. ECCV, pp. 563–578, 1992.Google Scholar
  5. 5.
    Y. Genc and J. Ponce. Parameterized image varieties: A novel approach to the analysis and synthesis of image sequences. In Proc. ICCV, pp. 11–16, 1998.Google Scholar
  6. 6.
    Y. Genc, J. Ponce, Y. Leedan, and P. Meer. Parameterized image varieties and estimation with bilinear constraints. In Proc. CVPR, 1999.Google Scholar
  7. 7.
    Yakup Genc. Weak Calibration and Image-Based Rendering Algorithms. PhD thesis, University of Illinois at Urbana-Champaign, September 1999.Google Scholar
  8. 8.
    S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M. Cohen. The lumigraph. In SIGGRAPH, pp. 43–54, 1996.Google Scholar
  9. 9.
    R.I. Hartley. A linear method for reconstruction from lines and points. In Proc. ICCV, pp. 882–887, 1995.Google Scholar
  10. 10.
    R.I. Hartley, R. Gupta, and T. Chang. Stereo from uncalibrated cameras. In Proc. CVPR, pp. 761–764, 1992.Google Scholar
  11. 11.
    J.J. Koenderink and A.J. Van Doorn. Affine structure from motion. J. Opt. Soc. Am. A, 8:377–385, 1990.CrossRefGoogle Scholar
  12. 12.
    K.N. Kutulakos and J. Vallino. Calibration-free augmented reality. IEEE Trans. Vis. Comp. Gr., 4(1):1–20, 1998.CrossRefGoogle Scholar
  13. 13.
    S. Laveau and O.D. Faugeras. 3D scene representation as a collection of images and fundamental matrices. Tech. Rep. 2205, INRIA, 1994.Google Scholar
  14. 14.
    M. Levoy and P. Hanrahan. Light field rendering. In SIGGRAPH, pp. 31–42, 1996.Google Scholar
  15. 15.
    F.S. Macaulay. The Algebraic Theory of Modular Systems. Cambridge Univ. Press, 1916.Google Scholar
  16. 16.
    C.J. Poelman and T. Kanade. A paraperspective factorization method for shape and motion recovery. PAMI, 19(3):206–218, 1997.Google Scholar
  17. 17.
    L. Quan and T. Kanade. Affine structure from line correspondences with uncalibrated affine cameras. PAMI, 19(8):834–845, 1997.Google Scholar
  18. 18.
    S.M. Seitz and C.R. Dyer. Physically-valid view synthesis by image interpolation. In Work. on Representation of Visual Scenes, 1995.Google Scholar
  19. 19.
    A. Shashua. Trilinearity in visual recognition by alignment. In Proc. ECCV, pp. 479–484, 1994.Google Scholar
  20. 20.
    J.R. Shewchuk. Triangle: Engineering a 2D quality mesh generator and Delaunay triangulator. In ACM Work. Applied Computational Geometry, pp. 124–133, 1996.Google Scholar
  21. 21.
    C.J. Taylor and D.J. Kriegman. Structure and motion from line segments in multiple images. PAMI, 17(10):1021–1032, 1995.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Yakup Genc
    • 1
  • Jean Ponce
    • 1
  1. 1.Department of Computer Science and Beckman InstituteUniversity of IllinoisUrbanaUSA

Personalised recommendations