Structure from Many Perspective Images with Occlusions
This paper proposes a method for recovery of projective shape and motion from multiple images by factorization of a matrix containing the images of all scene points. Compared to previous methods, this method can handle perspective views and occlusions jointly. The projective depths of image points are estimated by the method of Sturm & Triggs  using epipolar geometry. Occlusions are solved by the extension of the method by Jacobs  for filling of missing data. This extension can exploit the geometry of perspective camera so that both points with known and unknown projective depths are used. Many ways of combining the two methods exist, and therefore several of them have been examined and the one with the best results is presented. The new method gives accurate results in practical situations, as demonstrated here with a series of experiments on laboratory and outdoor image sets. It becomes clear that the method is particularly suited for wide base-line multiple view stereo.
Keywordsprojective reconstruction structure from motion wide baseline stereo factorization
Unable to display preview. Download preview PDF.
- 1.D. Martinec and T. Pajdla. Structure from Many Perspective Images with Occlusions. Research Report CTU-CMP-2001-20, Center for Machine Perception, K333 FEE Czech Technical University, Prague, Czech Republic, July 2001. ftp://cmp.felk.cvut.cz/pub/cmp/articles/martinec/Martinec-TR-2001-20.pdf.Google Scholar
- 3.A. W. Fitzgibbon and A. Zisserman. Automatic camera recovery for closed or open image sequences. In Proc. European Conference on Computer Vision, pages 311–326. Springer-Verlag, June 1998.Google Scholar
- 4.C. J. Harris and M. Stephens. A combined corner and edge detector. In Proc. of Alvey Vision Conference, pages 147–151, 1988.Google Scholar
- 6.A. Heyden. Projective structure and motion from image sequences using subspace methods. In Proc. 10th SCIA, pages 963–968, June 1997.Google Scholar
- 7.D. Q. Huynh and A. Heyden. Outlier Detection in Video Sequences under Affine Projection. In Proc. of CVPR, 2001.Google Scholar
- 8.D. Jacobs. Linear fitting with missing data: Applications to structure from motion and to characterizing intensity images. In CVPR, pages 206–212, 1997.Google Scholar
- 9.S. Mahamud and M. Hebert. Iterative projective reconstruction from multiple views. In CVPR, 2000.Google Scholar
- 10.S. Avidan and A. Shashua. Threading Fundamental Matrices. In IEEE Trans. on PAMI, Vol. 23(1), pp. 73–77, 2001.Google Scholar
- 11.P. Sturm and B. Triggs. A factorization based algorithm for multi-image projective structure and motion. In ECCV96(II), pages 709–720, 1996.Google Scholar
- 12.C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: A factorization method. In IJCV(9), No. 2, pages 137–154, November 1992.Google Scholar