Abstract
Our goal is to match contour lines between images and to recover structure and motion from those. The main difficulty is that pairs of lines from two images do not induce direct geometric constraint on camera motion. Previous work uses geometric attributes | orientation, length, etc. | for single or groups of lines. Our approach is based on using Pencil-of-Points (points on line) or pops for short. There are many advantages to using pops for structure-from-motion. The most important one is that, contrarily to pairs of lines, pairs of pops may constrain camera motion. We give a complete theoretical and practical framework for automatic structure-from-motion using pops | detection, matching, robust motion estimation, triangulation and bundle adjustment. For wide baseline matching, it has been shown that cross-correlation scores computed on neighbouring patches to the lines gives reliable results, given 2D homographic transformations to compensate for the pose of the patches. When cameras are known, this transformation has a 1-dimensional ambiguity. We show that when cameras are unknown, using pops lead to a 3-dimensional ambiguity, from which it is still possible to reliably compute cross-correlation. We propose linear and non-linear algorithms for estimating the fundamental matrix and for the multiple-view triangulation of pops. Experimental results are provided for simulated and real data.
Chapter PDF
References
Bignone, F., Henricsson, O., Fua, P., Stricker, M.: Automatic extraction of generic house roofs from high resolution aerial imagery. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 85–96. Springer, Heidelberg (1996)
Canny, J.: A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 8(6), 679–698 (1986)
Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Graphics and Image Processing 24(6), 381–395 (1981)
Hartley, R., Sturm, P.: Triangulation. Computer Vision and Image Understanding 68(2), 146–157 (1997)
Hartley, R.I.: Lines and points in three views and the trifocal tensor. International Journal of Computer Vision 22(2), 125–140 (1997)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (June 2000)
Longuet-Higgins, H.C.: A computer program for reconstructing a scene from two projections. Nature 293, 133–135 (1981)
Médioni, G., Nevatia, R.: Segment-based stereo matching. Computer Vision, Graphics and Image Processing 31, 2–18 (1985)
Mikolajczyk, K., Schmid, C.: An affine invariant interest point detector. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 128–142. Springer, Heidelberg (2002)
Schmid, C., Zisserman, A.: Automatic line matching across views. In: CVPR, pp. 666–671 (1997)
Triggs, B.: Linear projective reconstruction from matching tensors. Image and Vision Computing 15(8), 617–625 (1997)
Zhang, Z.: Determining the epipolar geometry and its uncertainty: A review. International Journal of Computer Vision 27(2), 161–195 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bartoli, A., Coquerelle, M., Sturm, P. (2004). A Framework for Pencil-of-Points Structure-from-Motion. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24671-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-24671-8_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21983-5
Online ISBN: 978-3-540-24671-8
eBook Packages: Springer Book Archive