Abstract
The aim of this paper is to give the non-specialist reader a comprehensible and intuitive introduction to multiview relations. It focusses on the geometric interpretation of the different image relationships, but also presents a concise mathematical formalism which allows to derive the algebraic expressions explicitly in an elementary and uniform manner. Special attention has been paid both to these multiview constraints as geometric incidence relations between image features (i.e. points and lines) in different views as well as to their use for image transfer. Moreover, an attempt has been made to provide sufficient pointers to the literature where the interested reader may find additional information on particular subjects as well as alternative viewpoints and mathematical formalisms.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
S. Avidan and A. Shashua, Novel view synthesis in tensor space, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’), Puerto Rico, IEEE Computer Society Press, Los Alamitos, 1997, pp. 1034–1040.
S. Avidan and A. Shashua, Unifying two-view and three-view geometry, Proceedings of the ARPA Image Understanding Workshop (IUW’97), Morgan Kaufmann Publishers, Orlando, FL, 1997.
S. Avidan and A. Shashua, Novel view synthesis by cascading trilinear tensors, submitted to IEEE Transactions on Visualisation and Computer Graphics (TVCG).
P.A. Beardsley, P.H.S. Torr, and A. Zisserman, 3DModel acquisition from extended image sequence, pp. II.683–II.695, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.
O.D. Faugeras, What can be seen in three dimensions with an uncalibrated stereo rig, pp. 563–578, in: G. Sandini (ed.), Computer Vision-(ECCV’92), Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, Berlin, 1992.
O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint, MIT Press, Cambridge, MA / London, UK, 1993.
O. Faugeras and B. Mourrain, On the geometry and algebra of the point and line correspondences between N images, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 951–956.
O. Faugeras and B. Mourrain, About the correspondences of points between N images, Proceedings of the IEEE workshop on the Representation of Visual Scenes, Boston, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995.
O. Faugeras and T. Papadopoulo, A nonlinear method for estimating the projective geometry of three views, Proc. 6th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 477–484.
A.W. Fitzgibbon and A. Zisserman, Automatic camera recovery for closed or open image sequences, pp. I.311–I.326, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, LNCS, Vol. 1406, Springer-Verlag, Berlin, 1998.
R.I. Hartley, Estimation of relative camera positions for uncalibrated cameras, pp. 579–587, in: G. Sandini (ed.), Computer Vision-(ECCV’92), Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, Berlin, 1992.
R.I. Hartley, Projective reconstruction from line correspondences, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle, WA, IEEE Computer Society Press, Los Alamitos 1994, pp. 903–907.
R.I. Hartley, Lines and points in three views-a unified approach, Proceedings of the ARPA Image Understanding Workshop (IUW’94), Monterey, CA, Morgan Kaufmann Publishers, Orlando, FL, 1994, pp. 1009–1016.
R.I. Hartley, A linear method for reconstruction from lines and points, Proceedings of the 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 882–887.
R.I. Hartley, Multilinear Relationships between coordinates of corresponding image points and lines, Computer Vision Applied Geometry, Nordfjordeid, Norway, 1995.
R.I. Hartley, In defence of the 8-point algorithm, Proceedings of the 5th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 1064–1070.
R.I. Hartley, Lines and points in three views and the trifocal tensor, International Journal of Computer Vision, Vol. 22 (1997), no. 2, pp. 125–140.
R.I. Hartley, Minimizing algebraic error in geometric estimation problems, Proceedings of the 6th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 469–476.
R.I. Hartley, Computation of the quadrifocal tensor, pp. I.20–I.35, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1406, Springer-Verlag, Berlin, 1998.
R.I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, Cambridge, UK, to appear.
R. Hartley, R. Gupta, and T. Chang, Stereo from uncalibrated cameras, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’92), IEEE Computer Society Press, Los Alamitos, CA, 1992, pp. 761–764.
A. Heyden, A common framework for multiple view tensors, pp. I.3–I.19, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1406, Springer-Verlag, Berlin, 1998.
A. Heyden and K. Åström, Algebraic varieties in multiple view geometry, pp. II.671–II.682, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.
A. Heyden and K. Åström, Algebraic properties of multilinear constraints, Mathematical Methods in the Applied Sciences, Vol. 20 (1997), pp. 1135–1162.
H.C. Longuet-Higgins, A computer algorithm for reconstructing a scene from two projections, Nature, Vol. 293 (1981), no. 10, pp. 133–135.
Q.-T. Luong and O.D. Faugeras, The fundamental matrix: Theory, algorithms, and stability analysis, Intern. Journal Computer Vision, Vol. 17 (1996), pp. 43–75.
Q.-T. Luong and T. Viéville, Canonic representations for the geometries of multiple projective views, pp. I.589–I.599, in: J.-O. Ecklund, Computer Vision-ECCV’94, LNCS, Vol. 800, Springer-Verlag, Berlin, 1994.
Q.-T. Luong and T. Viéville, Canonic representations for the geometries of multiple projective views, Comp. Vision Image Understanding, Vol. 64 (1996), pp. 589–599.
S.J. Maybank, The critical line concruence for reconstruction from three images, Applic. Algebra in Engineering, Comm. & Computing, Vol. 6 (1995), pp. 89–113.
S.J. Maybank and A. Shashua, Ambiguity in reconstruction from images of six points, Proc. 6 th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 703–708.
N. Navab, O.D. Faugeras, and T. Viéville, The critical sets of lines for camera displacement estimation: A mixed Euclidean-projective and constructive approach, Proc. of the 4 th International Conference on Computer Vision (ICCV’93), Berlin, Germany, IEEE Computer Society Press, Los Alamitos, CA, 1993, pp. 713–723.
T. Papadopoulo and O.D. Faugeras, A new characterization of the trifocal tensor, pp. I.109–I.123, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, LNCS, Vol. 1406, Springer-Verlag, Berlin, 1998.
A. Shashua, Trilinearity in visual recognition by alignment, pp. I.479–I.484, in: J.-O. Ecklund, Computer Vision-ECCV’94, Lecture Notes in Computer Science, Vol. 800, Springer-Verlag, Berlin / Heidelberg / New York / Tokyo, 1994.
A. Shashua, Projective structure from uncalibrated images, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 16 (1994), no. 8, pp. 778–790.
A. Shashua, Algebraic functions for recognition, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 17 (1995), no. 8, pp. 779–789.
A. Shashua, Multiple-view geometry and photometry and the trilinear tensor, Computer Vision and Applied Geometry, Nordfjordeid, Norway, 1995.
A. Shashua, Trilinear tensor: The fundamental construct of multiple-view geometry and its applications, Proceedings of the International Workshop on Algebraic Frames for the Perception Action Cycle (AFPAC97), Kiel, Germany, 1997.
A. Shashua and S. Avidan, The rank 4 constraint in multiple (≥ 3) view geometry, pp. II.196–II.206, in: B. Buxton and R. Cipolla (eds.), Computer Vision-ECCV’96, LNCS, Vol. 1065, Springer-Verlag, Berlin, 1996.
A. Shashua and N. Navab, Relative affine structure: Theory and application to 3D reconstruction from perspective views, Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle, WA, IEEE Computer Society Press, Los Alamitos, CA, 1994, pp. 483–489.
A. Shashua and M. Werman, Trilinearity of three perspective views and its associated tensor, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, 1995, pp. 920–925.
M.E. Spetsakis, A linear method for point and line-based structure from motion, CVGIP: Image Understanding, Vol. 56 (1992), no. 2, pp. 230–241.
M.E. Spetsakis and J. Aloimonos, A unified theory of structure from motion, Proceedings of the DARPA Image Understanding Workshop (IUW’90), Morgan Kaufmann Publishers, Orlando, FL, 1990, pp. 271–283.
G.P. Stein and A. Shashua, On degeneracy of linear reconstruction from three views: linear line complex and applications, pp. II.862–II.878, in: H. Burkhardt and B. Neumann (eds.), Computer Vision-ECCV’98, Lecture Notes in Computer Science, Vol. 1407, Springer-Verlag, Berlin / Heidelberg / New York / Tokyo, 1998.
P.H.S. Torr and D.W. Murray, The development and comparison of robust methods for estimating the fundamental matrix, International Journal of Computer Vision, Vol. 24 (1997), no. 3, pp. 271–300.
P.H.S. Torr and A. Zisserman, Robust parameterization and computation of the trifocal tensor, Image and Vision Computing, Vol. 15 (1997), pp. 591–605.
P.H.S. Torr and A. Zisserman, Robust computation and parameterization of multiview relations, Proc. 6 th International Conference on Computer Vision (ICCV’98), Bombay, India, Narosa Publishing House, New Delhi / London, 1998, pp. 727–732.
B. Triggs, Matching constraints and the joint image, Proc. 5 th International Conference on Computer Vision (ICCV’95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 338–343.
B. Triggs, The geometry of projective reconstruction I: matching constraints and the joint image, submitted to International Journal of Computer Vision, (1995).
B. Triggs, A new approach to geometric fitting, unpublished paper, 1998. (Can be obtained from: http://www.inrialpes.fr/movi/people/triggs/publications.html).
J. Weng, T.S. Huang, and N. Ahuja, Motion and structure from line correspondences: Closed-form solution, uniqueness, and optimization, IEEE Trans. Pattern Analysis and Artificial Intellingence (T-PAMI), Vol. 14 (1992), no. 3, pp. 318–336.
M. Werman and A. Shashua, The study of 3D-from-2D using elimination, Proceedings of the 5 th International Conference on Computer Vision (ICCV’ 95), Cambridge, MA, IEEE Computer Society Press, Los Alamitos, CA, 1995, pp. 473–479.
A. Zisserman, A Users Guide to the Trifocal Tensor, Department of Engineering Science, University of Oxford, 1996. Also a chapter in [20].
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Moons, T. (1998). A Guided Tour Through Multiview Relations. In: Koch, R., Van Gool, L. (eds) 3D Structure from Multiple Images of Large-Scale Environments. SMILE 1998. Lecture Notes in Computer Science, vol 1506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49437-5_21
Download citation
DOI: https://doi.org/10.1007/3-540-49437-5_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65310-3
Online ISBN: 978-3-540-49437-9
eBook Packages: Springer Book Archive