Abstract
Light field rendering allows fast visualization of complex scenes by view interpolation from images of densely spaced camera view-points. The light field data structure requires calibrated viewpoints, and rendering quality can be improved substantially when local scene depth is known for each viewpoint. In this contribution we propose to combine light field rendering with a geometry-based structure-from-motion approach that computes camera calibration and local depth estimates. The advantage of the combined approach w.r.t. a pure geometric structure recovery is that the estimated geometry need not be globally consistent but is updated locally depending on the rendering viewpoint. We concentrate on the viewpoint calibration that is computed directly from the image data by tracking image feature points. Ground-truth experiments on real light field sequences confirm the quality of calibration.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
P. Beardsley, P. Torr and A. Zisserman: 3D Model Acquisition from Extended Image Sequences. In: B. Buxton, R. Cipolla(Eds.) Computer Vision — ECCV 96, Cambridge, UK., vol.2, pp.683–695. LNCS, Vol. 1064. Springer, 1996.
I. J. Cox, S. L. Hingorani, and S. B. Rao: A Maximum Likelihood Stereo Algorithm. Computer Vision and Image Understanding, Vol. 63,No. 3, May 1996.
L. Falkenhagen: Hierarchical Block-Based Disparity Estimation Considering Neighborhood Constraints. Intern. Workshop on SNHC and 3D Imaging, Rhodes, Greece, Sept. 1997.
O. Faugeras, S. Maybank: Motion from Point Matches: Multiplicity of solutions. IJCV 4(3), June 1990.
O. Faugeras: What can be seen in three dimensions with an uncalibrated stereorig. Proc. ECCV’92, pp.563–578.
S. Gortler, R. Grzeszczuk, R. Szeliski, M. F. Cohen: The Lumigraph. Proceedings SIGGRAPH’ 96, pp. 43–54, ACM Press, New York, 1996.
R. Hartley: Estimation of relative camera positions for uncalibrated cameras. Proc. ECCV’92, pp.579–587.
W. Heidrich, H. Schirmacher, and H.-P. Seidel: A Warping-Based Refinement of Lumigraphs. Proc. WSCG’ 99, N.M. Thalman and V. Skala(eds.), Pilsen, 1999.
B. Heigl, R. Koch, M. Pollefeys, J. Denzler, L. Van Gool: Plenoptic Modeling and Rendering from Image Sequences taken by a Hand-Held Camera. Submitted to DAGM symposium, Bonn, Germany.
T.S. Huang, A.N. Netravali: 3D Motion estimation. in: H. Freeman (ed.), Machine vision for three-dimensional scenes, Academic Press, 1990.
R. Koch, M. Pollefeys, and L. Van Gool: Multi Viewpoint Stereo from Uncalibrated Video Sequences. Proc. ECCV’98, Freiburg, June 1998.
R. Koch, B. Heigl, M. Pollefeys, L. Van Gool, H. Niemann: Calibration of Hand-held Camera Sequences for Plenoptic Modeling. Submitted to ICCV’99, Corfu.
R. Koch, M. Pollefeys, L. Van Gool: Robust Calibration and 3D Geometric Modeling from Large Collections of Uncalibrated Images. Submitted to DAGM Symposium 99, Bonn, Germany.
M. Levoy, P. Hanrahan: Light field Rendering. Proceedings SIGGRAPH’ 96, pp. 31–42, ACM Press, New York, 1996.
H.C. Longuet-Higgins: A computer algorithm for reconstructing a scene from two projections. Nature vol. 293(81), pp. 133–135, 1981.
M. Pollefeys, R. Koch and L. Van Gool: Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters. Proc. ICCV’98, Bombay, India, Jan. 1998. Also accepted for publication in: International Journal on Computer Vision, Marr Price Special Issue, 1998.
P.H.S. Torr: Motion Segmentation and Outlier Detection. PhD thesis, University of Oxford, UK, 1995.
R. Y. Tsai, T. S. Huang: Uniqueness and Estimation of Three—Dimensional Motion Parameters of Rigid Objects with Curved Surfaces. PAMI 6(1), pp. 13–27, 1984.
R. Y. Tsai: A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology using off-the-shelf Cameras and Lenses. IEEE Journal Robotics and Automation RA-3,4 (Aug. 1987), 323–344.
R. Y. Tsai and R.K. Lenz: Real Time Versatile Robotics Hand/Eye Calibration Using 3D machine vision. Proceedings of ICRA 88, 554–561, IEEE Press, Philadelphia, April 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Koch, R., Heigl, B., Pollefeys, M., Van Gool, L., Niemann, H. (1999). A Geometric Approach to Light field Calibration. In: Solina, F., Leonardis, A. (eds) Computer Analysis of Images and Patterns. CAIP 1999. Lecture Notes in Computer Science, vol 1689. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48375-6_71
Download citation
DOI: https://doi.org/10.1007/3-540-48375-6_71
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66366-9
Online ISBN: 978-3-540-48375-5
eBook Packages: Springer Book Archive