Summary
In this paper an approach is presented that obtains virtual models from sequences of images. The system can deal with uncalibrated image sequences acquired with a hand-held camera. Based on tracked or matched features the relations between multiple views are computed. From this both the structure of the scene and the motion of the camera are retrieved. The ambiguity on the reconstruction is restricted from projective to metric through auto-calibration. A flexible multi-view stereo matching scheme is used to obtain a dense estimation of the surface geometry. From the computed data virtual models can be constructed or, inversely, virtual models can be included in the original images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P. Beardsley, A. Zisserman and D. Murray, “Sequential Updating of Projective and Affine Structure from Motion”, International Journal of Computer Vision (23), No. 3, Jun-Jul 1997, pp. 235–259.
K. Cornelis, M. Pollefeys, M. Vergauwen and L. Van Gool, “Augmented Reality from Uncalibrated Video Sequences”, In M. Pollefeys, L. Van Gool, A. Zisserman, A. Fitzgibbon (Eds.), 3D Structure from Images - SMILE 2000, Lecture Notes in Computer Science, Vol. 2018, pp.150–167. Springer-Verlag, 2001.
Cox, I., Hingorani, S., Rao, S., 1996, A Maximum Likelihood Stereo Algorithm, Computer Vision and Image Understanding, Vol. 63, No. 3.
B. Curless and M. Levoy, “A Volumetric Method for Building Complex Models from Range Images” Proc. SIGGRAPH ’96, pp. 303–312, 1996.
P. Debevec, C. Taylor and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry-and Image-Based Approach”, Proc. SIGGRAPH’96, pp. 11–20, 1996.
Falkenhagen, L., 1997, Hierarchical Block-Based Disparity Estimation Considering Neighbourhood Constraints. Proceedings International Workshop on SNHC and 3D Imaging, Rhodes, Greece, pp.115–122.
Faugeras, “What can be seen in three dimensions with an uncalibrated stereo rig”, Computer Vision - ECCV’92, Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, pp. 563–578, 1992.
O. Faugeras, Q.-T. Luong and S. Maybank. “Camera self-calibration: Theory and experiments”, Computer Vision - ECCV’92, Lecture Notes in Computer Science, Vol. 588, Springer-Verlag, pp. 321–334, 1992.
M. Fischler and R. Bolles, “RANdom SAmpling Consensus: a paradigm for model fitting with application to image analysis and automated cartography”, Commun. Assoc. Comp. Mach. 24:381–95, 1981.
C. Harris and M. Stephens, “A combined corner and edge detector”, Fourth Alvey Vision Conference, pp.147–151, 1988.
R. Hartley, R. Gupta, and T. Chang. “Stereo from uncalibrated cameras”. Proc. Conference Computer Vision and Pattern Recognition, pp. 761–764, 1992.
B. Heigl, R. Koch, M. Pollefeys, J. Denzler and L. Van Gool, Plenoptic Modeling and Rendering from Image Sequences taken by Hand-held Camera, Proc. DAGM’99, pp.94–101.
Koch, R., 1996, Automatische Oberflachenmodellierung starrer dreidimensionaler Objekte aus stereoskopischen Rundum-Ansichten, PhD thesis, University of Hannover, Germany, also published as Fortschritte-Berichte VDI, Reihe 10, Nr.499, VDI Verlag, 1997.
R. Koch, M. Pollefeys and L. Van Gool, Multi Viewpoint Stereo from Un-calibrated Video Sequences. Proc. European Conference on Computer Vision, pp.55–71. Freiburg, Germany, 1998.
R. Koch, M. Pollefeys, B. Heigl, L. Van Gool and H. Niemann. “Calibration of Hand-held Camera Sequences for Plenoptic Modeling”, Proc.ICCV’99 (international Conference on Computer Vision), pp.585–591, Corfu (Greece), 1999.
E. Ofek, E. Shilat, A. Rappopport and M. Werman, “Highlight and Reflection Independent Multiresolution Textures from Image Sequences”, IEEE Computer Graphics and Applications, vol.17 (2), March-April 1997.
M. Pollefeys, R. Koch and L. Van Gool, “A simple and efficient rectification method for general motion”, Proc.ICCV’99 (international Conference on Computer Vision), pp.496–501, Corfu (Greece), 1999.
M. Pollefeys, R. Koch and L. Van Gool. “Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters”, International Journal of Computer Vision, 32(1), 7–25, 1999.
J. Shi and C. Tomasi, “Good Features to Track”, Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), pp. 593–600, 1994.
C. Tomasi and T. Kanade, “Shape and motion from image streams under orthography: A factorization approach”, International Journal of Computer Vision 9(2):137–154, 1992
P. Torr, Motion Segmentation and Outlier Detection, PhD Thesis, Dept. of Engineering Science, University of Oxford, 1995
B. Triggs, “The Absolute Quadric”, Proc. 1997 Conference on Computer Vision and Pattern Recognition, IEEE Computer Soc. Press, pp. 609–614, 1997.
B. Triggs, P. McLauchlan, R. Hartley, A. Fiztgibbon, “Bundle Adjustment — A Modern Synthesis”, In B. Triggs, A. Zisserman, R. Szeliski (Eds.), Vision Algorithms: Theory and Practice, LNCS Vol.1883, pp.298–372, Springer-Verlag, 2000.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag London
About this paper
Cite this paper
Pollefeys, M., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Van Gool, L. (2001). Virtual Models from Video and Vice-Versa. In: Virtual and Augmented Architecture (VAA’01). Springer, London. https://doi.org/10.1007/978-1-4471-0337-0_2
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0337-0_2
Publisher Name: Springer, London
Print ISBN: 978-1-85233-456-7
Online ISBN: 978-1-4471-0337-0
eBook Packages: Springer Book Archive