Abstract
We present a novel approach to surface reconstruction from multiple images. The central idea is to explore the integration of both 3D stereo data and 2D calibrated images. This is motivated by the fact that only robust and accurate feature points that survived the geometry scrutiny of multiple images are reconstructed in space. The density insufficiency and the inevitable holes in the stereo data should be filled in by using information from multiple images. The idea is therefore to first construct small surface patches from stereo points, then to progressively propagate only reliable patches in their neighborhood from images into the whole surface using a best-first strategy. The problem reduces to searching for an optimal local surface patch going through a given set of stereo points from images. This constrained optimization for a surface patch could be handled by a local graph-cut that we develop. Real experiments demonstrate the usability and accuracy of the approach.
Chapter PDF
References
Amenta, N., Choi, S., Kolluri, R.: The power crust, unions of balls, and the medial axis transform. Computational Geometry: Theory and Applications (2001)
Blake, A., Zisserman, A.: Visual reconstruction. MIT Press, Cambridge (1987)
Boykov, Y., Kolmogorov, V.: Computing Geodesics and Minimal Surfaces via Graph Cuts. In: Int. Conf. on Computer Vision (2003)
Curless, B., Levoy, M.: A volumetric method for building complex models from range images. In: SIGGRAPH (1996)
Faugeras, O., Keriven, R.: Complete dense stereovision using level set methods. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, p. 379. Springer, Heidelberg (1998)
Faugeras, O., Luong, Q., Papadopoulo, T.: Geometry of Multiple Images. MIT Press, Cambridge (2001)
Ford, L., Fulkerson, D.: Flows in Networks. Princeton University Press, Princeton (1962)
Fua, P.: From multiple stereo views to multiple 3d surfaces. Int. Journal of Computer Vision (1997)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. CU Press, Cambridge (2000)
Hoff, W., Ahuja, N.: Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection. Trans. on Pattern Analysis and Machine Intelligence (1989)
Hoppe, H., Derose, T., Duchamp, T., McDonalt, J., Stuetzle, W.: Surface reconstruction from unorganized points. Computer Graphics (1992)
Ishikawa, H., Geiger, D.: Occlusions, discontinuities, and epipolar lines in stereo. In: Burkhardt, H.-J., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1406, p. 232. Springer, Heidelberg (1998)
Kimmel, R.: 3D Shape Reconstruction from Autostereograms and Stereo. Journal of Visual Communication and Image Representation (2002)
Kolmogorov, V., Zabih, R.: Multi-camera scene reconstruction via graph cuts. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 82–96. Springer, Heidelberg (2002)
Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. In: Int. Conf. on Computer Vision (1999)
Lee, M.S., Medioni, G., Mordohai, P.: Inference of Segmented Overlapping Surfaces from Binocular Stereo. Trans. on Pattern Analysis and Machine Intelligence (2002)
Lhuillier, M., Quan, L.: Quasi-dense reconstruction from image sequence. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 125–139. Springer, Heidelberg (2002)
Lhuillier, M., Quan, L.: Surface Reconstruction by Integrating 3D and 2D Data of Multiple Views. In: Int. Conf. on Computer Vision (2003)
Lorensen, W.E., Cline, H.E.: Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In: SIGGRAPH 1987 (1987)
Narayanan, P.J., Rander, P.W., Kanade, T.: Constructing Virtual Worlds using Dense Stereo. In: European Conf. on Computer Vision (1998)
Okutomi, M., Kanade, T.: A multiple-baseline stereo. Trans. on Pattern Analysis and Machine Intelligence (1993)
Paris, S., Sillion, F., Quan, L.: A Surface Reconstruction Method Using Global Graph Cut Optimization. In: Asian Conf. on Computer Vision (2004)
Roy, S.: Stereo without epipolar lines: A maximum-flow formulation. Int. Journal of Computer Vision (1999)
Sahwney, H.S., Tao, H., Kumar, R.: A global matching framework for stereo computation. In: Int. Conf. on Computer Vision (2001)
Seitz, S.M., Dyer, C.R.: Photorealistic scene reconstruction by voxel coloring. In: Computer Vision and Pattern Recognition (1997)
Sethian, J.A.: Level-set methods and fast marching methods. CU Press, Cambridge (1999)
Szeliski, R., Tonnesen, D., Terzopoulos, D.: Modelling surfaces of arbitrary topology with dynamic particles. In: Computer Vision and Pattern Recognition (1993)
Szeliski, R., Golland, P.: Stereo matching with transparency and matting. Int. Journal of Computer Vision (1999)
Tang, C.K., Medioni, G.: Curvature-augmented tensor voting for shape inference from noisy 3d data. Trans. on Pattern Analysis and Machine Intelligence (2002)
Whitaker, R.: A level-set approach to 3d reconstruction from range data. Int. Journal of Computer Vision (1998)
Zhang, Z., Shan, Y.: A progressive scheme for stereo matching. In: Pollefeys, M., Van Gool, L., Zisserman, A., Fitzgibbon, A.W. (eds.) SMILE 2000. LNCS, vol. 2018, p. 68. Springer, Heidelberg (2001)
Zhao, H.K., Osher, S., Merriman, B., Kang, M.: Implicit and non-parametric shape reconstruction from unorganized data using a variational level set method. In: Computer Vision and Image Understanding (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zeng, G., Paris, S., Quan, L., Lhuillier, M. (2004). Surface Reconstruction by Propagating 3D Stereo Data in Multiple 2D Images. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24670-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-24670-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21984-2
Online ISBN: 978-3-540-24670-1
eBook Packages: Springer Book Archive