Abstract
Most existing Multi-View Stereo (MVS) algorithms employ the image matching method using Normalized Cross-Correlation (NCC) to estimate the depth of an object. The accuracy of the estimated depth depends on the step size of the depth in NCC-based window matching. The step size of the depth must be small for accurate 3D reconstruction, while the small step significantly increases computational cost. To improve the accuracy of depth estimation and reduce the computational cost, this paper proposes an efficient image matching method for MVS. The proposed method is based on Phase-Only Correlation (POC), which is a high-accuracy image matching technique using the phase components in Fourier transforms. The advantages of using POC are (i) the correlation function is obtained only by one window matching and (ii) the accurate sub-pixel displacement between two matching windows can be estimated by fitting the analytical correlation peak model of the POC function. Thus, using POC-based window matching for MVS makes it possible to estimate depth accurately from the correlation function obtained only by one window matching. Through a set of experiments using the public MVS datasets, we demonstrate that the proposed method performs better in terms of accuracy and computational cost than the conventional method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Szeliski, R.: Computer Vision: Algorithms and Applications. Springer-Verlag New York Inc. (2010)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-views stereo reconstruction algorithms. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 519–528 (2006)
Strecha, C., Fransens, R., Gool, L.V.: Wide-baseline stereo from multiple views: A probabilistic account. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 552–559 (2004)
Strecha, C., Fransens, R., Gool, L.V.: Combined depth and outlier estimation in multi-view stereo. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 2394–2401 (2006)
Goesele, M., Curless, B., Seitz, S.M.: Multi-view stereo revisited. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 2402–2409 (2006)
Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.M.: Multi-view stereo for community photo collections. In: Proc. Int’l Conf. Computer Vision, pp. 1–8 (2007)
Strecha, C., von Hansen, W., Gool, L.V., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Campbell, N.D.F., Vogiatzis, G., Hernández, C., Cipolla, R.: Using Multiple Hypotheses to Improve Depth-Maps for Multi-View Stereo. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 766–779. Springer, Heidelberg (2008)
Bradley, D., Boubekeur, T., Heidrich, W.: Accurate multi-view reconstruction using robust binocular stereo and surface meshing. In: Proc. Int’l Conf. Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Analysis and Machine Intelligence 32, 1362–1376 (2010)
Kuglin, C.D., Hines, D.C.: The phase correlation image alignment method. In: Proc. Int’l Conf. Cybernetics and Society, pp. 163–165 (1975)
Takita, K., Aoki, T., Sasaki, Y., Higuchi, T., Kobayashi, K.: High-accuracy subpixel image registration based on phase-only correlation. IEICE Trans. Fundamentals E86-A, 1925–1934 (2003)
Strecha, C.: (Multi-view evaluation), http://cvlab.epfl.ch/data/
Shibahara, T., Aoki, T., Nakajima, H., Kobayashi, K.: A sub-pixel stereo correspondence technique based on 1D phase-only correlation. In: Proc. Int’l Conf. Image Processing, V-221–V-224 (2007)
Okutomi, M., Kanade, T.: A multiple-baseline stereo. IEEE Trans. Pattern Analysis and Machine Intelligence 15, 353–363 (1993)
Bouguet, J.Y.: (Camera calibration toolbox for matlab), http://www.vision.caltech.edu/bouguetj/calib_doc/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sakai, S., Ito, K., Aoki, T., Masuda, T., Unten, H. (2013). An Efficient Image Matching Method for Multi-View Stereo. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7727. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37447-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-37447-0_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37446-3
Online ISBN: 978-3-642-37447-0
eBook Packages: Computer ScienceComputer Science (R0)