Abstract
We propose a multi-view photometric stereo technique that uses photometric normal consistency to jointly estimate surface position and orientation. The underlying scene representation is based on oriented points, yielding more flexibility compared to smoothly varying surfaces. We demonstrate that the often employed least squares error of the Lambertian image formation model fails for wide-baseline settings without known visibility information. We then introduce a multi-view normal consistency approach and demonstrate its efficiency on synthetic and real data. In particular, our approach is able to handle occlusion, shadows, and other sources of outliers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bonfort, T., Sturm, P.F.: Voxel carving for specular surfaces. In: ICCV (2003)
Bouguet, J.Y.: Camera calibration toolbox for matlab (2012), http://www.vision.caltech.edu/bouguetj/calib_doc/
Coleman, E.N., Jain, R.: Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry. Computer Graphics and Image Processing 18, 309–328 (1982)
Esteban, C.H., Vogiatzis, G., Cipolla, R.: Multiview photometric stereo. PAMI 30(3), 548–554 (2008)
Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.M.: Multi-view stereo for community photo collections. In: ICCV (2007)
Higo, T., Matsushita, Y., Ikeuchi, K.: Consensus photometric stereo. In: CVPR (2010)
Joshi, N., Kriegman, D.: Shape from varying illumination and viewpoint. In: ICCV (2007)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction and its applications. In: Eurographics Symposium on Geometry Processing (2006)
Lim, J., Ho, J., Yang, M.H., Kriegman, D.J.: Passive photometric stereo from motion. In: ICCV (2005)
Maki, A., Cipolla, R.: Obtaining the shape of a moving object with a specular surface. In: BMVC (2009)
Maki, A., Watanabe, M., Wiles, C.: Geotensity: Combining motion and lighting for 3D surface reconstruction. IJCV 48(2), 75–90 (2002)
Moses, Y., Shimshoni, I.: 3D shape recovery of smooth surfaces: Dropping the fixed-viewpoint assumption. PAMI 31(7), 1310–1324 (2009)
Nehab, D., Weyrich, T., Rusinkiewicz, S.: Dense 3D reconstruction from specularity consistency. In: CVPR (2008)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR (2006)
Simakov, D., Frolova, D., Basri, R.: Dense shape reconstruction of a moving object under arbitrary, unknown lighting. In: ICCV (2003)
Slabaugh, G.G., Culbertson, W.B., Malzbender, T., Stevens, M.R., Schafer, R.W.: Methods for volumetric reconstruction of visual scenes. IJCV 57(3), 179–199 (2004)
Weber, M., Blake, A., Cipolla, R.: Towards a complete dense geometric and photometric reconstruction under varying pose and illumination. In: BMVC (2002)
Yoshiyasu, Y., Yamazaki, N.: Topology-adaptive multi-view photometric stereo. In: CVPR (2011)
Zhang, L., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and motion under varying illumination: Unifying structure from motion, photometric stereo, and multi-view stereo. In: ICCV (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Beljan, M., Ackermann, J., Goesele, M. (2012). Consensus Multi-View Photometric Stereo. In: Pinz, A., Pock, T., Bischof, H., Leberl, F. (eds) Pattern Recognition. DAGM/OAGM 2012. Lecture Notes in Computer Science, vol 7476. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32717-9_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-32717-9_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32716-2
Online ISBN: 978-3-642-32717-9
eBook Packages: Computer ScienceComputer Science (R0)