Abstract
In this paper we present the combination of Shape from Shading and stereo vision based on a fully integrated approach. The surface gradients of two camera views of an object are employed to refine an initial disparity map subject to the constraint of integrability of the resulting surface. The gradient field of the object’s surface is computed using Photometric Stereo and analytical reflectance models with spatially varying parameters. We evaluate the proposed algorithm on three data sets including a metallic object and objects with depth discontinuities and small details. We achieve compelling results on all data sets including the cast iron where our method is less noise-sensitive than the reference 3D scanner. However, since the scanner exhibits high-frequency noise, we use its low-passed depth data as reference. The mean error of all data sets is 1 mm and below with a low-cost acquisition setup, consisting of two cameras and 18 light sources only. Furthermore, a new method to calibrate the lighting of a multi-view Photometric Stereo setup is briefly introduced.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Vialux zSnapper Vario with AVT Pike F-421 (CCD Sensor), res. 2048 \(\times \) 2048 pixels.
- 2.
Modelling the surface as a collection of micro-facets suits metallic objects very well.
References
Ackermann, J., Langguth, F., Fuhrmann, S., Kuijper, A., Goesele, M.: Multi-view photometric stereo by example. In: International Conference on 3D Vision, pp. 259–266 (2014)
Alldrin, N.G., Kriegman, D.J.: Toward reconstructing surfaces with arbitrary isotropic reflectance: a stratified photometric stereo approach. In: ICCV (2007)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Blinn, J.F.: Models of light reflection for computer synthesized pictures. ACM SIGGRAPH 11(2), 192–198 (1977)
Bouguet, J.Y.: Camera Calibration Toolbox for Matlab (2008). http://www.vision.caltech.edu/bouguetj/calib_doc/index.html
Bronstein, I.N., Semendjajew, K., Musiol, G., Mühlig, H.: Taschenbuch der Mathematik, vol. 10. Europa-Lehrmittel, Haan (2016)
Chung, H.S., Jia, J.: Efficient photometric stereo on glossy surfaces with wide specular lobes. In: CVPR, pp. 1–8 (2008)
Cook, R.L., Torrance, K.E.: A reflectance model for computer graphics. ACM SIGGRAPH 15(3), 307–316 (1981)
Giesen, F.: Phong and Blinn-Phong Normalization Factors, vol. 1, pp. 1–2 (2009). http://www.farbrausch.de/~fg/stuff/phong.pdf
Hertzmann, A., Seitz, S.M.: Example-based photometric stereo: shape reconstruction with general, varying BRDFs. PAMI 27(8), 1254–1264 (2005)
Hirschmüller, H.: Accurate and efficient stereo processing by semi-global matching and mutual information. In: CVPR, vol. 2, pp. 807–814 (2005)
Horn, B.K.P., Brooks, M.J.: The variational approach to shape from shading. Comput. Vis. Graph. Image Process. 33, 174–208 (1986)
Hui, Z., Sankaranarayanan, A.C.: A dictionary-based approach for estimating shape and spatially-varying reflectance. In: ICCP (2015)
Langguth, F., Sunkavalli, K., Hadap, S., Goesele, M.: Shading-aware multi-view stereo. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 469–485. Springer, Cham (2016). doi:10.1007/978-3-319-46487-9_29
Lewis, R.R.: Making shaders more physically plausible. In: Fourth Eurographics Workshop on Rendering, pp. 47–62 (1994)
Maurer, D., Ju, Y.C., Breuß, M., Bruhn, A.: Combining shape from shading and stereo: a variational approach for the joint estimation of depth, illumination and albedo. In: BMVC, pp. 76.1–76.14 (2016)
Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311–317 (1975)
Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-view stereo reconstruction algorithms. In: CVPR, vol. 1, pp. 519–526 (2006)
Tola, E., Lepetit, V., Fua, P.: A fast local descriptor for dense matching. In: CVPR (2008)
Tola, E., Lepetit, V., Fua, P.: DAISY: an efficient dense descriptor applied to wide baseline stereo. PAMI 32(5), 815–830 (2010)
Torrance, K.E., Sparrow, E.M.: Theory for off-specular reflection from roughened surfaces. JOSA 57(9), 1105–1114 (1967)
Wu, C., Wilburn, B., Matsushita, Y., Theobalt, C.: High-quality shape from multi-view stereo and shading under general illumination. In: CVPR (2011)
Zhang, L., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multi-view stereo. In: ICCV, vol. 1, pp. 618–626 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Lenoch, M., Biebrach, P., Grumpe, A., Wöhler, C. (2017). Multi-view Shape from Shading Constrained by Stereo Image Analysis. In: Liu, M., Chen, H., Vincze, M. (eds) Computer Vision Systems. ICVS 2017. Lecture Notes in Computer Science(), vol 10528. Springer, Cham. https://doi.org/10.1007/978-3-319-68345-4_29
Download citation
DOI: https://doi.org/10.1007/978-3-319-68345-4_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-68344-7
Online ISBN: 978-3-319-68345-4
eBook Packages: Computer ScienceComputer Science (R0)