Abstract
Many recent methods for perspective shape from shading (SfS) are based on formulations in terms of partial differential equations (PDEs). However, while the quality of such methods steadily improves, their lacking robustness is still an open issue. In this context, variational methods seem to be a promising alternative, since they allow to incorporate smoothness assumptions that have proven to be useful for many other tasks in computer vision. Surprisingly, however, such methods have hardly been considered for perspective SfS so far. In our article we address this problem and develop a novel variational model for this task. By combining building blocks of recent PDE-based methods such as a Lambertian reflectance model and camera-centred illumination with a discontinuity-preserving second-order smoothness term, we obtain a variational method for perspective SfS that offers by construction an improved degree of robustness compared to existing PDE-based approaches. Our experiments confirm the success of our strategy. They show that embedding the assumptions of PDE-based approaches into a variational model with a suitable smoothness term can be very beneficial – in particular in scenarios with noise or partially missing information.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Abdelrahim, A.S., Abdelmunim, H., Graham, J., Farag, A.: Novel variational approach for the perspective shape from shading problem using calibrated images. In: Proc. International Conference on Image Processing, pp. 2563–2566 (2013)
Bors, A.G., Hancock, E.R., Wilson, R.C.: Terrain analysis using radar shape-from-shading. IEEE Trans. on Pattern Analysis and Machine Intelligence 25, 974–992 (2003)
Breuß, M., Cristiani, E., Durou, J.-D., Falcone, M., Vogel, O.: Perspective Shape from Shading: Ambiguity Analysis and Numerical Approximations. SIAM Journal on Imaging Sciences 5(1), 311–342 (2012)
Brooks, M.J., Horn, B.K.P.: Shape and source from shading. In: Proc. International Joint Conference in Artificial Intelligence, pp. 932–936 (1985)
Charbonnier, P., Blanc-Féraud, L., Aubert, G., Barlaud, M.: Deterministic Edge-Preserving Regularization in Computed Imaging. IEEE Trans. on Image Procesing 6(2), 298–311 (1997)
Courant, R., Hilbert, D.: Methods of Mathematical Physics. Interscience Publishers Inc., New York (1953)
Courteille, F., Crouzil, A., Durou, J.-D., Gurdjos, P.: Towards shape from shading under realistic photographic conditions. In: Int. Conference on Pattern Recognition, pp. 277–280 (2004)
Courteille, F., Crouzil, A., Durou, J.-D., Gurdjos, P.: 3D-spline reconstruction using shape from shading: spline from shading. Image and Vision Computing 26(4), 466–479 (2008)
Demetz, O., Stoll, M., Volz, S., Weickert, J., Bruhn, A.: Learning Brightness Transfer Functions for the Joint Recovery of Illumination Changes and Optical Flow. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part I. LNCS, vol. 8689, pp. 455–471. Springer, Heidelberg (2014)
Frankot, R.T., Chellappa, R.: A method for enforcing integrability in shape from shading algorithms. IEEE Trans. on Pattern Analysis and Machine Intelligence 10(4), 439–451 (1988)
Horn, B.K.P.: Shape from Shading: A Method for Obtaining the Shape of a Smooth Opaque Object from One View. PhD thesis. MIT, Cambridge (1970)
Ikeuchi, K., Horn, B.K.P.: Numerical shape from shading and occluding boundaries. Artificial Intelligence 17(1–3), 141–184 (1981)
Oliensis, J.: Shape from Shading as a Partially Well-Constrained Problem. Computer Vision, Graphics, and Image Processing: Image Understanding 54(2), 163–183 (1991)
Prados, E., Faugeras, O.: “Perspective Shape from Shading” and Viscosity Solutions. In: Proc. International Conference Computer Vision, pp. 826–831 (2003)
Prados, E., Faugeras, O.: Shape from shading: A well-posed problem? In: Proc. Conference on Computer Vision and Pattern Recognition, pp. 870–877 (2005)
Rouy, E., Tourin, A.: A Viscosity Solution Approach to Shape-From-Shading. SIAM Journal on Numerical Analysis 29(3), 867–884 (1992)
Schmaltz, C., Peter, P., Mainberger, M., Eberl, F., Weickert, J., Bruhn, A.: Understanding, optimising, and extending data compression with anisotropic diffusion. International Journal of Computer Vision 108(3), 222–240 (2014)
Tankus, A., Sochen, N., Yeshurun, Y.: A New Perspective [on] Shape-from-Shading. In: Proc. Conference on Computer Vision and Pattern Recognition, pp. 862–869 (2003)
Tankus, A., Sochen, N., Yeshurun, Y.: Shape-from-Shading Under Perspective Projection. International Journal of Computer Vision 63(1), 21–43 (2005)
Vogel, O., Bruhn, A., Weickert, J., Didas, S.: Direct Shape-from-Shading with Adaptive Higher Order Regularisation. In: Sgallari, F., Murli, A., Paragios, N. (eds.) SSVM 2007. LNCS, vol. 4485, pp. 871–882. Springer, Heidelberg (2007)
Wang, G.H., Han, J.Q., Zhang, X.M.: Three-dimensional reconstruction of endoscope images by a fast shape from shading method. Measurement Science and Technology 20 (2009)
Zhang, R., Tsai, P.-S., Cryer, J.E., Shah, M.: Shape from Shading: A Survey. IEEE Trans. on Pattern Analysis and Machine Intelligence 21(8), 690–706 (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Ju, Y.C., Bruhn, A., Breuß, M. (2015). Variational Perspective Shape from Shading. In: Aujol, JF., Nikolova, M., Papadakis, N. (eds) Scale Space and Variational Methods in Computer Vision. SSVM 2015. Lecture Notes in Computer Science(), vol 9087. Springer, Cham. https://doi.org/10.1007/978-3-319-18461-6_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-18461-6_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18460-9
Online ISBN: 978-3-319-18461-6
eBook Packages: Computer ScienceComputer Science (R0)