Abstract
When reconstructing surfaces from image data, reflections on specular surfaces are usually viewed as a nuisance that should be avoided. In this paper a different view is taken. Noting that such reflections contain information about the surface, this information could and should be used when estimating the shape of the surface. Specifically, assuming that the position of the light source and the cameras (i.e. the motion) are known, the reflection from a specular surface in a given image constrain the surface normal with respect to the corresponding camera.
Here the constraints on the normals, given by the reflections, are used to formulate a partial differential equation (PDE) for the surface. A smoothness term is added to this PDE and it is solved using a level set framework, thus giving a “shape from specularity” approach. The structure of the PDE also allows other properties to be included, e.g. the constraints from PDE based stereo.
The proposed PDE does not fit naturally into a level set framework. To address this issue it is proposed to couple a force field to the level set grid. To demonstrate the viability of the proposed method it has been applied successfully to synthetic data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M. J. Brooks and B. K. P. Horn. Shape and Source from Shading. MIT Press, Cambridge, MA, 1989.
V. Caselles, R. Kimmel, and G. Sapiro. Geodesic active contours. Int. Journal of Computer Vision, 1997.
L. D. Cohen and R. Kimmel. Global minimum for active contour models: A minimal path approach. In Proc. Conf. Computer Vision and Pattern Recognition, pages 666–673, 1996.
O. Faugeras and R. Keriven. Variational principles, surface evolution, pdes, level set methods, and the stereo problem. Image Processing, IEEE Transactions on, 7(3):336–344, 1998.
R. Hartley and A. Zisserman. Multiple View Geometry. Cambridge University Press, The Edinburgh Building, Cambridge CB2 2RU, UK, 2000.
A. Heyden and K. Åström. Euclidean reconstruction from image sequences with varying and unknown focal length and principal point. In Proc. Conf. Computer Vision and Pattern Recognition, pages 438–443, 1997.
H. Jin, A. Yezzi, and S. Soatto. Variational multiframe stereo in the presence of specular reflections. Technical Report TR01-0017, UCLA, 2001.
R. Kimmel and A. M. Bruckstein. Global shape from shading. In Computer Vision and Image Understanding, pages 120–125, 1995.
D. Morris and T. Kanade. Image-consistent surface triangulation. In IEEE Conf. Computer Vision and Pattern Recognition’2000, pages 332–338, 2000.
K. Museth, D.E. Breen, R.T. Whitaker, and A.H. Barr. Level set surface editing operators. ACM Transactions on Graphics, 21(3):330–8, 2002.
S. K. Nayar, K. Ikeuchi, and T. Kanade. Determining shape and reflectance of lambertian, specular, and hybrid surfaces using extended light sources. In IEEE Workshop on Industrial Applications of Machine Intelligence and Vision, 1989.
D. Nister. Automatic Dense Reconstruction from Uncalibrated Video Sequences. PhD thesis, Royal Institute of Technology, KTH, 2001.
M. Okutomi and T. Kanade. A multiple-baseline stereo. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 15(4):353–363, 1993.
S. J. Osher and R. P. Fedkiw. Level Set Methods and Dynamic Implicit Surfaces. Springer Verlag, 1st edition, November 2002.
S. Osher and J. A. Sethian. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations. Journal of Computational Physics, 79:12–49, 1988.
M. Pollefeys. Self-calibration and metric 3D reconstruction from uncalibrated image sequences. PhD thesis, K.U.Leuven, 1999.
S. Savarese and P. Perona. Local analysis for 3d reconstruction of specular surfaces. ii. Computer Vision — ECCV 2002. 7th European Conference on Computer Vision. Proceedings (Lecture Notes in Computer Science Vol.2351), pages 759–74, 2002.
J.A. Sethian. Level Set Methods and Fast Marching Methods Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science. Cambridge University Press, 1999.
C.C. Slama. Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, VA, 4:th edition, 1984.
T. Tasdizen, R. Whitaker, P. Burchard, and S. Osher. Geometric surface processing via normal maps. Technical Report UUCS-02-02, School of Computing, University of Utah, January 2002.
B Triggs, P F McLauchlan, R I Hartley, and A W Fitzgibbon. Special sessions — bundle adjustment — a modern synthesis. Lecture Notes in Computer Science, 1883:298–372, 2000.
Ruo Zhang, Ping-Sing Tsai, J.E. Cryer, and M. Shah. Shape-from-shading: a survey. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 21(8):690–706, 1999.
J. Y. Zheng and A. Murata. Acquiring a complete 3d model from specular motion under the illumination of circular-shaped light sources. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 22(8):913–920, 2000.
M. Ziegler, L. Falkenhagen, R. Horst, and D. Kalivas. Evolution of stereoscopic and three-dimensional video. Image Communication, 14, 1998.
A. Zisserman, P. Giblin, and A. Blakey. The information available to a moving observer from specularities. Image and vision computing, 1989.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Solem, J.E., Aanæs, H., Heyden, A. (2003). PDE Based Shape from Specularities. In: Griffin, L.D., Lillholm, M. (eds) Scale Space Methods in Computer Vision. Scale-Space 2003. Lecture Notes in Computer Science, vol 2695. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44935-3_28
Download citation
DOI: https://doi.org/10.1007/3-540-44935-3_28
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40368-5
Online ISBN: 978-3-540-44935-5
eBook Packages: Springer Book Archive