Abstract
One of the problems that hinders the application of conventional methods for shape-from-shading to the analysis of shiny objects is the presence of local highlights. The first of these are specularities which appear at locations on the viewed object where the local surface normal is the bisector of the light source and viewing directions. Highlights also occur at the occluding limb of the object where roughness results in backscattering from microfacets which protrude above the surface. In this paper, we consider how to subtract both types of highlight from shiny surfaces in order to improve the quality of surface normal information recoverable using shape-from-shading.
Chapter PDF
References
P. Beckmann and A. Spizzochino, The Scattering of Electromagnetic Waves from Rough Surfaces, Pergamon, New York, 1963.
J. Besag, “On the statistical analysis of dirty pictures,” J. R. Statis. Soc. Lond. B, Vol. 48, pp. 259–302, 1986.
M. Bichsel and A.P. Pentland, “A Simple Algorithm for Shape from Shading,” CVPR, pp. 459–465, 1992.
A. Blake and H. Bulthoff, “Shape from Specularities: computation and psychophysics,” Phil Trans R. Soc. Lond. B, Vol. 331, pp. 237–252, 1991.
G. Brelstaff and A. Blake, “Detecting Specular Reflection Using Lambertian Constraints,” ICCV, pp. 297–302, 1988.
K. Dana, S. Nayar, B. Van Ginneken and J. Koenderink, “Reflectance and Texture of Real-World Surfaces,” CVPR, pp. 151–157, 1997.
F.P. Ferrie and J. Lagarde, “Curvature Consistency Improves Local Shading Analysis,” ICPR, Vol. I, pp. 70–76, 1990.
R.T. Frankot and R. Chellappa, “A Method for Enforcing Integrability in Shape from Shading Algorithms,” ICCV, pp. 118–125, 1987.
G.H. Healey and T.O. Binford, “Local shape from specularity,” ICCV, pp. 151–160, 1987.
B.K.P. Horn and M. J. Brooks, “The Variational Approach to Shape from Shading,” CVGIP, Vol. 33, No. 2, pp. 174–208, 1986.
R. Kimmel and A.M. Bruckstein, “Tracking Level-sets by Level-sets: A Method for Solving the Shape from Shading Problem,” CVIU, Vol. 62, No. 1, pp. 47–58, 1995.
J.J. Koenderink, A.J. van Doorn and A.M.L. Kappers, “Surface Perception in Pictures,” Perception and Psychophysics, Vol. 52, No. 5, pp. 487–496, 1992.
C.C.J. Kuo and K.M. Lee, “Shape from Shading With a Generalized Reflectance Map Model,” CVIU, Vol. 67, No. 2, pp. 143–160, 1997.
S. Lin and S.W. Lee, “Estimation of Diffuse and Specular Appearance,” ICCV, pp. 855–860, 1999.
S. Magda, D. Kriegman, T. Zickler and P. Belhumeur, “Beyond Lambert: Reconstructing Surfaces with Arbitrary BRDFs,” ICCV, Vol. 2, pp. 391–399, 2001.
S.K. Nayar, K. Ikeuchi and T. Kanade, “Surface Reflection: Physical and Geometrical Perspectives,” PAMI, Vol. 13, No. 7, pp. 611–634, 1991.
S.K. Nayar, X. Fang and T. Boult, “Removal of specularities using color and polarization,” CVPR, pp. 583–590, 1993.
J. Oliensis and P. Dupuis, “A Global Algorithm for Shape from Shading,” CVPR, pp. 692–701, 1993.
M. Oren and S.K. Nayar, “Generalization of the Lambertian Model and Implications for Machine Vision,” IJCV, vol. 14, No. 3, pp. 227–251, 1995.
H. Ragheb, and E.R. Hancock, “Separating Lambertian and Specular Reflectance Components using Iterated Conditional Modes,” BMVC, pp. 541–552, 2001.
P.T. Sander and S.W. Zucker, “Inferring surface trace and differential structure from 3D images,” PAMI, Vol. 12, No. 9, pp 833–854, 1990.
H.D. Tagare and R.J.P. de Figueiredo, “A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces,” PAMI, Vol. 13, No. 2, pp. 133–151, 1991.
K. Torrance and E. Sparrow, “Theory for Off-Specular Reflection from Roughened Surfaces,” JOSA, Vol. 57, pp. 1105–1114, 1967.
L.B. Wolff, “On The Relative Brightness of Specular and Diffuse Reflection,” CVPR, pp. 369–376, 1994.
L.B. Wolff, S.K. Nayar and M. Oren, “Improved Diffuse Reflection Models for Computer Vision,” IJCV, Vol. 30, No. 1, pp. 55–71, 1998.
P.L. Worthington and E.R. Hancock, “New Constraints on Data-closeness and Needle-map consistency for SFS,” PAMI, Vol. 21, No. 11, pp. 1250–1267, 1999.
R. Zhang, P. Tsai, J.E. Cryer and M. Shah, “Shape from Shading: A Survey,” PAMI, Vol. 21, No. 8, pp. 690–706, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ragheb, H., Hancock, E.R. (2002). Highlight Removal Using Shape-from-Shading. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47967-8_42
Download citation
DOI: https://doi.org/10.1007/3-540-47967-8_42
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43744-4
Online ISBN: 978-3-540-47967-3
eBook Packages: Springer Book Archive