Abstract
Various problems in Computer Vision become difficult due to a strong influence of lighting on the images of an object. Recent work showed analytically that the set of all images of a convex, Lambertian object can be accurately approximated by the low-dimensional linear subspace constructed using spherical harmonic functions. In this paper we present two major contributions: first, we extend previous analysis of spherical harmonic approximation to the case of arbitrary objects; second, we analyze its applicability for near light. We begin by showing that under distant lighting, with uniform distribution of light sources, the average accuracy of spherical harmonic representation can be bound from below. This bound holds for objects of arbitrary geometry and color, and for general illuminations (consisting of any number of light sources). We further examine the case when light is coming from above and provide an analytic expression for the accuracy obtained in this case. Finally, we show that low-dimensional representations using spherical harmonics provide an accurate approximation also for fairly near light. Our analysis assumes Lambertian reflectance and accounts for attached, but not for cast shadows. We support this analysis by simulations and real experiments, including an example of a 3D shape reconstruction by photometric stereo under very close, unknown lighting.
Chapter PDF
References
Basri, R., Jacobs, D.W.: Lambertian reflectances and linear subspaces. PAMI 25(2) (2003)
Basri, R., Jacobs, D.W.: Photometric stereo with general, unknown lighting. In: CVPR, Vol. II, pp. 374–381 (2001)
Belhumeur, P., Kriegman, D.: What is the Set of Images of an Object Under All Possible Lighting Conditions? In: CVPR, pp. 270–277 (1996)
Epstein, R., Hallinan, P., Yuille, A.: 5±2 Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models. In: IEEE Workshop on Physics-Based Vision, pp. 108–116 (1995)
Groemer, H.: Geometric applications of Fourier series and spherical harmonics. Cambridge University Press, Cambridge (1996)
Hallinan, P.: A Low-Dimensional Representation of Human Faces for Arbitrary Lighting Conditions. In: CVPR, pp. 995–999 (1994)
Hara, K., Nishino, K., Ikeuchi, K.: Determining Reflectance and Light Position from a Single Image Without Distant Illumination Assumption. In: ICCV, pp. 560–567 (2003)
Kirby, M., Sirovich, L.: The application of the Karhunen-Loeve procedure for the characterization of human faces. PAMI 12(1), 103–108 (1990)
Lambert, J.: Photometria Sive de Mensura et Gradibus Luminus, Colorum et Umbrae. Eberhard Klett (1760)
Murase, H., Nayar, S.: Visual learning and recognition of 3D objects from appearance. International Journal of Computer Vision 14(1), 5–25 (1995)
Nillius, P., Eklundh, J.-O.: Low-Dimensional Representations of Shaded Surfaces under Varying Illumination. In: CVPR, pp. 185–192 (2003)
Nillius, P., Eklundh, J.-O.: Phenomenological Eigenfunctions for Image Irradiance. In: ICCV. pp. 568–575 (2003)
Ramamoorthi, R.: Analytic PCA construction for theoretical analysis of lighting in a single image of a Lambertian object. PAMI 24(10), 1322–1333 (2002)
Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: determining the illumination from images of convex Lambertian object. JOSA 18(10), 2448–2459 (2001)
Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: Siggraph, pp. 497–500 (2001)
Simakov, D., Frolova, D., Basri, R.: Dense shape reconstruction of a moving object under arbitrary, unknown lighting. In: ICCV, pp. 1202–1209 (2003)
Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3(1), 71–96 (1991)
Yuille, A., Snow, D., Epstein, R., Belhumeur, P.: Determining Generative Models of Objects Under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability. IJCV 35(3), 203–222 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Frolova, D., Simakov, D., Basri, R. (2004). Accuracy of Spherical Harmonic Approximations for Images of Lambertian Objects under Far and Near Lighting. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24670-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-24670-1_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21984-2
Online ISBN: 978-3-540-24670-1
eBook Packages: Springer Book Archive