Abstract
We address the problem of inferring homogeneous reflectance (BRDF) from a single image of a known shape in an unknown real-world lighting environment. With appropriate representations of lighting and reflectance, the image provides bilinear constraints on the two signals, and our task is to blindly isolate the latter. We achieve this by leveraging the statistics of real-world illumination and estimating the reflectance that is most likely under a distribution of probable illumination environments. Experimental results with a variety of real and synthetic images suggest that useable reflectance information can be inferred in many cases, and that these estimates are stable under changes in lighting.
Chapter PDF
Similar content being viewed by others
Keywords
- Ground Truth
- Independent Component Analysis
- Color Constancy
- High Dynamic Range Image
- Eurographics Symposium
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Beck, J., Prazdny, S.: Highlights and the perception of glossiness. Perception & Psychophysics 30(4) (1981)
Brainard, D., Freeman, W.: Bayesian color constancy. J. Opt. Soc. Am. A 14(7) (1997)
Ding, C., Li, T., Jordan, M.: Convex and semi-nonnegative matrix factorizations. IEEE T. Pattern Anal. 32(1) (2010)
Dror, R.: Surface reflectance recognition and real-world illumination statistics. Ph.D. thesis, Massachusetts Institute of Technology (2002)
Dror, R., Willsky, A., Adelson, E.: Statistical characterization of real-world illumination. J. Vision 4 (2004)
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM T. Graphics (Proc. ACM SIGGRAPH) 25(3) (2006)
Fleming, R., Dror, R.O., Adelson, E.H.: Real-world illumination and the perception of surface reflectance properties. J. Vision 3(5) (2003)
Georghiades, A.: Recovering 3-D shape and reflectance from a small number of photographs. In: Proc. Eurographics Workshop on Rendering (2003)
Ghosh, A., Achutha, S., Heidrich, W., O’Toole, M.: BRDF acquisition with basis illumination. In: Proc. IEEE Int. Conf. Computer Vision (2007)
Haber, T., Fuchs, C., Bekaer, P., Seidel, H., Goesele, M., Lensch, H.: Relighting objects from image collections. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2009)
Hara, K., Nishino, K., Ikeuchi, K.: Mixture of spherical distributions for single-view relighting. IEEE T. Pattern Anal. 30(1) (2008)
Levin, A., Weiss, Y., Durand, F., Freeman, W.: Understanding and evaluating blind deconvolution algorithms. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2009)
Mahajan, D., Ramamoorthi, R., Curless, B.: A theory of spherical harmonic identities for BRDF/lighting transfer and image consistency. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 41–55. Springer, Heidelberg (2006)
Marschner, S., Westin, S., Lafortune, E., Torrance, K., Greenberg, D.: Image-based BRDF measurement including human skin. In: Proc. Eurographics Symposium on Rendering (1999)
Matusik, W., Pfister, H., Brand, M., McMillan, L.: A data-driven reflectance model. ACM T. Graphics (Proc. ACM SIGGRAPH) 22(3) (2003)
Miskin, J.: Ensemble Learning for Independent Component Analysis. Ph.D. thesis, University of Cambridge (2000)
Miskin, J., MacKay, D.: Ensemble learning for blind source separation. Independent Component Analysis: Principles and Practice (2001)
Ng, R., Ramamoorthi, R., Hanrahan, P.: Triple product wavelet integrals for all-frequency relighting. ACM T. Graphics (Proc. ACM SIGGRAPH) 23(3) (2004)
Ngan, A., Durand, F., Matusik, W.: Experimental analysis of BRDF models. In: Eurographics Symposium on Rendering (2005)
Nishino, K.: Directional statistics BRDF model. In: Proc. IEEE Int. Conf. Computer Vision (2009)
Nishino, K., Zhang, Z., Ikeuchi, K.: Determining reflectance parameters and illumination distribution from a sparse set of images for view-dependent image synthesis. In: Proc. IEEE Int. Conf. Computer Vision (2001)
Pellacini, F., Ferwerda, J., Greenberg, D.: Toward a psychophysically-based light reflection model for image synthesis. In: Proc. ACM SIGGRAPH (2000)
Praun, E., Hoppe, H.: Spherical parametrization and remeshing. ACM T. Graphics 22(3) (2003)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: Proceedings of ACM SIGGRAPH, pp. 117–128 (2001)
Ramamoorthi, R., Hanrahan, P.: Frequency space environment map rendering. ACM Transactions on Graphics (TOG) 21(3), 517–526 (2002)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for reflection. ACM T. Graphics 23(4) (2004)
Romeiro, F., Vasilyev, Y., Zickler, T.: Passive reflectometry. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 859–872. Springer, Heidelberg (2008)
Romeiro, F., Zickler, T.: Ensemble learning for reflectometry. Tech. Rep. TR-06-10, Harvard School of Engineering and Applied Sciences (2010), ftp://ftp.deas.harvard.edu/techreports/tr-06-10.pdf
Rusinkiewicz, S.: A new change of variables for efficient BRDF representation. In: Eurographics Rendering Workshop ’98 (1998)
Sato, Y., Wheeler, M., Ikeuchi, K.: Object shape and reflectance modeling from observation. In: Proceedings of ACM SIGGRAPH (1997)
Sharan, L., Li, Y., Motoyoshi, I., Nishida, S., Adelson, E.: Image statistics for surface reflectance perception. J. Opt. Soc. Am. A 25(4) (2008)
Stark, M., Arvo, J., Smits, B.: Barycentric parameterizations for isotropic BRDFs. IEEE T. Vis. Computer Graphics 11(2) (2005)
Todd, J., Farley norman, J., Mingolla, E.: Lightness constancy in the presence of specular highlights. Psychological Science 15(1), 33–39 (2004)
Wang, R., Ng, R., Luebke, D., Humphreys, G.: Efficient wavelet rotation for environment map rendering. In: Eurographics Symposium on Rendering (2006)
Wills, J., Agarwal, S., Kriegman, D., Belongie, S.: Toward a perceptual space for gloss. ACM T. Graphics 28(4) (2009)
Yu, T., Wang, H., Ahuja, N., Chen, W.: Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images. In: Eurographics Symposium on Rendering (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Romeiro, F., Zickler, T. (2010). Blind Reflectometry. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6311. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15549-9_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-15549-9_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15548-2
Online ISBN: 978-3-642-15549-9
eBook Packages: Computer ScienceComputer Science (R0)