Abstract
Intrinsic images represent the underlying properties of a scene such as illumination (shading) and surface reflectance. Extracting intrinsic images is a challenging, ill-posed problem. Human performance on tasks such as shadow detection and shape-from-shading is improved by adding colour and texture to surfaces. In particular, when a surface is painted with a textured pattern, correlations between local mean luminance and local luminance amplitude promote the interpretation of luminance variations as illumination changes. Based on this finding, we propose a novel feature, local luminance amplitude, to separate illumination and reflectance, and a framework to integrate this cue with hue and texture to extract intrinsic images. The algorithm uses steerable filters to separate images into frequency and orientation components and constructs shading and reflectance images from weighted combinations of these components. Weights are determined by correlations between corresponding variations in local luminance, local amplitude, colour and texture. The intrinsic images are further refined by ensuring the consistency of local texture elements. We test this method on surfaces photographed under different lighting conditions. The effectiveness of the algorithm is demonstrated by the correlation between our intrinsic images and ground truth shading and reflectance data. Luminance amplitude was found to be a useful cue. Results are also presented for natural images.
Chapter PDF
References
Barrow, H.G., Tanenbaum, J.M.: Recovering intrinsic scene characteristics from images. Computer Vision systems, 3–26 (1978)
Land, E.H., McCann, J.J.: Lightness and retinex theory. Journal of the Optical Society of America A 61, 1–11 (1971)
Sinha, P., Adelson, E.: Recovering reflectance and illumination in a world of painted polyhedra. In: ICCV, pp. 156–163 (1993)
Bell, M., Freeman, W.T.: Learning local evidence for shading and reflectance. In: ICCV, vol. 1, pp. 670–677 (2001)
Funt, B.V., Drew, M.S., Brockington, M.: Recovering shading from color images. In: Sandini, G. (ed.) ECCV 1992. LNCS, vol. 588, pp. 124–132. Springer, Heidelberg (1992)
Olmos, A., Kingdom, F.A.A.: A biologically inspired algorithm for the reconvery of shading and reflectance images. Perception 33, 1463–1473 (2004)
Tappen, M.F., Freeman, W.T., Adelson, E.H.: Recovering intrinsic images from a single image. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1459–1472 (2005)
Parraga, C.A., Troscianko, T., Tolhurst, D.J.: Spatiochromatic properties of natural images and human vision. Current Biology 12, 483–487 (2002)
Finlayson, G.D., Hordley, S.D., Lu, C., Drew, M.: On the removal of shadows from images. IEEE Trans. Pattern Analysis and Machine Intelligence 28, 59–68 (2006)
Kingdom, F.A.A.: Perceiving light versus material. Vis. Res. 48, 2090–2105 (2008)
Shen, L., Tan, P., Lin, S.: Intrinsic image decomposition with non-local texture cues. In: IEEE Computer Vision and Pattern Recognition, pp. 1–7 (2008)
Weiss, Y.: Deriving intrinsic images from image sequences. In: ICCV, vol. 2, pp. 68–75 (2001)
Agrawal, A., Raskar, R., Chellappa, R.: Edge suppression by gradient field transformation using cross projection tensors. In: CVPR, vol. 2, pp. 2301–2308 (2006)
Matsushita, Y., Lin, S., Kang, S.B., Shum, H.Y.: Estimating intrinsic images from image sequences with biased illumination. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 274–286. Springer, Heidelberg (2004)
Schofield, A.J., Hesse, G., Rock, P.B., Georgeson, M.A.: Local luminance amplitude modulates the interpretation of shape-from-shading in textured surfaces. Vision Research 46, 3462–3482 (2006)
Simoncelli, E.P., Freeman, W.T.: The steerable pyramid: A flexible architecture for multi-scale derivative computation. In: ICIP, pp. 444–447 (1995)
Comanicu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24, 603–619 (2004)
Reinhard, E., Devlin, K.: Dynamic range reduction inspired by photoreceptor physiology. IEEE Trans. Visualization and Computer Graphics 11, 13–24 (2005)
Waltz, R.A., Morales, J.L., Nocedal, J., Orban, D.: An interior algorithm for nonlinear optimization that combines line search and trust region steps. Mathematical Programming 107, 391–408 (2006)
Grosse, R., Johnson, M.K., Adelson, E.H., Freeman, W.T.: Ground-truth dataset and baseline evaluations for intrinsic image algorithms. In: ICCV (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
1 Electronic Supplementary Material
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, X., Schofield, A.J., Wyatt, J.L. (2010). Correlation-Based Intrinsic Image Extraction from a Single Image. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15561-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-15561-1_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15560-4
Online ISBN: 978-3-642-15561-1
eBook Packages: Computer ScienceComputer Science (R0)