Abstract
Polynomial Texture Mapping (PTM) is a technique employed in a variety of settings, from museums to in-the-field image capture to multi-illuminant microscopy. It consists of illuminating the surface in question with lights from a collection of light directions, each light in turn. To date, the most accurate interpolation employed in PTM consists of two stages: a matte regression stage followed by a further specularity/shadow interpolation. For the first stage, recovering an underlying matte model so as to acquire surface albedo, normals and chromaticity, PTM employs polynomial regression at each pixel, mapping light-direction to luminance. A more accurate model excludes outlier values deriving from specularities and shadows by employing a robust regression from 6-D polynomials to 1-D luminance. Robust methods are guaranteed to automatically find the best representation of the underlying matte content. Here, we retain the idea of using robust methods but instead investigate using a much simpler robust 1-D mode-finder, acting on luminance and on chromaticity components. We then go on to increase accuracy by carrying out 3-D to 1-D regression: this strikes a balance between the best method and the fastest method, with greatly diminished complexity and another large speedup. We show that little accuracy is lost using this much simpler method, and demonstrate the effectiveness of the new method on several image datasets.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Malzbender, T., Gelb, D., Wolters, H.: Polynomial texture maps. In: Computer Graphics, SIGGRAPH 2001 Proceedings, pp. 519–528 (2001)
Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19, 139–144 (1980)
Mudge, M.: Cultural Heritage Imaging.: Personal Communication (2010)
Drew, M., Hel-Or, Y., Malzbender, T., Hajari, N.: Robust estimation of surface properties and interpolation of shadow/specularity components. Image and Vision Computing 30, 317–331 (2012)
Rousseeuw, P.J., Leroy, A.M.: Robust Regression and Outlier Detection. Wiley (1987)
Zickler, T., Enrique, S., Ramamoorthi, R., Belhumeur, P.: Reflectance sharing: image-based rendering from a sparse set of images. In: Eurographics Symposium on Rendering, pp. 253–265 (2005)
Zickler, T., Ramamoorthi, R., Enrique, S., Belhumeur, P.: Reflectance sharing: Predicting appearance from a sparse set of images of a known shape. IEEE Trans. on Patt. Anal. and Mach. Intell. 28, 1287–1302 (2006)
Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24, 756–764 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, M., Drew, M.S. (2012). Robust Luminance and Chromaticity for Matte Regression in Polynomial Texture Mapping. In: Fusiello, A., Murino, V., Cucchiara, R. (eds) Computer Vision – ECCV 2012. Workshops and Demonstrations. ECCV 2012. Lecture Notes in Computer Science, vol 7584. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33868-7_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-33868-7_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33867-0
Online ISBN: 978-3-642-33868-7
eBook Packages: Computer ScienceComputer Science (R0)