Abstract
Image-based and model-based methods are two representative rendering methods for generating virtual images of objects from their real images. Extensive research on these two methods has been made in CV and CG communities. However, both methods still have several drawbacks when it comes to applying them to the mixed reality where we integrate such virtual images with real background images. To overcome these difficulties, we propose a new method, which we refer to as the Eigen-Texture method. The proposed method samples appearances of a real object under various illumination and viewing conditions, and compresses them in the 2D coordinate system defined on the 3D model surface. The 3D model is generated from a sequence of range images. The Eigen-Texture method is practical because it does not require any detailed reflectance analysis of the object surface, and has great advantages due to the accurate 3D geometric models. This paper describes the method, and reports on its implementation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S.E. Chen and L. Williams, “View interpolation for image synthesis,” In Computer Graphics Proceedings, ACM SIGGRAPH 93, pages 279–288, Aug. 1993.
P. Debevec, “Rendering Synthesis Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography,” In Computer Graphics Proceedings, ACM SIGGRAPH 98, pages 189–198, Jul. 1998.
S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen, “The Lumi-graph,” In Computer Graphics Proceedings, ACM SIGGRAPH 96, pages 43–54, Aug. 1996.
M. Levoy and P. Hanrahan, “Light Field Rendering,” In Computer Graphics Proceedings, ACM SIGGRAPH 96, pages 31–42, Aug. 1996.
A. Matsui, K. Sato, and K. Chihara, “Composition of Real Light and Virtual Light based on Environment Observation and KL-expansion of Multiple Lightsource Image,” Technical Report of IEICE PRMU97–115, 97(324):29–36, Oct. 1997.
H. Murase and S.K. Nayar, “Visual Learning and Recognition of 3-D Objects from Appearance,” International Journal of Computer Vision, 14:5–24, 1995.
K. Nishino, I. Sato, Y. Sato, and K. Ikeuchi, “Eigen-Texture Mehod: Appearance Compression based on 3D Model,” In IPSJ Symposium Series, MIRU’98(in Japanese), volume 98, pages I-19–I-26, 7 1998.
K. Pulii, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, “View-based Rendering: Visualizing Real Objects from Scanned Range and Color Data,” In Proceedings of 8th Eurographics Workshop on Rendering, Jun. 1997.
I. Sato, Y. Sato, and K. Ikeuchi, “Seamless integration of virtual objects into a real scene based on a real illumination distribution,” Technical Report IIS-CVL-98-101, Computer Vision Lab., IIS, The Univ. of Tokyo, Jan. 1998.
K. Sato and S. Inokuchi, “Range-imaging system utilizing nematic liquid crystal mask,” In First International Conference on Computer Vision, IEEE, pages 657–661, 1987.
Y. Sato and K. Ikeuchi, “Temporal-color space analysis of reflection,” Journal of the Optical Society of America, 11(11): 1990–3002, 1994.
Y. Sato, M.D. Wheeler, and K. Ikeuchi, “Object shape and reflectance modeling from observation,” In Computer Graphics Proceedings, ACM SIGGRAPH 97, pages 379–387, Aug. 1997.
A. Shashua. Geometry and Photometry in 3D Visual Recognition, PhD thesis, Dept. Brain and Cognitive Science, MIT, 1992.
G. Turk and M. Levoy, “Zippered polygon meshes from range images,” In Computer Graphics Proceedings, ACM SIGGRAPH 94, pages 311–318, Jul. 1994.
M.D. Wheeler, Y Sato, and K. Ikeuchi, “Consensus Surfaces for Modeling 3D Objects from Multiple Range Images,” In Sixth International Conference on Computer Vision, IEEE, pages 917–924, 1998.
R.J. Woodham, “Photometric Stereo: A Reflectance Map Technique for Determining Surface Orientation from a Single View,” In Image Understanding Systems and Industrial Applications, volume 155, pages 136–143. Proc. SPIE 22nd Annual Technical Symp., Aug. 1978.
Z. Zhang, “Modeling Geometric Structure and Illumination Variation of a Scene from Real Images,” In Sixth International Conference on Computer Vision, pages 1041–1046, Jul. 1998.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer Science+Business Media New York
About this chapter
Cite this chapter
Nishino, K., Sato, Y., Ikeuchi, K. (2001). Eigen-Texture Method: Appearance Compression Based on 3D Model. In: Ikeuchi, K., Sato, Y. (eds) Modeling from Reality. The Springer International Series in Engineering and Computer Science, vol 640. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-0797-0_5
Download citation
DOI: https://doi.org/10.1007/978-1-4615-0797-0_5
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-5244-0
Online ISBN: 978-1-4615-0797-0
eBook Packages: Springer Book Archive