Creating Photorealistic Virtual Model with Polarization-based Vision System
Recently, 3D models are used in many fields such as education, medical services, entertainment, art, digital archive, etc., because of the progress of computational time and demand for creating photorealistic virtual model is increasing for higher reality. In the field of computer vision, a number of techniques have been developed for creating the virtual model by observing the real object in computer vision field. In this chapter, we propose the method for creating photorealistic virtual model by using laser range sensor and polarization based image capture system. We capture the range and color images of the object which is rotated on the rotary table. In geometrical aspects, an object surface shape is reconstructed by merging multiple range images of the object. In optical aspects, color images are captured under fixed point light source. By using reconstructed object shape and sequence of color images of the object, parameter of a reflection model are estimated in a robust manner. As a result, we can make photorealistic 3D model in consideration of surface reflection. The key point of the proposed method is that, first, the diffuse and specular reflection components are separated from the color image sequence, and then, reflectance parameters of each reflection component are estimated separately. In separation of reflection components, we use polarization filter. This approach enables estimation of reflectance properties of real objects whose surfaces show specularity as well as diffusely reflected lights. The recovered object shape and reflectance properties are then used for synthesizing object images with realistic shading effects under arbitrary illumination conditions.
KeywordsColor Image Linear Polarization Geometrical Optic Range Image Object Surface
Unable to display preview. Download preview PDF.
- P.Debevec, T.Hawkins, C.Tchou, H-P.Duiker, W.Sarokin and M.Sagar "Acquiring the Reflectance Field of a Human Face," Computer Graphics Proceedings, ACM SIGGRAPH’2000, Aug.2000Google Scholar
- P.Debevec, A.Wenger, C.Tchou, A.Gardner, J.Waese and T.Hawkins "A Lighting Reproduction Approach to Live-Action Compositing," Computer Graphics Proceedings, ACM SIGGRAPH’2002, July.2002Google Scholar
- A.S.Georghiades "Recovering 3-D Shape and Reflectance From a Small Number of Photographs," Eurographics Symposium on Rendering:14th Eurographics Workshop on Rendering, pp230-240, 2002Google Scholar
- S.J.Gorter, R.Grzeszczuk, R.Szeliski and M.F.Cohen, "The Lumigraph," Computer Graphics Proceedings,ACM SIGGRAPH’96, pp.43-54,Aug.1996.Google Scholar
- M.Levoy and P.Hanrahan, "Light Field Rendering," Computer Graphics Proceedings,ACM SIGGRAPH’96, pp.31-42,Aug.1996.Google Scholar
- S.K. Nayer,X. Fang, T.E. Boult, "Removal of specularities using color and polarization,"Proceedings of Computer Vision and Pattern Recognition ’93, pp.583-590, New York City, NY, June 1993.Google Scholar
- M. Saito,Y. Sato,K. Ikeuchi,H. Kashiwagi, "Measurement of Surface Orientations of Transparent Objects Using Polarization in Highlight," IEEE Trans.on Computer Vision and Pattern Recognition ’99, Vol.1,pp.381-386, Fort Collins,Colorado, June 1999.Google Scholar
- Y.Sato,M.D.Wheeler,K.Ikeuchi, "Object Shape and Reflectance Modeling from Observation," Computer Graphics Proceedings,ACM SIGGRAPH’97,pp. 379-387,Aug 1997.Google Scholar
- Y.Y.Schechner, J.Shamir and N.Kiryati, "Polarization-based Decorrelation of Transparent Layers: The Inclination Angle of an Invisible Sur-face," Proceedings of International Conference on Computer Vision ’99,pp.814-819, 1999.Google Scholar
- A.Wenger, A.Gardner, C.Tchou, J.Unger, T.Hawkins and P.Debevec "A Lighting Reproduction Approach to Live-Action Compositing," Computer Graphics Proceedings, ACM SIGGRAPH’2005, to be appear.Google Scholar
- D.N.Wood, D.I.Azuma, K.Aldinger, B.Curless, T.Duchamp, D.H.Salesin and W.Stuetzle, "Surface Light Fields for 3D Photography," Computer Graphics Proceedings,ACM SIGGRAPH’00, Aug.2000.Google Scholar