Abstract
We present a texturing approach for image-based modeling and rendering, where instead of texturing from one (or a blend of a few) sample images, new view-dependent textures are synthesized by modulating a differential texture basis. The texture basis contains image derivatives, and it models the first order intensity variation due to image projection errors, parallax and illumination variation. We derive an analytic form for this basis and show how to obtain it from images. Experimentally, we compare rendered views to ground truth real images and quantify how the texture basis can generate a more accurate rendering compared to conventional view-dependent textures. In a hardware accelerated implementation, we achieve frame rate on regular PCs and consumer graphics cards.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Movies of the experiments are available on http://www.cs.ualberta.ca/∼vis/scalesmod
Software is downloadable from http://www.cs.ualberta.ca/∼vis/ibmr
Barsi, R., Jacobs, D.: Lambertian refrectance and linear subspace. In: IEEE International Conference on Computer Vision, pp. 383–390 (2001)
Buehler, C., Bosse, M., McMillan, L., Gortler, S.J., Cohen, M.: Unstructured lumigraph rendering. In: Computer Graphics (SIGGRAPH), pp. 43–54 (2001)
Cobzas, D., Yerex, K., Jagersand, M.: Dynamic textures for image-based rendering of fine-scale 3D structure and animation of non-rigid motion. In: Eurographics (2002)
Dana, K.J., van Ginneken, B., Nayar, S.K., Koenderink, J.J.: Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18(1), 1–34 (1999)
Debevec, P.E., Taylor, C.J., Malik, J.: Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. In: SIGGRAPH (1996)
Doretto, G., Chiuso, A., Wu, Y.N., Soatto, S.: Dynamic textures. Int. J. Comput. Vis. 51(2), 91–109 (2003)
Eisemann, M., Decker, B.D., Magnor, M., Bekaert, P., de Aguiar, E., Ahmed, N., Theobalt, C., Sellent, A.: Floating textures. Comput. Graph. Forum (Proc. Eurographics EG’08) 27(2), 409–418 (2008)
Esteban, C.H., Schmitt, F.: Silhouette and stereo fusion for 3D object modeling. Comput. Vis. Image Understand. 96(3), 367–392 (2004)
Freeman, W.T., Adelson, E.H., Heeger, D.J.: Motion without movement. In: SIGGRAPH (1991)
Furukawa, R., Kawasaki, H., Ikeuchi, K., Sakauchi, M.: Appearance based object modeling using texture database: acquisition, compression and rendering. In: Proceedings of the 13th Eurographics Workshop on Rendering. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, pp. 257–266 (2002)
Gortler, S.J., Grzeszczuk, R., Szeliski, R.: The lumigraph. In: Computer Graphics (SIGGRAPH’96), pp. 43–54 (1996)
Hager, G.D., Belhumeur, P.N.: Efficient region tracking with parametric models of geometry and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 20(10), 1025–1039 (1998)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press (2000)
Heckbert, P.: Fundamentals of Texture Mapping. Msc thesis. Technical Report No. UCB/CSD 89/516, University of California, Berkeley (1989)
Jagersand, M.: Image based view synthesis of articulated agents. In: CVPR (1997)
Levoy, M., Hanrahan, P.: Light field rendering. In: Computer Graphics (SIGGRAPH’96), pp. 31–42 (1996)
Levy, B., Petitjean, S., Ray, N., Maillot, J.: Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph., 362–371 (2002)
Möller, T., Haines, E.: Real-Time Rendering. A.K. Peterson, Natick (2002)
Oliveira, M.M., Bishop, G., McAllister, D.: Relief texture mapping. In: Computer Graphics (SIGGRAPH’00) (2000)
Ramamoorthi, R.: Analytical pca construction for theoretical analysis of light variability in a single image of a lambertian object. IEEE Trans. Pattern Anal. Mach. Intell. 24(10) (2002)
Ramamoorthi, R., Hanarahan, P.: On the relationship between radiance and irradiance: determining the illumination from images of a convex lambertian object. J. Optical Soc. Am. A 18(10), 2448–2459 (2001)
Seitz, Curless, Diebel, Scharstein, Szeliski: A comparison of multiview stereo reconstruction algorithms. In: CVPR (2006)
Slabaugh, G.G., Culbertson, W.B., Malzbender, T., Schafer, R.W.: A survey of methods for volumetric scene reconstruction from photographs. In: International Workshop on Volume Graphics (2001)
Tarini, M., Callieri, M., Montani, C., Rocchini, C.: Marching intersections: an efficient approach to shape from silhouette. In: Proceedings of VMV 2002 (2002)
Vasilescu, M.A.O., Terzopoulos, D.: Tensortextures: multilinear image-based rendering. ACM Trans. Graph. 23(3), 336–342 (2004)
Vergauwen, M., Gool, L.V.: Web-based 3D reconstruction service. Mach. Vis. Appl. 17, 411–426 (2006)
Wood, D.N., Azuma, D.I., Aldinger, K., Curless, B., Duchamp, T., Salesin, D.H., Stuetzle, W.: Surface light fields for 3D photography. In: Computer Graphics (SIGGRAPH’00) (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jagersand, M., Birkbeck, N., Cobzas, D. (2010). View Dependent Texturing Using a Linear Basis. In: Ronfard, R., Taubin, G. (eds) Image and Geometry Processing for 3-D Cinematography. Geometry and Computing, vol 5. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12392-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-12392-4_13
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12391-7
Online ISBN: 978-3-642-12392-4
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)