Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping

  • Paul Debevec
  • Yizhou Yu
  • George Borshukov
Part of the Eurographics book series (EUROGRAPH)


This paper presents how the image-based rendering technique ofview dependent texture-mapping (VDTM) can be efficiently implementedusing projective texture mapping, a feature commonly available inpolygon graphics hardware. VDTM is a technique for generating novelviews of a scene with approximately known geometry making maximal useof a sparse set of original views. The original presentation of VDTMby Debevec, Taylor, and Malik required significant perpixelcomputation and did not scale well with the number of original images.In our technique, we precompute for each polygon the set of originalimages in which it is visibile and create a “view map” datastructure that encodes the best texture map to use for a regularlysampled set of possible viewing directions. To generate a novel view,the view map for each polygon is queried to determine a set of no morethan three original images to blend together in order to render thepolygon with projective texture-mapping. Invisible triangles areshaded using an object-space hole-filling method. We show how therendering process can be streamlined for implementation on standardpolygon graphics hardware. We present results of using the method torender a large-scale model of the Berkeley bell tower and itssurrounding campus enironment.


Texture Mapping Camera Position Graphic Hardware Vertex Color Original View 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dana, K. J., Ginneken, B., Nayar, S. K., AND Koenderink, J. J. Reflectance and texture of real-world surfaces. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog. (1997), pp. 151–157.Google Scholar
  2. 2.
    Debevec, P. E., Taylor, G. J., AND Malik, J. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In SIGGRAPH’ 96 (August 1996), pp. 11–20.Google Scholar
  3. 3.
    Foley, J. D., VAN Dam, A., Feiner, S. K., AND Hughes, J. F. Computer Graphics: principles and practice. Addison-Wesley, Reading, Massachusetts, 1990.Google Scholar
  4. 4.
    Gortler, S. J., Grzeszczuk, R., Szeliski, R., AND Cohen, M. F. The Lumigraph. In SIGGRAPH’ 96 (1996), pp. 43–54.Google Scholar
  5. 5.
    Laveau, S., AND Faugeras, O. 3-D scene representation as a collection of images. In Proceedings of 12th International Conference on Pattern Recognition (1994), vol. 1, pp. 689–691.Google Scholar
  6. 6.
    Levoy, M., AND Hanrahan, P. Light field rendering. In SIGGRAPH’ 96 (1996), pp. 31–42.Google Scholar
  7. 7.
    Mark, W. R., McMillan, L., AND Bishop, G. Post-rendering 3D warping. In Proceedings of the Symposium on Interactive 3D Graphics (New York, Apr. 27–30 1997), ACM Press, pp. 7–16.Google Scholar
  8. 8.
    McMillan, L., AND Bishop, G. Plenoptic Modeling: An image-based rendering system. In SIGGRAPH’ 95 (1995).Google Scholar
  9. 9.
    Pulli, K., Cohen, M., Duchamp, T., Hoppe, H., Shapiro, L., AND Stuetzle, W. View-based rendering: Visualizing real objects from scanned range and color data. In Proceedings of 8th Eurographics Workshop on Rendering, St. Etienne, France (June 1997), pp. 23–34.Google Scholar
  10. 10.
    Segal, M., Korobkin, C., VAN Widenfelt, R., Foran, J., AND Haeberli, P. Fast shadows and lighting effects using texture mapping. In SIGGRAPH’ 92 (July 1992), pp. 249–252.Google Scholar
  11. 11.
    Shade, J., Lischinski, D., Salesin, D., DeRose, T., AND Snyder, J. Hierarchical image caching for accelerated walkthroughs of complex environments. In SIGGRAPH 96 Conference Proceedings (1996), H. Rushmeier, Ed., Annual Conference Series, ACM SIGGRAPH, Addison Wesley, pp. 75–82.Google Scholar
  12. 12.
    Sillion, F., Drettakis, G., AND Bodelet, B. Efficient impostor manipulation for realtime visualization of urban scenery. Computer Graphics Forum (Proc. Eurographics 97) 16,3 (Sept. 4–8 1997), C207–C218.Google Scholar
  13. 13.
    Teller, S. J., AND Sequin, C. H. Visibility preprocessing for interactive walkthroughs. In SIGGRAPH’ 91 (1991), pp. 61–69.Google Scholar
  14. 14.
    Weghorst, H., Hooper, G., AND Greenberg, D. P. Improved computational methods for ray tracing. ACM Transactions on Graphics 3,1 (January 1984), 52–69.CrossRefGoogle Scholar
  15. 15.
    Weiler, K., AND Atherton, P. Hidden surface removal using polygon area sorting. In SIGGRAPH’ 77 (1977), pp. 214–222.Google Scholar
  16. 16.
    Williams, L., AND Chen, E. View interpolation for image synthesis. In SIGGRAPH’ 93 (1993).Google Scholar

Copyright information

© Springer-Verlag Wien 1998

Authors and Affiliations

  • Paul Debevec
    • 1
  • Yizhou Yu
    • 1
  • George Borshukov
    • 1
  1. 1.Univeristy of CaliforniaBerkeleyUSA

Personalised recommendations