Advertisement

Image-based Rendering with Controllable Illumination

  • Tien-Tsin Wong
  • Pheng-Ann Heng
  • Siu-Hang Or
  • Wai-Yin Ng
Part of the Eurographics book series (EUROGRAPH)

Abstract

A new image-based rendering method, based on the light field and Lumigraph system, allows illumination to be changed interactively. It does not try to recover or use any geometrical information (e.g., depth or surface normals) to calculate the illumination, but the resulting images are physically correct. The scene is first sampled from different viewpoints and under different illuminations. Treating each pixel on the back plane of the light slab as a surface element,the sampled images are used to find an apparent BRDF of each surface element. The tabular BRDF data of each pixel is further transformed to the spherical harmonic domain for efficient storage. Whenever the user changes the illumination setting, a certain number of views are reconstructed. The correct user perspective view is then displayed using the texture mapping technique of the Lumigraph system. Hence, the intensity, the type and the number of the light sources can be manipulated interactively.

Keywords

Spherical Harmonic Coefficient Light Vector Real World Scene Pixel Window Directional Light Source 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    E. H. Adelson and J. R. Bergen. The Plenoptic Function and the Elements of Early Vision, chapter 1. The MIT Press, Cambridge, Mass, 1991.Google Scholar
  2. 2.
    Peter N. Belhumeur and David J. Kriegman. What is the set of images of an object under all possible lighting conditions? In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, June 1996.Google Scholar
  3. 3.
    Brian Cabral, Nelson Max, and Rebecca Springmeyer. Bidirectional reflection functions from surface bump maps. In Computer Graphics (SIGGRAPH ‘87 Proceedings), volume 21, pages 273–281, July 1987.Google Scholar
  4. 4.
    Shenchang Eric Chen. QuickTime VR–an image-based approach to virtual environment navigation. In Computer Graphics Proceedings, Annual Conference Series, SIGGRAPH’95, pages 29–38, August 1995.Google Scholar
  5. 5.
    Shenchang Eric Chen and G. S. P. Miller. Cylindrical to planar image mapping using scanline coherence. United States Patent number 5,396,583, March 7 1995.Google Scholar
  6. 6.
    Shenchang Eric Chen and Lance Williams. View interpolation for image synthesis. In Computer Graphics (SIGGRAPH ‘83 Proceedings), 1993.Google Scholar
  7. 7.
    R. Courant and D. Hilbert. Methods of Mathematical Physics. Interscience Publisher, Inc., New York, 1953.Google Scholar
  8. 8.
    Thomas A. Foley, David A. Lane, and Gregory M. Nielson. Towards animating raytraced volume visualization. The Journal of Visualization and Computer Animation, 1 (1): 2–8, 1990.MathSciNetCrossRefGoogle Scholar
  9. 9.
    Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, SIGGRAPH’96, pages 43–54, August 1996.Google Scholar
  10. 10.
    James T. Kajiya. Anisotropie reflection models. In Computer Graphics (SIG-GRAPH ‘85 Proceedings), volume 19, pages 15–21, July 1985.Google Scholar
  11. 11.
    Marc Levoy and Pat Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, SIGGRAPH’96, pages 31–42, August 1996.Google Scholar
  12. 12.
    Leonard McMillan and Gary Bishop. Plenoptic modeling: An image-based rendering system. In Computer Graphics Proceedings, Annual Conference Series, SIGGRAPH’95, pages 39–46, August 1995.Google Scholar
  13. 13.
    Jeffry S. Nimeroff, Eero Simoncelli, and Julie Dorsey. Efficient re-rendering of naturally illuminated environments. In Fifth Eurographics Worksop on Rendering, pages 359–373, Darmstadt, Germany, June 1994.Google Scholar
  14. 14.
    Francois X. Sillion, James R. Arvo, Stephen H. Westin, and Donald P. Greenberg. A global illumination solution for general reflectance distributions. In Computer Graphics (SIGGRAPH ‘81 Proceedings), volume 25, pages 187–196, July 1991.Google Scholar
  15. 15.
    Gregory J. Ward. Measuring and modeling anisotropie reflection. In Computer Graphics (SIGGRAPH ‘82 Proceedings), volume 26, pages 265–272, July 1992.Google Scholar

Copyright information

© Springer-Verlag/Wien 1997

Authors and Affiliations

  • Tien-Tsin Wong
    • 1
  • Pheng-Ann Heng
    • 1
  • Siu-Hang Or
    • 1
  • Wai-Yin Ng
    • 2
  1. 1.Department of Computer Science & EngineeringThe Chinese University of Hong KongChina
  2. 2.Department of Information EngineeringThe Chinese University of Hong KongChina

Personalised recommendations