Virtual Asukakyo: Real-time Soft Shadows in Mixed Reality using Shadowing Planes

  • Tetsuya Kakuta
  • Takeshi Oishi
  • Katsushi Ikeuchi

This chapter introduces fast shading and shadowing method in Mixed Reality. We create realistic soft shadows of virtual objects in a fast and efficient way using shadowing planes and a set of pre-rendered basis images. In the preparatory stages, we generate shadowing planes from convex hulls of objects and render basis images with basis lights which approximate the illumination of the real world. We then synthesize basis images with luminance parameters and generate shadow images which correspond to the current illumination. Finally we map shadow images onto shadowing planes and express soft shadows of objects in real-time. The proposed method can support both dynamic changes of illumination and movements of user’s viewpoint. We successfully achieve the consistency of illumination and improve the quality of synthesized image in MR-systems.


Augmented Reality Virtual Object Basis Image Shadow Image Mixed Reality 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    R. Azuma, “A Survey of Augmented Reality,” In Presence: Teleoperators and Virtual Environments, pp. 355-385, 1997.Google Scholar
  2. [2]
    R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, “Recent Advances in Augmented Reality,” IEEE Computer Graphics and Applications, pp. 34-47, 2001.Google Scholar
  3. [3]
    K. Jacobs and C. Loscos, “Classification of Illumination Methods for Mixed Reality,” Proc. Eurographics State of the Art Report(STAR), pp. 95-118, 2004.Google Scholar
  4. [4]
    I. Sato, Y. Sato, and K. Ikeuchi, “Acquiring a radiance distribution to superimpose virtual objects onto a real scene,” IEEE Trans. on Visualization and Computer Graphics, pp. 1-12, 1999.Google Scholar
  5. [5]
    M. Haller, S. Drab, and W. Hartmann, “A real-time shadow approach for an augmented reality application using shadow volumes,” Proc. Symp. on ACM Virtual Reality Software and Technology(VRST’03), pp. 56-65, 2003.Google Scholar
  6. [6]
    S. Gibson, J. Cook, T. Howard, and R. Hubbold, “Rapid shadow generation in real-world lighting environments,” Proc. Eurographics Symp. on Rendering (EGSR03), pp. 219-229, 2003.Google Scholar
  7. [7]
    P. Debevec, “Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global Illumination and high dynamic range photography, Proc. SIGGRAPH ’98, pp. 189-198, 1998.Google Scholar
  8. [8]
    O. Bimber, A. Grundhofer, G. Wetzstein, and S. Knodel, “Consistent Illumination within Optical See-Through Augmented Environments,” Proc. IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR03), pp. 198-207, 2003.Google Scholar
  9. [9]
    I. Sato, M. Hayashida, F. Kai, Y. Sato, and K. Ikeuchi, “Fast Image Synthesis of Virtual Objects in a Real Scene with Natural Shading,” The Institute of Electronics, Information and Communication Engineers, D-II (in Japanese), pp. 1234-1242, 2001.Google Scholar
  10. [10]
    J. S. Nimeroff, E. Simoncelli, and J. Dorsey, “Efficient re-rendering of naturally illuminated environments,”, Proc. Eurographics Workshop on Rendering (EGWR94), pp. 359-373, 1994.Google Scholar
  11. [11]
    B. K. Horn, “Robot vision,” The MIT Press, 1986.Google Scholar
  12. [12]
    A. Pugh, “Polyhedra: a visual approach,” University of California Press, 1986.Google Scholar
  13. [13]
    S. Uchiyama, K. Takemoto, K. Satoh, H. Yamamoto, and H. Tamura, “MR Platform: A Basic Body on Which Mixed Reality Applications Are Built,” Proc. Int. Symp. on Mixed and Augmented Reality (ISMAR02), pp. 246-253. 2002.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Tetsuya Kakuta
  • Takeshi Oishi
  • Katsushi Ikeuchi
    • 1
  1. 1.Institute of Industrial ScienceThe University of TokyoMeguro-kuJapan

Personalised recommendations