Skip to main content
SpringerLink
Log in

Estimating Outdoor Illumination Conditions Based on Detection of Dynamic Shadows

  • Conference paper
Computer Vision, Imaging and Computer Graphics. Theory and Applications (VISIGRAPP 2011)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 274))

Abstract

The paper proposes a technique for estimating outdoor illumination conditions in terms of sun and sky radiances directly from pixel values of dynamic shadows detected in video sequences produced by a commercial stereo camera. The technique is applied to the rendering of virtual objects into the image stream to achieve realistic Augmented Reality where the shading and shadowing of virtual objects is consistent with the real scene. Other techniques require the presence of a known object, a light probe, in the scene for estimating illumination. The technique proposed here works in general scenes and does not require High Dynamic Range imagery. Experiments demonstrate that sun and sky radiances are estimated to within 7% of ground truth values.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barsi, L., Szimary-Kalos, L., Szecsi, L.: Image-based illumination on the gpu. Machine Graphics and Graphics 14(2), 159–169 (2005)

    Google Scholar 

  2. Blanco-Muriel, M., Alarcón-Padilla, D.C., López-Moratalla, T., Lara-Coira, M.: Computing the solar vector. Solar Energy 70(5), 431–441 (2001)

    Article  Google Scholar 

  3. Boivin, S., Gagalowicz, A.: Image-based rendering of diffuse, specular and glossy surfaces from a single image. In: Proceedings: ACM SIGGRAPH 2001, pp. 107–116 (August 2001), http://www.dgp.toronto.edu/~boivin/

  4. Boivin, S., Gagalowicz, A.: Inverse rendering from a single image. In: Proceedings: First European Conference on Color in Graphics, Images and Vision, Poitiers, France, pp. 268–277 (April 2002), http://www.dgp.toronto.edu/~boivin/

  5. Cao, X., Shen, Y., Shah, M., Foroosh, H.: Single view compositing with shadows. The Visual Computer, 639–648 (September 2005)

    Google Scholar 

  6. Chalidabhongse, T., Kim, K., Harwood, D., Davis, L.: A Perturbation Method for Evaluating Background Subtraction Algorithms. In: Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Nice, France, October 11-12 (2003)

    Google Scholar 

  7. Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings: SIGGRAPH 1998, Orlando, Florida, USA (July 1998)

    Google Scholar 

  8. Debevec, P.: Tutorial: Image-based lighting. IEEE Computer Graphics and Applications, 26–34 (March/April 2002)

    Google Scholar 

  9. Debevec, P., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings: SIGGRAPH 1997, Los Angeles, CA, USA (August 1997)

    Google Scholar 

  10. Dutré, P., Bekaert, P., Bala, K.: Advanced Global Illumination. A. K. Peters (2003)

    Google Scholar 

  11. Finlayson, G.D., Hordley, S.D., Drew, M.S.: Removing Shadows from Images. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 823–836. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  12. Gibson, S., Cook, J., Howard, T., Hubbold, R.: Rapic shadow generation in real-world lighting environments. In: Proceedings: EuroGraphics Symposium on Rendering, Leuwen, Belgium (June 2003)

    Google Scholar 

  13. Hara, K., Nishino, K., Ikeuchi, K.: Light source position and reflectance estimation from a single view without the distant illumination assumption. IEEE Trans. Pattern Anal. Mach. Intell. 27(4), 493–505 (2005)

    Article  Google Scholar 

  14. Havran, V., Smyk, M., Krawczyk, G., Myszkowski, K., Seidel, H.P.: Importance Sampling for Video Environment Maps. In: Eurographics Symposium on Rendering 2005, Konstanz, Germany, pp. 31–42, 311 (2005)

    Google Scholar 

  15. Horprasert, T., Harwood, D., Davis, L.S.: A statistical approach for real-time robust background subtraction and shadow detection. In: Proceedings: IEEE ICCV 1999 FRAME-RATE Workshop, Kerkyra, Greece (September 1999)

    Google Scholar 

  16. Huerta, I., Holte, M., Moeslund, T., Gonzàlez, J.: Detection and removal of chromatic moving shadows in surveillance scenarios. In: Proceedings: IEEE ICCV 2009, Kyoto, Japan (September 2009)

    Google Scholar 

  17. Jacobs, K., Loscos, C.: State of the art report on classification of illumination methods for mixed reality. In: EUROGRAPHICS, Grenoble, France (September 2004), http://www.cs.ucl.ac.uk/staff/k.jacobs/research.html

  18. Kanbara, M., Yokoya, N.: Real-time estimation of light source environment for photorealistic augmented reality. In: Proceedings of the 17th ICPR, Cambridge, United Kingdom, pp. 911–914 (August 2004)

    Google Scholar 

  19. Kim, K., Chalidabhongse, T., Harwood, D., Davis, L.: Real-time Foreground-Background Segmentation using Codebook Model. Real-time Imaging 11(3), 167–256 (2005)

    Article  Google Scholar 

  20. Loscos, C., Drettakis, G., Robert, L.: Interative virtual relighting of real scenes. IEEE Transactions on Visualization and Computer Graphics 6(4), 289–305 (2000)

    Article  Google Scholar 

  21. Madsen, C.B., Laursen, R.: A scalable gpu-based approach to shading and shadowing for photorealistic real-time augmented reality. In: Proceedings: International Conference on Graphics Theory and Applications, Barcelona, Spain, pp. 252–261 (March 2007)

    Google Scholar 

  22. Madsen, C.B., Moeslund, T.B., Pal, A., Balasubramanian, S.: Shadow detection in dynamic scenes using dense stereo information and an outdoor illumination model. In: Koch, R., Kolb, A. (eds.) Proceedings: 3rd Workshop on Dynamic 3D Imaging, in conjunction with Symposium of the German Association for Pattern Recognition, Jena, Germany, pp. 100–125 (September 2009)

    Google Scholar 

  23. Marchand, J.A., Onyango, C.M.: Shadow-invariant classification for scenes illuminated by daylight. Journal of the Optical Society of America 17(11), 1952–1961 (2000)

    Article  Google Scholar 

  24. Nielsen, M., Madsen, C.B.: Graph Cut Based Segmentation of Soft Shadows for Seemless Removal and Augmentation. In: Ersbøll, B.K., Pedersen, K.S. (eds.) SCIA 2007. LNCS, vol. 4522, pp. 918–927. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  25. Perez, R., Seals, R., Michalsky, J.: All-weather model for sky luminance distribution–preliminary configuration and validation. Solar Energy 50(3), 235–245 (1993), http://www.sciencedirect.com/science/article/B6V50-497T8FV-99/2/69a6d079526288e5f4bb5708e3fed05d

    Article  Google Scholar 

  26. PointGrey: Bumblebee XB3 stereo camera, Point Grey Research, Inc. (2009), http://www.ptgrey.com/products/bumblebee/index.html

  27. Prati, A., Mikic, I., Trivedi, M., Cucchiara, R.: Detecting Moving Shadows: Algorithms and Evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 918–923 (2003)

    Article  Google Scholar 

  28. Preetham, A.J., Shirley, P., Smits, B.: A practical analytic model for daylight. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1999, pp. 91–100. ACM Press/Addison-Wesley Publishing Co., New York (1999), http://dx.doi.org/10.1145/311535.311545

    Chapter  Google Scholar 

  29. Salvador, E., Cavalarro, A., Ebrahimi, T.: Shadow identification and classification using invariant color models. Computer Vision and Image Understanding 95, 238–259 (2004)

    Article  Google Scholar 

  30. Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics 5(1), 1–12 (1999)

    Article  Google Scholar 

  31. Sato, I., Sato, Y., Ikeuchi, K.: Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In: Proceedings: International Conference on Computer Vision, pp. 875–882 (September 1999)

    Google Scholar 

  32. Wang, Y., Samaras, D.: Estimation of multiple directional illuminants from a single image. Image Vision Computing 26(9), 1179–1195 (2008)

    Article  Google Scholar 

  33. Ward, G.: Radiance - Synthetic Imaging System (2009), http://radsite.lbl.gov/radiance/

  34. Yu, Y., Debevec, P., Malik, J., Hawkins, T.: Inverse global illumination: Recovering reflectance models of real scenes from photographs. In: Proceedings: SIGGRAPH 1999, Los Angeles, California, USA, pp. 215–224 (August 1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Architecture, Design and Media Technology, Aalborg University, Niels Jernes Vej 14, DK-9220, Aalborg East, Denmark

    Claus B. Madsen & Brajesh B. Lal

Authors
  1. Claus B. Madsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brajesh B. Lal
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Xerox Research Centre Europe, 6 ch. de Maupertuis, 38240, Meylan, France

    Gabriela Csurka

  2. Aalborg University, Niels Jernes Vej 14, 3-215A, 9220, Aalborg Ø, Denmark

    Martin Kraus

  3. Department of Computational Mathematics and Cybernetics, Moscow State University, Moscow, Russia

    Leonid Mestetskiy

  4. LISA-ISTIA, Université d’Angers, 62, avenue Notre-Dame du Lac, 49000, Angers, France

    Paul Richard

  5. Departamento de Sistemas e Informática, Escola Superior de Tecnologia do IPS, Rua do Vale de Chaves Estefanilha, 2910, Setúbal, Portugal

    José Braz

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Madsen, C.B., Lal, B.B. (2013). Estimating Outdoor Illumination Conditions Based on Detection of Dynamic Shadows. In: Csurka, G., Kraus, M., Mestetskiy, L., Richard, P., Braz, J. (eds) Computer Vision, Imaging and Computer Graphics. Theory and Applications. VISIGRAPP 2011. Communications in Computer and Information Science, vol 274. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32350-8_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32350-8_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32349-2

  • Online ISBN: 978-3-642-32350-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation