Abstract
A complex dynamic light field is generated in the world of 3D video, while a multi-view camera system can only observe a limited part of light field even if the number of cameras is increased. This chapter presents a novel method of estimating 3D dynamic lighting environment using shading patterns and shadows cast on reference objects. The novelty rests in the 3D shape and structure design of the reference objects, which enables the accurate estimation of 3D shape and motion of distributed light sources such as candle lights. Estimated 3D lighting environment data can be used to render natural atmospheres to 3D video as well as CG objects.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
While we assume here the shadow is cast on a flat plane, shadows are often cast on 3D surfaces and carry 3D information.
- 2.
In this simulation, we assumed that the surface reflectance of the skeleton cube follows the simplified Torrance–Sparrow model [15] with specular reflection component specified by k s and σ, which were estimated for the real skeleton cube under a controlled lighting environment.
References
Basri, R., Jacobs, D.W.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell. 25(2), 218–233 (2003)
Belhumeur, P.N., Kriegman, D.J.: What is the set of images of an object under all possible illumination conditions? Int. J. Comput. Vis. 28(3), 24–260 (1998)
Blender Foundation: http://www.blender.org/
Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: SIGGRAPH’98: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 189–198 (1998)
Debevec, P.: Image-based lighting. IEEE Comput. Graph. Appl. 22(2), 26–34 (2002)
Hara, K., Nishino, K., Ikeuchi, K.: Determining reflectance and light position from a single image without distant illumination assumption. In: IEEE International Conference on Computer Vision, vol. 2, pp. 560–567 (2003)
Lawson, C.L., Hanson, R.J.: Solving Least Squares Problems. Society for Industrial Mathematics, Philadelphia (1987)
Marschner, S.R., Greenberg, D.P.: Inverse lighting for photography. In: Fifth Color Imaging Conference, pp. 262–265 (1997)
Nillius, P., Eklundh, J.-O.: Automatic estimation of the projected light source direction. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. I, pp. 1076–1083 (2001)
Powell, M.W., Sarkar, S., Goldgof, D.: A simple strategy for calibrating the geometry of light sources. IEEE Trans. Pattern Anal. Mach. Intell. 23(9), 1022–1027 (2001)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: ACM SIGGRAPH, pp. 117–128 (2001)
Ronfard, R., Taubin, G. (eds.): Image and Geometry Processing for 3-D Cinematography. Geometry and Computing, vol. 5. Springer, Berlin (2010)
Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Vis. Comput. Graph. 5(1), 1–12 (1999)
Sato, I., Sato, Y., Ikeuchi, K.: Illumination from shadows. IEEE Trans. Pattern Anal. Mach. Intell. 25(3), 290–300 (2003)
Solomon, F., Ikeuchi, K.: Extracting the shape and roughness of specular lobe objects using four light photometric stereo. IEEE Trans. Pattern Anal. Mach. Intell. 18, 449–454 (1996)
Takai, T., Maki, A., Niinuma, K., Matsuyama, T.: Difference sphere: an approach to near light source estimation. Comput. Vis. Image Underst. 113(9), 966–978 (2009)
Unger, J., Wenger, A., Hawkings, T., Gardner, A., Debevec, P.: Capturing and rendering with incident light fields. In: EGRW’03: Proceedings of the 14th Eurographics Workshop on Rendering, pp. 141–149 (2003)
Wang, Y., Samaras, D.: Estimation of multiple directional illuminants from a single image. Image Vis. Comput. 26(9), 1179–1195 (2008)
Yang, Y., Yuille, A.: Sources from shading. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 534–539 (1991)
Zhang, Y., Yang, Y.-H.: Multiple illuminant direction detection with application to image system. IEEE Trans. Pattern Anal. Mach. Intell. 232(8), 915–920 (2001)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Zhou, W., Kambhamettu, R.: Estimation of illuminant direction and intensity of multiple light sources. In: European Conference on Computer Vision, pp. 206–220 (2002)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag London
About this chapter
Cite this chapter
Matsuyama, T., Nobuhara, S., Takai, T., Tung, T. (2012). Estimation of 3D Dynamic Lighting Environment with Reference Objects. In: 3D Video and Its Applications. Springer, London. https://doi.org/10.1007/978-1-4471-4120-4_6
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4120-4_6
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4119-8
Online ISBN: 978-1-4471-4120-4
eBook Packages: Computer ScienceComputer Science (R0)