Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment

  • Yohei OguraEmail author
  • Hideo Saito
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9475)


Relighting techniques can achieve the photometric consistency in synthesizing a composite images. Relighting generally need the object’s shape and illumination environment. Recent research demonstrates possibilities of relighting for an unknown shape object or the relighting the object under unknown illumination environment. However, achieving both tasks are still challenging issue. In this paper, we propose a relighting method for an unknown shape object captured under unknown illumination environment by using an RGB-D camera. The relighted object can be rendered from pixel intensity, surface albedo and shape of the object and illumination environment. The pixel intensity and the shape of the object can simultaneously be obtained from an RGB-D camera. Then surface albedo and illumination environment are iteratively estimated from the pixel intensity and shape of the object. We demonstrate that our method can perform relighting for a dynamic shape object captured under unknown illumination using an RGB-D camera.


  1. 1.
    Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: ACM SIGGRAPH. ACM (2000)Google Scholar
  2. 2.
    Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24(3), 756–764 (2005)CrossRefGoogle Scholar
  3. 3.
    Zhen, W., Liu, Z., Huang, T.S.: Face relighting with radiance environment maps. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE (2003)Google Scholar
  4. 4.
    Aldrian, O., Smith, W.: Inverse rendering with a morphable model: A multilinear approach. In: Proceedings of the British Machine Vision Conference. BMVA Press (2011)Google Scholar
  5. 5.
    Wang, Y., Zhang, L., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face relighting from a single image under arbitrary unknown lighting conditions. IEEE Trans. Pattern Anal. Mach. Intell. 31, 1968–1984 (2009)CrossRefGoogle Scholar
  6. 6.
    Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM (2001)Google Scholar
  7. 7.
    Matsumoto, K., Song, C., de Sorbier, F., Saito, H.: Joint upsampling and noise reduction for real-time depth map enhancement. In: Proceedings of IS&T/SPIE Electronic Imaging, SPIE (2014)Google Scholar
  8. 8.
    Holzer, S., Rusu, R.B., Dixon, M., Gedikli, S., Navab, N.: Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE (2012)Google Scholar
  9. 9.
    Nowrouzezahrai, D., Simari, P., Fiume, E.: Sparse zonal harmonic factorization for efficient SH rotation. ACM Trans. Graph. 31, 23 (2012)CrossRefGoogle Scholar
  10. 10.
    Zou, X., Kittler, J., Hamouz, M., Tena, J.R.: Robust albedo estimation from face image under unknown illumination. In: SPIE Defense and Security Symposium, SPIE (2008)Google Scholar
  11. 11.
    Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: ACM SIGGRAPH. ACM (2001)Google Scholar
  12. 12.
    Gruber, L., Richter-Trummer, T., Schmalstieg, D.: Real-time photometric registration from arbitrary geometry. In: IEEE International Symposium on Mixed and Augmented Reality. IEEE (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Keio UniversityYokohamaJapan

Personalised recommendations