Specular-Free Residual Minimization for Photometric Stereo with Unknown Light Sources

  • Tsuyoshi Migita
  • Kazuhiro Sogawa
  • Takeshi Shakunaga
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7087)


We address a photometric stereo problem that has unknown lighting conditions. To estimate the shape, reflection properties, and lighting conditions, we employ a nonlinear minimization that searches for parameters that can synthesize images that best fit the input images. A similar approach has been reported previously, but it suffers from slow convergence due to specular reflection parameters. In this paper, we introduce specular-free residual minimization that avoids the negative effects of specular reflection components by projecting the residual onto the complementary space of the light color. The minimization process simultaneously searches for the optimal light color and other parameters. We demonstrate the effectiveness of the proposed method using several real and synthetic image sets.


Input Image Photometric Stereo Point Light Source Preconditioned Conjugate Gradient Method Specular Component 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Belhumeur, P.N., Kriegman, D.J., Yuille, A.L.: The bas-relief ambiguity. Intl. J. of Computer Vision 35(1), 33–44 (1999)CrossRefGoogle Scholar
  2. 2.
    Chandraker, M., Kahl, F., Kriegman, D.: Reflections on the generalized bas-relief ambiguity. In: Proc. CVPR 2005, vol. I, pp. 788–795 (2005)Google Scholar
  3. 3.
    Georghiades, A.S.: Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In: Proc. ICCV 2003, vol. 2, pp. 816–823 (2003)Google Scholar
  4. 4.
    Ikeuchi, K.: Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-3(6), 661–669 (1981)CrossRefGoogle Scholar
  5. 5.
    Klinker, G., Shafer, S., Kanade, T.: The measurement of high-lights in color images. Intl. J. Computer Vision 2(1), 7–32 (1988)CrossRefGoogle Scholar
  6. 6.
    Migita, T., Ogino, S., Shakunaga, T.: Direct Bundle Estimation for Recovery of Shape, Reflectance Property and Light Position. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 412–425. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Okabe, T., Sato, Y.: Does a nearby point light source resolve the ambiguity of shape recovery in uncalibrated photometric stereo? In: Proc. MIRU 2007. pp. 881–886 (2007) (in Japanese)Google Scholar
  8. 8.
    Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical Recipes, 3rd edn. Cambridge University Press (2007)Google Scholar
  9. 9.
    Shafer, S.A.: Using color to separate reflection components. COLOR Research and Application 10(4), 210–218 (1985)CrossRefGoogle Scholar
  10. 10.
    Tan, P., Mallick, S.P., Quan, L., Kriegman, D., Zickler, T.: Isotropy, reciprocity and the generalized bas-relief ambiguity. In: Proc. CVPR 2007, pp. 1–8 (2007)Google Scholar
  11. 11.
    Tan, P., Zickler, T.: A projective framework for radiometric image analysis. In: Proc. CVPR 2009, pp. 2977–2984 (2009)Google Scholar
  12. 12.
    Tan, P., Lin, S., Quan, L.: Resolution-Enhanced Photometric Stereo. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part III. LNCS, vol. 3953, pp. 58–71. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  13. 13.
    Torrance, K., Sparrow, E.: Theory for off-specular reflection from roughened surfaces. J. Opt. Soc. Am. 57, 1105–1114 (1967)CrossRefGoogle Scholar
  14. 14.
    Yuille, A., Snow, D., Epstein, R., Belhumeur, P.: Determining generative models of objects under varying illumination: Shape and albedo from multiple mages using svd and integrability. Intl. J. of Computer Vision 35(3), 203–222 (1999)CrossRefGoogle Scholar
  15. 15.
    Zickler, T., Mallick, S.P., Kriegman, D.J., Belhumeur, P.N.: Color subspaces as photometric invariants. Intl. J. of Computer Vision 79(1), 13–30 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tsuyoshi Migita
    • 1
  • Kazuhiro Sogawa
    • 1
  • Takeshi Shakunaga
    • 1
  1. 1.Okayama UniversityJapan

Personalised recommendations