Shadow Graphs and Surface Reconstruction
We present a method to solve shape-from-shadow using shadow graphs which give a new graph-based representation for shadow constraints. It can be shown that the shadow graph alone is enough to solve the shape-from-shadow problem from a dense set of images. Shadow graphs provide a simpler and more systematic approach to represent and integrate shadow constraints from multiple images. To recover shape from a sparse set of images, we propose a method for integrated shadow and shading constraints. Previous shape-from-shadow algorithms do not consider shading constraints while shape-from-shading usually assumes there is no shadow. Our method is based on collecting a set of images from a fixed viewpoint as a known light source changes its position. It first builds a shadow graph from shadow constraints from which an upper bound for each pixel can be derived if the height values of a small number of pixels are initialized properly. Finally, a constrained optimization procedure is designed to make the results from shape-from-shading consistent with the upper bounds derived from the shadow constraints. Our technique is demonstrated on both synthetic and real imagery.
KeywordsSurface Geometry Shadow Graph Shading Optimization
Unable to display preview. Download preview PDF.
- 1.P. Belhumeur and D. Kriegman. What is the set of images of an object under all possible illumination conditions? Int. Journal Comp. Vision, 28(3):1–16, 1998.Google Scholar
- 2.P. Belhumeur, D. Kriegman, and A. Yuille. The bas-relief ambiguity. In IEEE Conf. on Comp. Vision andPatt. Recog., pages 1040–1046, 1997.Google Scholar
- 3.K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink. Reflectance and texture of real-world surfaces. In Proceedings of CVPR, pages 151–157, 1997.Google Scholar
- 4.M. Daum and G. Dudek. On 3-d surface reconstruction using shape from shadows. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 461–468, 1998.Google Scholar
- 5.P. Dupuis and J. Oliensis. Shape from shading: Provably convergent algorithms and uniqueness results. In Computer Vision-ECCV 94, pages 259–268, 1994.Google Scholar
- 6.Fsqp software. http://gachinese.com/aemdesign/FSQPframe.htm. Originally developed at the Institute for Systems Research, University of Maryland.
- 7.A. Georghiades, P. Belhumeur, and D. Kriegman. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, pages 47–54, 1999.Google Scholar
- 9.M. Hatzitheodorou. The derivation of 3-d surface shape from shadows. In Proc. Image Understanding Workshop, pages 1012–1020, 1989.Google Scholar
- 12.D. Jacobs. Linear fitting with missing data: Applications to structure from motion and characterizing intensity images. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 206–212, 1997.Google Scholar
- 13.J. Kender and E. Smith. Shape from darkness. In Int. Conf. on Computer Vision, pages 539–546, 1987.Google Scholar
- 14.D.J. Kriegman and P.N. Belhumeur. What shadows reveal about object structure. In Computer Vision-ECCV 98, 1998.Google Scholar
- 15.Y.G. Leclerc and A.F. Bobick. The direct computation of height from shading. In Proc. of IEEE Conf. on Comp. Vision and Patt. Recog., pages 552–558, 1991.Google Scholar
- 16.X. Liu, Y. Yu, and H.-Y Shum. Synthesizing bidirectional texture functions for real-world surfaces. In Proceedings of SIGGRAPH, pages 97–106, 2001.Google Scholar
- 19.W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. Numerical Recipes in C. Cambridge Univ. Press, New York, 1988.Google Scholar
- 20.S.A. Shafer. Shadows and silhouettes in computer vision. Kluwer Academic Publishers, 1985.Google Scholar
- 22.R.J. Woodham. Photometric method for determining surface orientation from multiple images. In B.K.P. Horn and M.J. Brooks, editors, Shape from Shading, pages 513–532. MIT Press, 1989.Google Scholar