Journal of Mathematical Imaging and Vision

, Volume 25, Issue 3, pp 307–328 | Cite as

A Unifying and Rigorous Shape from Shading Method Adapted to Realistic Data and Applications

  • Emmanuel Prados
  • Fabio Camilli
  • Olivier Faugeras


We propose a new method for the Lambertian Shape From Shading (SFS) problem based on the notion of Crandall-Lions viscosity solution. This method has the advantage of requiring the knowledge of the solution (the surface to be reconstructed) only on some part of the boundary and/or of the singular set (the set of the points at maximal intensity). Moreover it unifies in an unique mathematical formulation the works of Rouy et al. [34, 50], Falcone et al. [21], Prados et al. [46, 48, 49], based on the notion of viscosity solutions and the work of Dupuis and Oliensis [17] dealing with classical solutions and value functions. Also, it allows to generalize their results to the “perspective SFS” problem recently simultaneously introduced in [13,46,55].

While the theoretical part has been developed in [44], in this paper we give some stability results and we describe numerical schemes for the SFS based on this method. We construct provably convergent and robust algorithms. Finally, we apply our SFS method to real images and we suggest some real-life applications.


Shape From Shading Hamilton-Jacobi equations viscosity solutions states constraints finite differences 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M. Bardi and I. Capuzzo-Dolcetta, “Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations,” Birkhauser, 1997.Google Scholar
  2. 2.
    G. Barles. “Solutions de viscosité des Equations de Hamilton–Jacobi,” Springer–Verlag, 1994.Google Scholar
  3. 3.
    G. Barles and P.E. Souganidis. “Convergence of approximation schemes for fully nonlinear second order equations,” Asymptotic Analysis, Vol. 4, pp. 271–283, 1991.MATHMathSciNetGoogle Scholar
  4. 4.
    M. Bell and W.T. Freeman, “Learning local evidence for shading and reflectance,” In Proceedings of the International Conference on Computer Vision (ICCV’01), Vol. 1, pp. 670–677, July 2001.Google Scholar
  5. 5.
    M. S. Brown and W. B. Seales, “Document restoration using 3D shape,” In ICCV’01, 2001.Google Scholar
  6. 6.
    A. M. Bruckstein. “On shape fron shading.” Computer Vision Graphics Image Process, Vol. 44, pp. 139–154, 1988.CrossRefGoogle Scholar
  7. 7.
    F. Camilli and M. Falcone. “An approximation scheme for the maximal solution of the shape-from-shading model,” In ICIP’96, 1996. pp. 49–52.Google Scholar
  8. 8.
    F. Camilli and A. Siconolfi, “Maximal subsolutions for a class of degenerate hamilton-jacobi problems,” Indiana Univ. Math. J., Vol. 48 no. 3, pp. 1111–1132, 1999.Google Scholar
  9. 9.
    F. Camilli and A. Siconolfi, “Nonconvex degenerate Hamilton-Jacobi equations,” Mathematische Zeitschrift, Vol. 242, pp. 1–21, 2002.MATHMathSciNetCrossRefGoogle Scholar
  10. 10.
    I. Capuzzo-Dolcetta and P.-L. Lions. “Hamilton-jacobi equations with state constraints,” Trans. Amer. Math. Soc., Vol. 318 no. 2, pp. 643–68, 1990.Google Scholar
  11. 11.
    S.I. Cho and H. Saito. “A Divide-and-conquer Strategy in Shape from Shading problem,” In CVRP’97, IEEE Computer Society, 1997.Google Scholar
  12. 12.
    K.N. Choi, P. Worthington, and E.R. Hancock. “Facial pose using shape-from-shading,” In BMVC’99, 1999. pp. 402–411.Google Scholar
  13. 13.
    F. Courteille, A. Crouzil, J-D. Durou, and P. Gurdjos. “Towards shape from shading under realistic photographic conditions,” In ICPR’04, 2004. Vol. 2, pp. 277–280 IAPR.Google Scholar
  14. 14.
    B.L. Craine, E.R. Craine, C.J. O’Toole, and Q. Ji, “Digital imaging colposcopy: Corrected area measurements using shape-from-Shading,” IEEE Transactions on Medical Imaging, Vol. 17, no. 6, pp. 1003–1010, 1998.CrossRefGoogle Scholar
  15. 15.
    P.-E. Danielsson. “Euclidean distance Mapping,” Computer Graphics and Image Processing, Vol. 14, no. 3, pp. 227–248, 1980.CrossRefGoogle Scholar
  16. 16.
    P. Dupuis and J. Oliensis. “Direct method for reconstructing shape from shading,” SPIE, Vol. 1570, pp. 116–128, 1991.Google Scholar
  17. 17.
    P. Dupuis and J. Oliensis. “An optimal control formulation and related numerical methods for a problem in shape reconstruction,” The Annals of Applied Probability, Vol. 4, no. 2, pp. 287–346, 1994.MATHMathSciNetGoogle Scholar
  18. 18.
    P. Dupuis and J. Oliensis, “Shape from Shading: Provably convergent algorithms and uniqueness results,” In ECCV’94, Vol. 2, pp. 256–268, 1994.Google Scholar
  19. 19.
    J-D. Durou, M. Falcone, and M. Sagona, “A survey of numerical methods for shape from shading,” Research report 2004-2-R, IRIT, January 2004.Google Scholar
  20. 20.
    J.-D. Durou and H. Maître, “On convergence in the methods of strat and Smith for shape from shading,” IJCV, Vol. 17, no. 3, pp. 273–289, 1996.CrossRefGoogle Scholar
  21. 21.
    M. Falcone and M. Sagona. “An algorithm for the global solution of the shape-from-shading model,” ICIAP, Vol. 1, pp. 596–603, 1997. LNCS 1310.Google Scholar
  22. 22.
    M. Falcone, M. Sagona, and A. Seghini. “A scheme for the shape-from-shading model with “black shadows,”” In Proceedings of ENUMATH 2001, 2001.Google Scholar
  23. 23.
    C.H.Q. Forster and C.L. Tozzi. “Towards 3d reconstruction of endoscope images using shape from shading,” In 13th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI). IEEE Computer Society, October 2000.Google Scholar
  24. 24.
    G. Hermosillo and O. Faugeras, “Dense image matching with global and local statistical criteria: A variational approach,” In Proceedings of CVPR (1). ieee computer society, 2001.Google Scholar
  25. 25.
    B.K. Horn and M.J. Brooks, (Eds.). Shape from Shading, The MIT Press, 1989.Google Scholar
  26. 26.
    B.K.P. Horn, “Obtaining shape from shading information,” In P.H. Winston, (Eds.), The Psychology of Computer Vision, McGraw-Hill, New York, 1975.Google Scholar
  27. 27.
    H. Ishii and M. Ramaswamy, “Uniqueness results for a class of Hamilton-Jacobi equations with singular coefficients,” Comm. Par. Diff. Eq., Vol. 20, pp. 2187–2213, 1995.MATHMathSciNetGoogle Scholar
  28. 28.
    R. Kimmel and A.M. Bruckstein. “Global shape-from-shading,” CVGIP: Image Understanding, pp. 360–369, 1995.Google Scholar
  29. 29.
    R. Kimmel and A.M. Bruckstein, “Tracking level sets by level sets : A method for solving the shape from shading problem,” Computer Vision and Image Understanding, Vol. 62, no. 2, pp. 47–58, 1995.CrossRefGoogle Scholar
  30. 30.
    R. Kimmel and J.A. Sethian, “Optimal algorithm for shape from shading and path planning,” JMIV, Vol. 14, no. 2, pp. 237–244, 2001.MATHMathSciNetCrossRefGoogle Scholar
  31. 31.
    R. Klette, R. Kozera, and K. Schlüns. “Shape from shading and photometric stereo methods,” Technical Report CITR-TR-20, University of Auckland, New Zealand, 1998.Google Scholar
  32. 32.
    C.K. Kwoh, G.N. Khan, and D.F. Gillies, “Automated endoscope navigation and advisory system from medical imaging,” In Proceedings of SPIE’99, Vol. 3660, 1999.Google Scholar
  33. 33.
    P.-L. Lions. “Generalized Solutions of Hamilton–Jacobi Equations.” Number 69 in Research Notes in Mathematics. Pitman Advanced Publishing Program, 1982.Google Scholar
  34. 34.
    P.-L. Lions, E. Rouy, and A. Tourin. “Shape-from-shading, viscosity solutions and edges,” Numer. Math., Vol. 64, pp. 323–353, 1993.MATHMathSciNetCrossRefGoogle Scholar
  35. 35.
    C.S. McCamy, H. Marcus, and J.G. Davidson. A colorrendition chart. J. App. Photog. Eng., Vol. 2, pp. 95–99, 1976.Google Scholar
  36. 36.
    G.W. Meyer, “Wavelength selection for synthetic image generation,” CVGIP, Vol. 41, pp. 57–79, 1988.Google Scholar
  37. 37.
    T. Okatani and K. Deguchi, “Shape reconstruction from an endoscope image by shape from shading technique for a point light source at the projection center,” CVIU, Vol. 66, no. 2, pp. 119–131, May 1997.Google Scholar
  38. 38.
    J. Oliensis, “Shape from shading as a partially well–constrained problem,” CVGIP: Image Understanding, Vol. 54, no. 2, pp. 163–183, 1991.MATHCrossRefGoogle Scholar
  39. 39.
    J. Oliensis, “Uniqueness in shape from shading,” IJCV, Vol. 2, no. 6, pp. 75–104, 1991.CrossRefGoogle Scholar
  40. 40.
    J. Oliensis and P. Dupuis, “A global algorithm for shape from shading,” In Proceedings of ICCV’93, 1993, pp. 692–701,Google Scholar
  41. 41.
    E. Pr. ados. “Une approche du “Shape from Shading” par solutions de viscosité,” Master’s thesis, University of Nice-Sophia Antipolis, France (In French), INRIA, September 2001.Google Scholar
  42. 42.
    E. Prados. “Application of the theory of the viscosity solutions to the Shape From Shading problem”. PhD thesis, University of Nice-Sophia Antipolis, October 2004.Google Scholar
  43. 43.
    E. Prados, F. Camilli, and O. Faugeras. “A viscosity method for Shape-From-Shading without boundary data,” Technical Report RR-5296, INRIA, 2004.Google Scholar
  44. 44.
    E. Prados, F. Camilli, and O. Faugeras. “A viscosity solution method for shape-from-shading without boundary data,” Accepted to ESAIM: Mathematical Modelling and Numerical Analysis, 2006.Google Scholar
  45. 45.
    E. Prados and O. Faugeras. “A mathematical and algorithmic study of the lambertian SFS problem for orthographic and pinhole cameras,” Technical Report RR-5005, INRIA, 2003.Google Scholar
  46. 46.
    E. Prados and O. Faugeras. “Perspective shape from Shading and viscosity solutions,” In Proceedings of ICCV’03, Vol. 2, pp. 826–831. IEEE Computer Society, 2003.Google Scholar
  47. 47.
    E. Prados and O. Faugeras. “Unifying approaches and removing unrealistic assumptions in shape from Shading: Mathematics can help,” In Proceedings of ECCV’04 (4), Vol. 3024 of Lecture Notes in Computer Science, pp. 141–154. Springer, 2004.Google Scholar
  48. 48.
    E. Prados and O. Faugeras. “A generic and provably convergent shape-from-shading method for orthographic and pinhole cameras,” International Journal of Computer Vision, Vol. 65, Nos. 1/2, pp. 97–125, 2005.Google Scholar
  49. 49.
    E. Prados, O. Faugeras, and E. Rouy. “Shape from shading and viscosity solutions,” In Proceedings of ECCV’02, vol. 2351 of Lecture Notes in Computer Science, pp. 790–804. Springer, 2002.Google Scholar
  50. 50.
    E. Rouy and A. Tourin. “A viscosity Solutions Approach to Shape-from-Shading,” SIAM J. of Numerical Analysis, 29(3):867–884, 1992.Google Scholar
  51. 51.
    W.A.P. Smith and E.R. Hancock. “Face recognition using shape-from-Shading,” In Proceedings of British Machine Vision Conference (BMVC)), pp. 597–606, September 2002.Google Scholar
  52. 52.
    Q.Y.L. Smithwick and E.J. Seibel. “Depth enhancement using a scanning fiber optical endoscope,” In Proceedings of SPIE BiOS, 2002.Google Scholar
  53. 53.
    H. M. Soner. “Optimal control with state space constraints,” SIAM J. Contr. Optim, 24:Part I: 552–562, Part II: 1110–1122, 1986.Google Scholar
  54. 54.
    L. E. Sucar, D. F. Gillies, and H. Rashid. “Integrating shape from shading in a gradient histogram and its application to endoscope navigation,” In Proceedings of 5th International Conference on Artificial Intelligence (ICAI-V), 1992.Google Scholar
  55. 55.
    A. Tankus, N. Sochen, and Y. Yeshurun. “A new perspective [on] Shape-from-Shading,” in ICCV’03, 2003, Vol. 2, pp. 862–869,Google Scholar
  56. 56.
    A. Tankus, N. Sochen, and Y. Yeshurun. “Reconstruction of medical images by perspective shape-from-Shading,” in ICPR’04, 2004.Google Scholar
  57. 57.
    D. Tschumperlé and R. Deriche. “Vector-valued image regularization with PDE’s : A common framework for different applications,” In CVPR’03, 2003.Google Scholar
  58. 58.
    T. Wada, H. Ukida, and T. Matsuyama. “Shape from shading with interreflections under proximal light source-3D shape reconstruction of unfolded book surface from a scanner image,” In ICCV’95, 1995.Google Scholar
  59. 59.
    S.M. Yamany and A.A. Farag. “A system for human jaw modeling using intra-oral images,” in IEEE-EMBS, 1998, Vol. 20, pp. 563–566,Google Scholar
  60. 60.
    S.Y. Yeung, H.T. Tsui, and A. Yim. “Global shape from shading for an endoscope image,” inProceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), volume 1679 of Lecture Notes in Computer Science, Chris Taylor and Alan C. F. Colchester, (Eds.), September 1999. pp. 318–327,Google Scholar
  61. 61.
    R. Zhang, P.-S. Tsai, J.-E. Cryer, and M. Shah. “Shape from shading: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 21, no. 8, pp. 690–706, August 1999.Google Scholar
  62. 62.
    W. Zhao and R. Chellappa. “Illumination-insensitive face recognition using symmetric shape-from-Shading,” in CVPR’00, pp. 1286–1293, 2000.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  • Emmanuel Prados
    • 1
  • Fabio Camilli
    • 2
  • Olivier Faugeras
    • 3
  1. 1.UCLA Vision Lab.USA
  2. 2.Dipartimento di Matematica Pura e ApplicataUniversità dell'AquilaItaly
  3. 3.Odyssée Lab. - INRIA Sophia AntipolisFrance

Personalised recommendations