Face Image Relighting using Locally Constrained Global Optimization
Conference paper
Abstract
A face image relighting method using locally constrained global optimization is presented in this paper. Based on the empirical fact that common radiance environments are locally homogeneous, we propose to use an optimization based solution in which local linear adjustments are performed on overlapping windows throughout the input image. As such, local textures and global smoothness of the input image can be preserved simultaneously when applying the illumination transformation. Experimental results demonstrate the effectiveness of the proposed method comparing to some previous approaches.
Keywords
Face Image Target Face Ratio Image Local Window Active Appearance Model
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download
to read the full conference paper text
References
- 1.Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the Reflectance Field of a Human Face. In: Proceeding of ACM SIGGRAPH, pp. 145–156 (2000)Google Scholar
- 2.Marschner, S.R., Greenberg, D.P.: Inverse Lighting for Photography. In: Proceedings of Fifth Color Imaging Conference, pp. 262–265 (1997)Google Scholar
- 3.Shashua, A., Raviv, T.R.: The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations. IEEE Trans. on PAMI 23(2), 129–139 (2001)Google Scholar
- 4.Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: Proceedings of ACM SIGGRAPH, pp. 497–500 (2001)Google Scholar
- 5.Basri, R., Jacobs, D.W.: Lambertian Reflectance and Linear Subspaces. IEEE Trans. on PAMI 25(2), 218–233 (2003)Google Scholar
- 6.Zhang, L., Wang, S., Samaras, D.: Face synthesis and recognition from a single image under arbitrary unkown lighting using a spherical harmonic basis morphable model. In: Proceedings of IEEE CVPR, pp. 209–216 (2005)Google Scholar
- 7.Wang, Y., Liu, Z., Hua, G., Wen, Z., Zhang, Z., Samaras, D.: Face Re-Lighting from a Single Image Under Harsh Lighting Conditions. In: Proceedings of IEEE CVPR (2007)Google Scholar
- 8.Peers, P., Tamura, N., Matusik, M., Debevec, P.: Post-production Facial Performance Relighting using Reflectance Transfer. In: Proceedings of ACM SIGGRAPH (2007)Google Scholar
- 9.Marschner, S.R., Guenter, B., Raghupathy, S.: Modeling and Rendering for RealisticFacial Animation. In: Proceedings of Eurographics Rendering Workshop, pp. 231–242 (2000)Google Scholar
- 10.Stoschek, A.: Image-based re-rendering of faces for continuous pose and illumination directions. In: Proceedings of IEEE CVPR, pp. 582–587 (2000)Google Scholar
- 11.Liu, Z., Shan, Y., Zhang, Z.: Expressive expression mapping with ratio images. In: Proceedings of ACM SIGGRAPH, pp. 271–276 (2001)Google Scholar
- 12.Wen, Z., Liu, Z., Huang, T.: Face relighting with radiance environment maps. In: Proceedings of IEEE CVPR, pp. 157–165 (2003)Google Scholar
- 13.Ramamoorthi, R., Hanrahan, P.: On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of Convex Lambertian Object. J. Optical Soc. Am. 18(10), 2448–2459 (2001)CrossRefMathSciNetGoogle Scholar
- 14.Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: Proceedings of ACM SIGGRAPH, pp. 497–500 (2001)Google Scholar
- 15.Lee, K.C., Ho, J., Kriegman, D.: Nine Points of Light: Acquiring Subspaces for Face Recognition under Variable Lighting. In: Proceedings of IEEE CVPR, pp. 357–362 (2001)Google Scholar
- 16.Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans on PAMI 23(6), 681–685 (2001)Google Scholar
- 17.Matthews, I., Baker, S.: Active Appearance Models Revisited. Int’l J. Computer Vision 60(2), 135–164 (2004)CrossRefGoogle Scholar
- 18.Donner, R., Reiter, M., Langs, G., Peloschek, P., Bischof, H.: Fast Active Appearance Model Search Using Canonical Correlation Analysis. IEEE Trans. on PAMI 28(10), 1690–1694 (2006)Google Scholar
- 19.Georghiades, A., Belhumeur, P., Kriegman, D.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. on PAMI 23(6), 643–660 (2001)Google Scholar
- 20.Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., Zhao, D.: The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations. IEEE Trans. on SMC, Part A 38(1) (2008)Google Scholar
- 21.Bookstein, F.L.: Principal Warps: Thin-Plate Splines and the Decomposition of Deformations. IEEE Trans. on PAMI 11(6) (1989)Google Scholar
- 22.Levin, A., Lischinski, D., Weiss, Y.: A Closed Form Solution to Natural Image Matting. IEEE Trans. on PAMI 30(2), 1–15 (2008)Google Scholar
- 23.Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press, Cambridge (2004)zbMATHGoogle Scholar
- 24.Schenk, O., Gärtner, K.: Solving Unsymmetric Sparse Systems of Linear Equations with PARDISO. J. of Future Generation Computer Systems 20(3), 475–487 (2004)CrossRefGoogle Scholar
- 25.Schenk, O., Gärtner, K.: On fast factorization pivoting methods for symmetric indefinite systems. Elec. Trans. Numer. Anal. 23, 158–179 (2006)zbMATHGoogle Scholar
- 26.Schenk, O., Bollhoefer, M., Roemer, R.: On large-scale diagonalization techniques for the Anderson model of localization. SIAM Review 50, 91–112 (2008)zbMATHCrossRefMathSciNetGoogle Scholar
- 27.Schenk, O., Waechter, A., Hagemann, M.: Matching-based Preprocessing Algorithms to the Solution of Saddle-Point Problems in Large-Scale Nonconvex Interior-Point Optimization. J. of Comput. Opt. and App. 36(2-3), 321–341 (2007)zbMATHCrossRefGoogle Scholar
Copyright information
© Springer-Verlag Berlin Heidelberg 2010