Signal, Image and Video Processing

, Volume 13, Issue 1, pp 69–77 | Cite as

Effective inpainting method for natural textures with gradually changed illumination

  • Kai HeEmail author
  • Cheng-nan Shen
  • Jun-hui Niu
  • Wan-rong Huang
Original Paper


Natural textures with gradually changed illumination bring great troubles to the field of image inpainting. Using the improved dynamical modeling approach, an energy function model gradually changed from the center to the boundary of data missing region of image is established. On this basis, a gradually changed directional priority function is proposed to ensure the gradual propagation of texture synthesis. In addition, to achieve the feasible propagation of the boundary between different textural regions, the relative test point selection, as well as energy function modeling approach, is also discussed for different cases. Besides, the established energy function models are theoretically evaluated to demonstrate their accuracy in images. Experimental results show the effectiveness of the proposed approach in the natural images with gradually changed illumination.


Image inpainting Exemplar-based method Gradually changed illumination Energy function modeling 



We would like to thank Mr. Ping-fan Tang for sharing the code of Kansa algorithm. This work was supported in part by the National Natural Science Foundation of China under Grant No. 61271326.


  1. 1.
    Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, Madison, WI (2003).
  2. 2.
    Lee, J., Lee, D.K., Park, R.H.: Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans. Consum. Electron. (2012). Google Scholar
  3. 3.
    Xi, X.Y., Wang, F.L., Liu, Y.F.: Improved Criminisi algorithm based on a new Priority Function with the gray entropy. In: 9th International Conference on Computational Intelligence and Security (CIS). IEEE (2013).
  4. 4.
    Casaca, W., Boaventura, M., Almeida, M.P.D., Nonato, L.G.: Combining anisotropic diffusion, transport equation and texture synthesis for inpainting textured images. Pattern Recognit. Lett. 36, 36–45 (2014)CrossRefGoogle Scholar
  5. 5.
    Nan, A.J., Xi, X.Q.: An improved Criminisi algorithm based on a new priority function and updating confidence. In: 7th International Conference on Biomedical Engineering and Informatics (2014).
  6. 6.
    Xu, Z.B., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. (2010). MathSciNetzbMATHGoogle Scholar
  7. 7.
    Li, Z.D., He, H.J., Tai, H.M., Yin, Z.K., Chen, F.: Color-direction patch-sparsity-based image inpainting using multi direction features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. J. IEEE Trans. Image Process. (2013). MathSciNetzbMATHGoogle Scholar
  9. 9.
    Chen, X.W., Zhou, B., Guo, Y., Xu, F., Zhao, Q.: Structure guided texture inpainting through multi-scale patches and global optimization for image completion. Sci. China Inf. Sci. 57, 1–16 (2014)Google Scholar
  10. 10.
    Kumar, V., Mukherjee, J., Mandal, S.K.D.: Image inpainting through metric labeling via guided patch mixing. IEEE Trans. Image Process. 25(11), 5212–5226 (2016)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Ružić, T., Pižurica, A.: Context-aware patch-based image inpainting using Markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Jin, K.H., Ye, J.C.: Annihilating filter-based low-rank Hankel matrix approach for image inpainting. IEEE Trans. Image Process. 24(11), 3498–3510 (2015)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Kawai, N., Sato, T., Yokoya, N.: Diminished reality based on image inpainting considering background geometry. IEEE Trans. Vis. Comput. Graph. 22(3), 1236–1247 (2016)CrossRefGoogle Scholar
  14. 14.
    Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line (2015). Google Scholar
  15. 15.
    Fedorov, V., Arias, P., Facciolo, G., Ballester, C.: Affine invariant self-similarity for exemplar-based inpainting. In: Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2016)Google Scholar
  16. 16.
    Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. Proc. ACM SIGGRAPH 22(3), 313–318 (2003)CrossRefGoogle Scholar
  17. 17.
    Xue, S., Dai, Q.H.: Nonlinear Poisson image completion using color manifold. In: Int. Conf. on Image Processing, San Antonio, Texas, USA (2007).
  18. 18.
    Duan, Y., Tang, P.F., Huang, T.Z., Lai, S.J.: Coupling projection domain decomposition method and Kansa’s method in electrostatic problems. Comput. Phys. Commun. 180, 209–214 (2009)CrossRefzbMATHGoogle Scholar
  19. 19.
    Fawzi, A., Samulowitz, H., Turaga, D., Frossard, P.: Image inpainting through neural networks hallucinations. In: IEEE Image, Video, and Multidimensional Signal Processing Workshop (2016)Google Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2018

Authors and Affiliations

  • Kai He
    • 1
    Email author
  • Cheng-nan Shen
    • 1
  • Jun-hui Niu
    • 1
  • Wan-rong Huang
    • 1
  1. 1.School of Electrical and Information EngineeringTianjin UniversityTianjinChina

Personalised recommendations