Abstract
Natural textures with gradually changed illumination bring great troubles to the field of image inpainting. Using the improved dynamical modeling approach, an energy function model gradually changed from the center to the boundary of data missing region of image is established. On this basis, a gradually changed directional priority function is proposed to ensure the gradual propagation of texture synthesis. In addition, to achieve the feasible propagation of the boundary between different textural regions, the relative test point selection, as well as energy function modeling approach, is also discussed for different cases. Besides, the established energy function models are theoretically evaluated to demonstrate their accuracy in images. Experimental results show the effectiveness of the proposed approach in the natural images with gradually changed illumination.
Similar content being viewed by others
References
Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, Madison, WI (2003). https://doi.org/10.1109/cvpr.2003.1211538
Lee, J., Lee, D.K., Park, R.H.: Robust exemplar-based inpainting algorithm using region segmentation. IEEE Trans. Consum. Electron. (2012). https://doi.org/10.1109/TCE.2012.6227460
Xi, X.Y., Wang, F.L., Liu, Y.F.: Improved Criminisi algorithm based on a new Priority Function with the gray entropy. In: 9th International Conference on Computational Intelligence and Security (CIS). IEEE (2013). https://doi.org/10.1109/cis.2013.52
Casaca, W., Boaventura, M., Almeida, M.P.D., Nonato, L.G.: Combining anisotropic diffusion, transport equation and texture synthesis for inpainting textured images. Pattern Recognit. Lett. 36, 36–45 (2014)
Nan, A.J., Xi, X.Q.: An improved Criminisi algorithm based on a new priority function and updating confidence. In: 7th International Conference on Biomedical Engineering and Informatics (2014). https://doi.org/10.1109/bmei.2014.7002897
Xu, Z.B., Sun, J.: Image inpainting by patch propagation using patch sparsity. IEEE Trans. Image Process. (2010). https://doi.org/10.1109/TIP.2010.2042098
Li, Z.D., He, H.J., Tai, H.M., Yin, Z.K., Chen, F.: Color-direction patch-sparsity-based image inpainting using multi direction features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)
Liu, Y., Caselles, V.: Exemplar-based image inpainting using multiscale graph cuts. J. IEEE Trans. Image Process. (2013). https://doi.org/10.1109/TIP.2012.2218828
Chen, X.W., Zhou, B., Guo, Y., Xu, F., Zhao, Q.: Structure guided texture inpainting through multi-scale patches and global optimization for image completion. Sci. China Inf. Sci. 57, 1–16 (2014)
Kumar, V., Mukherjee, J., Mandal, S.K.D.: Image inpainting through metric labeling via guided patch mixing. IEEE Trans. Image Process. 25(11), 5212–5226 (2016)
Ružić, T., Pižurica, A.: Context-aware patch-based image inpainting using Markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)
Jin, K.H., Ye, J.C.: Annihilating filter-based low-rank Hankel matrix approach for image inpainting. IEEE Trans. Image Process. 24(11), 3498–3510 (2015)
Kawai, N., Sato, T., Yokoya, N.: Diminished reality based on image inpainting considering background geometry. IEEE Trans. Vis. Comput. Graph. 22(3), 1236–1247 (2016)
Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line (2015). https://doi.org/10.5201/ipol.2015.136
Fedorov, V., Arias, P., Facciolo, G., Ballester, C.: Affine invariant self-similarity for exemplar-based inpainting. In: Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (2016)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. Proc. ACM SIGGRAPH 22(3), 313–318 (2003)
Xue, S., Dai, Q.H.: Nonlinear Poisson image completion using color manifold. In: Int. Conf. on Image Processing, San Antonio, Texas, USA (2007). https://doi.org/10.1109/icip.2007.4379998
Duan, Y., Tang, P.F., Huang, T.Z., Lai, S.J.: Coupling projection domain decomposition method and Kansa’s method in electrostatic problems. Comput. Phys. Commun. 180, 209–214 (2009)
Fawzi, A., Samulowitz, H., Turaga, D., Frossard, P.: Image inpainting through neural networks hallucinations. In: IEEE Image, Video, and Multidimensional Signal Processing Workshop (2016)
Acknowledgements
We would like to thank Mr. Ping-fan Tang for sharing the code of Kansa algorithm. This work was supported in part by the National Natural Science Foundation of China under Grant No. 61271326.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
He, K., Shen, Cn., Niu, Jh. et al. Effective inpainting method for natural textures with gradually changed illumination. SIViP 13, 69–77 (2019). https://doi.org/10.1007/s11760-018-1329-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-018-1329-2