Abstract
Historical monuments are considered as one of the key aspects for modern communities. Unfortunately, due to a variety of factors the monuments get damaged. One may think of digitally undoing the damage to the monuments by inpainting, a process to fill-in missing regions in an image. A majority of inpainting techniques reported in the literature require manual selection of the regions to be inpainted. In this paper, we propose a novel method that automates the process of identifying the damage to visually dominant regions viz. eyes, nose and lips in face image of statues, for the purpose of inpainting. First, a bilateral symmetry based method is used to identify the eyes, nose and lips. Textons features are then extracted from each of these regions in a multi-resolution framework to characterize both the regular and irregular textures. These textons are matched with those extracted from a training set of true vandalized and non-vandalized regions, in order to classify the region under consideration. If the region is found to be vandalized, the best matching non-vandalized region from the training set is used to inpaint the identified region using the Poisson image editing method. Experiments conducted on face images of statues downloaded from the Internet, give promising results.
This work is a part of project sponsored by Department of Science and Technology (DST), Govt. of India (Grant No: NRDMS/11/1586/2009/Phase-II).
Chapter PDF
References
Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. Trans. Img. Proc. 12(8), 882–889 (2003)
Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Computer graphics (SIGGRAPH 2000), pp. 417–424 (2000)
Criminisi, A., Pérez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Trans. Img. Proc. 13(9), 1200–1212 (2004)
Emerson, C., Lam, N., Quattrochi, D.: Multi-scale fractal analysis of image texture and patterns. Photogrammetric Engg. and Remote Sensing 65(1), 51–62 (1999)
Google Images (March 2012), http://www.images.google.com
Hays, J., Efros, A.A.: Scene completion using millions of photographs. ACM Transactions on Graphics (SIGGRAPH 2007) 26(3) (2007)
Katahara, S., Aoki, M.: Face parts extraction windows based on bilateral symmetry of gradient direction. In: Solina, F., Leonardis, A. (eds.) CAIP 1999. LNCS, vol. 1689, pp. 489–497. Springer, Heidelberg (1999)
Legrand, P.: Local regularity and multifractal methods for image and signal analysis. In: Scaling, Fractals and Wavelets. Wiley (January 2009)
Levin, A., Zomet, A., Weiss, Y.: Learning how to inpaint from global image statistics. In: Int. Conf. on Computer Vision, vol. 1, pp. 305–312 (October 2003)
Masnou, S., Morel, J.M.: Level lines based disocclusion. In: Int. Conf. on Image Processing, vol. 3, pp. 259–263 (October 1998)
Parmar, C.M., Joshi, M.V., Raval, M.S., Zaveri, M.A.: Automatic image inpainting for the facial images of monuments. In: Proceedings of Electrical Engineering Centenary Conference 2011, December 14-17, pp. 415–420 (2011)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. In: ACM SIGGRAPH 2003 Papers, SIGGRAPH 2003, pp. 313–318 (2003)
Tibshirani, R., Walther, G., Hastie, T.: Estimating the number of clusters in a data set via the gap statistic. Journal of Royal Stat. Soc., B 63(2), 411–423 (2001)
Varma, M., Zisserman, A.: A statistical approach to material classification using image patch exemplars. IEEE Trans. PAMI 31(11), 2032–2047 (2009)
Varma, M., Zisserman, A.: Classifying images of materials: Achieving viewpoint and illumination independence. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 255–271. Springer, Heidelberg (2002)
Štruc, V., Pavešić, N.: Illumination invariant face recognition by non-local smoothing. In: Proceedings of the BioID MultiComm., pp. 1–8 (2009)
Weickert, J.: Theoretical foundations of anisotropic diffusion in image processing. Computing, Suppl. 11, 221–236 (1996)
Whyte, O., Sivic, J., Zisserman, A.: Get out of my picture! internet-based inpainting. In: Proceedings of the 20th British Machine Vision Conference, London (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Padalkar, M.G., Vora, M.V., Joshi, M.V., Zaveri, M.A., Raval, M.S. (2013). Identifying Vandalized Regions in Facial Images of Statues for Inpainting. In: Petrosino, A., Maddalena, L., Pala, P. (eds) New Trends in Image Analysis and Processing – ICIAP 2013. ICIAP 2013. Lecture Notes in Computer Science, vol 8158. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41190-8_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-41190-8_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41189-2
Online ISBN: 978-3-642-41190-8
eBook Packages: Computer ScienceComputer Science (R0)