A Fast Video Inpainting Technique

  • Mrinmoy Ghorai
  • Pulak Purkait
  • Bhabatosh Chanda
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8251)


In this paper we present a fast video inpainting technique to infer the unknown information in the target region by maximizing box-based self-similarity and coherence measure. The video inpainting is already proposed in the literature and some of them are able to produce good quality results. However, the bottleneck of those algorithms is they are painfully slow. Here we fill the texture in the target region that preserves the smooth motion of the object without inclusion of any artifacts in reasonable amount of time. Our experiments show that the proposed method is quite efficient to synthesize unknown information in a video and comparable to the existing state-of-the-art methods. Moreover, proposed method is based on box filling and optimization is done on multiple scale using EM algorithm, and is computationally faster than the existing ones.


video inpainting self-similarity spatio-temporal coherency 


  1. 1.
    Bertalmio, M., Sapiro, G.: Image In painting. In: Proc. of the ACM SIGGRAPH Conf. on Computer Graphics, New York, USA, pp. 417–424 (2000)Google Scholar
  2. 2.
    Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, New York (2001)Google Scholar
  3. 3.
    Criminisi, A., Perez, P., Toyama, K.: Object Removal by Exemplar-Based Image Inpainting. In: Proc. IEEE Int. Conf. on Computer Vision, vol. 2, pp. 721–728 (2003)Google Scholar
  4. 4.
    Sun, J., Yuan, L., Jia, J., Shum, H.: Image Completion with Structure Propagation. In: Proc. SIGGRAPH 2005, pp. 861–868 (2005)Google Scholar
  5. 5.
    Ashikhmin, M.: Synthesizing natural textures. In: Proc. of ACM Symp. on Interactive 3D Graphics, pp. 217–226 (2001)Google Scholar
  6. 6.
    Komodakis, N., Tziritas, G.: Image Completion using global optimization. In: Proc. IEEE Computer Soc. Conf. Computer Vision and Pattern Recognition, pp. 442–452 (2006)Google Scholar
  7. 7.
    Bugeau, A., Bertalmio, M., Caselles, V.: A comprehensive framework for image inpainting. IEEE Transaction on Image Processing 19 (October 2010)Google Scholar
  8. 8.
    Wexler, Y., Shechtman, E., Irani, M.: Space-time video completion. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. I.120–I.127 (2004)Google Scholar
  9. 9.
    Jia, J., Pang Wu, T., Wing Tai, Y., Keung Tang, C.: Video repairing: Inference of foreground and background under severe occlusion. In: Proc. Computer Vision and Pattern Recognition, pp. 364–371 (2004)Google Scholar
  10. 10.
    Sapiro, G., Patwardhan, K.A., Bertalmio, M.: Video inpainting of occluding and occluded objects. In: IEEE Int. Conf. Image Processing., vol. 2, pp. 69–72 (2005)Google Scholar
  11. 11.
    Patwardhan, K.A., Sapiro, G., Bertalmio, M.: Video inpainting under constrained camera motion. IEEE Transc. on Image Processing 16, 545–553 (2007)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Efros, A.A., Leung, T.: Texture synthesis by non-parametric sampling. In: IEEE International Conference on Computer Vision (ICCV), vol. 2, pp. 1033–1038 (1999)Google Scholar
  13. 13.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics, SIGGRAPH, 24.1–24.11 (2009)Google Scholar
  14. 14.
    Arya, S., Mount, D.M., Netanyahu, N.S., Silverman, R., Wu, A.Y.: An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of ACM 45, 891–923 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 463–476 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Mrinmoy Ghorai
    • 1
  • Pulak Purkait
    • 1
  • Bhabatosh Chanda
    • 1
  1. 1.Indian Statistical InstituteKolkataIndia

Personalised recommendations