Skip to main content
SpringerLink
Log in

A Robust Modeling of Impainting System to Eliminate Textual Attributes While Restoring the Visual Texture from Image and Video

  • Conference paper
  • First Online:
Software Engineering Methods in Intelligent Algorithms (CSOC 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 984))

Included in the following conference series:

  • 596 Accesses

Abstract

The area of video analytics in the context of collaborative networking has gained a lot of attention from the research community owing to its potential applicability in the real life aspects. However, although image and video content which mostly get exchanged in the networking pipelines consist of several significant textual information from the application view-point which often display various confidential textual credentials of a corresponding individual. The realization of this fact that this textual attributes has to be removed for various image forensic requirements, has led to image impainting. The study has addressed this problem and come up with a novel analytical solution which imposes two different methods and further combines this two. In the 1st stage it applies a robust mechanism to detect the region of an image and video frame sequence where textual data representation can be localized and perform extraction of those data it introduces artifact and visual anomalies. On the completion of this stage in the 2nd phase, to eliminate the artifacts from the respective locations, it introduces a novel impainting technique which is computationally efficient and attain higher degree of textual data eliminated recovered image or video sequence which is almost similar like the original image or video sequence, can be visually perceived. The comparative performance analysis show that the proposed technique attain better outcome in terms of textual attributes detection accuracy (%) from specific region of interest (ROI) and also consume very less processing time (Sec) in contrast with the existing system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Walden, S.: The Ravished Image. St. Martin’s Press, New York (1985)

    Google Scholar 

  2. Emile-Male, G.: The Restorer’s Handbook of Easel Painting. Van Nostrand Reinhold, New York (1976)

    Google Scholar 

  3. King, D.: The Commissar Vanishes. Henry Holt and Company, 1997. 6 Intuitively, it is clear that we can not address the inpainting problem with a single second order PDE, since regularization constraints on vector fields are needed (in [13], the general variational formulation suggested will normally lead to a fourth order gradient descent flow)

    Google Scholar 

  4. Joyeux, L., Buisson, O., Besserer, B., Boukir, S.: Detection and removal of line scratches in motion picture films. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, CVPR 1999, Fort Collins, Colorado, June 1999

    Google Scholar 

  5. Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, P.J.W.: Detection of missing data in image sequences. IEEE Trans. Image Process. 11(4), 1496–1508 (1995)

    Article  Google Scholar 

  6. Kokaram, A.C., Morris, R.D., Fitzgerald, W.J., Rayner, P.J.W.: Interpolation of missing data in image sequences. IEEE Trans. Image Process. 11(4), 1509–1519 (1995)

    Article  Google Scholar 

  7. Braverman, C.: Photoshop Retouching Handbook. IDG Books Worlwide, Foster City (1998)

    Google Scholar 

  8. Hirani, A., Totsuka, T.: Combining Frequency and spatial domain information for fast interactive image noise removal. Comput. Graph. 96, 269–276 (1996). SIGGRAPH

    Google Scholar 

  9. Efros, A., Leung, T.: Texture synthesis by non-parametric sampling. In: Proceedings of IEEE International Conference Computer Vision, Corfu, Greece, pp. 1033–1038, September 1999

    Google Scholar 

  10. Heeger, D., Bergen, J.: Pyramid based texture analysis/synthesis. In: Computer Graphics, SIGGRAPH 1995, pp. 229–238 (1995)

    Google Scholar 

  11. Simoncelli, E., Portilla, J.: Texture characterization via joint statistics of wavelet coefficient magnitudes. In: 5th IEEE International Conference on Image Processing, Chicago, IL, 4–7 October 1998 (1998)

    Google Scholar 

  12. Nitzberg, M., Mumford, D., Shiota, T.: Filtering, Segmentation, and Depth. Springer, Berlin (1993)

    Book  MATH  Google Scholar 

  13. Huang, J., Wang, Y., Cui, J., Tan, T.: Noise removal and impainting model for iris image. In: 2004 International Conference on Image Processing ICIP 2004, 24 October, vol. 2, pp. 869–872. IEEE (2004)

    Google Scholar 

  14. Karras, D.A., Mertzios, G.B.: Discretization schemes and numerical approximations of PDE impainting models and a comparative evaluation on novel real world MRI reconstruction applications. In: 2004 IEEE International Workshop on Imaging Systems and Techniques (IST), 14 May 2004, pp. 153–158. IEEE (2004)

    Google Scholar 

  15. Stolojescu-Crisan, C., Isar, A.: Impainting SONAR images by exemplar-based algorithm. In: 2013 International Symposium on Signals, Circuits and Systems (ISSCS), 11 July 2013, pp. 1–4. IEEE (2013)

    Google Scholar 

  16. Shen, J., Chan, T.F.: Mathematical models for local nontexture inpaintings. SIAM J. Appl. Math. 62(3), 1019–1043 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  17. Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Jun 2018, vol. 2, p. II. IEEE (2003)

    Google Scholar 

  18. Dimiccoli M, Salembier P.: Perceptual filtering with connected operators and image inpainting. In: Proceedings of ISMM 2007 October, vol. 1, pp. 227–238 (2007)

    Google Scholar 

  19. Ružić, T., Pižurica, A.: Context-aware patch-based image inpainting using markov random field modeling. IEEE Trans. Image Process. 24(1), 444–456 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  20. Buyssens, P., Le Meur, O., Daisy, M., Tschumperlé, D., Lézoray, O.: Depth-guided disocclusion inpainting of synthesized RGB-D images. IEEE Trans. Image Process. 26(2), 525–538 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  21. Jin, X., Su, Y., Zou, L., Wang, Y., Jing, P., Wang, Z.J.: Sparsity-based image inpainting detection via canonical correlation analysis with low-rank constraints. IEEE Access 6, 49967–49978 (2018)

    Article  Google Scholar 

  22. Li, H., Luo, W., Huang, J.: Localization of diffusion-based inpainting in digital images. IEEE Trans. Inf. Forensics Secur. 12(12), 3050–3064 (2017)

    Article  Google Scholar 

  23. Ding, D., Ram, S., Rodríguez, J.J.: Image inpainting using nonlocal texture matching and nonlinear filtering. IEEE Trans. Image Process. 28(4), 1705–1719 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  24. Jin, K.H., Ye, J.C.: Annihilating filter-based low-rank hankel matrix approach for image inpainting. IEEE Trans. Image Process. 24(11), 3498–3511 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  25. Li, Z., He, H., Tai, H.M., Yin, Z., Chen, F.: Color-direction patch-sparsity-based image inpainting using multidirection features. IEEE Trans. Image Process. 24(3), 1138–1152 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  26. Amrani, N., Serra-Sagristà, J., Peter, P., Weickert, J.: Diffusion-based inpainting for coding remote-sensing data. IEEE Geosci. Remote Sens. Lett. 14(8), 1203–1207 (2017)

    Article  Google Scholar 

  27. Guo, Q., Gao, S., Zhang, X., Yin, Y., Zhang, C.: Patch-based image inpainting via two-stage low rank approximation. IEEE Trans. Visual. Comput. Graph. 24(6), 2023–2036 (2018)

    Article  Google Scholar 

  28. Cai, L., Kim, T.: Context-driven hybrid image inpainting. IET Image Process. 9(10), 866–873 (2015)

    Article  Google Scholar 

  29. Lu, H., Zhang, Y., Li, Y., Zhou, Q., Tadoh, R., Uemura, T., Kim, H., Serikawa, S.: Depth map reconstruction for underwater Kinect camera using inpainting and local image mode filtering. IEEE Access 5, 7115–7122 (2017)

    Article  Google Scholar 

  30. Annunziata, R., Garzelli, A., Ballerini, L., Mecocci, A., Trucco, E.: Leveraging multiscale hessian-based enhancement with a novel exudate inpainting technique for retinal vessel segmentation. IEEE J. Biomed. Health Inform. 20(4), 1129–1138 (2016)

    Article  Google Scholar 

  31. Ogawa, T., Haseyama, M.: Adaptive subspace-based inverse projections via division into multiple sub-problems for missing image data restoration. IEEE Trans. Image Process. 25(12), 5971–5986 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  32. Zhang, H., et al.: Computed tomography sinogram inpainting with compound prior modelling both sinogram and image sparsity. IEEE Trans. Nucl. Sci. 63(5), 2567–2576 (2016)

    Article  Google Scholar 

  33. Xu, Y., Yu, L., Xu, H., Zhang, H., Nguyen, T.: Vector sparse representation of color image using quaternion matrix analysis. IEEE Trans. Image Process. 24(4), 1315–1329 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  34. Lun, D.P.: Inpainting for fringe projection profilometry based on geometrically guided iterative regularization. IEEE Trans. Image Process. 24(12), 5531–5542 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  35. Tirer, T., Giryes, R.: Image restoration by iterative denoising and backward projections. IEEE Trans. Image Process. 28(3), 1220–1234 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  36. Wen, F., Adhikari, L., Pei, L., Marcia, R.F., Liu, P., Qiu, R.C.: Nonconvex regularization-based sparse recovery and demixing with application to color image inpainting. IEEE Access 5, 11513–11527 (2017)

    Article  Google Scholar 

  37. Gao, Z., Li, Q., Zhai, R., Shan, M., Lin, F.: Adaptive and robust sparse coding for laser range data denoising and inpainting. IEEE Trans. Circ. Syst. Video Technol. 26(12), 2165–2175 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Maharaja Institute of Technology Mysore, Belavadi, Karnataka, India

    D. Pushpa

Authors
  1. D. Pushpa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to D. Pushpa .

Editor information

Editors and Affiliations

  1. Faculty of Applied Informatics, Tomas Bata University in Zlín, Zlín, Czech Republic

    Radek Silhavy

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pushpa, D. (2019). A Robust Modeling of Impainting System to Eliminate Textual Attributes While Restoring the Visual Texture from Image and Video. In: Silhavy, R. (eds) Software Engineering Methods in Intelligent Algorithms. CSOC 2019. Advances in Intelligent Systems and Computing, vol 984. Springer, Cham. https://doi.org/10.1007/978-3-030-19807-7_23

Download citation

Publish with us

Policies and ethics

Search

Navigation