Skip to main content
SpringerLink
Log in

Detection of Dust Deposition Using Convolutional Neural Network for Heritage Images

  • Conference paper
  • First Online:
Computational Intelligence: Theories, Applications and Future Directions - Volume II

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 799))

Abstract

This paper presents a vision-based approach for heritage image classification and condition monitoring to preserve the historical facts. The proposed approach uses convolutional neural network for classification. The approach interprets the heritage condition in terms of dust level. Initially, real-time scene image is preprocessed using image processing operators such as dilation, erosion, region filling, and binarization. Resultant image is segmented and enclosed by bounding boxes. The enclosed segments are fed to CNN for classification. The proposed approach also provides the dust level in image by comparison of probability score of the classified image with ideal one. The dust is interpreted as Gaussian noise in the image. The dust level, greater than an acceptable tolerance level, generates a notification for heritage maintenance. Results show that the proposed approach is able to classify the heritage image in the presence of noise.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Feilden, B., Jokilheto, J.: Management Guidelines for World Cultural Heritage Sites. ICCROM, Rome (1993)

    Google Scholar 

  2. Garziera, R., Amabili, M., Collini, L.: Structural health monitoring techniques for historical buildings. Eng. Struct. 19(9), 718–723 (1997)

    Article  Google Scholar 

  3. Anastasi, G., Re, G.L., Ortolani, M.: WSNs for structural health monitoring of historical buildings. In: 2nd IEEE Conference on Human System Interactions, pp. 574–579 (2009)

    Google Scholar 

  4. Glisic, B., Inaudi, D., Posenato, D., Figini, A., Casanova, N.: Monitoring of heritage structures and historical monuments using long-gage fiber optic interferometric sensorsan overview. In: Proceedings of the 3rd International Conference on Structural Health Monitoring of Intelligent Infrastructure-SHMII-3, pp. 13–16. Vancouver, BC, Canada (2007)

    Google Scholar 

  5. Cole, I.S., Corrigan, P.A., Ganther, W., Ho, T., Lewis, C.J., Muster, T.H., Galea, S.: Development of a sensor-based learning approach to prognostics in intelligent vehicle health monitoring. In: IEEE International Conference on Prognostics and Health Management, pp. 1–7 (2008)

    Google Scholar 

  6. Jafri, R., Arabnia, H.R.: A survey of face recognition techniques. JIPS 5(2), 41–68 (2009)

    Google Scholar 

  7. Gonzlez, G.M., Llorca, D.F., Gaviln, M., Fernndez, J.P., Alcantarilla, P.F., De Toro, P.R.: Automatic traffic signs and panels inspection system using computer vision. IEEE Trans. Intell. Transp. Syst. 12(2), 485–499 (2011)

    Google Scholar 

  8. Malek, A.S.: Online fabric inspection by image processing technology. Doctoral Dissertation, Universit de Haute Alsace-Mulhouse (2012)

    Google Scholar 

  9. Roy, S., Roy, S.: A tutorial review on face detection. Int. J. Eng. Res. Technol. (IJERT) 1(8), 2278-0181 (2012)

    Google Scholar 

  10. Verma, N.K., Sharma, T., Rajurkar, S.D., Salour, A.: Object identification for inventory management using convolutional neural network. In: IEEE Applied Imagery Pattern Recognition Workshop (AIPR). Washington DC, USA (2016) (In Proceedings)

    Google Scholar 

  11. Verma, N.K., Sunny, N.K., Mishra, A.: Generation of future image frame using autoregressive model. In: IEEE Conference on Industrial Electronics and Applications, pp. 171–176. Auckland, New Zealand, (2015)

    Google Scholar 

  12. Verma, N.K., Mishra, A.: Large displacement optical flow based image predictor model. In: IEEE Applied Imagery Pattern Recognition Workshop (AIPR), pp. 1–7. Washington DC, USA, Oct 2014

    Google Scholar 

  13. Verma, N.K., Singh, S.: Generation of future image frames using optical flow. In: Applied Imagery Pattern Recognition Workshop (AIPR), pp. 1–7. Washington DC, USA, 23–25 Oct 2013

    Google Scholar 

  14. Flickner, M., Sawhney, H., Niblack, W., Ashley, J., HUang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. IEEE. Comput. 28, 23–32 (1995)

    Google Scholar 

  15. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24, 509–522 (2002)

    Google Scholar 

  16. Deng, Y., Manjunath, B.S., Kenney, C., Moore, M.S., Shin, H.: An efficient color representation for image retrieval. IEEE Trans. Image Process. 10, 140–147 (2001)

    Google Scholar 

  17. Portilla, J., Simoncelli, E.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 40, 49–71 (2000)

    Google Scholar 

  18. Rosenfeld, A.: A nonlinear edge detection technique. Proc. IEEE 58(5), 814–816 (1970)

    Article  Google Scholar 

  19. Kuruvilla, J., Sukumaran, D., Sankar, A., Joy, S.P.: A review on image processing and image segmentation. In: 2016 International Conference on Data Mining and Advanced Computing (SAPIENCE), pp. 198–203 (2016)

    Google Scholar 

  20. Moghaddam, A.A.: Image processing techniques for classification of linear welding defects. In: 2nd International Conference on Knowledge-Based Engineering and Innovation (KBEI), pp. 978–981 (2015)

    Google Scholar 

  21. Chen, S., Haralick, R.M.: Recursive erosion, dilation, opening, and closing transforms. IEEE Trans. Image Process. 4(3), 335–345 (1995)

    Article  Google Scholar 

  22. Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. Image Process. 13(9), 1200–1212 (2004)

    Article  Google Scholar 

  23. Taneja, A., Ranjan, P., Ujjlayan, A.: A performance study of image segmentation techniques. In: 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO), India (2015)

    Google Scholar 

  24. Kang, S.M., Kim, J.H., Yuan, Z., Song, S.H., Cho, J.D.: A fast region expansion labeling of connected components in binary image. In: 18th IEEE International Symposium on Consumer Electronics (ISCE) (2014)

    Google Scholar 

  25. Verma, N.K., Goyal, A., Chaman, A., Sevakula, R.K., Salour, A.: Template matching for inventory management using fuzzy color histogram and spatial filters. In: IEEE Conference on Industrial Electronics and Applications, pp. 317–322. AuckLand, New Zealand (2015)

    Google Scholar 

  26. Verma, N.K., Sharma, T., Rajurkar, S.D., Ranjan, R., Salour A.: Vision based counting of texture-less objects using shape and color features. In: IEEE International Conference on Industrial and Information Systems (ICIIS). IIT Roorkee, India (2016) (In Proceedings)

    Google Scholar 

  27. Lowe, D.G.: Object recognition from local scale-invariant features. In: 7th IEEE International Conference on Computer Vision, Kerkrya, Greece (1999)

    Google Scholar 

  28. Bay, H., Tuytelaars, T., Van Gool, L.: Surf: Speeded up robust features. In: European Conference on Computer Vision, pp. 404–417. Springer, Berlin, Heidelberg (2006)

    Google Scholar 

  29. Verma, N.K., Sharma, T., Sevakula, R.K., Salour, A.: Vision based object counting using speeded up robust features for inventory control. In: International conference on Computational Science and Computational Intelligence (CSCI16), Las Vegas, Nevada, USA (2016) (In Proceedings)

    Google Scholar 

  30. Agrawal, P., Sharma, T., Verma, N.K.: Supervised approach for object identification using speeded up robust features. Int. J. Adv. Intell. Paradigms (IJAIP) (2016) (Accepted for publication)

    Google Scholar 

  31. Verma, N.K., Sharma, T., Rajurkar, S.D., Salour, A.: Object identification for inventory management using convolutional neural network. IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington DC, USA (2016) (In Proceedings)

    Google Scholar 

  32. Fukushima, K., Miyake, S.: Neocognitron: a self-organizing neural network model for a mechanism of visual pattern recognition. In: Competition and Cooperation in Neural Nets, pp. 267–285. Springer, Berlin, Heidelberg (1982)

    Google Scholar 

  33. Vapnik, V.N.: An overview of statistical learning theory. IEEE Trans. Neural Netw. 10(5), 988–999 (1999)

    Article  Google Scholar 

  34. Zhang, L., Huang, H., Jing, X.: A modified cyclostationary spectrum sensing based on softmax regression model. In: 16th International Symposium on Communications and Information Technologies (ISCIT), pp. 620–623 (2016)

    Google Scholar 

  35. Coates, A., Lee, H., Ng, A.Y.: An analysis of single layer networks in unsupervised feature learning. Ann. Arbor. 1001(48109), 2 (2010)

    Google Scholar 

  36. Deng, G., Cahill, L.W.: An adaptive Gaussian filter for noise reduction and edge detection. In: IEEE Nuclear Science Symposium and Medical Imaging Conference, pp. 1615–1619 (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Indian Institute of Technology Kanpur, Kanpur, 208016, India

    Teena Sharma, Pooja Agrawal & Nishchal K. Verma

Authors
  1. Teena Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pooja Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nishchal K. Verma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Teena Sharma .

Editor information

Editors and Affiliations

  1. Department of Electrical Engineering, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India

    Nishchal K. Verma

  2. Department of Aerospace Engineering, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India

    A. K. Ghosh

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sharma, T., Agrawal, P., Verma, N.K. (2019). Detection of Dust Deposition Using Convolutional Neural Network for Heritage Images. In: Verma, N., Ghosh, A. (eds) Computational Intelligence: Theories, Applications and Future Directions - Volume II. Advances in Intelligent Systems and Computing, vol 799. Springer, Singapore. https://doi.org/10.1007/978-981-13-1135-2_27

Download citation

Publish with us

Policies and ethics

Search

Navigation