Intelligent Technologies in the Diagnostics Using Object’s Visual Images

  • Sergey OrlovEmail author
  • Roman Girin
Part of the Studies in Systems, Decision and Control book series (SSDC, volume 259)


The problem of complex industrial equipment diagnostics using images in different spectral ranges is considered. An intelligent method for technical states classification according to images of a control object is proposed. Considered a neural network analyzer designed as a two-branch neural network. Convolutional neural network processes simultaneously three object’s images obtained in the visual, ultraviolet and infrared bands. The properties of the dataset for learning the neural network are investigated using the dimensionality reduction methods. Examples of the developed method and the neural network analyzer application for monitoring various industrial facilities are given.


Technical diagnostics Artificial neural network Deep learning Infrared thermography Ultraviolet light inspection 


  1. 1.
    Maldague Xavier, P.V.: Nondestructive Evaluation of Materials by Infrared Thermography. Springer-Verlag, London (1993)CrossRefGoogle Scholar
  2. 2.
    Lanzoni, D.: Infrared Thermography. Electrical and Industrial Applications. CreateSpace Independent Publishing Platform (2015)Google Scholar
  3. 3.
    Yi, H., Kai, L.: Inspection and Monitoring Technologies of Transmission Lines with Remote Sensing. ACADEMIC PRESS (2017)Google Scholar
  4. 4.
    Breitenstein, O., Warta, W., Schubert, M.: Lock-in Thermography. Basics and Use for Evaluating Electronic Devices and Materials. Springer International Publishing (2018)Google Scholar
  5. 5.
    Sarua, A., Ji, H., Kuball, M., Uren, M.J., Martin, T., Hilton, K.P., Balmer, R.S.: Integrated Raman-IR thermography for monitoring of self-heating in AlGaN/GaN transistor structure. IEEE Trans. Electron Dev. 53(10), 2438–2447 (2006)CrossRefGoogle Scholar
  6. 6.
    Kuball, M., Sarua, A., Pomeroy, J.W., Falk, A., Albright, A., Uren, M.J., Martin, T.: Integrated Raman-IR thermography for reliability and performance optimization, and failure analysis of electronic devices. In: Conference Proceedings from the 33rd International Symposium for Testing and Failure Analysis, ISTFA 2007, USA, ASM International (2007)Google Scholar
  7. 7.
    Orlov, S.P., Vasilchenko, A.N.: Intelligent measuring system for testing and failure analysis of electronic devices. In: Proceedings of the XIX IEEE International Conference on Soft Computing and Measurements, SCM’2016, May 25–27, 2016, vol. 1, pp. 401–403. Saint-Petersburg, Russia (2016)Google Scholar
  8. 8.
    Orlov, S.P., Girin, R.V.: The use of neural networks for testing and failure analysis of electronic devices. In: Proceedings of the 2nd International Scientific-Practical Conference “Fuzzy Technologies in the Industry (FTI 2018)” 23–25 October, 2018. vol. 2258/paper 21, pp. 160–167. Ulyanovsk, Russia (2018)Google Scholar
  9. 9.
    Hykin, S.: Neural Networks. A Comprehensive Foundation, 2nd edn. Prentice Hall (1999)Google Scholar
  10. 10.
    Norvig, P., Rassell, S.: Artificial Intelligence: A Modern Approach, 3rd edn. Pearson (2010)Google Scholar
  11. 11.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based Learning Applied to Document Recognition, pp. 306–351. IEEE Press (1998)Google Scholar
  12. 12.
    Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS’12 Proceedings of the 25th International Conference on Neural Information Processing Systems, vol. 1, pp. 1097–1105 (2012)Google Scholar
  13. 13.
    Ioffe, S., Szegedy, C.: Batch Normalization: accelerating Deep Network Training Reducing Internal Covariate Shift. Cornell University. (2015). Library.htpps:// Scholar
  14. 14.
    Goodfellow, I., Bengio, Y., Aaron, C.: Deep Learning. The MIT Press (2016)Google Scholar
  15. 15.
    Tilouche, S., Basseto, S., Nia, V.P.: Classification algorithms for virtual metrology. In: Proceedings of the 2014 IEEE International Conference on Management of Innovation and Technology, Singapore, pp. 495–499 (2014)Google Scholar
  16. 16.
    Vidal, R., Yi, Ma., Sastry, S.S.: Generalized Principal Component Analysis. Springer-Verlag, New York (2016)CrossRefGoogle Scholar
  17. 17.
    Borg, I., Groenen, P.: Modern Multidimensional Scaling: theory and Applications, 2nd edn. Springer, New York, NY (2005)zbMATHGoogle Scholar
  18. 18.
    Van der Maaten, L., Hinton, G.: Visualizing data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)zbMATHGoogle Scholar
  19. 19.
    Machine Learning in Python. Decomposing signals in components. Accessed 10 Nov 2018
  20. 20.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks, computer vision—ECCV 2014. Lect. Notes Comp. Sci. 8689, 818–833 (2014)CrossRefGoogle Scholar
  21. 21.
    Intel Nervana Neural Network Processors. Accessed 19 Feb 2019

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Samara State Technical UniversitySamaraRussia

Personalised recommendations