Skip to main content

Advertisement

SpringerLink
Log in

Automated Defect Recognition for Welds Using Simulation Assisted TFM Imaging with Artificial Intelligence

  • Published:
Journal of Nondestructive Evaluation Aims and scope Submit manuscript

Abstract

In this paper, Artificial Intelligence (AI) algorithms are employed for first, automating the process of creating a large synthetic Total Focusing Method (TFM) imaging dataset using a small set of Finite Element (FE) simulation datasets, and second for the automated defect-recognition (ADR) in butt-welds. In this paper, six types of imaging datasets are created with three approaches. In the first approach, weld TFM images are constructed using ultrasonic A-scan signals obtained from Full Matrix Capture (FMC) performed using FE analysis on models with weld defects (porosity and slag). The second approach generates near real-time weld TFM images by implementing fast deep convolution generative adversarial networks (DCGAN). This second technique permits simulations that are several orders faster when compared to the FE method. In the third approach, noise is extracted from FMC-TFM experimental measurements using the sliding kernel approach, and this noise is supplemented to individual simulated datasets for creating near to realistic scenarios. The first dataset is created using the first approach. The second dataset is created using the second approach, and the third hybrid dataset is a combination of FE and DCGAN weld TFM imaging. The fourth dataset is noise supplemented to FE based dataset. The fifth dataset is generated by adding noise to DCGAN images. The sixth hybrid dataset with noise is a combination of FE and DCGAN weld TFM noise images. AI plays a significant role in object detection and classification through robust feature extraction, reducing human intervention. In this work, for automated weld defect recognition, a convolutional neural network (CNN) is trained using six types of simulation-assisted weld TFM imaging datasets, which improves the reliability and efficiency of welds quality assurance. The mAP value is 85% for the ADR model trained using the hybrid weld TFM dataset with noise. The model prediction on classification on the hybrid dataset for porosity is 0.86 F1-score, and for slag is 0.80 F1-score.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Drinkwater, B.W., Wilcox, P.D.: Ultrasonic arrays for non-destructive evaluation a review. NDT E Int. 39, 525–41 (2006)

    Article  Google Scholar 

  2. Schmerr, L.W.: Fundamentals of Ultrasonic Nondestructive Evaluation—A Modeling approach. Plenum Press, New York (1998)

    Book  Google Scholar 

  3. Holmes, C., Drinkwater, B.W., Wilcox, P.D.: Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation. NDT E Int. 38(8), 701–11 (2005)

    Article  Google Scholar 

  4. Jobst, M., Connolly, G.: Demonstration of the Application of the Total Focusing Method to the Inspections of Steel Welds, ECNDT, paper 1.3.4 (2010)

  5. Reverdy, F., Benoist, G., Le Ber, L.: Advantages and complementarity of phased-array technology and total focusing method. In: 19th World Conference on Non-Destructive Testing (2016)

  6. Leonard, L.J., Robert, S., Villaverde, E.L., Prada, C.: Plane Wave Imaging for ultrasonic non-destructive testing: generalization to multimodal imaging. Ultrasonics 64, 128–138 (2016)

    Article  Google Scholar 

  7. Zhang, J., Drinkwater, B.W., Wilcox, P.D., Hunter, A.J.: Defect detection using ultrasonic arrays: the multi-mode total focusing method. NDT E Int. 43(2), 123–133 (2010)

    Article  Google Scholar 

  8. Felice, M.V., Velichko, A., Wilcox, P.D.: Accurate depth measurement of small surface-breaking cracks using an ultrasonic array post-processing technique. NDT E Int. 68, 105–112 (2014)

    Article  Google Scholar 

  9. Sambath, S., Nagaraj, P., Selvakumar, N.: Automatic defect classification in ultrasonic NDT using artificial. J. Nondestruct. Eval. 30, 20–28 (2010)

    Article  Google Scholar 

  10. Lalithakumari, S., Sheelarani, B., Venkatraman, B.: Artificial neural network based defect detection of welds in TOFD technique. Int. J. Comput. Appl. 0975-8887,V41-No.20 (2012)

  11. Ioannis, V., Dimitrios, K.: Multiclass defect detection and classification in weld radiographic images using geometric and texture features. Expert Syst. Appl. 37, 7606–7614 (2010)

    Article  Google Scholar 

  12. Virupakshappa, K., Marino, M., Oruklu, E.: A multi-resolution convolutional neural network architecture for ultrasonic flaw detection. In: 2018 IEEE International Ultrasonics Symposium (IUS), pp. 1–4 (2018)

  13. Munir, N., Kim, H., Park, J., Song, S., Kang, S.: Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. Ultrasonics (2019)

  14. Virkkunen, I., Koskinen, T., Jessen-Juhler, O., Rinta-Aho, J.: Augmented ultrasonic data for machine learning. arXiv:1903.11399v1 (2019)

  15. Munir, N., Kim, H.J., Song, S.J., Kang, S.S.: Investigation of deep neural network with drop out for ultrasonic flaw classification in weldments. J. Mech. Sci. Technol. 32(7), 3073–3080 (2018)

    Article  Google Scholar 

  16. Du, W., Shen, H., Fu, J., Zhang, G., He, Q.: Approaches for improvement of the x-ray image defect detection of automobile casting aluminum parts based on deep learning. ND E Int. 107, 102144 (2019)

    Article  Google Scholar 

  17. Virkkunen, I.: Virtual cracks and the future of inspection reliability. In: Karnteknikdagarna Nordic Symposium on Nuclear Technology (2017)

  18. Virkkunen, I., Miettinen, K., Packalen, T.: Virtual flaws for nde training and qualification. In: 11th European Conference on Non-Destructive Testing (ECNDT 2014), NDT.net, The e-Journal of Non-destructive Testing (2014)

  19. Liu, S., Huang, J.H., Sung, J., Lee, C.: Detection of cracks using neural network and computational mechanics. Comput. Appl. Mech. Eng. 191, 2831–2845 (2002)

    Article  Google Scholar 

  20. Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks, arXiv preprint arXiv:1511.06434 (2015)

  21. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)

  22. Dhruv, G., Sreedhar, U., Jyothir, R.K.J., Sureka, M., Padma, P., Bikash, G., Krishnan, B.: Automated defect recognition on X-ray radiographs of solid propellant using deep learning based on convolutional neural networks. J. Nondestr. Eval. NDE4.0 (2021)

  23. Alexey, B., Wang, C.-Y., Liao, H.-Y.: YOLOv4: optimal speed and accuracy of object detection, computer vision and pattern recognition, arXiv preprint arXiv:2004.10934v1 (2020)

  24. Redmon, J., Santosh, D., Ross, G., Farhadi, A.: You only look once: unified, real-time object detection, computer vision and pattern recognition, arXiv preprint arXiv:1506.02640v5 (2016)

  25. Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger, computer vision and pattern recognition, arXiv preprint arXiv:1612.08242v1 (2016)

  26. Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement, computer vision and pattern recognition, arXiv preprint arXiv:1804.02767v1 (2018)

  27. Smith, R.A., Nelson, L.J., Mienczakowski, M.J., Wilcox, P.D.: Ultrasonic analytic-signal responses from polymer-matrix composite laminates. Trans. Ultrason. Ferroelect. Frequency Control 65(2) (2018)

  28. Alexey, B.: https://github.com/pjreddie/darknet (2019)

  29. Everingham, M., Van Gool, L., Williams, C.K.I., et al.: The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338 (2010)

    Article  Google Scholar 

  30. Spencer, R., Sunderman, R., Todorov, E.: FMC/TFM experimental comparisons. AIP Conf. Proc. 1949, 020015 (2018)

    Article  Google Scholar 

  31. Bikash, G., Krishnan, B., Krishnamurthy, C.V., Rao, A.S.: Two dimensional fem simulation of ultrasonic wave propagation in isotropic solid media using comsol, excerpt from the proceedings of the comsol conference (2010)

  32. Rajagopal, P., Mickael, D., Elizabeth, A.S., Michael, J.S.L., Richard, V.C.: On the use of absorbing layers to simulate the propagation of elastic waves in unbounded isotropic media using commercially available finite element packages. NDT E Int. 51, 30–40 (2012)

    Article  Google Scholar 

  33. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training gans. In: Advances in Neural Information Processing Systems, pp. 2234–2242 (2016)

  34. Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456 (2015)

  35. Kingma, D., Ba, J.: Adam: a method for stochastic optimization, arXiv preprint arXiv:1412.6980 (2014)

  36. Nathan, I.: https://pytorch.org/tutorials/beginner/dcgan_faces_tutorial.html (2017

  37. Brandom, A.: http://bamos.github.io/2016/08/09/deep-completion/

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, Center for Non-Destructive Evaluation (CNDE), Indian Institute of Technology Madras, Chennai, 600036, India

    Thulsiram Gantala & Krishnan Balasubramaniam

Authors
  1. Thulsiram Gantala
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Krishnan Balasubramaniam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krishnan Balasubramaniam.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gantala, T., Balasubramaniam, K. Automated Defect Recognition for Welds Using Simulation Assisted TFM Imaging with Artificial Intelligence. J Nondestruct Eval 40, 28 (2021). https://doi.org/10.1007/s10921-021-00761-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10921-021-00761-1

Keywords

Search

Navigation