Robust Concrete Crack Detection Using Deep Learning-Based Semantic Segmentation

  • Donghan Lee
  • Jeongho Kim
  • Daewoo LeeEmail author
Original Paper


We propose a crack detection network based on an image segmentation network for robust crack detection, which utilizes information from the entire image and performs pixel-wise prediction. To overcome the lack of data, we also propose a crack image generation algorithm using a 2D Gaussian kernel and the Brownian motion process. We gathered 242 crack images from plain images to cluttered images to train and verify the robustness of the proposed crack segmentation network. To verify the usefulness of simulated cracks, we used 2 integrated datasets constructed with 100 and 200 simulated crack images added to the actual crack dataset, as well as an actual crack dataset. To derive the maximum prediction performance, the neural network was pre-trained on the MS-COCO dataset, and re-trained by each crack dataset. The results show that the proposed method is highly robust and accurate, even for complex images. The trained network was also tested under different brightness, hue, and noise conditions, and results have shown that this promising method can be used in various inspection platforms.


Automatic inspection Crack detection Convolutional neural networks Deep learning Image segmentation Drone inspection 



This work was supported by the National Research Foundation of Korea(NRF) Grant funded by the Korea government(MSIT) through GCRC-SOP (no. 2011-0030013).


  1. 1.
    Mohan A, Poobal S (2017) Crack detection using image processing: a critical review and analysis. Alexandria Eng J 57:787–798CrossRefGoogle Scholar
  2. 2.
    Aboudi J (1987) Stiffness reduction of cracked solids. Eng Fract Mech 26(5):637–650CrossRefGoogle Scholar
  3. 3.
    Eich M, Vogele T (2011) Design and Control of a lightweight magnetic climbing robot for vessel inspection. In: Mediterranean conference on control and automationGoogle Scholar
  4. 4.
    Lim RS, La MH, Shan Z, Sheng W (2011) Developing a crack inspection robot for bridge maintenance. In: International conference on robotics and automationGoogle Scholar
  5. 5.
    Metni N, Hamel T (2007) A UAV for bridge inspection: visual servoing control law with orientation limits. Automat Constr 17(1):3–10CrossRefGoogle Scholar
  6. 6.
    Wang P, Huang H (2010) Comparison analysis on present image-based crack detection methods in concrete structures. In: 3rd International congress on image and signal processingGoogle Scholar
  7. 7.
    Ziou D, Tabbone S (1998) Edge detection techniques-an overview. Pattern Recogn Image Anal 8(4):537–559Google Scholar
  8. 8.
    Cha Y-J, Choi W, Buyukozturk O (2017) Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil Infrastruct Eng 32(5):361–378CrossRefGoogle Scholar
  9. 9.
    Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th international conference on neural information processing systems, vol. 1, pp 1097–1105Google Scholar
  10. 10.
    Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. arXiv Preprint arXiv:1409.1556
  11. 11.
    Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: towards real-time object detection with region proposal networks. arXiv Preprint arXiv:1506.01497
  12. 12.
    Long J, Shelhamer E, Darrell T (2014) Fully convolutional networks for semantic segmentation. arXiv preprint arXiv:1411.4038v2
  13. 13.
    Zhang L, Yang F, Zhang YD, Zhu YJ (2016) Road crack detection using deep convolutional neural network. In: IEEE international conference on image processing (ICIP), pp 3708–3712Google Scholar
  14. 14.
    Chen F-C, Jahanshahi MR (2018) NB-CNN: deep learning-based crack detection using convolutional neural network and naïve Bayes data fusion. IEEE Trans Ind Electron 65(5):4392–4400CrossRefGoogle Scholar
  15. 15.
    Wang N, Zhao Q, Li S, Zhao X, Zhao P (2018) Damage classification for masonry historic structures using convolutional neural networks based on still images. Computer-Aided Civil Infrastruct Eng 33:1073–1089CrossRefGoogle Scholar
  16. 16.
    Yang X, Li H, Yu Y, Luo X, Huang T (2018) Automatic pixel-level crack detection and measurement using fully convolutional network. Computer-Aided Civil Infrastruct Eng 33:1090–1109CrossRefGoogle Scholar
  17. 17.
    Clevert DA, Unterthiner T, Hochreiter S (2015) Fast and accurate deep network learning by exponential linear units (ELUs). arXiv Preprint arXiv:1511.07289
  18. 18.
    Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv Preprint arXiv:1502.03167
  19. 19.
    Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15:1929–1958MathSciNetzbMATHGoogle Scholar
  20. 20.
    Maybeck PS (1979) Stochastic models estimation and control. Academic Press, CambridgezbMATHGoogle Scholar
  21. 21.
    Lin TY, Maire M, Belongie S, Bourdev L, Girshick R, Hays J, Perona P, Ramanan D, Zitnick LC, Dollar P (2014) Microsoft COCO: common object in context. arXiv Preprint arXiv:1405.0312
  22. 22.
    Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? arXiv Preprint arXiv:1411.1792
  23. 23.
    Kingma DP, Ba J (2014) ADAM: a method for stochastic optimization. arXiv Preprint arXiv:1412.6980

Copyright information

© The Korean Society for Aeronautical & Space Sciences 2019

Authors and Affiliations

  1. 1.Pusan National UniversityBusanRepublic of Korea

Personalised recommendations