Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 1, pp 237–256 | Cite as

Recurrent convolutional network for video-based smoke detection

  • Mengxia Yin
  • Congyan LangEmail author
  • Zun Li
  • Songhe Feng
  • Tao Wang
Article
  • 326 Downloads

Abstract

Video-based smoke detection plays an important role in the fire detection community. Such interesting topic, however, always suffers from great challenge due to the large variances of smoke texture, shape and color in the real applications. To effectively exploiting the long-range motion context, we propose a novel video-based smoke detection method via Recurrent Neural Networks (RNNs). More concretely, the proposed method first captures the space and motion context information by using deep convolutional motion-space networks. Then a temporal pooling layer and RNNs are used to effectively train the smoke model. Finally, to promote further research and evaluation of video-based smoke models, we also construct a new large database of 3000 challenging smoke video clips that cover large variations in illuminance and weather conditions. Experimental results demonstrate that our proposed method is capable of achieving state-of-the-art performance on all public benchmarks.

Keywords

Smoke detection Motion context information Deep convolution RNNs 

References

  1. 1.
    Antipov G, Baccouche M, Berrani SA, Dugelay JL (2016) Apparent age estimation from face images combining general and children-specialized deep learning models. In: IEEE conference on computer vision and pattern recognition workshops, pp 801–809Google Scholar
  2. 2.
    Avgerinakis K, Briassouli A, Kompatsiaris I (2012) Smoke detection using temporal hoghof descriptors and energy colour statistics from video. In: International workshop on multi-sensor systems and networks for fire detection and managementGoogle Scholar
  3. 3.
    Bao BK, Liu G, Xu C, Yan S (2012) Inductive robust principal component analysis. IEEE Trans Image Process 21(8):3794–3800MathSciNetCrossRefGoogle Scholar
  4. 4.
    Bao BK, Zhu G, Shen J, Yan S (2013) Robust image analysis with sparse representation on quantized visual features. IEEE Trans Image Process 22(3):860–871MathSciNetCrossRefGoogle Scholar
  5. 5.
    Barmpoutis P, Dimitropoulos K, Grammalidis N (2014) Smoke detection using spatio-temporal analysis, motion modeling and dynamic texture recognition. In: Signal processing conference, pp 1078–1082Google Scholar
  6. 6.
    Chen J, Wang Y, Tian Y, Huang T (2013) Wavelet based smoke detection method with rgb contrast-image and shape constrain. In: Visual communications and image processing, pp 1–6Google Scholar
  7. 7.
    Chen J, You Y, Peng Q (2013) Dynamic analysis for video based smoke detection. International Journal of Computer Science IssuesGoogle Scholar
  8. 8.
    Chen TH, Yin YH, Huang SF, Ye YT (2006) The smoke detection for early fire-alarming system base on video processing. In: International conference on intelligent information hiding and multimedia signal processing, pp 427–430Google Scholar
  9. 9.
    Cui Y, Dong H, Zhou E (2008) An early fire detection method based on smoke texture analysis and discrimination. In: Congress on image and signal processing, 2008. CISP ’08, pp 95–99Google Scholar
  10. 10.
    Dosovitskiy A, Fischer P, Ilg E, Husser P, Hazirbas C, Golkov V, Smagt PVD, Cremers D, Brox T (2015) Flownet: learning optical flow with convolutional networks. In: IEEE international conference on computer vision, pp 2758–2766Google Scholar
  11. 11.
    Genovese A, Labati RD, Piuri V, Scotti F (2011) Wildfire smoke detection using computational intelligence techniques. In: IEEE international conference on computational intelligence for measurement systems and applications, pp 1–6Google Scholar
  12. 12.
    Iida Y, Maruta H, Kurokawa F (2013) A study on smoke detection method based on lbp featured and adaboost. Ieice Technical Report Image Engineering 112 (475):57–62Google Scholar
  13. 13.
    Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. Computer ScienceGoogle Scholar
  14. 14.
    Ko BC (2012) Wildfire smoke detection using temporospatial features and random forest classifiers. Opt Eng 51(1):7208CrossRefGoogle Scholar
  15. 15.
    Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: International conference on neural information processing systems, pp 1097–1105Google Scholar
  16. 16.
    Krstini D, Stipaničev D, Jakovčevi T (2015) Histogram-based smoke segmentation in forest fire detection system. Information Technology and Control 38 (3):237–244Google Scholar
  17. 17.
    Liu H, Jie Z, Jayashree K, Qi M, Jiang J, Yan S, Feng J (2017) Video-based person re-identification with accumulative motion context. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)Google Scholar
  18. 18.
    Liu S, Ou X, Qian R, Wang W, Cao X (2016) Makeup like a superstar: deep localized makeup transfer network. In: International joint conference on artificial intelligence, pp 2568–2575Google Scholar
  19. 19.
    Liu S, Sun Y, Zhu D, Bao R, Wang W, Shu X, Yan S (2017) Face aging with contextual generative adversarial nets. In: ACM, pp 82–90Google Scholar
  20. 20.
    Liu S, Wang C, Qian R, Yu H, Bao R (2017) Surveillance video parsing with single frame supervision. In: IEEE conference on computer vision and pattern recognition workshops, pp 1–9Google Scholar
  21. 21.
    Lu J, Wang G, Deng W, Moulin P (2015) Multi-manifold deep metric learning for image set classification. In: IEEE conference on computer vision and pattern recognition, pp 1137–1145Google Scholar
  22. 22.
    Maruta H, Nakamura A, Kurokawa F (2010) A new approach for smoke detection with texture analysis and support vector machine. In: IEEE international symposium on industrial electronics, pp 1550– 1555Google Scholar
  23. 23.
    Millangarcia L, Sanchezperez G, Nakano M, Toscanomedina K, Perezmeana H, Rojascardenas L (2012) An early fire detection algorithm using ip cameras. Sensors 12(5):5670–86CrossRefGoogle Scholar
  24. 24.
    Niu Z, Zhou M, Wang L, Gao X, Hua G (2016) Ordinal regression with multiple output cnn for age estimation. In: IEEE conference on computer vision and pattern recognition, pp 4920–4928Google Scholar
  25. 25.
    Park JO, Ko BC, Nam JY, Kwak SY (2013) Wildfire smoke detection using spatiotemporal bag-of-features of smoke. In: IEEE workshop on applications of computer vision, pp 200–205Google Scholar
  26. 26.
    Tian H, Li W, Ogunbona P, Wang L (2014) Single image smoke detection. In: Europeon conference on computer visionGoogle Scholar
  27. 27.
    Tian H, Li W, Wang L (2012) Ogunbona: a novel video-based smoke detection method using image separation. In: IEEE international conference on multimedia and expo, pp 532–537Google Scholar
  28. 28.
    Tian H, Li W, Wang L, Ogunbona P (2012) A novel video-based smoke detection method using image separation. In: IEEE international conference on multimedia and expo, pp 532–537Google Scholar
  29. 29.
    Tian H, Li W, Wang L, Ogunbona P (2014) Smoke detection in video: an image separation approach. Int J Comput Vis 106(2):192–209CrossRefGoogle Scholar
  30. 30.
    Tian Y, Luo P, Wang X, Tang X (2015) Pedestrian detection aided by deep learning semantic tasks. In: IEEE conference on computer vision and pattern recognition, pp 5079–5087Google Scholar
  31. 31.
    Tian Y, Luo P, Wang X, Tang X (2015) Deep learning strong parts for pedestrian detection. In: IEEE international conference on computer vision, pp 1904–1912Google Scholar
  32. 32.
    Toreyin BU, Dedeoglu Y, Cetin AE (2005) Wavelet based real-time smoke detection in video. In: Signal processing conference, 2005 european, pp 1–4Google Scholar
  33. 33.
    Vezzani R, Calderara S, Piccinini P, Cucchiara R (2008) Smoke detection in video surveillance:the use of visor (video surveillance on-line repository). In: ACM international conference on image and video retrieval, Civr 2008, Niagara Falls, Canada, July, pp 289–298Google Scholar
  34. 34.
    Wu J, Yu Y, Huang C, Yu K (2015) Deep multiple instance learning for image classification and auto-annotation. In: IEEE conference on computer vision and pattern recognition, pp 3460–3469Google Scholar
  35. 35.
    Yang S, Zheng X (2014) A video smoke detection method based on various features integration and adaboost. J Comput Inf Syst 10(24):10,463–10,471Google Scholar
  36. 36.
    Yuan F (2008) A fast accumulative motion orientation model based on integral image for video smoke detection. Pattern Recogn Lett 29(7):925–932CrossRefGoogle Scholar
  37. 37.
    Yuan F (2011) Video-based smoke detection with histogram sequence of lbp and lbpv pyramids. Fire Safety Journal 46(3):132–139CrossRefGoogle Scholar
  38. 38.
    Yuan F, Fang Z, Wu S, Yang Y (2015) Real-time image smoke detection using staircase searching-based dual threshold adaboost and dynamic analysis. IET Image Process 9(10):849–856CrossRefGoogle Scholar
  39. 39.
    Zhu Z, Liang D, Zhang S, Huang SX, Li B (2016) Traffic-sign detection and classification in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2110– 2118Google Scholar
  40. 40.
    Zhao Y, Zhou Z, Xu M (2015) Forest fire smoke video detection using spatiotemporal and dynamic texture features. J Electr Comput Eng 2015(3):40Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Mengxia Yin
    • 1
  • Congyan Lang
    • 1
    Email author
  • Zun Li
    • 1
  • Songhe Feng
    • 1
  • Tao Wang
    • 1
  1. 1.Beijing Jiaotong UniversityBeijingChina

Personalised recommendations