Vision based smoke detection system using image energy and color information


Smoke detection is a crucial task in many video surveillance applications and could have a great impact to raise the level of safety of urban areas. Many commercial smoke detection sensors exist but most of them cannot be applied in open space or outdoor scenarios. With this aim, the paper presents a smoke detection system that uses a common CCD camera sensor to detect smoke in images and trigger alarms. First, a proper background model is proposed to reliably extract smoke regions and avoid over-segmentation and false positives in outdoor scenarios where many distractors are present, such as moving trees or light reflexes. A novel Bayesian approach is adopted to detect smoke regions in the scene analyzing image energy by means of the Wavelet Transform coefficients and Color Information. A statistical model of image energy is built, using a temporal Gaussian Mixture, to analyze the energy decay that typically occurs when smoke covers the scene then the detection is strengthen evaluating the color blending between a reference smoke color and the input frame. The proposed system is capable of detecting rapidly smoke events both in night and in day conditions with a reduced number of false alarms hence is particularly suitable for monitoring large outdoor scenarios where common sensors would fail. An extensive experimental campaign both on recorded videos and live cameras evaluates the efficacy and efficiency of the system in many real world scenarios, such as outdoor storages and forests.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Subscribe to journal

Immediate online access to all issues from 2019. Subscription will auto renew annually.

US$ 99

This is the net price. Taxes to be calculated in checkout.


  1. 1

    Narasimhan Srinivasa G., Nayar Shree K.: Vision and the atmosphere. Int. J. Comput. Vision 48(3), 233–254 (2002)

  2. 2

    Schechner Yoav Y., Narasimhan Srinivasa G., Nayar, Shree K.: Polarization-based vision through haze. Appl. Opt. 42, 3 (2003)

  3. 3

    Oakley, J. P., Bu, H.: Correction of simple contrast loss in color images. IEEE Trans. Image Process. 16(2), 511–522

  4. 4

    Garg K., Nayar S.K.: When does a camera see rain?. IEEE Int. Conf. Comp. Vis. (ICCV) 2, 1067–1074 (2005)

  5. 5

    Garg, K., Nayar, S.K.: Detection and removal of rain from videos. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, no. 1, pp. 528–535 (2004)

  6. 6

    Phillips W. III, Shah M., Lobo N.V.: FlameRecognition in Video. Pattern Recognit. Lett. 23(1–3), 319–327 (2002)

  7. 7

    Fastcom Tech.SA, Blvd. de Grancy 19A, CH-1006 Lausanne, Switzerland: Method and device for detecting fires based on image analysis. In: Patent Coop. Treaty(PCT) Appl.No: PCT/CH02/00118, PCT Pubn.No: WO02/069292

  8. 8

    Liu, C.B., Ahuja, N.: Vision Based Fire Detection. In: Proceedings of International Conference on Pattern Recognition, ICPR ’04, vol. 4 (2004)

  9. 9

    Kopilovic, I., Vagvolgyi, B., Sziranyi, T.: Application of panoramic annular lens for motion analysis tasks: surveillance and smoke detection. In: Proceedings of 15th International Conference on Pattern Recognition, vol. 4, pp. 714–717. IEEE, 3–7 September (2000)

  10. 10

    Chen, T.-H., Yin, Y.-H., Huang, S.-F., Ye, Y.-T.: The smoke detection for early fire-alarming system base on video processing. In: International Conference on Intelligent Information Hiding and Multimedia, pp. 427–430 (2006)

  11. 11

    Xiong, Z., Caballero, R., Wang, H., Finn, A., Lelic, M. A., Peng, P.: Video-based smoke detection: possibilities, techniques, and challenges suppression and detection research and applications. A Technical Working Conference (SUPDET 2007). March 5–8 Orlando, Florida (2007)

  12. 12

    Toreyin, B.U., Dedeoglu, Y., Cetin, A.E., Fazekas, D., Chetverikov, T. Amiaz, N. Kiryati.: Dynamic texture detection, segmentation and analysis In: Conference On Image And Video Retrieval, pp. 131–134. ACM, New York (2007)

  13. 13

    Garg, K., Nayar, S.K.: Photometric Model of a Rain Drop. Technical Report, Department of Computer Science, Columbia University, September 2004

  14. 14

    Vicente J., Guillemant P.: An image processing technique for automatically detecting forest fire. Int. J. Therm. Sci. 41(12), 1113–1120 (2002)

  15. 15

    Toreyin, B.U., Dedeoglu, Y., Cetin A.E.: Flame detection in video using hidden Markov models. In: IEEE International Conference on Image Processing IEEE (2005)

  16. 16

    Toreyin, B.U., Dedeoglu, Y., Cetin A.E.: Wavelet based real-time smoke detection in video. In: EUSIPCO ’05 (2005)

  17. 17

    Collins, R.T., Collins, A.J., Lipton, Kanade, T.: A system for video surveillance and monitoring. In: 8th International Topical Meeting on Robotics and Remote Systems. American Nuclear Society (1999)

  18. 18

    Cucchiara R., Grana C., Piccardi M., Prati A.: Detecting moving objects, ghosts and shadows in video streams. IEEE Trans. Pattern Anal. Mach. Intell. 25(10), 1337–1342 (2003)

  19. 19

    Vezzani, R., Cucchiara, R.: AD-HOC: appearance driven human tracking with occlusion handling. In: First International Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences (THEMIS’2008), Leeds, UK

  20. 20

    Mallat S.G.: A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans. Pattern Recogn. Mach. Intell. 11(7), 674–693 (1989)

  21. 21

    Sato, M.: Fast learning of on-line EM algorithm. Technical Report TR-H-281, ATR Human Information Processing Research Laboratories

  22. 22

    Casella G., Berger R.: Sattistical Inference, 2nd edn. Duxbury Press, Belmont (2002)

  23. 23

    Bishop C.: Pattern Recognition and Machine Learning. Springer, Berlin (2006)

  24. 24

    Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp. 246–252 (1999)

  25. 25

    Sato, M.: Fast learning of on-line EM algorithm, Technical Report TR-H-281. ATR Human Information Processing Research Laboratories

Download references

Author information

Correspondence to Simone Calderara.

Electronic Supplementary Material

The Below is the Electronic Supplementary Material.

ESM 1 (AVI 5,565 kb)

ESM 1 (AVI 5,565 kb)

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Calderara, S., Piccinini, P. & Cucchiara, R. Vision based smoke detection system using image energy and color information. Machine Vision and Applications 22, 705–719 (2011) doi:10.1007/s00138-010-0272-1

Download citation


  • Smoke detection
  • Image processing
  • MoG
  • DWT