Foreground and Shadow Detection Based on Conditional Random Field

  • Yang Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4673)


This paper presents a conditional random field (CRF) approach to integrate spatial and temporal constraints for moving object detection and cast shadow removal in image sequences. Interactions among both detection (foreground/background/shadow) labels and observed data are unified by a probabilistic framework based on the conditional random field, where the interaction strength can be adaptively adjusted in terms of data similarity of neighboring sites. Experimental results show that the proposed approach effectively fuses contextual dependencies in video sequences and significantly improves the accuracy of object detection.


Conditional random field contextual constraint object detection shadow removal 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-time surveillance of people and their activities. IEEE Trans. Patt. Anal. Mach. Intel. 22, 809–830 (2000)CrossRefGoogle Scholar
  2. 2.
    Jabri, S., Duric, Z., Wechsler, H., Rosenfeld, A.: Detection and location of people in video images using adaptive fusion of color and edge information. In: Proc. Int’l. Conf. Pattern Recognition, vol. 4, pp. 627–630 (2000)Google Scholar
  3. 3.
    Kumar, S., Hebert, M.: Discriminative fields for modeling spatial dependencies in natural images. Advances in Neural Information Processing Systems, 1351–1358 (2004)Google Scholar
  4. 4.
    Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proc. Int’l. Conf. Machine Learning, pp. 282–289 (2001)Google Scholar
  5. 5.
    Li, S.Z.: Markov Random Field Modeling in Image Analysis. Springer, Heidelberg (2001)zbMATHGoogle Scholar
  6. 6.
    Paragios, N., Ramesh, V.: A MRF-based approach for real-time subway monitoring. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 1034–1040 (2001)Google Scholar
  7. 7.
    Prati, A., Mikic, I., Trivedi, M.M., Cucchiara, R.: Detecting moving shadows: Algorithms and evaluation. IEEE Trans. Patt. Anal. Mach. Intel. 25, 918–923 (2003)CrossRefGoogle Scholar
  8. 8.
    Rittscher, J., Kato, J., Joga, S., Blake, A.: A probabilistic background model for tracking. Proc. European Conf. Computer Vision 2, 336–350 (2000)Google Scholar
  9. 9.
    Seki, M., Wada, T., Fujiwara, H., Sumi, K.: Background subtraction based on cooccurrence of image variations. Proc. IEEE Conf. Computer Vision and Pattern Recognition 2, 65–72 (2003)Google Scholar
  10. 10.
    Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using real-time tracking. IEEE Trans. Patt. Anal. Mach. Intel. 22, 747–757 (2000)CrossRefGoogle Scholar
  11. 11.
    Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: Principles and practice of background maintenance. Proc. Int’l Conf. Computer Vision 1, 255–261 (1999)CrossRefGoogle Scholar
  12. 12.
    Wang, Y., Loe, K.-F., Wu, J.-K.: A dynamic conditional random field model for foreground and shadow segmentation. IEEE Trans. Patt. Anal. Mach. Intel. 28, 279–289 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Yang Wang
    • 1
  1. 1.National ICT Australia, Kensington, NSW 2032Australia

Personalised recommendations