Incremental and Multi-feature Tensor Subspace Learning Applied for Background Modeling and Subtraction

  • Andrews SobralEmail author
  • Christopher G. Baker
  • Thierry Bouwmans
  • El-hadi Zahzah
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8814)


Background subtraction (BS) is the art of separating moving objects from their background. The Background Modeling (BM) is one of the main steps of the BS process. Several subspace learning (SL) algorithms based on matrix and tensor tools have been used to perform the BM of the scenes. However, several SL algorithms work on a batch process increasing memory consumption when data size is very large. Moreover, these algorithms are not suitable for streaming data when the full size of the data is unknown. In this work, we propose an incremental tensor subspace learning that uses only a small part of the entire data and updates the low-rank model incrementally when new data arrive. In addition, the multi-feature model allows us to build a robust low-rank background model of the scene. Experimental results shows that the proposed method achieves interesting results for background subtraction task.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baker, C.G., Gallivan, K.A., Van Dooren, P.: Low-rank incremental methods for computing dominant singular subspaces. Linear Algebra and its Applications 436(8), 2866–2888 (2012). Special Issue dedicated to Danny Sorensen’s 65th birthdayMathSciNetCrossRefzbMATHGoogle Scholar
  2. 2.
    Balzano, L., Wright, S.J.: On GROUSE and incremental SVD. CoRR, abs/1307.5494 (2013)Google Scholar
  3. 3.
    Bouwmans, T.: Traditional and recent approaches in background modeling for foreground detection: An overview. Computer Science Review (2014)Google Scholar
  4. 4.
    Bouwmans, T., Zahzah, E.: Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance. Special Isssue on Background Models Challenge, Computer Vision and Image Understanding, CVIU, vol. 122, pp. 22–34 (May 2014)Google Scholar
  5. 5.
    Brand, M.: Fast low-rank modifications of the thin singular value decomposition. Linear Algebra and Its Applications 415(1), 20–30 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Bunch, J.R., Nielsen, C.P.: Updating the singular value decomposition. Numerische Mathematik 31(2), 111–129 (1978)MathSciNetCrossRefzbMATHGoogle Scholar
  7. 7.
    Businger, P.A.: Updating a singular value decomposition. Nordisk Tidskr, 10 (1970)Google Scholar
  8. 8.
    Candes, E., Li, X., Ma, Y., Wright, J.: Robust principal component analysis? Int. Journal of ACM 58(3), 117–142 (2011)MathSciNetGoogle Scholar
  9. 9.
    De La Torre, F., Black, M.: A framework for robust subspace learning. Int. Journal on Computer Vision, 117–142 (2003)Google Scholar
  10. 10.
    Grasedyck, L., Kressner, D., Tobler, C.: A literature survey of low-rank tensor approximation techniques (2013)Google Scholar
  11. 11.
    He, J., Balzano, L., Lui, J.C.S.: Online robust subspace tracking from partial information. CoRR, abs/1109.3827 (2011)Google Scholar
  12. 12.
    He, X., Cai, D., Niyogi, P.: Tensor subspace analysis. In: Advances in Neural Information Processing Systems 18 (2005)Google Scholar
  13. 13.
    Hu, W., Li, X., Zhang, X., Shi, X., Maybank, S., Zhang, Z.: Incremental tensor subspace learning and its applications to foreground segmentation and tracking. Int. Journal of Computer Vision 91(3), 303–327 (2011)CrossRefzbMATHGoogle Scholar
  14. 14.
    Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Review (2008)Google Scholar
  15. 15.
    Lathauwer, L.D., Moor, B.D., Vandewalle, J.: A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21(4), 1253–1278 (2000)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Levy, A., Lindenbaum, M.: Sequential karhunen-loeve basis extraction and its application to images. IEEE Trans. on Image Processing 9(8), 1371–1374 (2000)CrossRefzbMATHGoogle Scholar
  17. 17.
    Li, X., Hu, W., Zhang, Z., Zhang, X.: Robust foreground segmentation based on two effective background models. In: Proceedings of the 1st ACM Int. Conf. on Multimedia Information Retrieval, MIR 2008, pp. 223–228. ACM, New York (2008)Google Scholar
  18. 18.
    Li, X., Hu, W., Zhang, Z., Zhang, X., Luo, G.: Robust visual tracking based on incremental tensor subspace learning. In: IEEE 11th Int. Conf. on Computer Vision (ICCV), pp. 1–8 (October 2007)Google Scholar
  19. 19.
    Lin, Z., Wei, S.: A block lanczos with warm start technique for accelerating nuclear norm minimization algorithms. CoRR, abs/1012.0365 (2010)Google Scholar
  20. 20.
    Lu, H., Plataniotis, K.N., Venetsanopoulos, A.N.: A survey of multilinear subspace learning for tensor data. Pattern Recogn. 44(7), 1540–1551 (2011)CrossRefzbMATHGoogle Scholar
  21. 21.
    Melenchón, J., Martínez, E.: Efficiently downdating, composing and splitting singular value decompositions preserving the mean information. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 436–443. Springer, Heidelberg (2007) CrossRefGoogle Scholar
  22. 22.
    Oliver, N.M., Rosario, B., Pentland, A.P.: A bayesian computer vision system for modeling human interactions. IEEE Trans. on Pattern Analysis and Machine Intelligence 22(8), 831–843 (2000)CrossRefGoogle Scholar
  23. 23.
    Ross, D.A., Lim, J., Lin, R., Yang, M.: Incremental learning for robust visual tracking. Int. J. Comput. Vision 77(1–3), 125–141 (2008)CrossRefGoogle Scholar
  24. 24.
    Shah, M., Deng, J., Woodford, B.: Video background modeling: Recent approaches, issues and our solutions. In: Machine Vision and Applications, Special Issue on Background Modeling for Foreground Detection in Real-World Dynamic Scenes (December 2013)Google Scholar
  25. 25.
    Shimada, A., Nonaka, Y., Nagahara, H., Taniguchi, R.: Case-based background modeling: associative background database towards low-cost and high-performance change detection. In: Machine Vision and Applications, Special Issue on Background Modeling for Foreground Detection in Real-World Dynamic Scenes (December 2013)Google Scholar
  26. 26.
    Sun, J., Tao, D., Papadimitriou, S., Yu, P.S., Faloutsos, C.: Incremental Tensor Analysis: Theory and applications. ACM Trans. Knowl. Discov. Data 2(3), 11:1–11:37 (2008)CrossRefGoogle Scholar
  27. 27.
    Vacavant, A., Chateau, T., Wilhelm, A., Lequièvre, L.: A benchmark dataset for outdoor foreground/background extraction. In: Park, J.-I., Kim, J. (eds.) ACCV Workshops 2012, Part I. LNCS, vol. 7728, pp. 291–300. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  28. 28.
    Wang, H., Ahuja, N.: Rank-r approximation of tensors using image-as-matrix representation. In: IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 346–353 (June 2005)Google Scholar
  29. 29.
    Wang, H., Yan, S., Huang, T., Tang, X.: A convergent solution to tensor subspace learning. In: Proceedings of the 20th Int. Joint Conf. on Artifical Intelligence, IJCAI 2007, pp. 629–634. Morgan Kaufmann Publishers Inc., San Francisco (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Andrews Sobral
    • 1
    Email author
  • Christopher G. Baker
    • 3
  • Thierry Bouwmans
    • 2
  • El-hadi Zahzah
    • 1
  1. 1.Laboratoire L3IUniversité de La RochelleLa RochelleFrance
  2. 2.Laboratoire MIAUniversité de La RochelleLa RochelleFrance
  3. 3.Computer Sciences CorporationFalls ChurchUSA

Personalised recommendations