Abstract
Compressive sensing (CS) is an emerging field that provides a framework for image recovery using sub-Nyquist sampling rates. The CS theory shows that a signal can be reconstructed from a small set of random projections, provided that the signal is sparse in some basis, e.g., wavelets. In this paper, we describe a method to directly recover background subtracted images using CS and discuss its applications in some communication constrained multi-camera computer vision problems. We show how to apply the CS theory to recover object silhouettes (binary background subtracted images) when the objects of interest occupy a small portion of the camera view, i.e., when they are sparse in the spatial domain. We cast the background subtraction as a sparse approximation problem and provide different solutions based on convex optimization and total variation. In our method, as opposed to learning the background, we learn and adapt a low dimensional compressed representation of it, which is sufficient to determine spatial innovations; object silhouettes are then estimated directly using the compressive samples without any auxiliary image reconstruction. We also discuss simultaneous appearance recovery of the objects using compressive measurements. In this case, we show that it may be necessary to reconstruct one auxiliary image. To demonstrate the performance of the proposed algorithm, we provide results on data captured using a compressive single-pixel camera. We also illustrate that our approach is suitable for image coding in communication constrained problems by using data captured by multiple conventional cameras to provide 2D tracking and 3D shape reconstruction results with compressive measurements.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: IEEE FRAME-RATE Workshop. Springer, Heidelberg (1999)
Piccardi, M.: Background subtraction techniques: a review. In: IEEE International Conference on Systems, Man and Cybernetics, vol. 4 (2004)
Cheung, G.K.M., Kanade, T., Bouguet, J.Y., Holler, M.: Real time system for robust 3 D voxel reconstruction of human motions. In: CVPR, pp. 714–720 (2000)
Wakin, M.B., Laska, J.N., Duarte, M.F., Baron, D., Sarvotham, S., Takhar, D., Kelly, K.F., Baraniuk, R.G.: An architecture for compressive imaging. In: ICIP, Atlanta, GA, October 2006, pp. 1273–1276 (2006)
Candes, E.: Compressive sampling. In: Proceedings of the International Congress of Mathematicians (2006)
Donoho, D.L.: Compressed Sensing. IEEE Trans. Info. Theory 52(4), 1289–1306 (2006)
Mallat, S., Zhang, S.: Matching pursuits with time-frequency dictionaries. Matching pursuits with time-frequency dictionaries 41(12), 3397–3415 (1993)
Aggarwal, A., Biswas, S., Singh, S., Sural, S., Majumdar, A.K.: Object Tracking Using Background Subtraction and Motion Estimation in MPEG Videos. In: ACCV, pp. 121–130. Springer, Heidelberg (2006)
Lamarre, M., Clark, J.J.: Background subtraction using competing models in the block-DCT domain. In: ICPR (2002)
Wang, W., Chen, D., Gao, W., Yang, J.: Modeling background from compressed video. In: IEEE Int. Workshop on VSPE of TS, pp. 161–168 (2005)
Töreyin, B.U., Çetin, A.E., Aksay, A., Akhan, M.B.: Moving object detection in wavelet compressed video. Signal Processing: Image Communication 20(3), 255–264 (2005)
Oliver, N., Rosario, B., Pentland, A.: A Bayesian Computer Vision System for Modeling Human Interactions. In: ICVS. Springer, Heidelberg (1999)
Uttam, S., Goodman, N.A., Neifeld, M.A.: Direct reconstruction of difference images from optimal spatial-domain projections. In: Proc. SPIE, San Diego, CA, August 2008, vol. 7096 (2008)
Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic Decomposition by Basis Pursuit. SIAM Journal on Scientific Computing 20, 33 (1998)
Mallat, S.: A Wavelet Tour of Signal Processing. Academic Press, London (1999)
Cevher, V., Chellappa, R., McClellan, J.H.: Gaussian approximations for energy-based detection and localization in sensor networks. In: IEEE Statistical Signal Processing Workshop, Madison, WI, August 26–29 (2007)
Van Trees, H.L.: Detection, Estimation, and Modulation Theory, Part I. John Wiley & Sons, Inc., Chichester (1968)
Hale, E.T., Yin, W., Zhang, Y.: A fixed-point continuation method for ℓ1-regularized minimization with applications to compressed sensing. Technical Report TR07-07, Rice University Department of Computational and Applied Mathematics, Houston, TX (2007)
Joo, S., Zheng, Q.: A Temporal Variance-Based Moving Target Detector. In: Proc. IEEE Int. Workshop on Performance Evaluation of Tracking and Surveillance (PETS) (2005)
Matsumoto, M., Nishimura, T.: Mersenne Twister: A 623-Dimensionally Equidistributed Uniform Pseudo-Random Number Generator. ACM Transactions on Modeling and Computer Simulation 8(1), 3–30 (1998)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proc. 8th Int’l Conf. Computer Vision, July 2001, vol. 2, pp. 416–423 (2001)
Khan, S.M., Shah, M.: A multi-view approach to tracking people in crowded scenes using a planar homography constraint. In: ECCV 2006, vol. 4, pp. 133–146 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cevher, V., Sankaranarayanan, A., Duarte, M.F., Reddy, D., Baraniuk, R.G., Chellappa, R. (2008). Compressive Sensing for Background Subtraction. In: Forsyth, D., Torr, P., Zisserman, A. (eds) Computer Vision – ECCV 2008. ECCV 2008. Lecture Notes in Computer Science, vol 5303. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88688-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-88688-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88685-3
Online ISBN: 978-3-540-88688-4
eBook Packages: Computer ScienceComputer Science (R0)