Abstract
We introduce a procedure for calibrated multi camera setups in which observed persons within a realistic and, thus, difficult surrounding are determined as foreground in image sequences via a fully automatic purely data driven segmentation.
In order to gain an optimal separation of fore- and background for each frame in terms of Expectation Maximization (EM), an algorithm is proposed which utilizes a combination of geometrical constraints of the scene and, additionally, temporal constraints for a optimization over the entire sequence to estimate the background. This background information is then used to determine accurate silhouettes of the foreground.
We demonstrate the effectiveness of our approach based on a qualitative data analysis and compare it to other state of the art approaches.
This work was partially supported by a grant from the Ministry of Science, Research and the Arts of Baden-Württemberg.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Grauman, K., Shakhnarovich, G., Darrell, T.: A bayesian approach to image-based visual hull reconstruction. In: CVPR 2003, vol. 1, pp. 187–194 (2003)
Gordon, G., Darrell, T., Harville, M., Woodfill, J.: Background estimation and removal based on range and color. In: CVPR 1999, vol. 2, pp. 459–464. IEEE Computer Society, Los Alamitos (1999)
Cheung, K.M.G.: Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling, Motion Tracking and Rendering. PhD thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213 (2003)
Vogiatzis, G., Torr, P.H.S., Cipolla, R.: Multi-view stereo via volumetric graph-cuts. In: CVPR 2005, vol. 2, pp. 391–398 (2005)
Mikić, I.: Human Body Model Acquisition and Tracking using Multi-Camera Voxel Data. Electrical and computer engineering (image and signal processing) University of California, San Diego (2002)
Rosenhahn, B., Kersting, U.G., Smith, A.W., Gurney, J., Brox, T., Klette, R.: A system for marker-less human motion estimation. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 230–237. Springer, Heidelberg (2005)
Lee, W., Woo, W., Boyer, E.: Identifying foreground from multiple images. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part II. LNCS, vol. 4844, pp. 580–589. Springer, Heidelberg (2007)
Kim, K., Chalidabhongse, T., Harwood, D., Davis, L.: Background modeling and subtraction by codebook construction. In: ICIP 2004, vol. 5, pp. 3061–3064 (2004)
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: CVPR 1999, vol. 2, pp. 2246–2252. IEEE Computer Society, Los Alamitos (1999)
Kaewtrakulpong, P., Bowden, R.: An improved adaptive background mixture model for realtime tracking with shadow detection. In: Proc. 2nd European Workshop on Advanced Video Based Surveillance Systems. Kluwer Academic Publishers, Dordrecht (2001)
Russell, D., Gong, S.: Minimum cuts of a time-varying background. In: BMVC 2006, vol. 2, pp. 809–818 (2006)
Russell, D.M., Gong, S.G.: Segmenting highly textured nonstationary background. In: BMVC 2007, (2007)
Lim, S.N., Mittal, A., Davis, L.S., Paragios, N.: Fast illumination-invariant background subtraction using two views: Error analysis, sensor placement and applications. In: CVPR 2005, pp. 1071–1078. IEEE Computer Society, Washington, DC, USA (2005)
Feldmann, T., Dießelberg, L., Wörner, A.: Adaptive foreground/background segmentation using multiview silhouette fusion. In: Denzler, J., Notni, G., Süße, H. (eds.) DAGM. LNCS, vol. 5748, pp. 522–531. Springer, Heidelberg (2009)
Broadhurst, A., Drummond, T.W., Cipolla, R.: A probabilistic framework for space carving. In: ICCV 2001, pp. 388–393 (2001)
Franco, J.S., Boyer, E.: Fusion of multi-view silhouette cues using a space occupancy grid. Technical Report 5551, INRIA (2005)
Kolev, K., Brox, T., Cremers, D.: Robust variational segmentation of 3d objects from multiple views. In: Franke, K., Müller, K.-R., Nickolay, B., Schäfer, R. (eds.) DAGM 2006. LNCS, vol. 4174, pp. 688–697. Springer, Heidelberg (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Feldmann, T. (2011). Spatio-Temporal Optimization for Foreground/Background Segmentation. In: Koch, R., Huang, F. (eds) Computer Vision – ACCV 2010 Workshops. ACCV 2010. Lecture Notes in Computer Science, vol 6468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22822-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-22822-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22821-6
Online ISBN: 978-3-642-22822-3
eBook Packages: Computer ScienceComputer Science (R0)