Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

A refined particle filter based on determined level set model for robust contour tracking

Abstract

Traditional particle filter which uses simple geometric shapes for representation cannot track objects with complex shape accurately. In this paper, we propose a refined particle filter method for contour tracking based on a determined binary level set model (DBLSM). In contrast with other previous work, the computational efficiency is greatly improved due to the simple form of the level set function. The DBLSM adds prior knowledge of the target model to the implementation of curve evolution which improves the curve acting principle and ensures a more accurate convergence to the target. Finally, we perform curve evolution in the update step of particle filter to make good use of the observation at current time. Some appearance information are considered together with the energy function to measure weights for particles, which can identify the target more accurately. Experiment results on several challenging video sequences have verified the proposed algorithm is efficient and effective in many complicated scenes.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

References

  1. 1.

    Hong, R., Tang, J., Tan, H., Ngo, C., Yan, S., Chua, T.: Beyond search: event-driven summarization for web videos. TOMCCAP 7(4), 35 (2011)

  2. 2.

    Wang, M., Hong, R., Li, G., Zha, Z., Yan, S., Chua, T.: Event driven web video summarization by tag localization and key-shot identification. IEEE Trans. Multimed. 14(4), 975–985 (2012)

  3. 3.

    Hong, R., Wang, M., Li, G., Nie, L., Zha, Z., Chua, T.: Multimedia question answering. IEEE MultiMed. 19(4), 72–78 (2012)

  4. 4.

    Zhang, S., Yao, H., Sun, X., Lu, X.: Sparse coding based visual tracking: review and experimental comparison. Pattern Recognit. 46(7), 1772–1788 (2013)

  5. 5.

    Zhang, S., Yao, H., Zhou, H., Sun, X., Liu, S.: Robust visual tracking based on online learning sparse representation. Neurocomputing 100, 31–40 (2013)

  6. 6.

    Zhang, S., Yao, H., Liu, S.: Dynamic background subtraction based on local dependency histogram. Int. J. Pattern Recognit. Artif. Intell. 23(7), 1397–1419 (2009)

  7. 7.

    Sevilla-Lara, L., Learned-Miller, E.: Distribution fields for tracking. In: IEEE Conference on Computer Vision and, Pattern Recognition, pp. 1910–1917 (2012)

  8. 8.

    Terzopoulos, D., Szeliski, R.: Active vision, chapter tracking with Kalman snakes. MIT Press, USA (1992)

  9. 9.

    Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 564–575 (2003)

  10. 10.

    Isard, M., Blake, A.: Condensation: conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1), 5–28 (1998)

  11. 11.

    Leichter, I., Lindenbaum, M., Rivlin, E.: Tracking by affine Kernel transformations using color and boundary cues. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 164–171 (2009)

  12. 12.

    Ning, J., Zhang, L., Zhang, D., Wu, C.: Robust object tracking using joint color-texture histogram. Int. J. Pattern Recognit. Artif. Intell. 23(7), 1245–1263 (2009)

  13. 13.

    Zhang, X., Hu, W., Maybank, S., Li, X., Zhu, M.: Sequential particle swarm optimization for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)

  14. 14.

    Li, P., Zhang, T., Ma, B.: Unscented Kalman filter for visual curve tracking. Image Vis. Comput. 22(21), 157–164 (2004)

  15. 15.

    Doucet, A., de Freitas, J.F.G., Gordon, N.J.: An introduction to sequential Monte Carlo methods. In: Sequential Monte Carlo Methods in Practice. Springer, NewYork (2001)

  16. 16.

    Wang, J., Chen, X., Gao, W.: Online selecting discriminative tracking features using particle filter.In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1037–1042 (2005)

  17. 17.

    Khan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1805–1819 (2005)

  18. 18.

    Li, M., Chen, W., Huang, K., Tan, T.: Visual tracking via incremental self-tuning particle filtering on the affine group.In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1315–1322 (2010)

  19. 19.

    Vaswani, N., RoyChowdhury, A., Chellappa, R.: Activity recognition using the dynamics of the configuration of interacting objects. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)

  20. 20.

    Lu, L., Hager, D.G.: A nonparametric treatment for location/segmentation based visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

  21. 21.

    Chen, Y., Rui, Y., Huang, T.: Jpdaf based hmm for real-time contour tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 543–550 (2001)

  22. 22.

    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vis. 1(4), 321–331 (1988)

  23. 23.

    Amini, A., Curwen, R., Gore, J.: Snakes and splines for tracking non-rigid heart motion. In: European Conference on Computer Vision, pp. 251–261 (1996)

  24. 24.

    Leymarie, F., Levine, M.D.: Tracking deformable objects in the plane using an active contour model. IEEE Trans. Pattern Anal. Mach. Intell. 15(6), 617–634 (1993)

  25. 25.

    Ueda, N., Mase, K.: Tracking moving contours using energy-minimizing elastic contour models. Int. J. Pattern Recognit. Artif. Intell. 9(3), 465–484 (1995)

  26. 26.

    Osher, S.J., Sethian, J.A.: Fronts propagation with curvature dependent speed: algorithms based on Hamilton–Jacobi formulations. Int. J. Comput. Phys. 79, 12–49 (1988)

  27. 27.

    Sethian, J.A.: Level set methods and fast marching methods, 2nd edn. Cambridge University Press, Cambridge (1999)

  28. 28.

    Chan, T., Vese, L.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)

  29. 29.

    Lie, J., Lysaker, M., Tai, X.C.: A binary level set model and some applications to Mumford–Shah image segmentation. IEEE Trans. Image Process. 15(5), 1171–1181 (2006)

  30. 30.

    Niethammer, M., Tannenbaum, A.: Dynamic geodesic snakes for visual tracking. IEEE Conf. Comput. Vis. Pattern Recognit. 1, 660–667 (2004)

  31. 31.

    Paragois, N., Deriche, R.: Geodesic active contorus and level sets for the detection and tracking of moving objects. IEEE Trans. Pattern Anal. Mach. Intell. 22(3), 266–280 (2000)

  32. 32.

    Yilmaz, A., Li, X., Shah, M.: Contour based object tracking with occlusion handling in video acquired using mobile cameras. IEEE Trans. Pattern Anal. Mach. Intell. 26(11), 1531–1536 (2004)

  33. 33.

    Jackson, J., Yezzi, A., Soatto, S.: Tracking deformable moving objects under severe occlusions. In: Conference decision and control (2004)

  34. 34.

    Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Tracking deforming objects using particle filtering for geometric active contours. IEEE Trans Pattern Anal. Mach. Intell. 29(8), 1470–1475 (2007)

  35. 35.

    Bibby, C., Reid, I.: Real-time tracking of multiple occluding objects using level sets. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1307–1314 (2010)

  36. 36.

    Yuille, A., Cohen, D., Halliman, P.: Feature extraction from faces using deformable templates. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 104–109 (1989)

  37. 37.

    Mansouri, A.: Region tracking via level set PDEs without motion computation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 947–961 (2002)

  38. 38.

    Arulampalam, M., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particles filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002)

  39. 39.

    Perez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: IEEE Conference on European Conference on Computer Vision, pp. 661–675 (2002)

Download references

Acknowledgments

The work was supported by the National Natural Science Foundation of China (Grant No. 61071180) and Key Program (Grant No.61133003).

Author information

Correspondence to Hongxun Yao.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Sun, X., Yao, H. A refined particle filter based on determined level set model for robust contour tracking. Machine Vision and Applications 25, 1727–1736 (2014). https://doi.org/10.1007/s00138-013-0553-6

Download citation

Keywords

  • Tracking
  • Particle filter
  • Active contour
  • Level set
  • Dynamic scenes