Skip to main content
SpringerLink
Log in

A framework for unsupervised mesh based segmentation of moving objects

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multimedia analysis usually deals with a large amount of video data with a significant number of moving objects. Often it is necessary to reduce the amount of data and to represent the video in terms of moving objects and events. Event analysis can be built on the detection of moving objects. In order to automatically process a variety of video content in different domain, largely unsupervised moving object segmentation algorithms are needed. We propose a fully unsupervised system for moving object segmentation that does not require any restriction on the video content. Our approach to extract moving objects relies on a mesh-based combination of results from colour segmentation (Mean Shift) and motion segmentation by feature point tracking (KLT tracker). The proposed algorithm has been evaluated using precision and recall measures for comparing moving objects and their colour segmented regions with manually labelled ground truth data. Results show that the algorithm is comparable to other state-of-the-art algorithms. The extracted information is used in a search and retrieval tool. For that purpose a moving object representation in MPEG-7 is implemented. It facilitates high performance indexing and retrieval of moving objects and events in large video databases, such as the search for similar moving objects occurring in a certain period.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Antonini G, Martinez SV, Bierlaire M, Thiran JP (2006) Behavioral priors for detection and tracking of pedestrians in video sequences source. Int J Comput Vis 69(2):159–180

    Article  Google Scholar 

  2. Bailer W, Schallauer P (2006) Detailed audiovisual profile: enabling interoperability between MPEG-7 based systems. International Conference on Multi Media Modelling

  3. Bailer W, Schallauer P, Bergur Haraldsson H, Rehatschek H (2005) Optimized mean shift algorithm for color segmentation in image sequences. Image and Video Communications and Processing, pp 522–529

  4. Bailer W, Höller F, Messina A, Airola D, Schallauer P, Hausenblas M (2005) State of the art of content analysis tools for video, audio and speech. Deliverable Prestospace, Homepage: http://www.prestospace.org/project/deliverables/D15-3_Content_Analysis_Tools.pdf

  5. Barron JL, Fleet DJ, Beauchemin SS (1994) Performance of optical flow techniques. International Journal of Computer Vision

  6. Borshukov GD, Bozdagi G, Altunbasak Y, Tekalp AM (1997) Motion segmentation by multistage affine classification. IEEE Trans Image Process 6:1591–1594

    Article  Google Scholar 

  7. Celasun I, Tekalp AM, Gökçetekin MH, Harmancı DM (2001) 2-D mesh-based video object segmentation and tracking with occlusion resolution. Signal Processing: Image Communication Volume 16, Issue 10

  8. Comaniciu D (2002) Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern analysis and machine intelligence

  9. Comaniciu D, Meer P (1997) Robust analysis of feature spaces: colour image segmentation. Department of Electrical and Computer Engineering

  10. Computer Vision Research Group, Department of Computer Science, Homepage: http://www.cs.otago.ac.nz/research/vision, http://of-eval.sourceforge.net/, 1999.

  11. Davis JC (2002) Statistics and data analysis in geology, 3d edn. Wiley

  12. Donoser M (2003) Object segmentation in film and video. Diploma thesis, TU-Graz

  13. Duda RO, Hart PE, Stork DG (2001) Pattern classification. Wiley

  14. Erdem CE, Sankur B (2000) Performance evaluation metrics for object-based video segmentation. Proceedings of the 10th European Signal Processing Conference (EUSIPCO ’00), pp. 917–920, Tampere, Finland

  15. Galić S, Lončarić S (2000) Spatio-temporal image segmentation using optical flow and clustering algorithm. Proceedings of the First International Workshop on Image and Signal Processing and Analysis

  16. Guo J, Kim J, Jay Kuo C-C (1999) New Video object segmentation technique with color/motion information and boundary postprocessing. Applied Intelligence Journal

  17. Heidrich W, Seidel H-P (1999) Realistic, Hardware-accelerated Shading and Lighting. Proceeding of SIGGRAPH 99

  18. Horn BKP, Schunck BG (1980) Determining optical flow. Massachusetts Institute of Technology

  19. Kriechbaum A (2005) Segmentation of moving objects in film and video. Master thesis

  20. Lepetit V, Fua P (2005) Monocular model-based 3D tracking of rigid objects: a survey. Foundations and Trends in Computer Graphics and Vision 1(1):1–89

    Article  Google Scholar 

  21. Lienhart R (2001) Reliable transition detection in videos: a survey and practitioner’s guide. International Journal of Image and Graphics (IJIG) 1(3):469–486

    Article  Google Scholar 

  22. Liu L, Fan G (2005) Combined key-frame extraction and object-based video segmentation. IEEE Trans. Circuits and System for Video Technology

  23. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. International Joint Conference on Artificial Intelligence, pp 674–679

  24. Martinez JM (2002) MPEG-7 overview. International organisation for standardisation

  25. Oh J, Lee J, Vemuri E (2003) An efficient technique for segmentation of key object(s) from video shots. ITCC ’03: Proceedings of the International Conference on Information Technology: Computers and Communications

  26. Rehatschek H, Schallauer P, Bailer W, Haas W, Wertner A (2004) An innovative system for formulating complex combined content-based and keyword-based queries. Proceedings of SPIE-IS&T, Electronic Imaging, vol. 5304, pp 160–169

  27. Tsechpenakis G, Rapatzikos K, Tsapatsoulis N, Kollias S (2003) Object tracking in clutter and partial occlusion through rule-driven utilization of snakes. IEEE International Conference on Multimedia & Expo (ICME)

  28. Wei Z, Jun D, Wen G, Qingming H (2005) Robust moving object segmentation on H.264/AVC compressed video using the block-based MRF model. Real-Time Imaging

  29. Xu N, Ahuja N, Bansal R (2003) Object segmentation using graph cuts based active contours. CVPR03, pp 46–53

  30. Zhang D, Lu G (2001) Segmentation of moving objects in image sequence: a review. Circuits Syst Signal Process 20(2):143–183

    Article  MATH  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Werner Haas, Werner Bailer and Peter Schallauer as well as several other colleagues at JOANNEUM RESEARCH, who provided valuable feedback. The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 216465 (ICT project SCOVIS).

Author information

Authors and Affiliations

  1. JOANNEUM RESEARCH, Institute of Information Systems, Steyrergasse 17, 8010, Graz, Austria

    Andreas Kriechbaum, Roland Mörzinger & Georg Thallinger

Authors
  1. Andreas Kriechbaum
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roland Mörzinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Georg Thallinger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andreas Kriechbaum.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kriechbaum, A., Mörzinger, R. & Thallinger, G. A framework for unsupervised mesh based segmentation of moving objects. Multimed Tools Appl 50, 7–28 (2010). https://doi.org/10.1007/s11042-009-0366-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0366-9

Keywords

Search

Navigation