Skip to main content

Image Segmentation According to the Movement of Real Objects

  • Chapter
  • First Online:
Variational and Level Set Methods in Image Segmentation

Part of the book series: Springer Topics in Signal Processing ((STSP,volume 5))

  • 1536 Accesses

Abstract

In the preceding chapter, image segmentation used optical flow. The flow components in each region were described by a linear parametric model. Therefore, the model parameters served to distinguish the segmentation regions. We presented two methods which differed by their representation of the segmentation boundaries. One of the methods (Chapter 7, Section 7.2) can be viewed as an optical flow edge detection method. It used the minimum description length (MDL) formulation [1], and placed the segmentation boundary edges at points between adjacent pixels described by distinct model parameters. The other method we described was a level set method, using closed curves to delineate the segmentation regions each of which is described by the parameters of a general linear model of image motion [2] In both methods, the parametric models did not express any relationship to the movement of the physical objects from which the optical flow arose.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Y. G. Leclerc, “Constructing simple stable descriptions for image partitioning,” International Journal of Computer Vision, vol. 3, no. 1, pp. 73–102, 1989.

    Article  Google Scholar 

  2. C. Vázquez, A. Mitiche, and R. Laganière, “Joint segmentation and parametric estimation of image motion by curve evolution and level sets,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 782–793, 2006.

    Article  Google Scholar 

  3. H. Sekkati and A. Mitiche, “Concurrent 3-d motion segmentation and 3-d interpretation of temporal sequences of monocular images,” IEEE Transactions on Image Processing, vol. 15, no. 3, pp. 641–653, 2006.

    Article  Google Scholar 

  4. A. Mitiche and H. Sekkati, “Optical flow 3d segmentation and interpretation: A variational method with active curve evolution and level sets,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 11, pp. 1818–1829, 2006.

    Article  Google Scholar 

  5. H. Sekkati and A. Mitiche, “Joint optical flow estimation, segmentation, and 3d interpretation with level sets,” Computer Vision and Image Understanding, vol. 103, no. 2, pp. 89–100, 2006.

    Article  Google Scholar 

  6. S. Ullman, “The interpretation of structure from motion,” Proceedings of the Royal Society of London, B, vol. 203, pp. 405–426, 1979.

    Article  Google Scholar 

  7. A. Mitiche, Computational Analysis of Visual Motion. Plenum Press, New York, 1994.

    Google Scholar 

  8. —–-, Computational Analysis of Visual Motion. Kluwer Academic, 1994.

    Google Scholar 

  9. H. Longuet-Higgins and K. Prazdny, “The interpretation of a moving retinal image,” Proceedings of the Royal Society of London, B, vol. 208, pp. 385–397, 1981.

    Article  Google Scholar 

  10. X. Zhuang and R. Haralick, “Rigid body motion and the optical flow image,” in International Conference on Artificial Intelligence Applications, 1984, pp. 366–375.

    Google Scholar 

  11. B. K. P. Horn and B. G. Schunck, “Determining optical flow,” Artificial Intelligence, vol. 17, no. 17, pp. 185–203, 1981.

    Article  Google Scholar 

  12. A. Mitiche and P. Bouthemy, “Computation and analysis of image motion: A synopsis of current problems and methods,” International Journal of Computer Vision, vol. 19, no. 1, pp. 29–55, 1996.

    Article  Google Scholar 

  13. G. Aubert, R. Deriche, and P. Kornprobst, “Computing optical flow via variational techniques,” SIAM Journal of Applied Mathematics, vol. 60, no. 1, pp. 156–182, 1999.

    Article  MathSciNet  MATH  Google Scholar 

  14. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, “High accuracy optical flow estimation based on a theory for warping,” in European Conference on Computer Vision (ECCV), vol. 4, 2004, pp. 25–36.

    Google Scholar 

  15. J. M. Odobez and P. Bouthemy, “Robust multiresolution estimation of parametric motion models,” Journal of Visual Communication and Image Representation, vol. 6, no. 4, pp. 348–365, 1995.

    Article  Google Scholar 

  16. D. Cremers, “A multiphase level set framework for motion segmentation,” in Scale Space Theories in Computer Vision, 2003, pp. 599–614.

    Google Scholar 

  17. W. MacLean, A. Jepson, and R. Frecher, “Recovery of egomotion and segmentation of independent object motion using the em algorithm,” in British Machine Vision Conference (BMVC), 1994, pp. 13–16.

    Google Scholar 

  18. S. Fejes and L. Davis, “What can projections of flow fields tell us about visual motion,” in International Conference on Computer Vision (ICCV), 1998, pp. 979–986.

    Google Scholar 

  19. J. Weber and J. Malik, “Rigid body segmentation and shape description from dense optical flow under weak perspective,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 2, pp. 139–143, 1997.

    Article  Google Scholar 

  20. T. Huang, Image sequence analysis. Newyrok, Springer-Verlag Berlin Heidelberg, 1981.

    MATH  Google Scholar 

  21. J. Aloimonos and C. Brown, “Direct processing of curvilinear sensor motion from a sequence of perspective images,” in IEEE Workshop on Computer Vision, Representation and Control, 1984, pp. 72–77.

    Google Scholar 

  22. S. Negahdaripour and B. Horn, “Direct passive navigation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 9, no. 1, pp. 168–176, 1987.

    Article  MATH  Google Scholar 

  23. B. Horn and E. Weldon, “Direct methods for recovering motion,” International Journal of Computer Vision, vol. 2, no. 2, pp. 51–76, 1988.

    Article  Google Scholar 

  24. Y. Hung and H. Ho, “A kalman filter approach to direct depth estimation incorporating surface structure,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 6, pp. 570–575, 1999.

    Article  Google Scholar 

  25. S. Srinivasan, “Extracting structure from optical flow using the fast error search technique,” International Journal of Computer Vision, vol. 37, no. 3, pp. 203–230, 2000.

    Article  MATH  Google Scholar 

  26. T. Brodsky, C. Fermuller, and Y. Aloimonos, “Structure from motion: Beyond the epipolar constraint,” International Journal of Computer Vision, vol. 37, no. 3, pp. 231–258, 2000.

    Article  MATH  Google Scholar 

  27. N. Gupta and N. Kanal, “3-D motion estimation from motion field,” Artificial Intelligence, vol. 78, no. 1-2, pp. 45–86, 1995.

    Article  Google Scholar 

  28. Y. Xiong and S. Shafer, “Dense structure from a dense optical flow,” in International conference on Computer vision and Image Understanding, 1998, pp. 222–245.

    Google Scholar 

  29. H. Sekkati and A. Mitiche, “Dense 3D interpretation of image sequences: A variational approach using anisotropic diffusion,” in International Conference on Image Analysis and Processing (ICIAP). Mantova, Italy, 2003, pp. 424–429.

    Google Scholar 

  30. A. Mitiche and S. Hadjres, “Mdl estimation of a dense map of relative depth and 3d motion from a temporal sequence of images,” Pattern Analysis and Applications, vol. 6, no. 1, pp. 78–87, 2003.

    Article  MathSciNet  MATH  Google Scholar 

  31. P. Ciarlet, Introduction à l’analyse numérique matricielle et à l’optimisation. Masson, Fifth, 1994.

    Google Scholar 

  32. G. E. Forsyth, A. A. Malcolm, and C. B. Moler, Computer methods for mathematical computations. Prentice Hall, 1977.

    Google Scholar 

  33. R. Feghali and A. Mitiche, “Fast computation of a boundary preserving estimate of optical flow,” SME Vision Quarterly, vol. 17, no. 3, pp. 1–4, 2001.

    Google Scholar 

  34. S. C. Zhu and A. Yuille, “Region competition: Unifiying snakes, region growing, and Bayes/MDL for multiband image segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 9, pp. 884–900, Sep. 1996.

    Article  Google Scholar 

  35. M. Rousson and R. Deriche, “A variational framework for active and adaptative segmentation of vector valued images,” in IEEE Workshop on Motion and Video Computing, 2002, pp. 56–61.

    Google Scholar 

  36. L. Vese and T. Chan, “A multiphase level set framework for image segmentation using the Mumford and Shah model,” International Journal of Computer Vision, vol. 50, no. 3, pp. 271–293, 2002.

    Article  MATH  Google Scholar 

  37. A. Yezzi, A. Tsai, and A. Willsky, “A fully global approach to image segmentation via coupled curve evolution equations,” Journal of Visual Communication and Image Representation, vol. 13, no. 1, pp. 195–216, Mar. 2002.

    Article  Google Scholar 

  38. C. Vázquez, A. Mitiche, and I. Ben Ayed, “Image segmentation as regularized clustering: A fully global curve evolution method,” in International Conference on Image Processing (ICIP), 2004, pp. 3467–3470.

    Google Scholar 

  39. I. Ben Ayed, A. Mitiche, and Z. Belhadj, “Polarimetric image segmentation via maximum-likelihood approximation and efficient multiphase level-sets,” IEEE Transactions on Pattern Analalysis and Machine Intelligence, vol. 28, no. 9, pp. 1493–1500, 2006.

    Article  Google Scholar 

  40. A. Mansouri, A. Mitiche, and C. Vázquez, “Multiregion competition: A level set extension of region competition to multiple region partioning,” Computer Vision and Image Understanding, vol. 101, no. 3, pp. 137–150, 2006.

    Article  Google Scholar 

  41. C. Debrunner and N. Ahuja, “Segmentation and factorization-based motion and structure estimation for long image sequences,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 2, pp. 206–211, 1998.

    Article  Google Scholar 

  42. T. Chan and L. Vese, “Active contours without edges,” IEEE Transactions on Image Processing, vol. 10, no. 2, pp. 266–277, 2001.

    Article  MATH  Google Scholar 

  43. D. Cremers and S. Soatto, “Motion cpmetition: A variational approach to piecewise parametric motion segmentation,” International Journal of Computer Vision, vol. 62, no. 3, pp. 249–265, 2005.

    Article  Google Scholar 

  44. C. Vázquez, A. Mansouri, and A. Mitiche, “Approximation of images by basis functions for multiple region segmentation with level sets,” in International Conference on Image Processing (ICIP), 2004, pp. 549–552.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amar Mitiche .

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Mitiche, A., Ayed, I.B. (2010). Image Segmentation According to the Movement of Real Objects. In: Variational and Level Set Methods in Image Segmentation. Springer Topics in Signal Processing, vol 5. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15352-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15352-5_8

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15351-8

  • Online ISBN: 978-3-642-15352-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics