Skip to main content

A Way of Energy Analysis for Image and Video Sequence Processing

  • Chapter
  • First Online:
Computer Vision in Control Systems-1

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 73))

Abstract

Usually the object movements are determined by the analysis of interframe difference in video signals. It is the simplest universal method. However, it does not provide the intelligent processing, especially in the case of extremely low luminance. The interframe differences of energy and phase-energy spectrums are considered as an alternative way. The phase-energy spectrum is a product of partial derivatives in spatial phase-frequency spectrum over their spatial frequencies. It provides the detailed information about motion in finite frames. Moreover, the edges in an image have a significant role. The modeling of interframe differences of frequency responses is based on the analysis of pixels locating near the “moving” boundaries. This increases a probability of movement’s detection. A distortion of moving object’s shape, movement’s characteristics, and a quantity of moving objects are defined from the analysis of types of interframe differences. The interframe differences of frequency responses always lead to the best results than the differences of video signals in spatial domain. The changes of the energetic indexes in static images determine the efficiency function as a dependence of output and input energies of 2D filter. This function is defined on a whole set of impulse responses of a filter. The efficiency function is a positively certain quadratic form with certain coefficients. These coefficients are obtained as a result of energy spectrum decomposition of input frame into 2D Fourier series over the cosines. The analysis of stationary points and also their efficiency function allow to synthesize the optimum and the quasi-optimum 2D filters. The proposed way of energy analysis provides some novel possibilities, for example, a detection of visual objects with extremely small contrast.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Behar J, Porat M, Zeevi YY (1992) Image reconstruction from localized phase. IEEE Trans Signal Process 40(4):736–743

    Article  Google Scholar 

  2. Burt PJ (1984) The pyramid as a structure for efficient for computation. In Rosenfeld A (ed) Multiresolution image processing and analysis, Springer Series in Information Sciences 12:6–35

    Google Scholar 

  3. Dong DW, Atick JJ (1995) Statistics of natural time-varying images. Comput Neural Syst 6:345–358

    Article  MATH  Google Scholar 

  4. Dunn D, Higgins WE, Wakeley J (1994) Texture segmentation using 2-D Gabor Elementary-Functions. IEEE Trans Pattern Anal Mach Intell 16(2):130–149

    Article  Google Scholar 

  5. Jähne B (2005) Digital image processing, 6th edn. Springer, Berlin

    Google Scholar 

  6. Wong A, Clausi DA (2007) ARRSI: automatic registration of remote-sensing images. IEEE Trans Geosci Remote Sens 45(5):1483–1492

    Article  Google Scholar 

  7. Rozenfeld A (ed) (1984) Multiresolution image processing and analysis, of springer series in information sciences, vol 12. Springer, New York

    Google Scholar 

  8. Stocker AA, Simoncelli EP (2006) Noise characteristics and prior expectations in human visual speed perception. Nat Neurosci 9:578–585

    Article  Google Scholar 

  9. Porat M, Zeevi YY (1988) The generalized Gabor scheme of image representation in biological and machine vision. IEEE Trans Pattern Anal Mach Intell 10(4):452–468

    Article  MATH  Google Scholar 

  10. Olshausen BA (2003) Learning sparse, overcomplete representations of time-varying natural images. IEEE Int Conf Image Proc 1:41–44

    Google Scholar 

  11. Gonzalez RC, Woods RE (2002) Digital image processing, 2nd edn. Prentice Hall, Upper Saddle River

    Google Scholar 

  12. Oppenheim AV, Willsky AS, Nawab SH (1996) Signals and systems, 2nd edn. Prentice-Hall, Upper Saddle River

    Google Scholar 

  13. Perona P, Malik J (1990) Scale-space and edge detection using anisotropic diffusion. IEEE Trans Pattern Anal Mach Intell 12(7):629–639

    Article  Google Scholar 

  14. Randen T, Husoy JH (1999) Filtering for texture classification: a comparative study. IEEE Trans Pattern Anal Mach Intell 21(4):291–310

    Article  Google Scholar 

  15. Skarbnik N, Sagiv C, Zeevi YY (2009) Edge Detection and Skeletonization using Quantized phase. In: 17th European signal processing conference (EUSIPCO 2009), pp 1542–1546

    Google Scholar 

  16. Ruderman DL (1996) The statistics of natural images. Comput Neural Syst 5:517–548

    Article  Google Scholar 

  17. Torralba A, Oliva A (2003) Statistics of natural image categories. Network 14(3):391–412

    Article  Google Scholar 

  18. Weiss Y, Simoncelli EP, Adelson EH (2002) Motion illusions as optimal percepts. Nat Neurosci 5:598–604

    Article  Google Scholar 

  19. Morrone MC, Burr DC (1988) Feature detection in human vision: a phase-dependent energy model. Proc R Soc Lond B 235:221–245

    Article  Google Scholar 

  20. Xiao Z, Hou Z (2004) Phase based feature detector consistent with human visual system characteristics. Pattern Recogn Lett 25(10):1115–1121

    Article  Google Scholar 

  21. Bonnet N, Vautrot P (1997) Image analysis: Is the Fourier transform becoming obsolete. Microsc Microanal Microstruct 8(1):59–75

    Article  Google Scholar 

  22. Daugman J (2001) Statistical richness of visual phase information: update on recognizing persons by iris patterns. Int J Comput Vis 45(1):25–38

    Article  MATH  Google Scholar 

  23. Gegenfurtner KR, Braun DI, Wichmann FA (2003) The importance of phase information for recognizing natural images. J Vis 3(9):519

    Google Scholar 

  24. Hansen BC, Hess RF (2007) Structural sparseness and spatial phase alignment in natural scenes. J Opt Soc Am A 24(7):1873–1885

    Article  Google Scholar 

  25. Morgan MJ, Ross J, Hayes A (1991) The relative importance of local phase and local amplitude in patchwise image reconstruction. Biol Cybern 65(2):113–19

    Article  Google Scholar 

  26. Kuglin CD, Hines DC (1975) The phase correlation image alignment method. In: IEEE conference on cybernetics and society, pp 163–165

    Google Scholar 

  27. Michael G, Porat M (2001) Image reconstruction from localized Fourier magnitude. In: Proceedings of international conference on image processing (Cat. No. 01CH37205), pp 213–16

    Google Scholar 

  28. Oppenheim AV, Lim JS (1981) The importance of phase in signals. Proc IEEE 69(5):529–541

    Article  Google Scholar 

  29. Shapiro Y, Porat M (1998) Image representation and reconstruction from spectral amplitude or phase. In: IEEE international conference on electronics, circuits and systems, pp 461–464

    Google Scholar 

  30. Tanaka H, Yoshida Y, Fukami K, Nakano H (2004) Texture segmentation using amplitude and phase information of Gabor filters. Electron Commun Jpn Part 3 (Fundam Electron Sci) 87(4):66–79

    Google Scholar 

  31. Kovesi P (1999) Image features from phase congruency. Videre 1(3):1–14

    Google Scholar 

  32. Urieli S, Porat M, Cohen N (1998) Optimal reconstruction of images from localized phase. IEEE Trans Image Process 7(6):838–853

    Article  MathSciNet  MATH  Google Scholar 

  33. Li Y, Belkasim S, Chen X, Fu X (2006) Contour-based object segmentation using phase congruency. IntCongress of Imaging Science ICIS’06 661–664

    Google Scholar 

  34. Bogoslovski AV (2013) Multidimensional signal processing. Radiotec, Moscow (in Russian)

    Google Scholar 

  35. Dufaux F, Moscheni F (1995) Motion estimation techniques for digital TV: a review and a new contribution. Proc IEEE 83(6):858–876

    Article  Google Scholar 

  36. Magarey JFA, Kingsbury NG (1998) Motion estimation using a complex-valued wavelet transform. IEEE Trans Signal Proc 46:1069–1084

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Irina Zhigulina .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Bogoslovsky, A., Zhigulina, I. (2015). A Way of Energy Analysis for Image and Video Sequence Processing. In: Favorskaya, M., Jain, L. (eds) Computer Vision in Control Systems-1. Intelligent Systems Reference Library, vol 73. Springer, Cham. https://doi.org/10.1007/978-3-319-10653-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-10653-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-10652-6

  • Online ISBN: 978-3-319-10653-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics