Advertisement

Video Content Representation Based on Texture and Lighting

  • Ivan S. Radev
  • George Paschos
  • Niki Pissinou
  • Kia Makki
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1929)

Abstract

When dealing with yet unprocessed video, structuring and extracting features according to models that reflect the idiosyncrasies of a video data category (film, news, etc.) are essential for guaranteeing the content annotation, and thus the use of video. In this paper, we present methods for automatic extraction of texture and lighting features of representative frames of video data shots. These features are the most important elements which characterize the development of plastic (physical) space in the film video. They are also important in other video categories. Texture and lighting are two basic properties, or features, of video frames represented in the general film model presented in [12]. This model is informed by the internal components and interrelationships known and used in the film application domain. The method for extraction of texture granularity is based on the approach for measuring the granularity as the spatial rate of change of the image intensity [3], where we extend it to color textures. The method for extraction of lighting feature is based on the approach of closed solution schemes [4], which we improve by making it more general and more effective.

Keywords

Video Data Automatic Extraction Video Shot Texture Granularity Color Texture 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [3]
    M. Amadasun and R. King. Textural Features Corresponding to Textural Properties. IEEE Transactions on Systems, Man and Cybernetics (SMC), 19(5):1264–1289, May 1989.CrossRefGoogle Scholar
  2. [4]
    M. J. Brooks and B. K. P. Horn. Shape and Source from Shading. A.I. Memo 820, M.I.T., 1985.Google Scholar
  3. [5]
    M. Flickner. Query by Image and Video Content. IEEE Computer, 28(9):23–32, September 1995.Google Scholar
  4. [6]
    S. Gibbs, C. Breiteneder, and D. Tsichritzis. Audio/Video Databases: An Object-Oriented Approach. In A. Elmagarmid and E. Neuhold, editors, Proceedings of 9th International Conference on Data Engineering (ICDE’93), pages 381–390, Vienna, Austria, April 1993. IEEE Computer Society Press.Google Scholar
  5. [7]
    R. Hjelsvold and R. Midstraum. Modelling and Querying Video Data. In M. Maybury, editor, Proceedings of 20th Conference on Very Large Databases (VLDB’94), pages 686–695, Santiago, Chile, September 1994. AAAI Press and The MIT Press.Google Scholar
  6. [8]
    J. Monaco. How to Read a Film: The Art, Technology, Language, History and Theory of Film and Media. Oxford University Press, 1977.Google Scholar
  7. [9]
    A. Nagasaka and Y. Tanaka. Automatic Video Indexing and Full-Video Search for Object Appearances. In E. Knuth and L. Wegner, editors, Visual Database Systems, II, pages 113–127. Elsevier Science Publishers B.V., 1992.Google Scholar
  8. [10]
    G. Paschos and I. Radev. Video Sequence Cut Detection in Di_erent Color Spaces. In IASTED International Conference on Signal and Image Processing (SIP’99), Nassau, Bahamas, October 1999.Google Scholar
  9. [11]
    A. P. Pentland. Finding the Illuminant Direction. Journal of Optical Society of America, pages 448–455, 1982.Google Scholar
  10. [12]
    I. Radev, N. Pissinou, and K. Makki. Film Video Modeling. In Proceedings of IEEE Workshop on Knowledge and Data Engineering Exchange (KDEX’99), Chicago, Illinois, November 1999.Google Scholar
  11. [13]
    L. Rowe, J. Boreczky, and C. Eads. Indexes for Access to Large Video Databases. In W. Niblack and R. Jain, editors, Proceedings of Conference on Storage and Retrieval for Image and Video Databases II (SPIE’94), volume 2185, pages 150–161, San Jose, California, February 1994. SPIE.Google Scholar
  12. [14]
    P. L. Worthington and E. R. Hancock. New Constraints on Data-Closeness and Needle Map Consistency for Shape-for-Shading. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 21(12):1250–1267, July 1999.CrossRefGoogle Scholar
  13. [15]
    Q. Zheng and R. Chellapa. Estimation of Illuminant Direction, Albedo, and Shape from Shading. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 3(7):680–702, July 1991.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Ivan S. Radev
    • 1
  • George Paschos
    • 2
  • Niki Pissinou
    • 1
  • Kia Makki
    • 1
  1. 1.University of LouisianaLafayette
  2. 2.National University of SingaporeSingapore

Personalised recommendations