Multimedia Tools and Applications

, Volume 34, Issue 2, pp 201–220 | Cite as

Early evaluation of future consumer AV content analysis applications with PC networks

  • Jan Nesvadba
  • Fons de LangeEmail author
Open Access


The paper deals with software productivity improvement for consumer multimedia devices by means of PC and component technology and shows how this is done for complex real-time content analysis applications used in advanced new storage products of the future. Content analysis is a relatively new and immature technology. It is used for browsing and searching particular content items among thousands of others on “big” embedded storage devices like hard disks. As the storage capacity of hard disk and flash continues to grow rapidly, content analysis is bound to become a key enabling technology in future storage products. A major problem with content analysis features (and many other features as well) is that underlying algorithms are unstable, sometimes unavailable, or at least, very much in their infancy, and as such, subject to frequent changes. The paper describes an approach to facilitate early evaluation and integration of such immature features. This is done by packing each feature, as-is, into components and by providing PC network technology to interconnect them. In our prototyping framework, each component is an independent executable program that runs on some PC in the network, streaming AV data via TCP/IP and being controlled through UPnP networking. Experiences with large-scale prototyping activities we have carried out for the assessment of future content analysis systems, show that a PC based prototyping approach enables the integration of many different media processing features in a short time and that it allows for accurate analysis of the resource (CPU/memory) requirements of such components.


Multimedia content analysis PC networking Prototyping UPnP Service oriented architecture 


  1. 1.
  2. 2.
    de Haan G (2000) Video processing for multimedia systems. In: ISBN: 90-9014015-8, EindhovenGoogle Scholar
  3. 3.
    de Kock EA et al, YAPI: application modeling for signal processing systems. In: Proceedings of the 37th conference on Design automationGoogle Scholar
  4. 4.
    de Lange A, Snijder F, Method of and device for synchronizing multiple input streams. Patent application, PHAT050002 USGoogle Scholar
  5. 5.
    Dimitrova N, Jeannin S, Nesvadba J, McGee T, Agnihotri L, Mekenkamp G (2002) Real time commercial detection using MPEG features. In: 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, IPMU 2002, Annecy France July 1–5 2002Google Scholar
  6. 6.
  7. 7.
    Ma Q, Kondo H, Sumiya K et al (2001) Virtual TV channel filtering, merging and presenting internet broadcasting channels. SIGNotes Information Processing Society of Japan, JunGoogle Scholar
  8. 8.
  9. 9.
    McKinney M, Breebaart J (2003) Features for audio and music classification. In: 4th International Symposium on Music Information and Retrieval, Oct, Baltimore, MarylandGoogle Scholar
  10. 10.
    MultimediaN, Multimedia analysis, database technology, and human computer interaction.
  11. 11.
    Nesvadba J, Ernst F, Perhavc J, Benois-Pineau J, Primaux L (2005) Comparison of shot boundary detectors. In: Int. Conf. for Multimedia and Expo, Amsterdam, The Netherlands, June 6–8, 2005Google Scholar
  12. 12.
    Nesvadba J, Miguel Fonseca P, Kleihorst R, Broers H, Fan J (2004) Face related features in consumer electronic (CE) environments. In: IEEE SMC, Den Haag, The NetherlandsGoogle Scholar
  13. 13.
    Nesvadba J, Louis N, Benois-Pineau J, Desainte-Catherine M, Klein Middelink M (2004) Low-level cross-media statistical approach for semantic partitioning of audio-visual content in a home multimedia environment. In: Proc. IEEE IWSSIP’04 (Int. Workshop on Systems, Signals and Image Processing), pp 235–238, Poznan, Poland, September 13–15, 2004Google Scholar
  14. 14.
    Nieuwland A, Kang J, Gangwal OP et al (2002) A heterogeneous multi-processor architecture and scalable and flexible protocol for the design of embedded signal processing systems. Des Autom Embed Syst 7(3):233–270 (Kluwer)zbMATHCrossRefGoogle Scholar
  15. 15.
    Sayed Hashimi, Service oriented architecture explained.
  16. 16.
    UHAPI, New application programming interface for the consumer electronics industry.
  17. 17.
    UPnP, The universal plug and play forum.

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Philips ResearchEindhovenThe Netherlands

Personalised recommendations