Abstract
The paper deals with software productivity improvement for consumer multimedia devices by means of PC and component technology and shows how this is done for complex real-time content analysis applications used in advanced new storage products of the future. Content analysis is a relatively new and immature technology. It is used for browsing and searching particular content items among thousands of others on “big” embedded storage devices like hard disks. As the storage capacity of hard disk and flash continues to grow rapidly, content analysis is bound to become a key enabling technology in future storage products. A major problem with content analysis features (and many other features as well) is that underlying algorithms are unstable, sometimes unavailable, or at least, very much in their infancy, and as such, subject to frequent changes. The paper describes an approach to facilitate early evaluation and integration of such immature features. This is done by packing each feature, as-is, into components and by providing PC network technology to interconnect them. In our prototyping framework, each component is an independent executable program that runs on some PC in the network, streaming AV data via TCP/IP and being controlled through UPnP networking. Experiences with large-scale prototyping activities we have carried out for the assessment of future content analysis systems, show that a PC based prototyping approach enables the integration of many different media processing features in a short time and that it allows for accurate analysis of the resource (CPU/memory) requirements of such components.
Article PDF
Similar content being viewed by others
References
CASSANDRA project. http://www.research.philips.com/technologies/storage/cassandra
de Haan G (2000) Video processing for multimedia systems. In: ISBN: 90-9014015-8, Eindhoven
de Kock EA et al, YAPI: application modeling for signal processing systems. In: Proceedings of the 37th conference on Design automation
de Lange A, Snijder F, Method of and device for synchronizing multiple input streams. Patent application, PHAT050002 US
Dimitrova N, Jeannin S, Nesvadba J, McGee T, Agnihotri L, Mekenkamp G (2002) Real time commercial detection using MPEG features. In: 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, IPMU 2002, Annecy France July 1–5 2002
Hollemans G (2003) Meaningful navigation. http://www.research.philips.com/technologies/misc/homelab/downloads/homelab_365.pdf
Ma Q, Kondo H, Sumiya K et al (2001) Virtual TV channel filtering, merging and presenting internet broadcasting channels. SIGNotes Information Processing Society of Japan, Jun
Maxtor, Big Drives, Maxtor Technologies White Paper. http://www.maxtor.com/_files/maxtor/en_us/documentation/white_papers/big_drives_white_papers.pdf
McKinney M, Breebaart J (2003) Features for audio and music classification. In: 4th International Symposium on Music Information and Retrieval, Oct, Baltimore, Maryland
MultimediaN, Multimedia analysis, database technology, and human computer interaction. http://homepages.cwi.nl/~mk/multimedianonline/
Nesvadba J, Ernst F, Perhavc J, Benois-Pineau J, Primaux L (2005) Comparison of shot boundary detectors. In: Int. Conf. for Multimedia and Expo, Amsterdam, The Netherlands, June 6–8, 2005
Nesvadba J, Miguel Fonseca P, Kleihorst R, Broers H, Fan J (2004) Face related features in consumer electronic (CE) environments. In: IEEE SMC, Den Haag, The Netherlands
Nesvadba J, Louis N, Benois-Pineau J, Desainte-Catherine M, Klein Middelink M (2004) Low-level cross-media statistical approach for semantic partitioning of audio-visual content in a home multimedia environment. In: Proc. IEEE IWSSIP’04 (Int. Workshop on Systems, Signals and Image Processing), pp 235–238, Poznan, Poland, September 13–15, 2004
Nieuwland A, Kang J, Gangwal OP et al (2002) A heterogeneous multi-processor architecture and scalable and flexible protocol for the design of embedded signal processing systems. Des Autom Embed Syst 7(3):233–270 (Kluwer)
Sayed Hashimi, Service oriented architecture explained. http://www.ondotnet.com/pub/a/dotnet/2003/08/18/soa_explained.html
UHAPI, New application programming interface for the consumer electronics industry. http://www.uhapi.org
UPnP, The universal plug and play forum. http://www.upnp.org
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Nesvadba, J., de Lange, F. Early evaluation of future consumer AV content analysis applications with PC networks. Multimed Tools Appl 34, 201–220 (2007). https://doi.org/10.1007/s11042-006-0090-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-006-0090-7