Abstract
In this paper, we propose a new real-time content filtering framework for live broadcasts in TV terminals. Content filtering in TV terminals is a necessary provision of personalized broadcasting services in that it enables a TV viewer to obtain desired scenes from multiple channel broadcasts. In this paper, a stable and reliable filtering structure and an algorithm for multiple inputs are proposed. Moreover, real-time filtering requirements such as frame sampling rate per channel, number of input channels, and buffer condition are analyzed to achieve real-time processing in terminals with limited computing power. Based on queueing theory, we model the system and resolve the filtering requirements. To verify the proposed system and analysis, a filtering algorithm for soccer videos is applied which is modified for real-time processing. Through analysis of visual features (e.g., dominant color and edge components) and detection of spatial objects (e.g., a score board), it recognizes a temporal pattern between successive video frames and filters desired scenes. Experiments on soccer videos have been performed and the results validate the effectiveness of the proposed approach and system.
Similar content being viewed by others
References
Bais M, Cosmas J, Dosch C, Engelsberg A, Erk A, Hansen PS, Healey P, Klungsoeyr GK, Mies R, Ohm J-R, Paker Y, Pearmain A, Pedersen L, Sandvand A, Schafer R, Schoonjans P, Stammnitz P (2002) Customized television: standards compliant advanced digital television. IEEE Trans Broadcast 48(2):151–158
Choi JS, Kim JW, Han DS, Nam JY, Ha YH (2004) Design and implementation of DVB-T receiver system for digital TV. IEEE Trans Consum Electron 50(4):991–998
Dimitrova N, McGee T, Elenbaas H, Martino J (1998) Video content management in consumer devices. IEEE Trans Knowl Data Eng 10(6):988–995
Dimitrova N, Zhang H-J, Shahraray B, Sezan I, Huang T, Zakhor A (1999) Applications of video-content analysis and retrieval. IEEE Multimed 6(2):14–17
Dimitrova N, Elenbass H, McGee T, Agnihotri L (2000) An architecture for video content filtering in consumer domain. In: Proceedings of the international conference on information technology: coding and computing, 27–29 March 2000, pp 214–221
Dimitrova N, Zhang H-J, Shahraray B, Sezan I, Huang T, Zakhor A (2002) Applications of video-content analysis and retrieval. IEEE Multimed 9(3):42–55
Eckberg A Jr (1979) The single server queue with periodic arrival process and deterministic service times. IEEE Trans Commun 27(3):556–562
Ekin A, Tekalp AM (2003) Generic play-break event detection for summarization and hierarchical sports video analysis. In: Proceedings of the IEEE international conference on multimedia & expo 2003, pp 27–29
Ekin A, Tekalp AM, Mehrotra R (2003) Automatic soccer video analysis and summarization. IEEE Trans Image Process 12(7):796–807
Fu Y, Ekin A, Tekalp AM, Mehrotra R (2002) Temporal segmentation of video objects for hierarchical object-based motion description. IEEE Trans Image Process 11:135–145
Gauch JM, Gauch S, Bouix S, Zhu X (1999) Real time video scene detection and classification. Inf Process Manag 35:381–400
Gross D, Harris CM (1998) Fundamentals of queueing theory. Wiley, New York
Jin SH, Bae TM, Ro YM, Kang K (2004) Intelligent agent-based system for personalized broadcasting services. In: Proceedings of the international conference on image science, systems and technology ’04, pp 613–619
Kim J, Suh S, Sull S (2003) Fast scene change detection for personal video recorder. IEEE Trans Consum Electron 49(3):683–688
Kleinrock L (1975) Queueing system. Wiley, New York
Kumano M, Ariki Y, Tsukada K, Hamaguchi S, Kiyose H (2004) Automatic extraction of PC scenes based on feature mining for a real time delivery system of baseball highlight scenes. In: Proceedings of the IEEE international conference on multimedia and expo 2004, pp 277–280
Lee K, Park HS (1994) Approximation of the queue length distribution of general queues. ETRI J 15(3):35–46
Lee J, Lee G, Kim W (2003) Automatic video summarization tool using MPEG-7 descriptors for personal video recorder. IEEE Trans Consum Electron 49(3):742–749
Leonardi R, Migliorati P, Prandini M (2004) Semantic indexing of soccer audio–visual sequences: a multimodal approach based on controlled Markov chains. IEEE Trans Circuits Syst Video Technol 14(5):634–643
Li H, Liu G, Zhang Z, Li Y (2004) Adaptive scene-detection algorithm for VBR video stream. IEEE Trans Multimedia 6(4):624–633
Li Y, Narayanan S, Jay Kuo C-C (2004) Content-based movie analysis and indexing based on audiovisual cues. IEEE Trans Circuits Syst Video Technol 14(8):1073–1085
Meer P, Georgescu B (2001) Edge detection with embedded confidence. IEEE Trans Pattern Anal Mach Intell 23(12):1351–1365
Moon J-C, Lim H-S, Kang S-J (1999) Real-time event kernel architecture for home-network gateway set-top-box (HNGS). IEEE Trans Consum Electron 45(3):488–495
Ngo C-W, Ma Y-F, Zhang H-J (2005) Video summarization and scene detection by graph modeling. IEEE Trans Circuits Syst Video Technol 15(2):296–305
Otsuka I, Nakane K, Divakaran A, Hatanaka K, Ogawa M (2005) A highlight scene detection and video summarization system using audio feature for a personal video recorder. IEEE Trans Consum Electron 51(1):112–116
Pekowsky S, Jaeger R (1998) The set-top box as multi-media terminal. IEEE Trans Consum Electron 44(3):833–840
Shahrary B (1995) Scene change detection and content-based sampling of video sequences. Proc SPIE 2419:2–13
TVAF (2005) Phase 2 benchmark features. SP001v20, p 9, http://www.tv-anytime.org/
Wolf C, Jolion J-M, Chassaing F (2002) Text localization, enhancement and binarization in multimedia documents. In Proceedings of the 16th international conference on pattern recognition, vol. 2. IEEE, Piscataway, pp 1037–1040
Zhong D, Chang S (2004) Real-time view recognition and event detection for sports video. J Vis Commun Image Represent 15(3):330–347
Zhu X, Fan J, Elmagarmid AK, Wu X (2003) Hierarchical video content description and summarization using unified semantic and visual similarity. Multimedia Syst 9:31–53
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jin, S.H., Cho, J.H. & Ro, Y.M. Real-time content filtering for live broadcasts in TV terminals. Multimed Tools Appl 36, 285–301 (2008). https://doi.org/10.1007/s11042-007-0148-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-007-0148-1