Abstract
Free Viewpoint Multiview Video TV (FTV) allows a user to pan horizontally within a video field of view. Interactive live FTV allows a user to experience being live at a soccer game with the interactive capability to freely look from side-to-side. Current efforts to commercialize interactive live FTV have failed due to a lack of standardization and unacceptably high real-world DVB (Direct Video Broadcast) system bandwidth requirements. In this paper, we provide a solution called OLFVmv (Optimized Live Free Viewpoint Multiview Video) that applies adaptive prediction of future video content requirements based on past viewer behavior, thereby dramatically reducing system bandwidth requirements. To expand, OLFVmv entails algorithms and a system architecture that allows for the intelligent segmentation and prioritization of video content based on video compression layering combined with viewer behavior statistics. Based on our positive results, we show that system operators can practically implement OLFVmv into existing systems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
ISO/IEC, Standard 14496-10:2008: Information technology – coding of audio-visual objects – part 10: advanced video coding (2008)
Ohm, J.R.: MPEG Developments in multi-view video coding and 3D video, multiview & 3d video coding – EBU workshop, April 2009
ISO/IEC, Standard 14496-10:2009: Information technology – coding of audio-visual objects – part 10: advanced video coding, 16 Mar 2009
ISO/IEC, Standard 14496-10:2010: Information technology – coding of audio-visual objects – part 10: advanced video coding, 9 Mar 2010
ISO/IEC, Standard ISO/IEC 14496-10:2014: Information technology – coding of audio-visual objects – part 10: advanced video coding, 27 Aug 2014
Kramer, R.A.: Thesis: optimization of interactive live free viewpoint multiview video streaming bandwidth, Oregon State University at ScholarsArchive@OSU, Available July 2017
Ohm, J.R., Sullivan G.: MPEG-4 advanced video coding, MPEG doc#: N7314, July 2005
Smolic, A.: Advanced video coding [subsection] multiview video coding. The Motion Picture Experts Group, MPEG doc #N9580
Dufaux, F., Pesquet-Popescu, B., Cagnazzo, M.: Emerging technologies for 3D video: creation, coding, transmission and rendering. Wiley, New York (2013)
Cheung, Gene, Ortega, Antonio, Cheung, Ngai-Man: Interactive streaming of stored multiview video. IEEE Trans. Image Process. 20(3), 744–761 (2011)
Müller, Karsten, Schwarz, Heiko, et al.: 3D high-efficiency video coding for multi-view video and depth data. IEEE Trans. Image Process. 22(9), 3366–3378 (2013)
DIOMEDES Marketing Brochure: Distribution of multiview entertainment using content aware delivery systems (2013)
DIOMEDES, Standard D2.3 : Final reference system architecture report, Final Revision, 31 Jan 2012
DIOMEDES, Standard D3.6: Public report on 3D audio/video rendering and content adaption, Final revision, 31 Oct 2011
DIOMEDES, Standard 4.4: Report on the developed audio and video codecs, Final revision, 31 Oct 2011
DIOMEDES, Standard D4.5: Report on results of integrated MD-SMVD and P2P system, Final revision, 31 Jan 2011
ETSI, Standard EN 300 421 V1.1.2: Digital video broadcasting (DVB); framing structure, channel coding and modulation for 11/12 GHz satellite services, Aug 1997
ETSI, Standard EN 300 429 V1.2.1: Digital video broadcasting (DVB); framing structure, channel coding and modulation for cable systems, Apr 1998
ETSI, Standard EN 302 304 V1.1.1: Digital video broadcasting (DVB); transmission system for handheld terminals (DVB-H), Nov 2004
ETSI, Standard EN 302 307 V1.2.1: Digital video broadcasting (DVB); second generation framing structure, channel coding and modulation systems for Broadcasting, Interactive Services, News Gathering and other broadband satellite applications (DVB-S2), Aug 2009
ETSI, Standard EN 302 755 V1.2.1: Digital video broadcasting (DVB); frame structure channel coding and modulation for a second generation digital terrestrial television broadcasting system (DVB-T2), Oct 2010
ETSI, Standard ETSI TS 102 034 V1.4.1: Digital video broadcasting (DVB); transport of MPEG-2 TS based DVB services over IP based networks, Aug 2009
Schierl, T., Narasimhan, S.: Transport and storage systems for 3-D video using MPEG-2 systems, RTP, and ISO file format. Proc. IEEE 99(4), 671 (2011)
Kim, Y. et al.: The performance analysis of SVC image service for mobile IPTV system. In: 13th International Conference on Advanced Communication Technology (ICACT) (2011)
Uitto, M., Vehkapera, J.: Enhanced quality adaptation strategies for scalable video. In: 2013 IEEE International Symposium Signal Processing and Information Technology (ISSPIT) (2013)
Polycom, More scale at lower cost with scalable video coding, Nov 2010
Rimac-Drlje, S., Nemčić, O., Vranješ, M.: Scalable video coding extension of the H.264/AVC standard. In: 50th international symposium ELMAR-2008, 10–12 Sept 2008
Wiegand, T., Sullivan, G.J.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circ. Syst. Video Technol. 13(7), 560 (2003)
Vetro, Anthony, Wiegand, Thomas, Sullivan, Gary: Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc. IEEE 99(4), 626–642 (2011)
Nguyen, Kien, Nguyen, Thinh, Cheung, Sen-Ching: Video streaming with network coding. J. Sig. Process. Syst. 59(3), 319–333 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kramer, R.A., Nguyen, T. (2019). Optimization of Interactive Live Free Viewpoint Multiview Video Streaming Bandwidth. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2018. Advances in Intelligent Systems and Computing, vol 869. Springer, Cham. https://doi.org/10.1007/978-3-030-01057-7_49
Download citation
DOI: https://doi.org/10.1007/978-3-030-01057-7_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01056-0
Online ISBN: 978-3-030-01057-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)