Skip to main content
SpringerLink
Log in

Multi-device Content Based on Video. A Practical Toolset for Creation and Delivery

  • Conference paper
  • First Online:
Applications and Usability of Interactive Television (jAUTI 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 813))

  • 418 Accesses

Abstract

The arrival of head mounted displays (HMDs) to the contemporary living room extends the need for producing content that works for the television and companion screen devices. In this work we introduce a set of three tools that can be used for the production and delivery of synchronous multi-device content, across the TV, companion screens and HMDs. The production tool is implemented as a custom Adobe Premiere Pro plugin. The publication and delivery process is implemented as an online service controlled through a web application. The content playout is implemented with a multi-device video player that combines video decoding and playout. In this article we introduce the design choices guiding our software development and the different tools we developed to realize it. We also detail some basic measures of system performance on different devices, and propose further steps towards the easy production and delivery of multi-device content.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Boronat, F., Montagud, M., Marfil, D., Luzón, C.: Hybrid broadcast/broadband TV services and media synchronization: demands, preferences and expectations of spanish consumers. IEEE Trans. Broadcast. (2017)

    Google Scholar 

  2. Carranza, J., Theobalt, C., Magnor, M.A., Seidel, H.-P.: Free-viewpoint video of human actors. In: ACM Transactions on Graphics (TOG), pp. 569–577 (2003)

    Article  Google Scholar 

  3. Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., Sullivan, S.: High-quality streamable free-viewpoint video. ACM Trans. Graph. (TOG) 34(4), 69 (2015)

    Article  Google Scholar 

  4. Courtois, C., D’heer, E.: Second screen applications and tablet users: constellation, awareness, experience, and interest. In: Proceedings of the 10th European Conference on Interactive TV and Video, pp. 153–156 (2012)

    Google Scholar 

  5. D’heer, E., Courtois, C.: The changing dynamics of television consumption in the multimedia living room. Convergence 22(1), 3–17 (2016)

    Article  Google Scholar 

  6. Gómez, D., Boronat, F., Montagud, M., Luzón, C.: End-to-end DASH platform including a network-based and client-based adaptive quality switching module. In: Proceedings of the 7th International Conference on Multimedia Systems, p. 38 (2016)

    Google Scholar 

  7. Huang, J., Chen, Z., Ceylan, D., Jin, H.: 6-DOF VR videos with a single 360-camera. In: Virtual Reality (VR), 2017 IEEE, pp. 37–44 (2017)

    Google Scholar 

  8. Meixner, B., Glancy, M., Rogers, M., Ward, C., Röggla, T., Cesar, P.: Multi-screen director: a new role in the TV production workflow? In: Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, pp. 57–62 (2017)

    Google Scholar 

  9. Montagud, M., Boronat, F., Stokking, H., van Brandenburg, R.: Inter-destination multimedia synchronization: schemes, use cases and standardization. Multimed. Syst. 18(6), 459–482 (2012)

    Article  Google Scholar 

  10. Niamut, O.A., Thomas, E., D’Acunto, L., Concolato, C., Denoual, F., Lim, S.Y.: MPEG DASH SRD: spatial relationship description. In: Proceedings of the 7th International Conference on Multimedia Systems, p. 5 (2016)

    Google Scholar 

  11. Rainer, B., Timmerer, C.: Self-organized inter-destination multimedia synchronization for adaptive media streaming. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 327–336 (2014)

    Google Scholar 

  12. Sheikh, A., Brown, A., Watson, Z., Evans, M.: Directing attention in 360-degree video, pp. 43–47 (2016). http://dx.doi.org/10.1049/ibc.2016.0029

  13. Skupin, R., Sanchez, Y., Hellge, C., Schierl, T.: Tile based HEVC video for head mounted displays (2016)

    Google Scholar 

  14. Slater, M.: Place illusion and plausibility in virtual environments. Philos. Trans. R. Soc. B: Biol. Sci. 364(1535), 3549 (2009)

    Article  Google Scholar 

  15. Starck, J., Hilton, A.: Spherical matching for temporal correspondence of non-rigid surfaces. In: Tenth IEEE International Conference on Computer Vision (ICCV 2005), Volume 1, vol. 2, pp. 1387–1394 (2005). https://doi.org/10.1109/iccv.2005.229

  16. Starck, J., Miller, G., Hilton, A.: Video-based character animation. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics Symposium on Computer Animation - SCA 2005, p. 49 (2005). https://doi.org/10.1145/1073368.1073375

  17. Veenhuizen, A., van Brandenburg, R.: Frame accurate media synchronization of heterogeneous media sources in an HBB context. In: Media Synchronization Workshop (2012)

    Google Scholar 

  18. Vinayagamoorthy, V., Ramdhany, R., Hammond, M.: Enabling frame-accurate synchronised companion screen experiences. In: Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, pp. 83–92 (2016)

    Google Scholar 

  19. The ImmersiaTV Project. www.immersiatv.eu. Accessed 08 Jan 2018

  20. The DVB-CSS Protocol. http://www.etsi.org/deliver/etsi_ts/103200_103299/10328601/01.01.01_60/ts_10328601v010101p.pdf. Accessed 08 Jan 2018

  21. Description of the Precision Time Protocol, as implemented in the Gstreamer framework. https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-libs/html/GstPtpClock.html. Accessed 08 Jan 2018

  22. The Portal Game. http://store.steampowered.com/app/400/. Accessed 08 Jan 2018

  23. VideoStitch Studio. https://www.orah.co/software/videostitch-studio/. Accessed 21 Feb 2018

  24. CaraVR. https://www.thefoundry.co.uk/products/cara-vr/. Accessed 21 Feb 2018

  25. Mettle. https://www.mettle.com. Accessed 21 Feb 2018

  26. Gpac. https://gpac.wp.mines-telecom.fr/mp4box/. Accessed 21 Feb 2018

  27. Gstreamer. https://gstreamer.freedesktop.org/

  28. ImmersiaTV Server. http://server.immersiatv.eu/public_http/metadata/ImmersiaTV.html. Accessed 21 Feb 2018

  29. Gstreamer Movie Texture. https://www.assetstore.unity3d.com/en/#!/content/59897. Accessed 21 Feb 2018

Download references

Acknowledgements

This work has been developed with the support of the European Union’s Horizon 2020 programme under grant agreement No. 688619 (www.immersiatv.eu). Developing an end-to-end pipeline requires competent and motivated programmers. In the work here introduced we acknowledge the contributions of Wojciech Kapsa and Daniel Piesik, from PSNC, as well as Ibai Jurado, David Gómez, Einar Meyerson, David Cassany and Juan Gordo from i2cat Foundation.

Author information

Authors and Affiliations

  1. i2cat Foundation, C/Gran Capità 2-4, 08035, Barcelona, Spain

    Joan Llobera, Isaac Fraile, Juan A. Núñez, Xavier Artigas & Sergi Fernandez

  2. PSNC, Jana Pawła II 10, 61-139, Poznań, Poland

    Szymon Malewski

Authors
  1. Joan Llobera
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Isaac Fraile
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juan A. Núñez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Szymon Malewski
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xavier Artigas
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sergi Fernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Joan Llobera .

Editor information

Editors and Affiliations

  1. CICPBA - III-LIDI, National University of La Plata, La Plata, Argentina

    María José Abásolo

  2. University of Aveiro, Aveiro, Portugal

    Jorge Abreu

  3. University of Aveiro, Aveiro, Portugal

    Pedro Almeida

  4. University of Aveiro, Aveiro, Portugal

    Telmo Silva

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Llobera, J., Fraile, I., Núñez, J.A., Malewski, S., Artigas, X., Fernandez, S. (2018). Multi-device Content Based on Video. A Practical Toolset for Creation and Delivery. In: Abásolo, M., Abreu, J., Almeida, P., Silva, T. (eds) Applications and Usability of Interactive Television. jAUTI 2017. Communications in Computer and Information Science, vol 813. Springer, Cham. https://doi.org/10.1007/978-3-319-90170-1_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-90170-1_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-90169-5

  • Online ISBN: 978-3-319-90170-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation