Multimedia Tools and Applications

, Volume 70, Issue 2, pp 827–846 | Cite as

Experiencing standardized media fragment annotations within HTML5

  • Davy Van Deursen
  • Wim Van Lancker
  • Erik Mannens
  • Rik Van de Walle


W3C’s Video in the Web activity aims at a better integration of media within the Web. In this paper, we show how two specifications currently under development within this activity, i.e., Media Fragment URIs and Media Annotations, can be combined within media-enabled HTML5 Web applications. In particular, we introduce a number of extensions for the Media Annotations ontology in order to close the gap with Media Fragment URIs. Additionally, we show how rich media fragment annotations can be converted into a WebVTT file. The latter can be used by HTML5-enabled players to show the annotations in a synchronized way. Further, a fully integrated Web application has been developed that shows how both specifications can work together within an HTML5 environment. This application relies on NinSuna, our media delivery platform targeted at multichannel publication that provides server-side support for both Media Fragment URIs and Media Annotations.


HTML5 Media Annotations Media Fragments Text Track API WebVTT 



The research activities as described in this paper were funded by Ghent University, the Interdisciplinary Institute for Broadband Technology (IBBT), the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT), the Fund for Scientific Research-Flanders (FWO-Flanders), and the European Union.


  1. 1.
    Fialho A, Troncy R, Hardman L, Saathoff C, Scherp A (2010) What’s on this evening? Designing user support for event-based annotation and exploration of media. In: Proceedings of the 1st international workshop on EVENTS 2010 - recognising and tracking events on the web and in real life, Athens, Greece, pp 40–54Google Scholar
  2. 2.
    Google (2012) YouTube video annotations. Accessed 24 April 2012
  3. 3.
    Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the web. Int J Digit Libr 10(1):15–32CrossRefGoogle Scholar
  4. 4.
    Haslhofer B, Momeni E, Gay M, Simon R (2010) Augmenting Europeana content with linked data resources. In: Proceedings of the 6th international conference on semantic systems (I-SEMANTICS ’10), Graz, Austria, pp 40:1–40:3Google Scholar
  5. 5.
    Haslhofer B, Simon R, Sanderson R, Van De Sompel H (2011) The open annotation collaboration (OAC) model. In: Proceedings of the workshop on multimedia on the webGoogle Scholar
  6. 6.
    Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply linked data principles to multimedia fragments. In: Proceedings of the 2nd workshop on linked data on the web (LDOW’09), Madrid, SpainGoogle Scholar
  7. 7.
    Hickson I (ed) (2012) HTML5 – a vocabulary and associated APIs for HTML and XHTML. W3C working draft. World Wide Web ConsortiumGoogle Scholar
  8. 8.
    Hickson I (ed) (2012) WebVTT. Living standard. World Wide Web ConsortiumGoogle Scholar
  9. 9.
    Kurz T, Schaffert S, Bürger T (2011) LMF a framework for linked media. In: Proceedings of the workshop on multimedia on the webGoogle Scholar
  10. 10.
    Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Strassner J (eds) (2012) Ontology for media resources 1.0. W3C recommendation. World Wide Web ConsortiumGoogle Scholar
  11. 11.
    Li Y, Wald M, Omitola T, Shadbolt N, Wills G (2012) Synote: weaving media fragments and linked data. In: Proceedings of the 5th workshop on linked data on the web (LDOW 2012), Lyon, FranceGoogle Scholar
  12. 12.
    Mozilla (2012) Popcorn.js. Accessed 24 April 2012
  13. 13.
    Pantos R (2012) HTTP live streaming. Accessed 24 April 2012
  14. 14.
    Shaw R, Troncy R, Hardman L (2009) LODE: linking open descriptions of events. In: Proceedings of the 4th Asian semantic web conference, Shanghai, China, pp 153–167Google Scholar
  15. 15.
    Stegmaier F, Lee W, Poppe C, Bailer W (eds) (2011) API for media resources 1.0. W3C candidate recommendation. World Wide Web ConsortiumGoogle Scholar
  16. 16.
    Steiner T (2010) Semwebvid - making video a first class semantic web citizen and a first class web bourgeois. In: Proceedings of the 9th international semantic web conference (ISWC 2010), Shanghai, ChinaGoogle Scholar
  17. 17.
    Troncy R, Mannens E (eds) (2009) Use cases and requirements for media fragments. W3C working draft. World Wide Web ConsortiumGoogle Scholar
  18. 18.
    Troncy R, Hardman L, van Ossenbruggen J, Hausenblas M (2007) Identifying spatial and temporal media fragments on the web. W3C video on the web workshopGoogle Scholar
  19. 19.
    Troncy R, Mannens E, Pfeiffer S, Van Deursen D (eds) (2012). Media fragments URI 1.0 (basic). W3C proposed recommendation. World Wide Web ConsortiumGoogle Scholar
  20. 20.
    Van Deursen D, Van Lancker W, De Bruyne S, De Neve W, Mannens E, Van de Walle R (2010) Format-independent and metadata-driven media resource adaptation using semantic web technologies. Multimed Syst 16(2):85–104CrossRefGoogle Scholar
  21. 21.
    Van Deursen D, Van Lancker W, De Neve W, Paridaens T, Mannens E, Van de Walle R (2010) NinSuna: a fully integrated platform for format-independent multimedia content adaptation and delivery based on semantic web technologies. Multimed Tools Appl 46(2–3):371–398 (Special Issue on Data Semantics for Multimedia Systems)CrossRefGoogle Scholar
  22. 22.
    Van Lancker W, Van Deursen D, Mannens E, Van de Walle R (2012) Implementation strategies for efficient media fragment retrieval. Multimed Tools Appl (2):243–267 (Special Issue on Recent Advances and Future Directions in Multimedia and Mobile Computing)Google Scholar
  23. 23.
    Verstockt S, Van Leuven S, Van de Walle R, Dermaut E, Torelle S, Gevaert W (2009) Actor recognition for interactive querying and automatic annotation in digital video. In: Proceedings of the 13th IASTED international conference on internet and multimedia systems and applications. ACTA Press, Honolulu, HI, USA, pp 149–155Google Scholar
  24. 24.
    Waitelonis J (2009.) Augmenting video search with linked open data. In: Proceedings of international conference on semantic systems (i-semantics), Graz, AustriaGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Davy Van Deursen
    • 1
  • Wim Van Lancker
    • 1
  • Erik Mannens
    • 1
  • Rik Van de Walle
    • 1
  1. 1.Department of Electronics and Information Systems – Multimedia LabGhent University – IBBTLedeberg-GhentBelgium

Personalised recommendations