Skip to main content
SpringerLink
Log in

Experiencing standardized media fragment annotations within HTML5

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

W3C’s Video in the Web activity aims at a better integration of media within the Web. In this paper, we show how two specifications currently under development within this activity, i.e., Media Fragment URIs and Media Annotations, can be combined within media-enabled HTML5 Web applications. In particular, we introduce a number of extensions for the Media Annotations ontology in order to close the gap with Media Fragment URIs. Additionally, we show how rich media fragment annotations can be converted into a WebVTT file. The latter can be used by HTML5-enabled players to show the annotations in a synchronized way. Further, a fully integrated Web application has been developed that shows how both specifications can work together within an HTML5 environment. This application relies on NinSuna, our media delivery platform targeted at multichannel publication that provides server-side support for both Media Fragment URIs and Media Annotations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://www.w3.org/2008/WebVideo/Activity.html

  2. http://www.w3.org/2008/WebVideo/Annotations/

  3. http://en.wikipedia.org/wiki/SubRip

  4. The ontology, called the NinSuna ontology, is available at http://multimedialab.elis.ugent.be/organon/ontologies/ninsuna.

  5. http://json-ld.org/

  6. http://docs.api.talis.com/platform-api/output-types/rdf-json

  7. http://ninsuna.elis.ugent.be

  8. http://www.w3.org/2001/tag/issues.html#httpRange-14

  9. http://radiohead-prague.nataly.fr/

  10. The application is available at http://ninsuna.elis.ugent.be/Showcase/.

References

  1. Fialho A, Troncy R, Hardman L, Saathoff C, Scherp A (2010) What’s on this evening? Designing user support for event-based annotation and exploration of media. In: Proceedings of the 1st international workshop on EVENTS 2010 - recognising and tracking events on the web and in real life, Athens, Greece, pp 40–54

  2. Google (2012) YouTube video annotations. http://www.youtube.com/t/annotations_about. Accessed 24 April 2012

  3. Haslhofer B, Jochum W, King R, Sadilek C, Schellner K (2009) The LEMO annotation framework: weaving multimedia annotations with the web. Int J Digit Libr 10(1):15–32

    Article  Google Scholar 

  4. Haslhofer B, Momeni E, Gay M, Simon R (2010) Augmenting Europeana content with linked data resources. In: Proceedings of the 6th international conference on semantic systems (I-SEMANTICS ’10), Graz, Austria, pp 40:1–40:3

  5. Haslhofer B, Simon R, Sanderson R, Van De Sompel H (2011) The open annotation collaboration (OAC) model. In: Proceedings of the workshop on multimedia on the web

  6. Hausenblas M, Troncy R, Raimond Y, Bürger T (2009) Interlinking multimedia: how to apply linked data principles to multimedia fragments. In: Proceedings of the 2nd workshop on linked data on the web (LDOW’09), Madrid, Spain

  7. Hickson I (ed) (2012) HTML5 – a vocabulary and associated APIs for HTML and XHTML. W3C working draft. World Wide Web Consortium

  8. Hickson I (ed) (2012) WebVTT. Living standard. World Wide Web Consortium

  9. Kurz T, Schaffert S, Bürger T (2011) LMF a framework for linked media. In: Proceedings of the workshop on multimedia on the web

  10. Lee W, Bailer W, Bürger T, Champin P-A, Malaisé V, Michel T, Sasaki F, Söderberg J, Stegmaier F, Strassner J (eds) (2012) Ontology for media resources 1.0. W3C recommendation. World Wide Web Consortium

  11. Li Y, Wald M, Omitola T, Shadbolt N, Wills G (2012) Synote: weaving media fragments and linked data. In: Proceedings of the 5th workshop on linked data on the web (LDOW 2012), Lyon, France

  12. Mozilla (2012) Popcorn.js. http://popcornjs.org. Accessed 24 April 2012

  13. Pantos R (2012) HTTP live streaming. http://tools.ietf.org/html/draft-pantos-http-live-streaming-08. Accessed 24 April 2012

  14. Shaw R, Troncy R, Hardman L (2009) LODE: linking open descriptions of events. In: Proceedings of the 4th Asian semantic web conference, Shanghai, China, pp 153–167

  15. Stegmaier F, Lee W, Poppe C, Bailer W (eds) (2011) API for media resources 1.0. W3C candidate recommendation. World Wide Web Consortium

  16. Steiner T (2010) Semwebvid - making video a first class semantic web citizen and a first class web bourgeois. In: Proceedings of the 9th international semantic web conference (ISWC 2010), Shanghai, China

  17. Troncy R, Mannens E (eds) (2009) Use cases and requirements for media fragments. W3C working draft. World Wide Web Consortium

  18. Troncy R, Hardman L, van Ossenbruggen J, Hausenblas M (2007) Identifying spatial and temporal media fragments on the web. W3C video on the web workshop

  19. Troncy R, Mannens E, Pfeiffer S, Van Deursen D (eds) (2012). Media fragments URI 1.0 (basic). W3C proposed recommendation. World Wide Web Consortium

  20. Van Deursen D, Van Lancker W, De Bruyne S, De Neve W, Mannens E, Van de Walle R (2010) Format-independent and metadata-driven media resource adaptation using semantic web technologies. Multimed Syst 16(2):85–104

    Article  Google Scholar 

  21. Van Deursen D, Van Lancker W, De Neve W, Paridaens T, Mannens E, Van de Walle R (2010) NinSuna: a fully integrated platform for format-independent multimedia content adaptation and delivery based on semantic web technologies. Multimed Tools Appl 46(2–3):371–398 (Special Issue on Data Semantics for Multimedia Systems)

    Article  Google Scholar 

  22. Van Lancker W, Van Deursen D, Mannens E, Van de Walle R (2012) Implementation strategies for efficient media fragment retrieval. Multimed Tools Appl (2):243–267 (Special Issue on Recent Advances and Future Directions in Multimedia and Mobile Computing)

  23. Verstockt S, Van Leuven S, Van de Walle R, Dermaut E, Torelle S, Gevaert W (2009) Actor recognition for interactive querying and automatic annotation in digital video. In: Proceedings of the 13th IASTED international conference on internet and multimedia systems and applications. ACTA Press, Honolulu, HI, USA, pp 149–155

  24. Waitelonis J (2009.) Augmenting video search with linked open data. In: Proceedings of international conference on semantic systems (i-semantics), Graz, Austria

Download references

Acknowledgements

The research activities as described in this paper were funded by Ghent University, the Interdisciplinary Institute for Broadband Technology (IBBT), the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT), the Fund for Scientific Research-Flanders (FWO-Flanders), and the European Union.

Author information

Authors and Affiliations

  1. Department of Electronics and Information Systems – Multimedia Lab, Ghent University – IBBT, Gaston Crommenlaan 8/201, 9050, Ledeberg-Ghent, Belgium

    Davy Van Deursen, Wim Van Lancker, Erik Mannens & Rik Van de Walle

Authors
  1. Davy Van Deursen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wim Van Lancker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Erik Mannens
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rik Van de Walle
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Davy Van Deursen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Van Deursen, D., Van Lancker, W., Mannens, E. et al. Experiencing standardized media fragment annotations within HTML5. Multimed Tools Appl 70, 827–846 (2014). https://doi.org/10.1007/s11042-012-1129-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1129-6

Keywords

Search

Navigation