Skip to main content
SpringerLink
Log in

Semantic adaptation of multimedia documents

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Multimedia documents have to be played on multiple device types. Hence, usage and platform diversity requires document adaptation according to execution contexts, not generally predictable at design time. In an earlier work, a semantic framework for multimedia document adaptation was proposed. In this framework, a multimedia document is interpreted as a set of potential executions corresponding to the author specification. To each target device corresponds a set of possible executions complying with the device constraints. In this context, adapting requires to select an execution that satisfies the target device constraints and which is as close as possible from the initial composition. This theoretical adaptation framework does not specifically consider the main multimedia document dimensions, i.e., temporal, spatial and hypermedia. In this paper, we propose a concrete application of this framework on standard multimedia documents. For that purpose, we first define an abstract structure that captures the spatio-temporal and hypermedia dimensions of multimedia documents, and we develop an adaptation algorithm which transforms in a minimal way such a structure according to device constraints. Then, we show how this can be used for adapting concrete multimedia documents in SMIL through converting the documents in the abstract structure, using the adaptation algorithm, and converting it back in SMIL. This can be used for other document formats without modifying the adaptation algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Notes

  1. During the presentation, a narrative audio content commenting the images is played in parallel, however to avoid visual overloading we do not consider it in this paper.

  2. Our proposed classification extends the one presented in [26], especially the static and dynamic adaptation cases.

  3. The used continuous transformations are defined in [12] for the Allen relations and in [32] for the RCC8 relations.

  4. A path consistency function was preliminary defined for qualitative Allen temporal relations in [1].

  5. http://www.real.com/international/

  6. http://www.cwi.nl/projects/Ambulant/

  7. http://wam.inrialpes.fr/software/pocketsmil/

References

  1. Allen J (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832–843

    Article  MATH  Google Scholar 

  2. Amous I, Jedidi A, Sèdes F (2005) A contribution to multimedia document modeling and querying. Multimed Tools Appl 25(3):391–404

    Article  Google Scholar 

  3. Asadi MK, Dufourd JC (2004) Knowledge-based and semantic adaptation of multimedia content. In: Hobson P, Izquierdo E, Kompatsiaris Y, O’Connor NE (eds) Knowledge-based media analysis for self-adaptive and agile multimedia technology, pp 285–293

  4. Ayars J, Bulterman D, Cohen A, Day K, Hodge E, Hoschka P, Hyche E, Jourdan M, Kim M, Kubota K, Lanphier R, Layaïda N, Michel T, Newman D, van Ossenbruggen J, Rutledge L, Saccocio B, Schmitz P, ten Kate W (2005) Synchronized multimedia integration language (SMIL 2.0), 2nd edn. W3C http://www.w3.org/TR/2005/REC-SMIL2-20050107/

  5. Badros GJ, Borning A, Stuckey PJ (2001) The cassowary linear arithmetic constraint solving algorithm. ACM Trans Comput-Hum Interact (TOCHI) 8(4):267–306

    Article  Google Scholar 

  6. Bilasco IM, Gensel J, Villanova-Oliver M (2005) STAMP: a model for generating adaptable multimedia presentations. Multimed Tools Appl 25(3):361–375 (Special issue on metadata and adaptibility in web-based information systems)

    Article  Google Scholar 

  7. Bormans J, Hill K (2002) MPEG-21 overview v.5. ISO/IEC JTC1/SC29/WG11/N5231. http://www.chiariglione.org/mpeg/standards/mpeg-21/mpeg-21.htm

  8. Bra PD, Smits D, Stash N (2006) The design of AHA! In: Wiil UK, Nürnberg PJ, Rubart J (eds) Proceedings of the 17th ACM conference on hypertext and hypermedia ACM Press, pp 133–134

  9. Brusilovsky P (1996) Methods and techniques of adaptive hypermedia. User Model User-Adapt Interact 6(2–3):87–129

    Article  Google Scholar 

  10. Condotta JF, Ligozat G, Saade M (2007) Eligible and frozen constraints for solving temporal qualitative constraint networks. In: Proceedings of the 13th international conference on principles and practice of constraint programming, pp 806–814

  11. Euzenat J, Layaïda N, Dias V (2003) A semantic framework for multimedia document adaptation. In: Proceedings of the 18th international joint conference on artificial intelligence, pp 31–36

  12. Freksa C (1992) Temporal reasoning based on semi-intervals. Artif Intell 54(1–2):199–227

    Article  MathSciNet  Google Scholar 

  13. Gerevini A, Nebel B (2002) Qualitative spatio-temporal reasoning with RCC-8 and Allen’s interval calculus: computational complexity. In: Proceedings of the 15th European conference on artificial intelligence, pp 312–316

  14. Geurts J, van Ossenbruggen J, Hardman L (2001) Application-specific constraints for multimedia presentation generation. In: Proceedings of the international conference on multimedia modeling, pp 247–266

  15. Grifoni P (2009) Multimodal fission. In: Grifoni P (ed) Multimodal human computer interaction and pervasive services, chapter 6. IGI Global, pp 103–120

  16. Hardman L, Bulterman DCA, van Rossum G (1994) The Amsterdam hypermedia model: adding time and context to the Dexter model. Commun ACM 37(2):50–62

    Article  Google Scholar 

  17. He J, Gao T, Hao W, Yen IL, Bastani F (2007) A flexible content adaptation system using a rule-based approach. IEEE Trans Knowl Data Eng 19(1):127–140

    Article  Google Scholar 

  18. Jannach D, Leopold K, Timmerer C, Hellwagner H (2006) A knowledge-based framework for multimedia adaptation. Appl Intell 24(2):109–125

    Article  Google Scholar 

  19. Kirda E, Kerer C (2005) DIWE: A framework for constructing device-independent web applications. In: Ubiquitous Mobile Information and Collaboration Systems, LNCS 3272, Springer, pp 96–110

  20. Klyne G, Reynolds F, Woodrow C, Ohto H, Hjelm J, Butler MH, Tran L (2001) Composite capability/preference profiles (CC/PP): Structure and vocabularies 1.0. W3C. http://www.w3.org/TR/CCPP-struct-vocab/

  21. Laborie S (2006) Spatio-temporal proximities for multimedia document adaptation. In: Proceedings of the 12th international conference on artificial intelligence: methodology, systems, applications. LNAI 4183, Springer, pp 128–137

  22. Laborie S (2009) A screencast of our SMIL document adaptation prototype. http://www.irit.fr/PERSONNEL/SIG/laborie/videos/ScreenCast-Adaptation.mov

  23. Laborie S, Euzenat J (2008) An incremental framework for adapting the hypermedia structure of multimedia documents. In: Wallace M, Angelides M, Mylonas P (eds) Advances in semantic media adaptation and personalization of studies in computational intelligence series, chapter 8, vol 93, Springer, pp 157–176

  24. Laborie S, Euzenat J, Layaïda N (2006) A spatial algebra for multimedia document adaptation. In: Poster proceedings of the first international conference on semantic and digital media technologies, pp 7–8

  25. Layaïda N (1997) Madeus: système d’édition et de présentation de documents structurés multimédia. PhD thesis, Université Joseph Fourier (Grenoble, France)

  26. Lei Z, Georganas ND (2001) Context-based media adaptation in pervasive computing. In: Proceedings of Canadian conference on electrical and computer engineering, vol 2, pp 913–918

  27. Lemlouma T, Layaïda N (2001) The negotiation of multimedia content services in heterogeneous environments. In: Proceedings of the 8th international conference on multimedia modeling, pp 187–206

  28. Lemlouma T, Layaïda N (2004) Context-aware adaptation for mobile devices. In: Proceedings of the 5th IEEE international conference on mobile data management, pp 106–111

  29. Nebel B (1996) Solving hard qualitative temporal reasoning problems: evaluating the efficiency of using the ORD-horn class. In: Proceedings of the 12th European conference on artificial intelligence, pp 38–42

  30. Open Mobile Alliance (2008) Multimedia messaging service conformance document. http://www.openmobilealliance.org/Technical/release_program/docs/MMS/V1_3-20080128-C/OMA-TS-MMS-CONF-V1_3-20080128-C.pdf

  31. Rabin J, McCathieNevile C (2008) Mobile Web best practices 1.0. W3C. http://www.w3.org/TR/mobile-bp/

  32. Randell DA, Cui Z, Cohn A (1992) A spatial logic based on regions and connection. In: Nebel B, Rich C, Swartout W (eds) Principles of knowledge representation and reasoning: Proceedings of the third international conference, Morgan Kaufmann, pp 165–176

  33. Roisin C (1998) Authoring structured multimedia documents. In: Proceedings of the conference on current trends in theory and practice of informatics, pp 222–239

  34. Rousseau F, García-Marcías JA, de Lima JV, Duda A (1999) User adaptable multimedia presentations for the world wide web. In: Proceedings of the 8th international conference on world wide web, Elsevier North-Holland, Inc, pp 1273–1290

  35. Scherp A, Boll S (2005) MM4U - a framework for creating personalized multimedia content. In: Managing multimedia semantics, chapter 11. IRM Press, pp 246–287

  36. Shao B, Velazquez LM, Scaringella N, Singh N, Mattavelli M (2006) SMIL to MPEG-4 BIFS conversion. In: AXMEDIS ’06: Proceedings of the second international conference on automated production of cross media content for multi-channel distribution, IEEE computer society, pp 77–84

  37. van Beek P, Manchak DW (1996) The design and experimental analysis of algorithms for temporal reasoning. J Artif Intell Res 4:1–18

    MATH  Google Scholar 

  38. Vetro A, Christopoulos C, Ebrahimi T (eds) (2003) From the guest editors - universalmultimedia access. In: IEEE signal processing magazine, special issue on universal multimedia access, vol 20 of 2. IEEE Press, p 16

  39. W3C (2005) Mobile web initiative. http://www.w3.org/2005/MWI/Activity.html

  40. W3C (2010) Ubiquitous Web Domain. http://www.w3.org/UbiWeb/

Download references

Author information

Authors and Affiliations

  1. IRIT – Université Paul Sabatier, 118 Route de Narbonne, 31062, Toulouse Cedex 9, France

    Sébastien Laborie

  2. INRIA Grenoble Rhône-Alpes & LIG, 655 Avenue de l’Europe, Montbonnot, 38334, Saint Ismier Cedex, France

    Jérôme Euzenat & Nabil Layaïda

Authors
  1. Sébastien Laborie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jérôme Euzenat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nabil Layaïda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sébastien Laborie.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Laborie, S., Euzenat, J. & Layaïda, N. Semantic adaptation of multimedia documents. Multimed Tools Appl 55, 379–398 (2011). https://doi.org/10.1007/s11042-010-0552-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0552-9

Keywords

Search

Navigation