Multimedia Tools and Applications

, Volume 77, Issue 23, pp 30437–30474 | Cite as

Spatial reasoning about multimedia document for a profile based adaptation

Combining distances, directions and topologies
  • Yehya BelhadadEmail author
  • Allaoua Refoufi
  • Philippe Roose


The continuous evolution of smart devices has led to serious limitations in multimedia applications. The multimedia graphic design and animation and the increased use of rich and complex multimedia content on the web or other media have all created a need to diversify the accessibility of the content. Therefore several techniques are used today to design a universally accessible content. The main techniques that are still used to maintain accessibility is to create two parallel streams of design and development of the same content. Thus, the continuous evolution will certainly lead to create other streams. For this, the automatic reasoning on multimedia to allow a computer to modify the design according to different variables, devices capabilities, user status and context to provide personalized adapted content. In this paper, we propose an abstract document model called XMS short for XML Multimedia Specification; it describes the composition of an original multimedia document and can be extended to any document type. We present how we may use spatial information present in this document to adapt and modify the original document. We mainly focus on the spatial aspect of a web document, a combination of RCC8, qualitative distances, and directions are used to describe the layout of a set of objects. The level of granularity of the definition of the objects defines the level of details that will be processed by our PROLOG based inference system, simplified versions of algorithms from the inference system and how it works on the spatial dimension of the document are shown. In the end samples of how spatial relations manipulation algorithms work are illustrated.


Content adaptation Multimedia document Spatial reasoning PROLOG Inference 


  1. 1.
    Adel A, Laborie S, Roose P (2014) Semantic context-aware adaptation platform architecture. Procedia Comput Sci 32:959–964CrossRefGoogle Scholar
  2. 2.
    Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832–843CrossRefGoogle Scholar
  3. 3.
    Archana P, Kulkarni SS (2015) Meta-heuristic approach for resource optimization in mobile real time video traffic. Int J Comput Appl 110:14Google Scholar
  4. 4.
    Bulterman DC, Rutledge LW (2008) SMIL 3.0: flexible multimedia for web mobile devices and daisy talking books. Springer Publishing Company IncorporatedGoogle Scholar
  5. 5.
    Burnett I, Van de Walle R, Hill K, Bormans J, Pereira F (2003) Mpeg-21: goals and achievements. IEEE MultiMed 10(4):60–70CrossRefGoogle Scholar
  6. 6.
    Burnett IS, Pereira F, Van de Walle R, Koenen R (2006) The MPEG-21 book. WileyGoogle Scholar
  7. 7.
    Cavallaro A (2005) Universal multimedia access. In: Encyclopedia of multimedia technology and networking. IGI Global, pp 1001–1007Google Scholar
  8. 8.
    Chuang KS, Tzeng HL, Chen S, Wu J, Chen TJ (2006) Fuzzy c-means clustering with spatial information for image segmentation. Comput Medical Imag Graph 30(1):9–15CrossRefGoogle Scholar
  9. 9.
    De Bra P, Smits D, Stash N (2006) The design of aha! In: Proceedings of the seventeenth conference on hypertext and hypermedia. ACM, pp 133–134Google Scholar
  10. 10.
    Dromzée C, Laborie S, Roose P (2013) A semantic generic profile for multimedia documents adaptation. In: Intelligent Multimedia technologies for networking applications: techniques and tools, pp 225–246Google Scholar
  11. 11.
    Ellis TJ (2001) Multimedia enhanced educational products as a tool to promote critical thinking in adult students. J Educ Multimed Hypermed 10(2):107–124MathSciNetGoogle Scholar
  12. 12.
    Euzenat J, Layaïda N, Dias V (2003) A semantic framework for multimedia document adaptation. In: Proceedings of the 18th international joint conference on artificial intelligence IJCAI’2003. Morgan Kauffman, Acapulco, pp 31–36
  13. 13.
    Frank AU (1992) Qualitative spatial reasoning about distances and directions in geographic space. J Vis Lang Comput 3(4):343–371CrossRefGoogle Scholar
  14. 14.
    Frank AU (1996) Qualitative spatial reasoning: cardinal directions as an example. Int J Geogr Inf Sci 10(3):269–290CrossRefGoogle Scholar
  15. 15.
    Freire J, Kumar B, Lieuwen D (2001) Webviews: accessing personalized web content and services. In: Proceedings of the 10th international conference on World Wide Web. ACM, pp 576–586Google Scholar
  16. 16.
    Gerevini A, Nebel B (2002) Qualitative spatio-temporal reasoning with rcc-8 and allen’s interval calculus: computational complexity. In: Proceedings of the 15th European conference on artificial intelligence. IOS Press, pp 312–316Google Scholar
  17. 17.
    Gerevini A, Renz J (2002) Combining topological and size information for spatial reasoning. Artif Intell 137(1–2):1–42MathSciNetCrossRefGoogle Scholar
  18. 18.
    Geurts J, van Ossenbruggen JR, Hardman HL (2001) Application-specific constraints for multimedia presentation generation. Centrum voor Wiskunde en InformaticaGoogle Scholar
  19. 19.
    Hardman L, Bulterman DC, Van Rossum G (1994) The amsterdam hypermedia model: adding time and context to the Dexter model. Commun ACM 37(2):50–62CrossRefGoogle Scholar
  20. 20.
    He J, Gao T, Hao W, l Yen I, Bastani F (2007) A flexible content adaptation system using a rule-based approach. IEEE Trans Knowl Data Eng 19 (1):127–140. CrossRefGoogle Scholar
  21. 21.
    Held A, Buchholz S, Schill A (2002) Modeling of context information for pervasive computing applications. In: Proceedings of SCI, pp 167–180Google Scholar
  22. 22.
    Jones CB, Purves R, Ruas A, Sanderson M, Sester M, Van Kreveld M, Weibel R (2002) Spatial information retrieval and geographical ontologies an overview of the spirit project. In: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 387–388Google Scholar
  23. 23.
    Katai Z, Toth L (2010) Technologically and artistically enhanced multi-sensory computer-programming education. Teach Teacher Educ 26(2):244–251CrossRefGoogle Scholar
  24. 24.
    Kiss C (2007) Composite capability/preference profiles (cc/pp): structure and vocabularies 2.0. W3C Working Draft, p 30Google Scholar
  25. 25.
    Lan X, Ma AJ, Yuen PC (2014) Multi-cue visual tracking using robust feature-level fusion based on joint sparse representation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1194–1201Google Scholar
  26. 26.
    Lan X, Zhang S, Yuen PC (2016) Robust joint discriminative feature learning for visual tracking. In: IJCAI, pp 3403–3410Google Scholar
  27. 27.
    Lan X, Zhang S, Yuen PC, Chellappa R (2018) Learning common and feature-specific patterns: a novel multiple-sparse-representation-based tracker. IEEE Trans Image Process 27(4):2022–2037MathSciNetCrossRefGoogle Scholar
  28. 28.
    Lasch P, Naumann D (1998) Ft-ir microspectroscopic imaging of human carcinoma thin sections based on pattern recognition techniques. Cellular Molec Biol (Noisy-le-Grand France) 44(1):189–202Google Scholar
  29. 29.
    Lei Z, Georganas ND (2001) Context-based media adaptation in pervasive computin. In: Canadian Conference on electrical and computer engineering, 2001, vol 2. IEEE, pp 913–918Google Scholar
  30. 30.
    Li Q, Yang J, Zhuang Y (2008) Multimedia information retrieval at a crossroad. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 242–249Google Scholar
  31. 31.
    Louafi H, Coulombe S, Chandra U (2015) Robust qoe-aware prediction-based dynamic content adaptation framework applied to slides documents in mobile web conferencing. Multimed Tools Appl 74(18):7883–7920CrossRefGoogle Scholar
  32. 32.
    Mohan R, Smith JR, Li CS (1999) Adapting multimedia internet content for universal access. IEEE Trans Multimed 1(1):104–114CrossRefGoogle Scholar
  33. 33.
    Osbakk P, Ryan NS (2002) Context, cc/pp, and p3p. UbiComp 2002 adjunct proceedings, pp 9–10Google Scholar
  34. 34.
    Renz J (2002) Qualitative spatial reasoning with topological information. Springer-VerlagGoogle Scholar
  35. 35.
    Reynolds F (1999) Composite capability/preference profiles (cc/pp): a user side framework for content negotiation. W3C noteGoogle Scholar
  36. 36.
    Saravanaselvam N, Rajangam K, Dhanam L, Balasubramanian A (2015) Mobile web browsing based on content preserving with reduced cost. Int J Adv Network Appl 6(4):2398Google Scholar
  37. 37.
    Scherp A, Boll S (2008) Mm4u: A framework for creating personalized multimedia content. In: Multimedia technologies: concepts, methodologies, tools, and applications. IGI Global, pp 325–363Google Scholar
  38. 38.
    Sharma J, Flewelling DM (1995) Inferences from combined knowledge about topology and directions. In: International Symposium on spatial databases. Springer, pp 279–291Google Scholar
  39. 39.
    Van Essen DC, Anderson CH, Felleman DJ (1992) Information processing in the primate visual system: an integrated systems perspective. Science 255(5043):419–423CrossRefGoogle Scholar
  40. 40.
    Vetro A (2004) Mpeg-21 digital item adaptation: enabling universal multimedia access. IEEE Multimed 11(1):84–87MathSciNetCrossRefGoogle Scholar
  41. 41.
    Wang Y, Kim JG, Chang SF, Kim HM (2007) Utility-based video adaptation for universal multimedia access (uma) and content-based utility function prediction for real-time video transcoding. IEEE Trans Multimed 9(2):213–220CrossRefGoogle Scholar
  42. 42.
    Yuan Z, Ghinea G, Muntean GM (2015) Beyond multimedia adaptation: quality of experience-aware multi-sensorial media delivery. IEEE Trans Multimed 17 (1):104–117CrossRefGoogle Scholar
  43. 43.
    Zhang D, Jangam A, Zhou L, Yakut I (2015) Context-aware multimedia content adaptation for mobile web. Int J Netw Distrib Comput 3(1):1–10CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.University of Ferhat Abbes Setif 1SetifAlgeria
  2. 2.LIUPPA, IUT de BayonneAngletFrance

Personalised recommendations