Semiotic-based Conceptual Modelling of Hypermedia

  • Elio Toppano
  • Vito Roberto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8157)


We address the conceptual modelling of hypermedia regarded as semiotic texts, whose meanings are conceived by a designer, transferred through the artifact and interpreted by users within their context. We outline the communication framework, with the artifact embedding the images of the designer and user. The full model is represented in terms of four interrelated modules: story, discourse, text and social-relational ontologies. The first and second one account for the narrative structures underlying the hypermedia content, which is externalized through sensorial qualities that, in turn, evoke impressions into the user. The model addresses issues that are poorly covered by the description standard MPEG-7. It can be used for analysis, evaluation, indexing of existing hypermedia as well as the design of new ones.


Modelling hypermedia ontologies semiotics 


  1. 1.
    Wright, P., Wallace, J., McCarthy, J.: Aesthetic and Experience-Centered Design. ACM Transactions on Computer-Human Interaction 15(4), Article 18 (2008)Google Scholar
  2. 2.
    Kazmierczak, E.: Design as meaning making: from making things to the design of thinking. Design Studies 19(2), 45–59 (2003)Google Scholar
  3. 3.
    Crilly, N., Maier, A., Clarkson, P.J.: Representing Artifacts as Media: Modelling the Relationship between Designer Intent and Consumer Experience. Journal of Design 2(3), 15–27 (2008)Google Scholar
  4. 4.
    Desmet, P., Hekkert, P.: Framework of product experience. International Journal of Design (1), 57–66 (2007)Google Scholar
  5. 5.
    Hardman, L., Bulterman, D.C.A., van Rossum, G.: The Amsterdam Hypermedia Model: adding time and context to the Dexter model. Communications of the ACM 37(2), 50–62 (1994)CrossRefGoogle Scholar
  6. 6.
    Montero, S., Diaz, P., Aedo, I.: A framework for the analysis and comparison of hypermedia design methods. In: Proc. Applied Informatics 2003, pp. 1053–1058 (2003)Google Scholar
  7. 7.
    Sieckenius De Souza, C.: The Semiotic Engineering of Human-Computer Interaction. The MIT Press, Cambridge (2004)Google Scholar
  8. 8.
    Gangemi, A., Borgo, S., Catenacci, C., Lehmann, J.: Metokis: Task taxonomies for knowledge content. Deliverable D07, Laboratory of Applied Ontology, IRST-CNR (Italy), 80–84 (2005)Google Scholar
  9. 9.
    Toppano, E., Roberto, V.: Semiotic Design and Analysis of Hypermedia. In: Proc. 20th ACM Conference on Hypertext and Hypermedia, HT 2009, Turin, Italy, pp. 367–368 (2009)Google Scholar
  10. 10.
    Benitez, A.B., Martinez, J.M., Rising, H., Salembier, P.: Description of a single multimedia document. In: Manjunath, B.S., Salembier, P., Sikora, T. (eds.) Introduction to MPEG 7: Multimedia Content Description Language, pp. 111–138. Wiley (2002)Google Scholar
  11. 11.
    Martinez, J.M.: MPEG-7 Overview. ISO/IEC JTC1/SC29/WG11 N6828, Palma de Mallorca, Spain (2004)Google Scholar
  12. 12.
    Martinez, J.M., Koenen, R., Pereira, F.: MPEG-7: the generic Multimedia Content Description Standard. Part 1. IEEE Multimedia, 78–87 (2002)Google Scholar
  13. 13.
    Martinez, J.M., Koenen, R., Pereira, F.: MPEG-7: overview of MPEG-7 Description Tools. Part 2. IEEE Multimedia, 83–93 (July-September 2002)Google Scholar
  14. 14.
    Hunter, J.: Adding Multimedia to the Semantic Web – Building an MPEG-7 Ontology. In: Stamou, G., Kollias, S. (eds.) Multimedia Content and the Semantic Web, ch. 3. Wiley (2005)Google Scholar
  15. 15.
    Peirce, C.S.: Collected Writings. In: Hartshorne, C., Weiss, P., Burks, A.W. (eds.), Harvard Univ. Press, Cambridge (1931)Google Scholar
  16. 16.
    Greimas, A.J., Courts, P.: An Analytical Dictionary. Indiana University Press, Bloomington (1982)Google Scholar
  17. 17.
    Lowe, N.J.: A cognitive model. In: Bernstein, M., Gerco, D. (eds.) Reading Hypertext. Eastgate Systems (2009)Google Scholar
  18. 18.
    Kress, G., van Leeuwen, T.: Reading Images. The Grammar of Visual Design, Routledge (2003)Google Scholar
  19. 19.
    Buchanan, R.: Declaration by design: rhetoric, argument, and demonstration in design practice. Design Issues 2(1), 4–22 (1985)CrossRefGoogle Scholar
  20. 20.
    Hekkert, P.: Design Aesthetics: principles of pleasure in design. Psychology Science 48(2), 157–172 (2006)Google Scholar
  21. 21.
    Hekkert, P., Leder, H.: Product aesthetics. In: Schifferstein, Hekkert (eds.) Product Experience, ch. 10. Elsevier Science (2007)Google Scholar
  22. 22.
    Blythe, M., Hassenzahl, M.: The semantic of fun: differentiating enjoyable experiences. In: Blythe, M.A., Monk, A.F., Overbeeke, K., Wright, P.C. (eds.) Funology: from Usability to Enjoyment, pp. 91–100. Kluwer Academic Publisher (2003)Google Scholar
  23. 23.
    Demir, E., Desmet, P.M.A., Hekkert, P.: Appraisal patterns of emotions in human–product interaction. International Journal of Design 3(2), 41–51 (2009)Google Scholar
  24. 24.
    Russel, J.A.: A circumplex model of affect. Journal of Personality and Social Psychology 39(6), 1161–1178 (1980)CrossRefGoogle Scholar
  25. 25.
    Bartle, R.: Presence and Flow: ill-fitting clothes for virtual worlds. Techne 10(3), Article 4 (2007)Google Scholar
  26. 26.
    Kouprie, M., Visser, F.S.: A framework for empathy in design: stepping into and out of the user’ s life. Journal of Engineering Design 20(5), 437–448 (2009)CrossRefGoogle Scholar
  27. 27.
    Lim, Y., Lee, S., Kim, D.: Interactivity attributes for expression-oriented Interaction Design. International Journal of Design 5(3), 113–128 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Elio Toppano
    • 1
  • Vito Roberto
    • 1
  1. 1.Department of InformaticsUniversity of UdineItaly

Personalised recommendations