Advertisement

The Embodied Morphemes of Gaze

  • Isabella Poggi
  • Francesca D’Errico
  • Alessia Spagnolo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5934)

Abstract

The paper presents some empirical studies aimed at singling out the meanings of specific items of gaze and of some of their parameters. It argues that the values on some parameters of gaze items are not comparable to phonemes in a verbal language, but rather to morphemes, since by themselves they convey some specific meanings. The different positions of the upper and lower eyelids are combined and the meanings conveyed by their possible values are investigated. It is found that wide open upper eyelids and raised lower eyelids convey activation and effort, while half open and half closed upper eyelids convey de-activation and relaxation. These embodied morphemes, stemming from particular physical states, become part of the meanings of gaze items conveyed by the combination of these eyelid positions.

Keywords

multimodality gaze lexicon morphemes embodied 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Allwood, J., Ahlsén, E., Lund, J., Sundqvist: Multimodality in Own communication management. In: Allwood, J., Dorriots, B., Nicholson, S. (eds.) Multimodal communication. Proceedings from the Second Nordic Conference on Multimodal communication, Gothenburg Papers in Theoretical Linguistics, Department of Linguistics, Goteborg University, pp. 43–62 (2005)Google Scholar
  2. Argyle, M., Cook, M.: Gaze and mutual gaze. Cambridge University Press, Cambridge (1976)Google Scholar
  3. Bavelas, J., Coates, L., Johnson, T.: Listeners as Co-narrators. J. Pers. & Soc. Psyc. 79(6), 941–952 (2000)CrossRefGoogle Scholar
  4. Baker-Schenk, C.: Nonmanual behaviors in sign languages: methodological concerns and recent findings. In: Stokoe, W., Volterra, V. (eds.) SRL 1983, Sign Language Research. Linstock Press, Silver Spring (1985)Google Scholar
  5. Bevacqua, E.: Computational model of listener behavior for Embodied Conversational Agents. PhD Thesis, Université Paris 8 – Università di Roma “La Sapienza” (2009)Google Scholar
  6. Bevacqua, E., Mancini, M., Niewiadomski, R., Pelachaud, C.: An expressive ECA showing complex emotions. In: Language, Speech and Gesture for Expressive Characters, AISB 2007, Newcastle, UK (2007)Google Scholar
  7. Boyes-Braem, P.: Significant Features of the handshape in American Sign Language. Unpublished PhD. Thesis, University of California, Berkeley (1981)Google Scholar
  8. Brunswik, E.: Representative design and probabilistic theory in a functional psychology. Psychological Review 62, 193–217 (1955)CrossRefGoogle Scholar
  9. Calbris, G.: The semiotics of French Gestures. Indiana University Press, Bloomington (1990)Google Scholar
  10. Calbris, G.: L’expression gestuelle de la pensée d’un homme politique. Ed. du CNRS, Paris (2003)Google Scholar
  11. Cassell, J.: Nudge nudge wink wink: Elements of Face-to-face-Conversation for Embodied Conversational Agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents. The MIT Press, Cambridge (2000)Google Scholar
  12. Darwin, C.: The Expression of the Emotions in Man and Animals. Appleton and Company, New York (1872)CrossRefGoogle Scholar
  13. Eibl-Eibesfeldt, I.: Similarities and differences between cultures in expressive movements. In: Hinde, R. (ed.) Non-verbal communication, pp. 297–314. Cambridge University Press, London (1972)Google Scholar
  14. Ekman, P.: About brows: Emotional and conversational signals. In: von Cranach, M., Foppa, K., Lepenies, W., Ploog, D. (eds.) Human ethology: Claims and limits of a new discipline: contributions to the Colloquium, pp. 169–248. Cambridge University Press, Cambridge (1979)Google Scholar
  15. Goodwin, C.: Il senso del vedere. In: Fabbri, P., Marrone, G. (eds.) Pratiche sociali della significazione. Meltemi, Roma (2003)Google Scholar
  16. Heylen, D.: A closer look at gaze. In: Pelachaud, C., André, E., Kopp, S., Ruttkay Z.M. (eds.) Creating Bonds with Embodied Conversational Agents. AAMAS Workshop, pp. 3–9 (2005)Google Scholar
  17. Kendon, A.: Some functions of gaze direction in social interaction. Acta Psych. 26, 1–47 (1967)CrossRefGoogle Scholar
  18. Kendon, A.: Abstraction in Gesture. Semiotica 90(3-4), 225–250 (1992)Google Scholar
  19. Kendon, A.: Gesture. Visible action as utterance. Cambridge University Press, Cambridge (2004)Google Scholar
  20. Klima, E.S., Bellugi, U.: The signs of language. Harvard University Press, Cambridge (1979)Google Scholar
  21. Kreidlin, G.E.: Neverbal´naia semiotika: Iazyk tela i estestvennyi iazyk. Novoe literaturnoe obozrenie, Moskva (2002)Google Scholar
  22. Maatman, R., Gratch, I., Marsella, S.: Natural behaviour of a listening agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 25–36. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  23. Peters, C., Pelachaud, C., Bevacqua, E., Mancini, M., Poggi, I.: A model of attention and interest using gaze behavior. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661, pp. 229–240. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  24. Poel, M., Heylen, D.K.J., Nijholt, A., Meulemans, M., van Bremen, A.: Gaze Behavior, Believability, Likability and the iCat. AI and Society. Nijholt, A., Stock, O., Nishida, T. (eds.) The Journal of Human-Centred Systems 24(1), 61–73 (2009)Google Scholar
  25. Poggi, I.: Mind, hands, face and body. A goal and belief view of multimodal communication. Weidler, Berlin (2007)Google Scholar
  26. Poggi, I., Pelachaud, C., de Rosis, F.: Eye communication in a conversational 3D synthetic agent. AI Communications (13), 169–181 (2000)Google Scholar
  27. Poggi, I., Roberto, E.: Meaningful eyes. In: Ahlsén, E., Henrichsen, P.J., Hirsch, R., Nivre, J., Abelin, A., Stroemqvist, S., Nicholson, S., Dorriots, B. (eds.) Communication – Action – Meaning. A festschrift to Jens Allwood, Department of Linguistics, Goteborg University, Goteborg, pp. 325–341 (2007)Google Scholar
  28. Poggi, I., Vincze, L.: The persuasive import of gesture and gaze. In: Proceeding on the Workshop on Multimodal Corpora, LREC, Marrakech, pp. 46–51 (2008)Google Scholar
  29. Posner, R.: Everyday gestures as a result of ritualization. In: Rector, M., Poggi, I., Trigo, N. (eds.) Gestures. Meaning and Use. Edicoes Universidade Fernando Pessoa, Porto (2003)Google Scholar
  30. Stokoe, W.C.: Sign Language Structure: An Outline of the Communicative Systems of the American Deaf. Linstock Press, Silver Spring (1978)Google Scholar
  31. Rossano, F.: When it’s over is it really over? On the effects of sustained gaze vs. gaze withdrawal at sequence possible completion. In: 9th International Pragmatics Conference, Riva del Garda, July 10-15 (2005)Google Scholar
  32. Thompson, R., Emmorey, K., Kluender, R.: The relationship between eye gaze and verb agreement in American Sign Language: an eye-tracking study. Natural Language & Linguistic Theory 24, 571–604 (2006)CrossRefGoogle Scholar
  33. Tomasello, M., Hare, B., Lehmann, H., Call, J.: Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis. Journal of Human Evolution 52(3), 314–320 (2007)CrossRefGoogle Scholar
  34. Underwood, G. (ed.): Cognitive Processes in Eye Guidance. Oxford University Press, Oxford (2005)Google Scholar
  35. Volterra, V.: La Lingua Italiana dei Segni. Il Mulino, Bologna (1987)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Isabella Poggi
    • 1
  • Francesca D’Errico
    • 1
  • Alessia Spagnolo
    • 1
  1. 1.Dipartimento di Scienze dell’EducazioneUniversità Roma TreRomaItaly

Personalised recommendations