Skip to main content

Mediated Faces

  • Conference paper
  • First Online:
Cognitive Technology: Instruments of Mind (CT 2001)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2117))

Included in the following conference series:

Abstract

Incorporating faces into mediated discussions is a complex design problem. The face conveys social and personal identity; it reports fleeting changes of emotion and the cumulative effects of often repeated expressions. The face both expresses and betrays: it shows what the person wishes to convey - and much more. We are highly attuned to recognizing and interpreting faces (though these interpretations are very subjective). Incorporating faces into mediated environments can be quite desirable: it helps the participants gain a stronger sense of their community and can potentially provide finely nuanced expression. Yet there are significant disadvantages and difficulties. The immediate identifying markers revealed by the face, e.g. race, gender, age, are not necessarily the initial information one wants to have of others in an ideal society. And much can be lost in the path from user’s thought to input device to output rendering. This essay discusses key social, cognitive and technical issues involved in incorporating faces in mediated communication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Argyle, M. and Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)

    Google Scholar 

  2. Aronson, E. The Social Animal. Freeman, NY (1988)

    Google Scholar 

  3. Ayatsuka, Y., Matsushita, N., Rekimoto, J.: ChatScape: a Visual Informal Communication Tool in Communities. In: CHI 2001 Extended Abstracts (2001) 327–328

    Google Scholar 

  4. Bruce, V. & Young, A.: In the eye of the beholder: The science of face perception. Oxford University Press, Oxford UK. (1998)

    Google Scholar 

  5. Burford D. and Blake, E.: Real-time facial animation for avatars in collaborative virtual environments. In: South African Telecommunications Networks and Applications Conference’ 99, (1999) 178–183

    Google Scholar 

  6. Chernoff H.: The use of faces to represent points in k-dimensional space graphically. In: Journal of American Statistic Association, Vol. 68 (1973) 331–368

    Google Scholar 

  7. Choissier, B.: Face Blind! http://www.choisser.com/faceblind/

  8. Darwin, C. and Ekman, P. (ed.): The Expression of the Emotions in Man and Animals. Oxford University Press, Oxford UK (1998)

    Google Scholar 

  9. Donath, J.: The illustrated conversation. In: Multimedia Tools and Applications, Vol 1 (1974) 79–88.

    Article  Google Scholar 

  10. Donath, J.: Identity and deception in the virtual community. In: Kollock, P. and Smith, M. (eds.): Communities in Cyberspace. Routledge, UK (1998)

    Google Scholar 

  11. P. Eisert, S. Chaudhuri and B. Girod.: Speech Driven Synthesis of Talking Head Sequences. In: 3D Image Analysis and Synthesis, Erlangen (1997) pp. 51–56

    Google Scholar 

  12. Ekman, P.: Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage. New York: W. W. Norton. (1992)

    Google Scholar 

  13. Ekman, P.: Should we call it expression or communication?. In Innovations in Social Science Research, Vol. 10, No. 4 (1997) pp 333–344.

    Article  Google Scholar 

  14. Essa, I, Basu, S. Darrell, T. Pentland, A.: Modeling, Tracking and Interactive Animation of Faces and Heads using Input from Video. In: Proceedings of Computer Animation’ 96 Conference, Geneva, Switzerland, IEEE Computer Society Press (1996)

    Google Scholar 

  15. Fernández-Dols, J. M and Carroll, J.M.: Context and Meaning. In: Russell, J.A, Fernández-Dols, J. M. (eds.): The Psychology of Facial Expression. University of Cambridge Press, Cambridge, UK (1997)

    Google Scholar 

  16. Forchheimer R. and Fahlander, O.: Low Bit-rate Coding Through Animation. In: Proceedings of Picture Coding Symposium. (March 1983) 113–114

    Google Scholar 

  17. Fridlund, A.J.: The new ethology of human facial expression. In: Russell, J.A, Fernández-Dols, J. M. (eds.): The Psychology of Facial Expression. University of Cambridge Press, Cambridge, UK (1997)

    Google Scholar 

  18. Frijda, N.H., Tcherkassof, A.: Facial expressions as modes of action readiness. In: Russell, J.A, Fernández-Dols, J. M. (eds.): The Psychology of Facial Expression. University of Cambridge Press, Cambridge, UK (1997)

    Google Scholar 

  19. Fujitsu Systems. New World Radio Manual, http://www.vzmembers.com/help/vz/communicate.html (1999)

  20. Herring, S.: Gender differences in computer-mediated communication. Miami: American Library Association (1994)

    Google Scholar 

  21. Hollan, Jim, and Stornetta, Scott. Beyond Being There. In Proceedings of CHI’ 92

    Google Scholar 

  22. Isaacs, E. & Tang, J.: What Video Can and Can’t Do for Collaboration: A Case Study. In: Multimedia Systems, 2, (1994) 63–73.

    Article  Google Scholar 

  23. Izard, C.E.: Emotions and facial expressions: A perspective from Differential Emotions Theory. In: Russell, J.A, Fernández-Dols, J. M. (eds.): The Psychology of Facial Expression. University of Cambridge Press, Cambridge, UK (1997)

    Google Scholar 

  24. Johnson, M., Dziurawiec, S., Ellis, H. and Morton, J.: Newborns’ preferential tracking of face-like stimuli and its subsequent decline. Cognition. 40. (1991)1–19.

    Article  Google Scholar 

  25. Kunda, Z.: Social Cognition: Making Sense of People. Cambridge, MA: MIT Press. (1999)

    Google Scholar 

  26. Lanier, J.: Virtually there. In: Scientific American, April 2001. pp 66–76 (2001)

    Google Scholar 

  27. Nakanishi, H., Yoshida, C, Nishimura, T. and Ishida, T.: FreeWalk: Supporting Casual Meetings in a Network. In: Proceedings of ACM Conference on Computer Supported Cooperative Work CSCW’96, (1996) 308–314

    Google Scholar 

  28. Nass, C., Steuer, J. and Tauber, E.: Computers are Social Actors. In: Proceedings for Chi’ 94., 72–78 (1994)

    Google Scholar 

  29. Ostermann, J., Beutnagel, M. Fischer, A., Wang, Y: Integration of Talking Heads and Text-to-Speech Synthesizers for Visual TTS. In: Proceedings of the International Conference on Speech and Language Processing, Sydney, Australia (1998)

    Google Scholar 

  30. Paulos, E. and Canny, J.: Designing Personal Tele-embodiment. In: IEEE International Conference on Robotics and Automation. (1998)

    Google Scholar 

  31. Pearson, D.E., and Robinson, J. A.: Visual Communication at Very Low Data Rates. In: Proceedings of the IEEE, vol. 4, (April 1985) 795–812

    Google Scholar 

  32. Picard, R. Affective Computing. MIT Press, Cambridge, MA (1997)

    Book  Google Scholar 

  33. Pollack, A.: Happy in the East (—) or Smiling:-) in the West. In: The New York Times, (Aug. 12, 1996) Section D page 5

    Google Scholar 

  34. Rocco, E.: Trust breaks down in electronic contexts but can be repaired by some initial face-to-face contact. In: Proceedings of CHI’ 98. (1998) 496–502.

    Google Scholar 

  35. Russell, J.A, Fernández-Dols, J. M.: What does a facial expression mean? In: Russell, J.A, Fernández-Dols, J. M. (eds.): The Psychology of Facial Expression. University of Cambridge Press, Cambridge, UK (1997)

    Chapter  Google Scholar 

  36. Scheirer, J., Fernandez, J. and Picard, R.: Expression Glasses: A Wearable Device for Facial Expression Recognition. In: Proceedings of CHI’ 99, Pittsburgh, PA (1999)

    Google Scholar 

  37. Sellen, A., Buxton, W. & Arnott, J.: Using spatial cues to improve videoconferencing. In: Proceedings of CHI’ 92 (1992) 651–652

    Google Scholar 

  38. Sproull, L. and Kiesler, S. Connections. Cambridge: MIT Press (1990)

    Google Scholar 

  39. Sproull, L, Subramani, R., Walker, J. Kiesler, S. and Waters, K.: When the interface is a face. In: Human Computer Interaction, Vol. 11: (1996) 97–124

    Article  Google Scholar 

  40. Stephenson, N. Snow Crash. Bantam, New York (1991)

    Google Scholar 

  41. Suler, J.. The psychology of avatars and graphical space. In: The Psychology of Cyberspace, http://www.rider.edu/users/suler/psycyber/psycyber.html (1999)

  42. Terzopoulos D.and Waters, K.: Analysis and synthesis of facial image sequences using physical and anatomical models. In: PAMI, 15(6) (1993) 569–579

    Article  Google Scholar 

  43. Valente, S. and Dugelay, J.-L.: Face tracking and Realistic Animations for Telecommunicant Clones. In: IEEE Multimedia Magazine, February (2000)

    Google Scholar 

  44. Vertegaal, R.:. The GAZE Groupware System: Mediating Joint Attention in Multiparty Communication and Collaboration. In: Proceedings of CHI’ 99. Pittsburgh, PA. (1999)

    Google Scholar 

  45. Viégas, F. and Donath, J.: Chat circles. In: Proceeding of the CHI’ 99 conference on Human factors in computing systems, (1999) 9–16

    Google Scholar 

  46. Vilhjálmsson, H.H. and Cassell, J.: BodyChat: autonomous communicative behaviors in avatars. In: Proceedings of the second international conference on Autonomous agents. Minneapolis, MN USA. (1998) 269–276

    Google Scholar 

  47. Waters, K.: A Muscle Model for Animating Three-Dimensional Facial Expression. In: ACM Computer Graphics, Volume 21, Number 4, (July 1987)

    Google Scholar 

  48. Whyte, W: City. Doubleday, New York. (1988)

    Google Scholar 

  49. Zebrowitz, L.: Reading Faces. Westview Press, Boulder, CO. (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Donath, J. (2001). Mediated Faces. In: Beynon, M., Nehaniv, C.L., Dautenhahn, K. (eds) Cognitive Technology: Instruments of Mind. CT 2001. Lecture Notes in Computer Science(), vol 2117. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44617-6_34

Download citation

  • DOI: https://doi.org/10.1007/3-540-44617-6_34

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42406-2

  • Online ISBN: 978-3-540-44617-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics