Skip to main content

Emotion-oriented Human–Computer Interaction

  • Chapter
Emotional Engineering

Abstract

In the information-oriented society, people spend a lot of time interacting with computer systems. Therefore, we need to develop devices which make it a pleasure to interact with computer systems. In human face-to-face communication, nonverbal messages such as facial expressions, gestures, body movements, and postures can convey a speaker’s emotions better than verbal messages. Among verbal messages, chiming in to express a listener’s support and repeating the speaker’s utterances can convey the listener’s emotions, encourage the speaker to continue his/her talk, and make the conversation go smoothly. Therefore, we have developed several human–computer interactive systems using facial expressions as a human interface, and have constructed a human–computer interface which chimed in with the user and repeated the user’s responses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ellison J.W., Massaro DW.: Featural evaluation, integration, and judgment of facial affect. J. Exp. Psychol. Human Perception Perform. 23(1):213–226(1977)

    Article  Google Scholar 

  2. Iwata M., Onisawa T.: Route decision system associating with facial expression. J. Jpn. Soc. Fuzzy Theor. Syst. 8(3):532–540 (in Japanese) (1996)

    Google Scholar 

  3. Onisawa T., Date D.: Personified game playing support system. Jpn. J. Ergonomics 35(3):157–167 (in Japanese) (1999)

    Google Scholar 

  4. Yamashita T. et al.: A study on characteristics of faces as a human interface. J. Jpn. Soc. Fuzzy Theor. Syst. 14(2):248–253 (in Japanese) (2002)

    Google Scholar 

  5. Yamashita T.: An application of human mind to engineering. J. Soc. Biomech. 28(2):72–78 (in Japanese) (2004)

    Article  Google Scholar 

  6. Yamashita T., Koseki H.: An application of fuzzy reasoning to facial selection. Jpn. J. Edu. Technol. 22(3):193–199 (in Japanese) (1998)

    Google Scholar 

  7. Yamashita T. et al.: An application of facial selection model by fuzzy reasoning to human interface. J. Jpn. Soc. Fuzzy Theor. Syst. 12(2):313–320 (in Japanese) (2000)

    Google Scholar 

  8. Yamashita T., Sakai H.: Face selection model by fuzzy reasoning and its application to computer game. Jpn. J. Ergonomics 36(3):139–145 (in Japanese) (2000)

    Google Scholar 

  9. Ichimura T. et al.: Approach to emotion oriented intelligent system by parallel sand glass type neural networks and emotion generating calculations. J. Human Interface Soc. 3(4):225–238 (in Japanese) (2001)

    Google Scholar 

  10. Ichimura T. et al.: Emotion orientated intelligent systems. In: Howlett R.J. et al. (eds.) Internet-based Intelligent Information Processing Systems, pp. 183–226. World Scientific Publishing Company, Singapore (2003)

    Google Scholar 

  11. Plutchik R.: The multifactor-analytic theory of emotion. J. Psychol. 50:153–171 (1960)

    Article  Google Scholar 

  12. Matsumoto Y. et al.: Japanese Morphological Analysis System Chasen, Version 2.0. http://chasen-legacy.sourceforge.jp (in Japanese) (1999)

    Google Scholar 

  13. Yamashita T. et al.: Facial expressions as a human interface for e-mail. Mem. Tokyo Metropolitan Inst. Technol. 14:7–11 (2000)

    Google Scholar 

  14. Osaka N.: Cross-cultural differences in the perception of facial expressions of ambiguous Noh faces. Bull. Psychonomic Soc. 24(6):427–430 (1986)

    Google Scholar 

  15. Yamashita T. et al.: Recognition of affects in the facial expressions of Noh mask by fuzzy reasoning. Jpn. J. Ergonomics 35(3):193–199 (in Japanese) (1999)

    Google Scholar 

  16. Yamashita T., Minoshita S.: Categorical perception in facial expressions on Noh mask “koomote.” J. Jpn. Acad. Facial Stud. 5(1): 49–57 (in Japanese) (2005)

    Google Scholar 

  17. Ekman P., Friesen V.W.: Unmasking the Face. Prentice-Hall, New Jersey (1975)

    Google Scholar 

  18. Waley A.: Hagoromo. http://etext.virginia.edu/etcbin/toccer-new2?id=WalHago.sgm&images=images/modeng&data=/texts/english/modeng/parsed&tag=public&part=1&division=div1. The University of Virginia Library Electronic Text Center (1997)

    Google Scholar 

  19. Sato Y. et al.: Proposal of automatic responding system for chat-system detecting affirmative/negative. In: Proceedings of 17th Fuzzy System Symposium, pp. 509–512 (2001)

    Google Scholar 

  20. Yamashita T.: Communication in terms of psychology: human computer interaction. Sci. Mach. 59(1):198–203 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Shuichi Fukuda

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Yamashita, T., Eibo, A., Ichimura, T., Mera, K. (2011). Emotion-oriented Human–Computer Interaction. In: Fukuda, S. (eds) Emotional Engineering. Springer, London. https://doi.org/10.1007/978-1-84996-423-4_11

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-423-4_11

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-422-7

  • Online ISBN: 978-1-84996-423-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics