Soft Computing Technique in Kansei (Emotional) Information Processing

  • Takehisa Onisawa
Part of the Computer Science Workbench book series (WORKBENCH)


In human face-to-face communication, not only language but also voice pitch, facial expressions and a gesture are employed in order to have a smooth communication. The former is called verbal information and the latter is non-verbal information [1]. On the other hand, in human-computer interaction only a character, a numeric character and a symbolic character, which are a kind of verbal information, were used as the main conveyance way in the early days of a computer. Human-computer interaction was done by only verbal information because of poor technology, and it cannot help being recognized that a computer system was designed by a machine-oriented way in these days. As the recent development of multimedia technology, however, human-computer interaction can be performed by the use of sound information and image information as well as language information. And studies on human interface and human-computer interaction aiming at a human-friendly system have started [2]. These recent studies deal with non-verbal information aiming at having smooth communication between human and computer like human face-to-face communication. The non-verbal information is not confined to the above-mentioned information such as image information and sound information, and includes voice pitch, facial expressions, a gesture, so called human feelings information. Hereafter in this chapter these pieces of human feelings information are called Kansei information [3]-[7].


Facial Expression Neural Network Model Model Recognition Soft Computing Technique Feature Term 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    T. Kurokawa, Non-verbal Interface, Ohmusha, Tokyo, 1994.Google Scholar
  2. [2]
    Laboratory for International Fuzzy Engineering Research (Ed.) Intelligent Information Processing by Fuzzy Thinking, Computer Age, Tokyo, 1995.Google Scholar
  3. [3]
    Japan Interdisciplinary Council (Ed.) Kansei and Information Processing-New Possibility to Computer Science, Kyoritsu, Tokyo, 1993.Google Scholar
  4. [4]
    S. Iguchi, et. al. Kansei information Processing, Ohmusha, Tokyo, 1994.Google Scholar
  5. [5]
    S. Tsuji, “Science of Kansei-an approach to Kansei information processing,” Saiensu-sha Co., Ltd. Publishers, Tokyo, 1997.Google Scholar
  6. [6]
    M. Nagamachi, “Kansei engineering and comfort-preface,” International Journal of Industrial Ergonomics, Vol.19, No.1, pp.79–80, 1997.CrossRefGoogle Scholar
  7. [7]
    Japan Society for Fuzzy Theory and Systems (Ed.), “Panel discussion: Kansei engineering,” Journal of Japan Society for Fuzzy Theory and Systems, Vol.10, No.3, pp.426–444. 1998.Google Scholar
  8. [8]
    N.J. Nilsson, Problem-Solving Methods in Artificial Intelligence, McGraw-Hill Book Company, New York, 1971.Google Scholar
  9. [9]
    P.H. Winston, Artificial Intelligence, Addison-Wesley Publishing Company, Inc., Mass., 1977.MATHGoogle Scholar
  10. [10]
    Nikkei Computer, An Extra Issue, A.I.-Dawn of Its Practicality, Nikkei McGraw-Hill, Inc., Tokyo, 1985.Google Scholar
  11. [11]
    P.S. Shell, Expert Systems: A Practical Introduction, Macmillan, Hampshire, 1985.Google Scholar
  12. [12]
    L.A. Zadeh, “Fuzzy Sets,” Information and Control, Vol.8, pp.338–353, 1965.MathSciNetMATHCrossRefGoogle Scholar
  13. [13]
    B. Halstead, “Anti-darwinian Theory in Japan,” Nature, Vol.317, 587, 1985.CrossRefGoogle Scholar
  14. [14]
    H. Nakahara and S. Sakawa, “Theory of Evolution Is Changing-Molecular Biology Shakes Darwinism”, Blue Backs, B-852, Kodansha, Tokyo, 1995.Google Scholar
  15. [15]
    H. Tanaka, “The past, present and future states of the art of fuzzy systems theory,” Journal of Japan Society for Fuzzy Theory and Systems, Vol.1, No.1, pp.48–62, 1989.Google Scholar
  16. [16]
    C.W. Dodge, Euclidean Geometry and Transformation, Addison Wesely Pub. Co., MASS., 1972.Google Scholar
  17. [17]
    D. Gans, An Introduction to Non-Euclidean Geometry, Academic Press, New York, 1973MATHGoogle Scholar
  18. [18]
    J.L. McCauley, Chaos, Dynamics and Fractals, An Algorithmic Approach to Deterministic Chaos, Cambridge University Press, Cambridge, 1993.MATHGoogle Scholar
  19. [19]
    R.M. Smullyan, Godel’s Incompleteness Theorems, Oxford University Press, New York, 1992.Google Scholar
  20. [20]
    S.S. Stevens (Ed.), Handbook of Experimental Psychology, p.43, John Wiley & Sons, Inc., New York, 1951.Google Scholar
  21. [21]
    H.A. David, The Method of Paired Comparison, Charles Griffin, London, 1963.Google Scholar
  22. [22]
    C. Chatfield and A.J. Collins, Introduction to Multivariate Analysis, Chapman and Hall, London, 1980.MATHGoogle Scholar
  23. [23]
    J.G. Snider and C.E. Osgood (Eds.), Semantic Differential Technique, A Sourcebook, Aidine, Chicago, 1969.Google Scholar
  24. [24]
    R.P. McDonald, Factor Analysis and Related Methods, Lawrence Erlbaum Associators, Hillsdak, N.J., 1985.Google Scholar
  25. [25]
    M. Mizumoto, “Pictorial Representations of Fuzzy Connectives, Part I: Cases of t-norms, t-conorms and Averaging Operators,” Fuzzy Sets and Systems, Vol.31, pp.217–242, 1989.MathSciNetCrossRefGoogle Scholar
  26. [26]
    E. Hollnagel, Human Reliability Analysis, Context and Control, Academic Press, London, 1993.Google Scholar
  27. [27]
    A.D. Swain and H.E. Guttmann, Handbook of Human Reliability Analysis with Emphasis on Nuclear Power Plant Applications, NUREG/CR-1278, 1983.Google Scholar
  28. [28]
    Special Issue on Fuzzy Methodology in System Failure Engineering, Fuzzy Sets and Systems, Vol. 83, No.2, 1996.Google Scholar
  29. [29]
    T. Onisawa and J. Kacprzyk (Eds.), Reliability and Safety Analyses Under Fuzziness, Physica-Verlag, A Springer-Verlag Company, Heidelberg, 1995.MATHGoogle Scholar
  30. [30]
    E. Kerre, T. Onisawa, B. Cappele, and I. Gazdik, “Reliability,” pp.391–420, in Fuzzy Sets in Decision Analysis, Operations Research and Statics, R. Slowinski (Ed.) The Handbooks of Fuzzy Sets Series, D. Dubois and H. Prade (Eds.), Kluwer Academic Publishers, London, 1998.CrossRefGoogle Scholar
  31. [31]
    L. Fausett, “FUndamentals of Neural Networks: Architectures, Algorithms and Applications,” Prentice Hall, N.J., 1994.MATHGoogle Scholar
  32. [32]
    D.E. Goldberg, emphGenetic Algorithm in Serach, Optimization, and Machine Learning, Addison-Wesley, 1989.Google Scholar
  33. [33]
    X. Li, D. Ruan, and A.J. van der Wal, “Discussion on Soft Computing at FLINS’96,” International Journal of Intelligent Systems, Vol. 13, pp.287–300, 1998.CrossRefGoogle Scholar
  34. [34]
    Special Issue on Technical Papers, Interactive Evolutionary Computing, Journal of Japanese Society for Artificial Intelligence, Vol.13, No.5, pp.691–745, 1998.Google Scholar
  35. [35]
    K.S. Gill (Ed.), Human Machine Symbiosis-The Foundations of Human-Centred Systems Design, Springer-Verlag, London, 1996.Google Scholar
  36. [36]
    M. Ito, H. Ushida, A. Yamadori, T. Ono, A. Tokisumi and K. Ikeda, Cognitive Science 6, Jodo (Emotions), Iwanami, Tokyo, 1994.Google Scholar
  37. [37]
    Special Issue on Human Face, The Transactions of The Institute of Electronics, Information and Communication Engineers, Vol.J80-A, No.8 and Vol.J80-D-II, No.8, 1997.Google Scholar
  38. [38]
    O.A. Uwechue and A.S. Pandya, Human Face Recognition Using Third-Order Synthetic Neural Networks, Kluwer Academic Publishers, Mass., 1997.CrossRefGoogle Scholar
  39. [39).
    H. Doi and M. Ishizuka, “A visual software agent connected to WWW /Mosaic,” The Transactions of The Institute of Electronics, Information and Communication Engineers D-II, Vol.J79-D-II, No.4, pp.585–591, 1996.Google Scholar
  40. [40]
    H. Harashima, “Face, expression, and emotion-an approach from video-robot technology,” Journal of the Japan Society of Mechanical Engineering, Vol.95, No.883, pp.503–507, 1992.Google Scholar
  41. [41]
    F. Hara, “Artificial emotion: generation model and expression,” Mathematical Sciences, Saiensu-sha, Tokyo, No.373, pp.52–59, 1994.Google Scholar
  42. [42]
    P. Ekman and W.V. Friesen, Facial Action Coding System (FACS): A Technique for the Measurement of Facial Action, Consulting Psychology Press, California, 1978.Google Scholar
  43. [43]
    T. Onisawa and S. Kitazaki, “Recognition of facial expressions and its application to human computer interaction,” in Intelligent Biometric Techniques in Fingerprint and Face Recognition, L.C. Jain et al. (Eds.) pp.423–458, CRC Press LLC, Florida, 1999.Google Scholar
  44. [44]
    S. Kitazaki and T. Onisawa, “Communication model considering facial expressions and situations,” Proc. of 1998 IEEE International Conference on Fuzzy Systems, Vol. 1, pp.171–176, Anchorage, 1998.Google Scholar
  45. [45]
    S. Iwashita and T. Onisawa, “A study on facial caricature drawing by fuzzy theory,” Proc. of Sixth IEEE International Conference on Fuzzy Systems, Vol.2, pp.933–938, Barcelona, 1997.Google Scholar
  46. [46]
    T. Onisawa and M. Iwata, “A model of route decision and facial expression,” Proc. Of the Sixth International Fuzzy Systems Association World Congress, pp.629–632, San Paulo, July, 1995.Google Scholar
  47. [47]
    T. Onisawa, Y. Masuda and M. Iwata, “A route decision system with human interaction and facial expression model,” Proc. of the 1996 International Fuzzy Systems and Intelligent Control Conference, pp.137–146, Hawaii, 1996.Google Scholar
  48. [48]
    T. Onisawa and D. Date, “Personified Game Playing Support System,” Japanese Journal of Ergonomics, Vol.35, No.3, pp.157–167, 1999.CrossRefGoogle Scholar
  49. [49]
    T. Naito and A. Takeuchi, “Interaction with vision-based synthesized facial display,” Computer Vision and Image Media, May 24, pp.39–46, 1996.Google Scholar
  50. [50]
    O. Hasegawa, K. Sakaue, K. Ito, T. Karita, S. Hayamizu, K. Tanaka, and N. Otsu, “A multimodal anthropomorphic agent which learns visual information through interactions,” Computer Vision and Image Media, May 24, pp.33–38, 1996.Google Scholar
  51. [51]
    J. Hayashi, K. Murakami and H. Koshimizu, “A method for automatic generation of caricature profile in PICASO system,” The Transactions of The Institute of Electronics, Information and Communication Engineers D-II, Vol.J80-D-II, No.8, pp.2102–2109, 1997.Google Scholar
  52. [52]
    H. Shimada and M. Shiono, “A method for caricature generation based on 3D facial model,” The Transactions of The Institute of Electronics, Information and Communication Engineers D-II, Vol.J76-D-II, No.12, pp.2513–2521, 1993.Google Scholar
  53. [53]
    J. Nishino, T. Kameyama, H. Shirai, T. Odaka, and H. Ogura, “Facial caricature drawing and modification using linguistic expressions,” Proc. of the 5th International Conference on Soft Computing and Information/Intelligent Systems, Vol.1, pp.205–208. Iizuka, 1998.Google Scholar
  54. [54]
    L.A. Zadeh, “Fuzzy logic = computing with words,” IEEE Transactions on Fuzzy Systems, Vol.4, No.2, pp.103–111, 1996.MathSciNetCrossRefGoogle Scholar
  55. [55]
    History Reader, Extra Number ( Japanese Series ): Japanese Faces, Shin-Jinbutsu Ohrai-sha, Tokyo, 1995.Google Scholar

Copyright information

© Springer-Verlag Tokyo 2000

Authors and Affiliations

  • Takehisa Onisawa

There are no affiliations available

Personalised recommendations