An Engineering Approach to Conversational Informatics

  • Toyoaki Nishida
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7258)


Conversational informatics is a field of research that focuses on investigating human behaviors and designing artifacts that can interact with people in a conversational fashion. The field draws on a foundation provided by artificial intelligence, natural language processing, speech and image processing, cognitive science, and conversation analysis. It aims to shed light on meaning creation and interpretation during conversations, in search of better methods of computer-mediated communication, human-computer interaction, and support for knowledge creation. In this article, I will highlight recent developments in an engineering approach to conversational informatics. I also address empathic agents as future challenges.


Conversational Informatics Intelligent Virtual Agents Empathic Agents 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Clark, H.: Using Language. Cambridge University Press (1996)Google Scholar
  2. 2.
    Nishida, T. (ed.): Conversational Informatics: an Engineering Approach. John Wiley & Sons Ltd., London (2007)Google Scholar
  3. 3.
    Huang, H.H., Furukawa, T., Ohashi, H., Nishida, T., Cerekovic, A., Pandzic, I.S., Nakano, Y.I.: How multiple concurrent users react to a quiz agent attentive to the dynamics of their game participation. In: Proc. AAMAS 2010, pp. 1281–1288 (2010)Google Scholar
  4. 4.
    Kiselev, A., Hacker, B.A., Wankerl, T., Abdikeev, N., Nishida, T.: Toward incorporating emotions with rationality into a communicative virtual agent. AI Soc. 26(3), 275–289 (2011)CrossRefGoogle Scholar
  5. 5.
    Cerekovic, A., Huang, H.-H., Pandzic, I.S., Nakano, Y., Nishida, T.: Towards a Multicultural ECA Tour Guide System. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 364–365. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  6. 6.
    Nishida, T., Terada, K., Tajima, T., Hatakeyama, M., Ogasawara, Y., Sumi, Y., Xu, Y., Mohammad, Y.F.O., Tarasenko, K., Ohya, T., Hiramatsu, T.: Toward robots as embodied knowledge media. IEICE Transactions 89-D(6), 1768–1780 (2006)Google Scholar
  7. 7.
    Weizenbaum, J.: ELIZA — A computer program for the study of natural language communication between man and machine. CACM 9(1), 36–45 (1966)Google Scholar
  8. 8.
    Winograd, T.: Understanding Natural Language. Academic Press (1972)Google Scholar
  9. 9.
    Erman, L.D., Hayes-Roth, F., Lesser, V.R., Reddy, R.: The Hearsay-II speech-understanding system: integrating knowledge to resolve uncertainty. ACM Computing Surveys 12(2), 213–253 (1980)CrossRefGoogle Scholar
  10. 10.
    Bolt, R.A.: Put-that-there: Voice and gesture at the graphics interface. In: Proc. the 7th Annual Conference on Computer Graphics and Interactive Techniques, vol. 14(3), pp. 262–270 (1980)Google Scholar
  11. 11.
    Byrne, J.A., Sculley, J.: Odyssey: Pepsi to Apple: A Journey of Adventure, Ideas, and the Future. Harpercollins (1987) Google Scholar
  12. 12.
    Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. The MIT Press (2000)Google Scholar
  13. 13.
    Prendinger, H., Ishizuka, M. (eds.): Life-like Characters—tools, affective functions and applications. Springer (2004)Google Scholar
  14. 14.
    Rehm, M., Nakano, Y., André, E., Nishida, T., Bee, N., Endrass, B., Huang, H.H., Lipi, A.A., Wissner, M.: From observation to simulation: generating culture-specific behavior for interactive systems. AI & Society 24(3), 267–280 (2009)CrossRefGoogle Scholar
  15. 15.
    Nishida, T.: Talking with Uncertainty. In: Tang, Y., Huynh, V.-N., Lawry, J. (eds.) IUKM 2011. LNCS, vol. 7027, pp. 1–6. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Ohashi, H., Okada, S., Ohmoto, Y., Nishida, T.: A proposal of a novel WOZ environment for realizing essence of communication in social robots. In: 9th International Workshop on Social Intelligence Design (SID 2010), London, United Kingdom, September 13-16 (2010)Google Scholar
  17. 17.
    Saiga, H.: Construction of A Semi-automatic Telepresence System Correcting Motion by Integrating A Controller’s Behavior with A Remote Sensing Data. Master thesis, Department of Intelligence Science and Technology, Kyoto University (2012) (in Japanese)Google Scholar
  18. 18.
    Mohammad, Y.F.O., Nishida, T., Okada, S.: Unsupervised simultaneous learning of gestures, actions and their associations for Human-Robot Interaction. In: Proc. IROS 2009, pp. 2537–2544 (2009)Google Scholar
  19. 19.
    Mohammad, Y.F.O., Nishida, T.: Learning interaction protocols using Augmented Baysian Networks applied to guided navigation. In: Proc. IROS 2010, pp. 4119–4126 (2010)Google Scholar
  20. 20.
    Nishida, T., Fujihara, N., Azechi, S., Sumi, K., Yano, H.: Public Opinion Channel for communities in the information age. New Generation Computing 14(4), 417–427 (1999)CrossRefGoogle Scholar
  21. 21.
    Nishida, T.: Conversation Quantization for Conversational Knowledge Process. In: Bhalla, S. (ed.) DNIS 2005. LNCS, vol. 3433, pp. 15–33. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  22. 22.
    Okamura, G., Kubota, H., Sumi, Y., Nishida, T., Tsukahara, H., Iwasaki, H.: Quantization and reuse of driving conversations. Transactions of Information Processing Society of Japan 48(12), 3893–3906 (2007) (in Japanese) Google Scholar
  23. 23.
    Merckel, L., Nishida, T.: Enabling situated knowledge management for complex instruments by real-time reconstruction of surface coordinate system on a mobile device. AI & Society 24(1), 85–95 (2009)CrossRefGoogle Scholar
  24. 24.
    Ohmoto, Y., Ohashi, H., Lala, D., Mori, S., Sakamoto, K., Kinoshita, K., Nishida, T.: ICIE: Immersive environment for social interaction based on socio-spatial information, Conference. In: Proc. Conference on Technologies and Applications of Artificial Intelligence (TAAI 2011), Taoyuan, Taiwan, pp. 119–125 (2011)Google Scholar
  25. 25.
    Mori, S., Ohmoto, Y., Nishida, T.: Constructing immersive virtual space for HAI with photos. In: Proc. GrC 2011, pp. 479–484 (2011)Google Scholar
  26. 26.
    Thovuttikul, S., Lala, D., Ohashi, H., Okada, S., Ohmoto, Y., Nishida, T.: Simulated Crowd: Towards a synthetic culture for engaging a learner in culture-dependent nonverbal interaction. In: 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction at IUI 2011, California, USA (2011)Google Scholar
  27. 27.
    Hofstede, G.J., Pedersen, P., Hofstede, G.: Exploring Culture, Exercise, Stories and Synthetic Cultures. Intercultural Press, Yarmouth (2002)Google Scholar
  28. 28.
    Lala, D., Nishida, T.: VISIE: A spatially immersive interaction environment using real-time human measurement. In: Proc. GrC 2011, pp. 363–368 (2011)Google Scholar
  29. 29.
    Lala, D., Nishida, T.: Towards a virtual environment for capturing behavior in cultural crowds. In: Proc. ICDIM 2011, pp. 310–315 (2011)Google Scholar
  30. 30.
    Lala, D., Nishida, T.: The interpretation of emotion based on gestural parameters and culture. In: CMVC 2011, Reykjavik, Iceland (2011)Google Scholar
  31. 31.
    Yano, M.: Construction of 3-dimensional Recording Environments for Multi-party Conversation with RGB-depth Sensors. Master thesis, Department of Intelligence Science and Technology, Kyoto University (2012) (in Japanese)Google Scholar
  32. 32.
    Eisenberg, N., Eggum, N.D., Di Giunta, L.: Empathy-related responding: associations with prosocial behavior, Aggression, and Intergroup Relations. Social Issues and Policy Review 4(1), 143–180 (2010)CrossRefGoogle Scholar
  33. 33.
    Caire, P.: Designing convivial digital cities: A social intelligence design approach. AI Soc. 24(1), 97–114 (2009)MathSciNetCrossRefGoogle Scholar
  34. 34.
    Iacoboni, M.: Mirroring People – The New Science of How We Connect with Others. Farrar, Straus & Giroux, New York (2008)Google Scholar
  35. 35.
    Nishida, T.: Toward mutual dependency between empathy and technology. AI Soc. 25th Anniversary volume – a Faustian Exchange: what Is to be Human in the Era of Ubiquitous Technology? (Online First, 2012), doi: 10.1007/s00146-012-0403-5 Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Toyoaki Nishida
    • 1
  1. 1.Graduate School of InformaticsKyoto UniversitySakyo-kuJapan

Personalised recommendations