Extracting Interval Distribution of Human Interactions

  • Ryohei Kimura
  • Noriko Takemura
  • Yoshio Iwai
  • Kosuke Sato
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7088)


Recently, activity support systems that enable dialogue with humans have been intensively studied owing to the development of various sensors and recognition technologies. In order to enable a smooth dialogue between a system and a human user, we need to clarify the rules of dialogue, including how utterances and motions are interpreted among human users. In conventional study on dialogue analysis, duration between the time when someone finishes an utterance and the time when another human starts the next utterance were analyzed. In a real dialogue between humans, however, there are sufficient intervals between an utterance and a visually observable motion such as bowing and establishing eye-contact; the facilitation of communication and cooperation seem to depend on these intervals. In our study, we analyze interactions that involve utterances and motions at a reception scenario by resolving motions into motion primitives (a basic unit of motion). We also analyze the timing of utterances and motions in order to structure dialogue behaviors. Our result suggest that a structural representation of interaction can be useful for improving the ability of activity support systems to interact and support human dialogue.


Structural Representation of Interaction Action Primitives Interval Analysis 


  1. 1.
    Takizawa, M., Makihara, Y., Shimada, N., Miura, J., Shirai, Y.: A Service Robot with Interactive Vision-Object Recognition Using Dialog with User. In: Proc. of the 1st Int. Workshop on Language Understanding and Agents for Real World Interaction (Academic Journal), pp. 16–23 (July)Google Scholar
  2. 2.
    Kuriyama, H., Murata, Y., Shibata, N., Yasumoto, K., Ito, M.: Congestion Alleviation Scheduling Technique for Car Drivers Based on Prediction of Future Congestion on Roads and Spots. In: Proc. of 10th IEEE Int’l. Conf. on Intelligent Transportation Systems (ITSC 2007), pp. 910–915 (September 2007)Google Scholar
  3. 3.
    Fukaya, K., Watanabe, A.: Intuitive Manipulation to Mobile Robot by Hand Gesture. In: 24th ISPE International Conference on CAD/CAM, Robotics and Factories of the Future (July 2008)Google Scholar
  4. 4.
    Shirberg, E.: Spontaneous Speech: How People Really Talk and Why Engineers Should Care. In: Proc. EUROSPEECH (2005)Google Scholar
  5. 5.
    Fujie, S., Fukushima, K., Kobayashi, T.: Back-channel Feedback Generation Using Linguistic and Nonlinguistic Information and Its Application to Spoken Dialogue System. In: Proc. EUROSPEECH, pp. 889–892 (2005)Google Scholar
  6. 6.
    Hirose, K., Sato, K., Minematsu, N.: Emotional speech synthesis with corpus-based generation of F0 contours using generation process model. In: Proceedings of International Conference on Speech Prosody, Nara, pp. 417–420 (March 2004)Google Scholar
  7. 7.
    Fujiwara, N., Itoh, T., Araki, K.: Analysis of Changes in Dialogue Rhythm Due to Dialogue Acts in Task-Oriented Dialogues. In: Matoušek, V., Mautner, P. (eds.) TSD 2007. LNCS (LNAI), vol. 4629, pp. 564–573. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  8. 8.
    Nishimura, R., Kitaoka, N., Nakagawa, S.: Analysis of relationship between impression of human to human conversations and prosodic change and its modeling. In: Proceeding of the Interspeech, pp. 534–537 (2008)Google Scholar
  9. 9.
    Kawashima, H., Nishikawa, T., Matsuyama, R.: Analysis of Visual Timing Structure in Rakugo Turn-taking (written in Japanese). IPSJ Journal 48(12), 3715–3728 (2007)Google Scholar
  10. 10.
    Sumi, Y., Yano, M., Nishida, T.: Analysis environment of conversational structure with nonverbal multimodal data. In: 12th International Conference on Multimodal Interfaces and 7th Workshop on Machine Learning for Multimodal Interaction (ICMI-MLMI 2010), Beijing, China (November 2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ryohei Kimura
    • 1
  • Noriko Takemura
    • 1
  • Yoshio Iwai
    • 2
  • Kosuke Sato
    • 1
  1. 1.Graduate School of Engineering ScienceOsaka UniversityJapan
  2. 2.Graduate School of EngineeringTottori UniversityJapan

Personalised recommendations