Abstract
In this paper, we propose a Japanese dialogue processing method based on a similarity measure using tf· AoI(termfrequency × Amountof Information). Keywords are specially used in a spoken dialogue system because a user utterance includes an erroneous recognition, filler and a noise. However, when a system uses keywords for robustness, it is difficult to realize detailed differences. Therefore, our method calculates similarity between two sentences without deleting any word from an input sentence, and we use a weight which multiplies term frequency and amount of information(tf · AoI). We use 173 open data sets which are collected from 12,095 sentences in SLDB. The experimental result using our method has a correct response rate of 67.1%. We confirmed that correct response rate of our method was 11.6 points higher than that of the matching rate measure between an input sentence and a comparison sentence. Furthermore that of our method was 7.0 points higher than that of tf · idf.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wcizcubaum, J.: ELIZA - A Computer Program for the Study of Natural Language Comunication Between Man and Machine. Communications of the Association for Computing Machinery 9(1), 36–45 (1966)
Takebayashi, Y., Tsuboi, H., Kanazawa, H., Sadamoto, Y., Hashimoto, H., Shinichi, H.: A real-time speech dialog system using spontaneous speech understanding. IEICE Trans. Inf. and Syst. E-76D(l) (January 1993)
Zue, V., Seneff, S., Glass, J., Polifroni, J., Pao, C., Hazen, T.J., Hethcrington, L.: JUPITER: A telephone-based conversational interface for weather information. IEEE Transactions on Speech and Audio Processing 8(1) (January 2000)
Litman, D., Pan, S., Walker, M.: Evaluating Response Strategies in a Web-Based Spoken Dialogue Agent. In: Proceedings of ACL/COLING 1998 (1998)
Aissawa, A.: The Feature Quantity: An Information Theoretic Perspective of Tfidf-like Measures. In: Proc. of ACM SIGIR 2000, pp. 104–111 (2000)
Matsumoto, Y., Kitauchi, A., Yamashita, T., Hirano, Y., Matsuda, H., Takaoka, K., Asahara, M.: Japanese Morphological Analysis System ChaScn version 2.2.1 (December 2000)
Morimoto, T., Uratani, N., Takezawa, T., Furuse, O., Sobashima, Y., Iida, H., Nakamura, A., Sagisaka, Y., Higuchi, N., Yamazaki, Y.: A speech and language database for speech translation research. In: Proc. ICSLP 1994, pp. 1791–1794 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kimura, Y., Araki, K., Tochinai, K. (2004). Evaluation of Japanese Dialogue Processing Method Based on Similarity Measure Using tf· AoI . In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2004. Lecture Notes in Computer Science, vol 2945. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24630-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-540-24630-5_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21006-1
Online ISBN: 978-3-540-24630-5
eBook Packages: Springer Book Archive