Abstract
Some distinctive mouth shapes are formed when Japanese words and phrases are uttered. Because people who have acquired a skill of Japanese lip-reading know these characteristics, they can read lips movement. To realize the machine lip-reading, we propose a method which detects the distinctive mouth shapes from Japanese-speaking images based on their techniques. We define six mouth shapes as the distinctive mouth shapes, and the mouth shape images are used as template images. To detect the mouth shapes in utterance images, template matching is applied. Waveforms of similarity which are calculated by the template matching show some characteristic forms. Thus, we detect the mouth shapes from the waveforms. We carry out some experiments using Japanese words, and confirm effectiveness of the proposed method from the results.
Keywords
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Kenji, M., Pentland, A.: Automatic Lip-reading by Optical-flow Analysis. The Transactions of the Institute of Electronics. Information and Communication Engineers J73-D-II(6), 796–803 (1990) (in Japanese)
Yasuyuki, N., Moritoshi, A.: Lipreading Method Using Color Extraction Method and Eigenspace Technique. The Transactions of the Institute of Electronics, Information and Communication Engineers J85-D-II(12), 1813–1822 (2002) (in Japanese)
Takeshi, S., Mitsugu, H., Ryosuke, K.: Analysis of Features for Efficient Japanese Vowel Recognition. The IEICE Transactions on Information and Systems E90-D(11), 1889–1891 (2007)
Kimiyasu, K., Keiichi, U.: An Uttered Word Recognition Using Lip Image Information. The Transactions of the Institute of Electronics, Information and Communication Engineers J76-D-II(3), 812–814 (1993) (in Japanese)
Tsuyoshi, M., Toyoshiro, N.: The Codification of Distinctive Mouth Shapes and the Expression Method of Data Concerning Changes in Mouth Shape when Uttering Japanese. IEEJ Transactions on Electronics, Information and Systems 129(12), 2108–2114 (2009) (in Japanese)
Tsuyoshi, M., Toyoshiro, N., Naohiro, I.: Evaluation for an Automatic Generation of Lips Movement Images Based on Mouth Shapes Sequence Code in Japanese Pronunciation. In: Proc. of Japan-Cambodia Joint Symposium on Information Systems and Communication Technology 2011 (JCAICT 2011) pp. 89–92 (2011)
Tsuyoshi, M., Toyoshiro, N.: A Deriving Method of Distinctive Mouth Shapes for Lip-reading. In: Multimedia, Distributed, Cooperative, and Mobile Symposium, pp. 1544–1549 (2009) (in Japanese)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Miyazaki, T., Nakashima, T., Ishii, N. (2011). A Detection Method of Basic Mouth Shapes from Japanese Utterance Images. In: Jacko, J.A. (eds) Human-Computer Interaction. Design and Development Approaches. HCI 2011. Lecture Notes in Computer Science, vol 6761. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21602-2_66
Download citation
DOI: https://doi.org/10.1007/978-3-642-21602-2_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21601-5
Online ISBN: 978-3-642-21602-2
eBook Packages: Computer ScienceComputer Science (R0)