Abstract
A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.
Key words
The original version of this chapter was revised: The copyright line was incorrect. This has been corrected. The Erratum to this chapter is available at DOI: 10.1007/978-0-387-35660-0_65
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Shigeo Morishima, “Face Analysis and Synthesis”, IEEE Signal Processing Magazine, Vol. 18, No. 3, pp. 26–34, May 2001.
T. Takezawa, et.al., “Japanese-to-English speech translation system:ATR-MATRIX”, Proc. of ICSLP, pp. 957–960, 1998.
Facial Image Processing System for Human-like “Kansei” .
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 IFIP International Federation for Information Processing
About this chapter
Cite this chapter
Iwasawa, S., Yotsukura, T., Morishima, S. (2003). Face Analysis and Synthesis for Interactive Entertainment. In: Nakatsu, R., Hoshino, J. (eds) Entertainment Computing. IFIP — The International Federation for Information Processing, vol 112. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-35660-0_19
Download citation
DOI: https://doi.org/10.1007/978-0-387-35660-0_19
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-5153-6
Online ISBN: 978-0-387-35660-0
eBook Packages: Springer Book Archive