Abstract
In this paper, an automatic translation system from Spanish language into Spanish Sign Language (LSE) performed by a virtual interpreter is presented. The translator is based on rules from Spanish grammar considering the syntactical and morphological characteristics of words and the semantics of their meaning. The system has been incorporated to an animation engine in which a virtual character acts as an interpreter that communicates using LSE. The mood of the interpreter is considered, so that the translation and the signs are modified depending on whether the interpreter is happy, angry, etc. The system has been tested with satisfactory results in speed and quality.
Chapter PDF
Similar content being viewed by others
References
Ong, S., Ranganath, S.: Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Trans Pattern Analysis and Machine Intelligence 27(6), 873–891 (2005)
San-Segundo, R., Barra, R., Córdoba, R., D’Haro, L.F., Fernández, F., Ferreiros, J., Lucas, J.M., Macías-Guirasa, J., Monero, J.M., Pardo, J.M.: Speech to sign language translation system for Spanish. Speech Communication 50, 1009–1020 (2008)
Olivrin, G.: Composing Facial expressions with signing avatars. In: Speech and Face-to-Face Communication Workshop, Grenoble (2008)
FreeLing, http://garraf.epsevg.upc.es/freeling
Baldassarri, S., Cerezo, E., Seron, F.: Maxine: A platform for embodied animated agents. Computer & Graphics 32, 430–437 (2008)
Cerezo, E., Hupont, I., Manresa, C., Varona, J., Baldassarri, S., Perales, F., Seron, F.: Real-time Facial Expression Recognition for Natural Interaction. In: Martí, J., Benedí, J.M., Mendonça, A.M., Serrat, J. (eds.) IbPRIA 2007. LNCS, vol. 4478, pp. 40–47. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Baldassarri, S., Cerezo, E., Royo-Santas, F. (2009). Automatic Translation System to Spanish Sign Language with a Virtual Interpreter. In: Gross, T., et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03655-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-03655-2_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03654-5
Online ISBN: 978-3-642-03655-2
eBook Packages: Computer ScienceComputer Science (R0)