Abstract
This paper deals with computer-human interfacing in the special context of sign language as used by deaf persons; it focuses on sign-language synthesis employing a uniform data representation model. The data is built up from the sublexical elements of sign language, since this is most natural from a linguistic point of view. It is also economical: using only four types of sublexical elements, many meaningful lexical items can be constructed. Two principal advantages of this synthesis approach are that the components of the database are language-independent, and that complex signs can be effectively described. Although we do not discuss the 3D engine in detail, in our implementation we have succeeded in our objective that the synthesis should be performed in real-time. Here we consider only problems associated with the visualization of hand and arm positions; the other parts of the body used for signing are the subject of future work.
This work is supported under contract no. TST-00014/2003 from the Hungarian Ministry of Education.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Augustine, S.: VRML-based Representations of ASL Fingerspelling on the World-Wide Web. In: ASSETS 1998 (1998)
Verlinden, M., Tijsseling, C., Frowein, H.: Sign Language on the WWW. In: Proceedings of 18th Int. Symposium on Human Factors in Telecommunication (2001)
Ohene-Djan, J., Zimmer, R., Gorle, M., Naqvi, S.: A Personalisable Electronic Book for Videobased Sign Language Education. Education Technology & Society, 86–99 (2003)
Stokoe, W.C., Casterline, D.C., Croneberg, C.G.: A Dictionary of American Sign Language on Linguistic Principles, p. 346. Linstok Press, Silver Spring (1976)
Liddell, S.K., Robert, E.: American Sign Language: The phonological base. Sign Language Studies 64, 195–277 (1989)
Sandler, W.: Phonological Characteristic of Sign Languages. In: Working Papers in Linguistics, Special Issue on Sign Language Phonology, Dept. of Linguistics, Univ. of Trondheim, 18–37 (1995)
Sandler, W.: Representing Handshapes. In: Edmondson, W.H., Wilbur, R. (eds.) Edmondson, International Review of Sign Linguistics, pp. 115–158. Lawrence Erlbaum Publishers, Mahwah (1996)
Szabó, M.H.: A kétkezes jelek fonológiai szerkezete a magyar jelnyelv fonológiai vizsgálatának tükrében [Two-handed signs in the light of the phonological analysis of Hungarian Sign Language]. In: Gécseg, Z. (ed.) LingDoc, University of Szeged, pp. 107–128 (2002)
Rissanen, T.: The basic structure of Finnish Sign Language. In: Tervoort, B.T. (ed.) Signs of life, pp. 42–46 (1986)
Harder, R., Schermer, T.: A first phonological analysis of handshapes in the Sign Language of the Netherlands (SLN). In: Tervoort, B.T. (ed.) op. cit., pp. 47–51 (1986)
Furst, J., Alkoby, K., Berthiaume, A., Chomwong, P., Davidson, M., Konie, B., Lancaster, G., Lytinen, S., McDonald, J., Roychoudhuri, L., Toro, J., Tomuro, N., Wolfe, R.: Database Design for American Sign Language. In: Proceedings of the ISCA 15th International Conference on Computers and Their Applications, pp. 427–430 (2000)
Piotr, F., Jaroslaw, F.: Synthesis and Representation of the Polish Sign Language Gestures. In: 1st Int. Conf. On Applied Mathematics and Informatics at Universities, pp. 190–197 (2001)
Lebourque, T., Gibet, S.: A Complete System for the Specification and Generation of Sign Language Gestures. In: Braffort, A., Gibet, S., Teil, D., Gherbi, R., Richardson, J. (eds.) GW 1999. LNCS (LNAI), vol. 1739, pp. 227–238. Springer, Heidelberg (2000)
Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J.: HamNoSys Version 2.0; Hamburg Notation System for Sign Languages. In: An introductory guide. Int. Studies on Sign Language and Communication of the Deaf, vol. (5), Signum Verlag, Hamburg (1989)
Nedel, L.P., Thalmann, D.: Modeling and Deformation of the Human Body using an Anatomically-Based Approach. In: Proceedings of Computer Animation 1998, pp. 34–40 (1998)
Smiljanic, M., Blanken, H., Keulen, M., Jonker, W.: Distributed XML Database Systems. Technical report, Centre for Telematics and Information Technology (2002)
Unger, K.C.: Reflections on phonetic and phonological movement in Swedish Sign Language. In: Working Papers in Linguistics, Special Issue on Sign Language Phonology, Dept. of Linguistics, Univ. of Trondheim, pp. 38–53 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Havasi, L., Szabó, H.M. (2004). HANDY: Sign Language Synthesis from Sublexical Elements Based on an XML Data Representation. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2004. Lecture Notes in Computer Science(), vol 3206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30120-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-30120-2_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23049-6
Online ISBN: 978-3-540-30120-2
eBook Packages: Springer Book Archive