Abstract
Co-articulation is a language phenomenon. In sign language (SL), it takes the form of impact among adjacent signs, which results in variations of signs from their standard configurations. Standard configuration is the appearance of a sign when it appears singly, without context. Without co-articulation, SL animation based on virtual character will be a simple concatenation of signs. The movement of virtual character will be mechanical, lacking fluency and realism. This paper presents a key frame based SL co-articulation animation scheme aiming at the three most important elements of co-articulation, i.e. hand shape, hand position and SL speed. To generate co-articulation, motion data of signs which appear sequentially is parsed to identify hand shapes and positions included in these signs. Then, co-articulation will be achieved through some modification to the motion data according to the interaction between adjacent hand shapes and adjacent hand positions. SL Speed acts as an adjusting parameter which dynamically impacts co-articulation. Different expression speed will lead to different degree of co-articulation.
Similar content being viewed by others
References
Chi D, Costa M, Zhao L, Badler N (2000) The EMOTE model for effort and shape. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques. SIGGRAPH’00, New Orleans, Louisiana, USA, July 23–28, 2000, pp 173–182. doi:10.1145/344779.352172
China Association for the deaf (2003) Chinese sign language. HuaXia Press, Beijing
Conway A, Veale T (1994) A linguistic approach to sign language synthesis. In: People and Computers IX. Cambridge University Press, Cambridge, pp 211–222
Dasgupta T, Basu A (2008) Prototype machine translation system from text-to-Indian sign language. In: 13th International Conference on Intelligent User Interfaces. IUI’08, Canary Islands, Spain, January 13–16, 2008, pp 313–316. doi:10.1145/1378773.1378818
Delorme M, Filhol M, Braffort A (2009) Animation generation process for sign language synthesis. In: 2nd International Conferences on Advances in Computer-Human Interactions. ACHI’09, Cancun, Mexico, February 1–7, 2009, pp 386–390. doi:10.1109/ACHI.2009.29
Grosvald M, Corina D (2008) Location-to-Location coarticulation: A phonetic investigation of American Sign Language. In: Proceedings of the 24th Northwest Linguistics Conference. NWLC’08, Seattle, Washington, May 3–4, 2008, pp 59–66
Jerde TE, Soechting JF, Flanders M (2003) Coarticulation in Fluent Fingerspelling. The Journal of Neuroscience 23:2383–2393
Jerde TE, Soechting JF, Flanders M (2003) Biological constraints simplify the recognition of hand shapes. IEEE Transactions on Biomedical Engineering 50:265–269. doi:10.1109/TBME.2002.807640
Li S, Kong D, Wang L, Sun Y, Huang Q (2012) Optimal control theory based interpolation for Chinese sign language animation. In: The 15th International Conference on Geometry and Graphics. ICGG’12, Montreal, Canada, August 1–5, 2012, pp 397–402
Liddell SK (1984) Unrealized inceptive aspect in American sign language: feature insertion in syllabic frames. Chicago Linguistics Society 20:257–270
Luo W (2008) Study on the Handshape of Chinese sign language. Beijing Normal University, Dissertation
Mauk CE (2003) Undershoot in two modalities: Evidence from fast speech and fast signing. Dissertation, University of Texas at Austin
San-Segundo R, Barra R, Córdoba R et al (2008) Speech to sign language translation system for Spanish. Speech Communication 50:1009–1020. doi:10.1016/j.specom.2008.02.001
Segouat J, Braffort A (2009) Toward the study of sign language coarticulation: Methodology Proposal. In: Second International Conferences on Advances in Computer-Human Interactions. ACHI’09, Cancun, Mexico, February 1–7, 2009, pp 369–374. doi:10.1109/ACHI.2009.25
Shantz M, Poizner H (1982) A computer program to synthesize American sign language. Behavior Research Methods and Instrumentation 14:467–474. doi:10.3758/BF03203314
Sharieh A, Ellia G (2008) Toward international multi-sign languages. In: 19th International Conference on Database and Expert Systems Applications. DEXA’08, Turin, Italy, September 1–5, 2008, pp 622–625. doi:10.1109/DEXA.2008.129
Sosnik R, Hauptmann B, Karni A, Flash T (2004) When practice leads to co-articulation: the evolution of geometrically defined movement primitives. Experimental Brain Research 156:422–438. doi:10.1007/s00221-003-1799-4
Stokoe WC (1978) Sign language structure. Linstok Press, Silver Spring
Stokoe WC, Casterline DC, Croneberg CG (1976) A dictionary of American sign language on linguistic principles. Linstok Press, Silver Spring
Sudarsky S, House D (2000) An integrated approach towards the representation, manipulation and reuse of prerecorded motion. In: Proceedings of Computer Animation. CA’00, Philadelphia, PA, USA, 2000, pp 56–61. doi:10.1109/CA.2000.889036
Ye K, Yin B, Wang L (2009) CSLML: a markup language for expressive Chinese sign language systhesis. Computer Animation and Virtual Worlds 20:237–245. doi:10.1002/cav.307
Acknowledgments
The work in this paper was funded by National Natural Science Foundation of China (No. 61170104, 61370119, U0935004, 61227004), Beijing Natural Science Foundation (4112008).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, S., Wang, L. & Kong, D. Synthesis of sign language co-articulation based on key frames. Multimed Tools Appl 74, 1915–1933 (2015). https://doi.org/10.1007/s11042-013-1724-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1724-1