Toward Modeling Sign Language Coarticulation

  • Jérémie Segouat
  • Annelies Braffort
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5934)


This article presents a study on coarticulation modeling in French Sign Language. Our aim is to use this model to provide information to deaf people, by the mean of a virtual signer. We propose a definition for “coarticulation”, based on an overview of the literature. We explain the methodology we have set up: from video corpus design to features correlations extractions, through corpus annotations and analysis. We expose first results and what are going to be the next steps of this study.


Sign Language Coarticulation Modeling Corpus Design Corpus Annotation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Moody, B.: La communication internationale chez les sourds (International communication of the deaf). Rééducation Orthophonique 107, 213–223 (1979)Google Scholar
  2. 2.
    Mottez, B.: Les banquets de Sourds-Muets et la naissance du mouvement sourd (Dinners of the Deaf-Mute and root of the deaf movement). Le pouvoir des signes, pp. 170–178. INJS, Paris (1989)Google Scholar
  3. 3.
    Cuxac, C.: La langue des signes française; Les voies de l’iconicité (French Sign Language; Iconicity). In: Ophrys (ed.) Faits de Langues 15/16, Paris (2000)Google Scholar
  4. 4.
    Sallandre, M.-A.: Simultaneity in French Sign Language Discourse. In: Vermeerbergen, Leeson, Crasborn (eds.) Simultaneity in Signed Languages: Form and Function (2007)Google Scholar
  5. 5.
    Cox, S.J., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., Abbott, S.: TESSA, a system to aid communication with deaf people. In: 5th Conference on Assistive Technologies. ASSETS 2002 (2002)Google Scholar
  6. 6.
    VCom3D: SigningAvatar Frequently Asked Questions (2000),
  7. 7.
    Elliott, R., Glauert, J., Kennaway, J., Marshall, I., Safr, E.: Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. In: Springer (ed.) Universal Access in the Information Society (UAIS), Special issue 6/4 (2004)Google Scholar
  8. 8.
    Segouat, J., Braffort, A.: Toward the Study of Sign Language Coarticulation: Methodology Proposal. In: 2nd International Conference on Advances in Computer-Human Interactions ACHI 2009 (2009)Google Scholar
  9. 9.
    Wood, S.A.J.: Assimilation or coarticulation? Evidence from the temporal co-ordination of tongue gestures for the palatalization of Bulgarian alveolar stops. Journal of Phonetics 24(1), 139–164 (1996)CrossRefGoogle Scholar
  10. 10.
    Vogler, C.: American Sign Language Recognition: Reducing the Complexity of the Task with Phoneme-Based Modeling and Parallel Hidden Markov Models. Doctoral Thesis. University of Pennsylvania (2002)Google Scholar
  11. 11.
    Benguerel, A.P., Cowan, H.A.: Coarticulation of upper lip protrusion in French. Phonetica 30, 41–55 (1974)CrossRefGoogle Scholar
  12. 12.
    Marchal, A.: La production de la parole (Speech Production). Hermes Science Publications, Paris (2007)Google Scholar
  13. 13.
    Shamaie, A., Hai, W., Sutherland, A.: Hand gesture recognition for HCI. ERCIM News 46 (2001),
  14. 14.
    Jurafsky, D., Martin, J.H.: Speech and Language Processing. Prentice Hall, Upper Saddle River (2000)Google Scholar
  15. 15.
    Yang, R., Sarkar, S., Loeding, B.: Enhanced Level Building Algorithm for the Movement Epenthesis Problem in Sign Language Recognition. In: Computer Vision and Pattern Recognition IEEE Conference, pp. 1–8, 17–22 (2007)Google Scholar
  16. 16.
    Holt, G.T., Hendriks, P., Andringa, T.: Why Don’t You See What I Mean? Prospects and Limitations of Current Automatic Sing Recognition Research. Sign Language Studies 6(4) (2006)Google Scholar
  17. 17.
    Huenerfauth, M.: Generating American Sign Language classifier predicates for English-to-ASL machine translation, Doctoral Thesis. University of Pennsylvania (2006)Google Scholar
  18. 18.
    Segouat, J., Braffort, A., Bolot, L., Choisier, A., Filhol, M., Verrecchia, C.: Building 3D French Sign Language lexicon. In: 3rd Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corpora. 6th international conference on Language Resources and Evaluation, LREC 2008 (2008)Google Scholar
  19. 19.
    Kipp, M.: Anvil - A Generic Annotation Tool for Multimodal Dialogue. In: 7th European Conference on Speech Communication and Technology, Eurospeech 2001 (2001)Google Scholar
  20. 20.
    Sallandre, M.-A.: Les unités du discours en Langue des Signes Française. Tentative de catégorisation dans le cadre d’une grammaire de l’iconicité (Discourse unit in French Sign Language. A try to categorization within the scope of a grammar of iconicity), Doctoral Thesis. University of Paris VIII (2003)Google Scholar
  21. 21.
    Johnson, R.E., Liddell, K.S.: Sign language phonetics: architecture and description (in preparation)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jérémie Segouat
    • 1
    • 2
  • Annelies Braffort
    • 1
  1. 1.LIMSI-CNRSOrsayFrance
  2. 2.WebSourd, Bât AToulouseFrance

Personalised recommendations