Towards Interactive Web-Based Virtual Signers: First Step, a Platform for Experimentation Design

  • Jean-Paul Sansonnet
  • Annelies Braffort
  • Cyril Verrecchia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5934)


In this paper, we present a Web-based framework for interactive Sign Language using virtual signing agents. The main feature of this framework is that it is a full DOM-Integrated architecture. Firstly, we discuss the advantages and the constraints raised by the implementation of proper interactive Virtual Signers within this full DOM-integrated approach. Secondly, we discuss an experimental study about Web-based Virtual Signers that take advantage of the specific interactivity provided by our framework. This study deals with a structure of Sign Language utterances that requires dynamic handling of spatio-temporal variability and coarticulation stances in the sign generation phase.


Web-based Virtual Signers Sign Language dynamic generation Sign variability Coarticulation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Losson, O., Cantegrit, B.: An assistive interface for learning lexical corpus employing a virtual signer. Technology and Accessibility 13(2), 83–94 (2000)Google Scholar
  2. 2.
    Braffort, A., Dalle, P.: Sign language applications: preliminary modeling. International journal “Universal Access in the Information Society” (UAIS), Special issue 6/4 “Emerging Technologies for Deaf Accessibility in the Information Society”. Springer, Heidelberg (2007)Google Scholar
  3. 3.
    Liddell, S.: Grammar, gesture and meaning in American Sign Language. Cambridge University Press, Cambridge (2003)CrossRefGoogle Scholar
  4. 4.
    Cuxac, C.: La Langue des Signes Française (LSF): les voies de l’iconicité. Faits de langues 15-16, Ophrys (2000)Google Scholar
  5. 5.
    ScienceSign URL, the online BSL/English glossary for science education,
  6. 6.
    Adamo-Villani, N., Benes, B., Brisbin, M.: A natural interface for sign language mathematics. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Nefian, A., Meenakshisundaram, G., Pascucci, V., Zara, J., Molineros, J., Theisel, H., Malzbender, T. (eds.) ISVC 2006. LNCS, vol. 4291, pp. 70–79. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Heloir, A., Gibet, S., Multon, F., Courty, N.: Captured Motion Data Processing for Real Time Synthesis of Sign Language. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 168–171. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Elliott, R., Glauert, J., Jennings, V., Kennaway, J.R.: An Overview of the SiGML Notation and SiGML Signing Software System. In: Fourth International Conference on Language Resources and Evaluation, LREC 2004, pp. 98–104 (2004)Google Scholar
  10. 10.
    Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J., et al.: Hamburg notation system for sign languages: An introductory guide, Institute of German Sign Language and Communication of the Deaf, University of Hamburg. International Studies on Sign Language and the Communication of the Deaf, vol. 5 (1989)Google Scholar
  11. 11.
    Avatar Signing Dictionary: Scottish BSL,
  12. 12.
    Signing Science Dictionary (SSD),
  13. 13.
    Maes, P.: Agents that reduce work and information overload. CACM 37(7), 30–40 (1994)Google Scholar
  14. 14.
    Randall, N., Pedersen, I.: Who exactly is trying to help us? The ethos of help systems in popular computer applications. In: 16th Annual Int. Conf. on Computer Documentation, pp. 63–69. ACM, New York (1998)Google Scholar
  15. 15.
    Lester, J., Converse, S., et al.: The Persona Effect: Affective Impact of Animated Pedagogical Agents. In: CHI 1997 (1997)Google Scholar
  16. 16.
    Prendinger, H., Mayer, S., Mori, J., Ishizyka, M.: Persona Effect revisited: Using bio-signals to measure and reflect the impact of character-based interfaces. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 283–291. Springer, Heidelberg (2003)Google Scholar
  17. 17.
    Sansonnet, J.-P., Leray, D., Martin, J.-C.: Architecture of a Framework for Generic Assisting Conversational Agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 145–156. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  18. 18.
    Buisine, S., Abrilian, S., Rendu, C., Martin, J.-C.: Towards Experimental Specification and Evaluation of Lifelike Multimodal Behavior. In: Workshop on Embodied Conversational Agents at AAMAS (2002)Google Scholar
  19. 19.
    Segouat, J.: A study of sign language coarticulation. ACM SIGACCESS Accessibility and Computing (93), 31–38 (2009)Google Scholar
  20. 20.
  21. 21.
    Sansonnet, J.-P., Braffort, A., Segouat, J., Verrecchia, C.: SL Teacher: a Framework for teaching LSF on the Web. In: Second International Conference on ICT and Accessibility (2009)Google Scholar
  22. 22.
    Elliott, R., Glauer, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modeling and language-processing technologies for Avatar-based sign language presentation. In: Universaal Access in the Information Society, 6/4. Springer, Heidelberg (2008)Google Scholar
  23. 23.
    Huenerfauth, M.: Spatial, Temporal, and Semantic Models for American Sign Language Generation: Implications for Gesture Generation. Int. J. Semantic Computing 2(1), 21–45 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jean-Paul Sansonnet
    • 1
  • Annelies Braffort
    • 1
  • Cyril Verrecchia
    • 1
  1. 1.LIMSI-CNRSOrsay cedexFrance

Personalised recommendations