Advertisement

Towards Interactive Web-Based Virtual Signers: First Step, a Platform for Experimentation Design

  • Jean-Paul Sansonnet
  • Annelies Braffort
  • Cyril Verrecchia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5934)

Abstract

In this paper, we present a Web-based framework for interactive Sign Language using virtual signing agents. The main feature of this framework is that it is a full DOM-Integrated architecture. Firstly, we discuss the advantages and the constraints raised by the implementation of proper interactive Virtual Signers within this full DOM-integrated approach. Secondly, we discuss an experimental study about Web-based Virtual Signers that take advantage of the specific interactivity provided by our framework. This study deals with a structure of Sign Language utterances that requires dynamic handling of spatio-temporal variability and coarticulation stances in the sign generation phase.

Keywords

Web-based Virtual Signers Sign Language dynamic generation Sign variability Coarticulation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Losson, O., Cantegrit, B.: An assistive interface for learning lexical corpus employing a virtual signer. Technology and Accessibility 13(2), 83–94 (2000)Google Scholar
  2. 2.
    Braffort, A., Dalle, P.: Sign language applications: preliminary modeling. International journal “Universal Access in the Information Society” (UAIS), Special issue 6/4 “Emerging Technologies for Deaf Accessibility in the Information Society”. Springer, Heidelberg (2007)Google Scholar
  3. 3.
    Liddell, S.: Grammar, gesture and meaning in American Sign Language. Cambridge University Press, Cambridge (2003)CrossRefGoogle Scholar
  4. 4.
    Cuxac, C.: La Langue des Signes Française (LSF): les voies de l’iconicité. Faits de langues 15-16, Ophrys (2000)Google Scholar
  5. 5.
    ScienceSign URL, the online BSL/English glossary for science education, http://www.sciencesigns.ac.uk
  6. 6.
    Adamo-Villani, N., Benes, B., Brisbin, M.: A natural interface for sign language mathematics. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Nefian, A., Meenakshisundaram, G., Pascucci, V., Zara, J., Molineros, J., Theisel, H., Malzbender, T. (eds.) ISVC 2006. LNCS, vol. 4291, pp. 70–79. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  7. 7.
    Heloir, A., Gibet, S., Multon, F., Courty, N.: Captured Motion Data Processing for Real Time Synthesis of Sign Language. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 168–171. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Elliott, R., Glauert, J., Jennings, V., Kennaway, J.R.: An Overview of the SiGML Notation and SiGML Signing Software System. In: Fourth International Conference on Language Resources and Evaluation, LREC 2004, pp. 98–104 (2004)Google Scholar
  10. 10.
    Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J., et al.: Hamburg notation system for sign languages: An introductory guide, Institute of German Sign Language and Communication of the Deaf, University of Hamburg. International Studies on Sign Language and the Communication of the Deaf, vol. 5 (1989)Google Scholar
  11. 11.
    Avatar Signing Dictionary: Scottish BSL, http://www2.cmp.uea.ac.uk/~jrwg/Dictionary094/
  12. 12.
    Signing Science Dictionary (SSD), http://signsci.terc.edu/
  13. 13.
    Maes, P.: Agents that reduce work and information overload. CACM 37(7), 30–40 (1994)Google Scholar
  14. 14.
    Randall, N., Pedersen, I.: Who exactly is trying to help us? The ethos of help systems in popular computer applications. In: 16th Annual Int. Conf. on Computer Documentation, pp. 63–69. ACM, New York (1998)Google Scholar
  15. 15.
    Lester, J., Converse, S., et al.: The Persona Effect: Affective Impact of Animated Pedagogical Agents. In: CHI 1997 (1997)Google Scholar
  16. 16.
    Prendinger, H., Mayer, S., Mori, J., Ishizyka, M.: Persona Effect revisited: Using bio-signals to measure and reflect the impact of character-based interfaces. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 283–291. Springer, Heidelberg (2003)Google Scholar
  17. 17.
    Sansonnet, J.-P., Leray, D., Martin, J.-C.: Architecture of a Framework for Generic Assisting Conversational Agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 145–156. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  18. 18.
    Buisine, S., Abrilian, S., Rendu, C., Martin, J.-C.: Towards Experimental Specification and Evaluation of Lifelike Multimodal Behavior. In: Workshop on Embodied Conversational Agents at AAMAS (2002)Google Scholar
  19. 19.
    Segouat, J.: A study of sign language coarticulation. ACM SIGACCESS Accessibility and Computing (93), 31–38 (2009)Google Scholar
  20. 20.
  21. 21.
    Sansonnet, J.-P., Braffort, A., Segouat, J., Verrecchia, C.: SL Teacher: a Framework for teaching LSF on the Web. In: Second International Conference on ICT and Accessibility (2009)Google Scholar
  22. 22.
    Elliott, R., Glauer, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modeling and language-processing technologies for Avatar-based sign language presentation. In: Universaal Access in the Information Society, 6/4. Springer, Heidelberg (2008)Google Scholar
  23. 23.
    Huenerfauth, M.: Spatial, Temporal, and Semantic Models for American Sign Language Generation: Implications for Gesture Generation. Int. J. Semantic Computing 2(1), 21–45 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Jean-Paul Sansonnet
    • 1
  • Annelies Braffort
    • 1
  • Cyril Verrecchia
    • 1
  1. 1.LIMSI-CNRSOrsay cedexFrance

Personalised recommendations