Abstract
Sign language and Web 2.0 applications are currently incompatible, because of the lack of anonymisation and easy editing of online sign language contributions. This paper describes Dicta-Sign, a project aimed at developing the technologies required for making sign language-based Web contributions possible, by providing an integrated framework for sign language recognition, animation, and language modelling. It targets four different European sign languages: Greek, British, German, and French. Expected outcomes are three showcase applications for a search-by-example sign language dictionary, a sign language-to-sign language translator, and a sign language-based Wiki.
Chapter PDF
Similar content being viewed by others
References
Ong, A.C.W., Ranganath, S.: Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning. IEEE Trans. PAMI 27(6), 873–891 (2005)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–154 (2004)
Maragos, P.: Morphological Filtering for Image Enhancement and Detection. In: Bovik, A.C. (ed.) The Image and Video Processing Handbook, 2nd edn., pp. 135–156. Elsevier Acad. Press, Amsterdam (2005)
Sofou, A., Maragos, P.: Generalized Flooding and Multicue PDE-based Image Segmentation. IEEE Transactions on Image Processing 17(3), 364–376 (2008)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. PAMI 23(6), 681–685 (2001)
Papandreou, G., Maragos, P.: Multigrid Geometric Active Contour Models. IEEE Trans. Image Processing 16(1), 229–240 (2007)
Starner, T., Weaver, J., Pentland, A.: Real-Time American Sign Language Recognition Using Desk and Wearable Computer-Based Video. IEEE Trans. Pattern Analysis and Machine Intelligence 20(12), 1371–1375 (1998)
Vogler, C., Metaxas, D.: A Framework for Recognizing the Simultaneous Aspect of ASL. CVIU 81, 358–384 (2001)
Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.G.: The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. MIT Press, Cambridge (2000)
Gravier, G., Potamianos, G., Neti, C.: Asynchrony modeling for audiovisual speech recognition. In: Proc. Human Language Technology Conference, San Diego, California (March 2002)
Fotinea, S.-E., Efthimiou, E., Karpouzis, K., Caridakis, G., Glauert, J. (eds.): A Knowledge-based Sign Synthesis Architecture. Emerging Technologies for Deaf Accessibility in the Information Society: Editorial. Journal of Universal Access in the Information Society 6(4), 405–418 (special issue, 2008)
Marshall, I., Sáfár, E.: Grammar Development for Sign Language Avatar-Based Synthesis. In: Proceedings HCII 2005, 11th International Conference on Human Computer Interaction (CD-ROM), Las Vegas, USA (July 2005)
Braffort, A., Bossard, B., Segouat, J., et al.: Modélisation des relations spatiales en langue des signes française. In: TALS 2005, atelier de TALN 2005 (2005)
Elliott, R., Glauert, J.R.W., Kennaway, J.R., Marshall, I.: Development of Language Processing Support for the Visicast Project. In: ASSETS 2000 4th International ACM SIGCAPH Conference on Assistive Technologies, Washington, DC, USA (2000)
Hanke, T.: HamNoSys - representing sign language data in language resources and language processing contexts. In: Streiter, O., Vettori, C. (eds.) LREC 2004, Workshop proceedings: Representation and processing of sign languages, pp. 1–6. ELRA, Paris (2004)
Efthimiou, E., Sapountzaki, G., Karpouzis, K., Fotinea, S.-E.: Developing an e-Learning Platform for the Greek Sign Language. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds.) ICCHP 2004. LNCS, vol. 3118, pp. 1107–1113. Springer, Heidelberg (2004)
Braffort, A., Choisier, A., Collet, C., et al.: Toward an annotation software for video of Sign Language, including image processing tools and signing space modelling. In: LREC 2004 (2004)
Gianni, F., Collet, C., Dalle, P.: Robust tracking for processing of videos of communication’s gestures. In: International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2007), Lisbon, Portugal (May 2007)
Efthimiou, E., Fotinea, S.-E.: GSLC: Creation and Annotation of a Greek Sign Language Corpus for HCI. In: Stephanidis, C. (ed.) HCI 2007. LNCS, vol. 4554, pp. 657–666. Springer, Heidelberg (2007)
Neidle, C., Sclaroff, S.: Data collected at the National Center for Sign Language and Gesture Resources, Boston University (2002), http://www.bu.edu/asllrp/ncslgr.html
Koehn, P., Och, F.J., Marcu, D.: Statistical Phrase-Based Translation. In: Proceedings of the Human Language Technology Conference 2003 (HLT-NAACL 2003), Edmonton, Canada (May 2003)
Diab, M., Finch, S.: A Statistical Word-Level Translation Model for Comparable Corpora. In: Proceedings of the Conference on Content-Based Multimedia Information Access, RIAO 2000, Paris, France, April 12-14 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Efthimiou, E. et al. (2009). Sign Language Recognition, Generation, and Modelling: A Research Effort with Applications in Deaf Communication. In: Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Addressing Diversity. UAHCI 2009. Lecture Notes in Computer Science, vol 5614. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02707-9_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-02707-9_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02706-2
Online ISBN: 978-3-642-02707-9
eBook Packages: Computer ScienceComputer Science (R0)