An Improved Framework for Layering Linguistic Processes in Sign Language Generation: Why There Should Never Be a “Brows” Tier

  • John McDonald
  • Rosalee Wolfe
  • Sarah Johnson
  • Souad Baowidan
  • Robyn Moncrief
  • Ningshan Guo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10278)


Creating legible animations of sign language that satisfy the needs of native users requires drawing from the fields of computational linguistics, computer animation and user experience research. This paper explores the problem of layering the many linguistic processes that contribute to a sign language utterance in avatar animation. A new framework is presented that satisfies requirements from each of these fields, and yields a flexible architecture for sign language avatars capable of leveraging a wide range of animation techniques to generate rich multi-layered animations of sign.


Sign language avatars Computational linguistics Computer animation Hierarchical models User interface 


  1. 1.
    Signed Language vs. Sign Language, Canadian Cultural Society of the Deaf. Accessed 17 Jan 2017
  2. 2.
    Valli, C., Lucas, C.: Linguistics of American Sign Language: An Introduction. Gaulladet University Press, Washington D.C. (2000)Google Scholar
  3. 3.
    Elliott, R., Glauert, J.R., Kennaway, R., Marshall, I., Safar, E.: Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. Univ. Access Inf. Soc. 6(4), 375–391 (2008)CrossRefGoogle Scholar
  4. 4.
    Kipp, M., Heloir, A., Nguyen, Q.: Sign language avatars: animation and comprehensibility. In: International Workshop on Intelligent Virtual Agents (2011)Google Scholar
  5. 5.
    Crasborn, O., Sloetjes, H.: Enhanced ELAN functionality for sign language corpora. In: Proceedings of the 3rd Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corpora (2008)Google Scholar
  6. 6.
    Hanke, T., Storz, J.: iLex – a database tool for integrating sign language corpus linguistics and sign language lexicography. In: Workshop on the Representation and Processing of Sign Language, at the Sixth International Conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco (2008)Google Scholar
  7. 7.
    Kipp, M.: Multimedia annotation, querying and analysis in ANVIL. In: Multimedia Information Extraction, vol. 19 (2010)Google Scholar
  8. 8.
    Hanke, T.: Lexical sign language resources: synergies between empirical work and automatic language generation. In: Language Resources and Evaluation Conference (LREC), Libson (2004)Google Scholar
  9. 9.
    Thorpe, D.: Certified ASL Interpreter. Personal Communication, Chicago (2016)Google Scholar
  10. 10.
    Lidell, S., Johnson, R.: American sign language: the phonological base. Sign Lang. Stud. 64(1), 195–277 (1989)CrossRefGoogle Scholar
  11. 11.
    Wilbur, R.: Phonological and prosodic layering of nonmanuals in American sign language. In: Emmorey, K., Lane, H.L., Bellugi, U., Klima, E. (eds.) The Signs of Language Revisited: Festscrift for Ursula Bellugi and Edward Klima, pp. 213–241 (2000)Google Scholar
  12. 12.
    Morgan, G.: Event packaging in British Sign Language discourse. In: Wiinston, E. (ed.) Storytelling & Conversation: Discourse in Deaf Communities, pp. 27–58. Gallaudet University Press, Washington, DC (1999)Google Scholar
  13. 13.
    Schick, B.: Classifier predicates in American Sign Language. Int. J. Sign Linguist. 1(1), 15–40 (1990)MathSciNetGoogle Scholar
  14. 14.
    Filhol, M.: «Grammaire récursive non linéaire pour les langues des signes,» chez Conférence sur le Traitement Automatique des Langues Naturelles, Marseille (2014)Google Scholar
  15. 15.
    Wolfe, R., McDonald, J., Moncrief, R., Baowidan, S., Stumbo, M.: Inferring biomechanical kinematics from linguistic data: a case study for role shift. In: Symposium on Sign Language Translation and Avatar Technology (SLTAT), Paris, France (2015)Google Scholar
  16. 16.
    Weast, T.P.: Questions in American Sign Language: A quantitative analysis of raised and lowered eyebrows, ProQuest (2008)Google Scholar
  17. 17.
    Wolfe, R., Cook, P., McDonald, J., Schnepp, J.: Linguistics as structure in computer animation: Toward a more effective synthesis of brow motion in American Sign Language. Nonmanuals Sign Lang. Spec. Issue Sign Lang. Linguist. 14(1), 179–199 (2011)Google Scholar
  18. 18.
    Lasseter, J.: Director, Toy Story. [Film]. Walt Disney Pictures/Pixar Studios, USA (1995)Google Scholar
  19. 19.
    Lee, J., Lee, K.H.: Precomputing avatar behavior from human motion data. Graph. Models 68(2), 158–174 (2006)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Wolfe, R., McDonald, J., Schnepp, J.: An Avatar to Depict Sign Language: Building from Reusable Hand Animation, Berlin, Germany, 10–11 January 2011Google Scholar
  21. 21.
    Gibet, S., Courty, N., Duarte, K., Le Naour, T.: The SignCom system for data-driven animation of interactive virtual signers: methodology and evaluation. ACM Trans. Interact. Intell. Syst. (TiiS) 1(1), 1–26 (2011)CrossRefGoogle Scholar
  22. 22.
    Jennings, V., Elliott, R., Kennaway, R.: Requirements for a signing avatar. In: Workshop on Copora and Sign Language Technologies (CSLT), LREC, Malta (2010)Google Scholar
  23. 23.
    McDonald, J., Wolfe, R., Wilbur, R., Moncrief, R., Malaia, E., Fujimoto, S., Baowidan, S., Stec, J.: A new tool to facilitate prosodic analysis of motion capture data and a data-driven technique for the improvement of avatar motion. In: Lanugage Resources Evaluation Conference (LREC), Portoroz (2016)Google Scholar
  24. 24.
    Lefebvre-Albaret, F., Gibet, S., Turki, A., Hamon, L., Brun, R.: Overview of the Sign3D Project High-fidelity 3D recording, indexing and editing of French Sign Language content. In: Third International Symposium on Sign Language Translation and Avatar Technology (SLTAT), Chicago (2013)Google Scholar
  25. 25.
    McDonald, J., Wolfe, R., Schnepp, J., Hochgesang, J., Jamrozik, D., Stumbo, M., Berke, L., Bialek, M., Thomas, F.: An automated technique for real-time production of lifelike animations of American Sign Language, pp. 1–16 (2015)Google Scholar
  26. 26.
    Parent, R.: Computer Animation: Algorithms and Techniques. Newnes, Boston (2012)Google Scholar
  27. 27.

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • John McDonald
    • 1
  • Rosalee Wolfe
    • 1
  • Sarah Johnson
    • 1
  • Souad Baowidan
    • 1
  • Robyn Moncrief
    • 1
  • Ningshan Guo
    • 1
  1. 1.DePaul UniversityChicagoUSA

Personalised recommendations