A Context-Based Collaborative Framework to Build Sign Language Databases by Real Users

  • Diego Roberto AntunesEmail author
  • André L. P. Guedes
  • Laura Sánchez García
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9176)


Sign Languages (SL) are the main tools used by Deaf people for access to information (AI), an essential issue to allow their social inclusion. Information Systems (IS) have a key role in this AI, but in some cases they fail to work by not considering the needs of the Deaf, such as a Human-Computer Interaction (HCI) with communication by SL. The Automatic SL Recognition (ASLR) area has developed algorithms to solve technical problems, but there’s still need to develop HCI tools for users in real contexts. This paper presents a context-based collaborative framework to create and upgrade SL databases by Deafs, to improve the development process of ASLR systems from the HCI perspective.


Context-based framework Tools for deafs Collaborative methods Sign language Datasets Real users Automatic recognition 


  1. 1.
    Acesso Brasil, May 2011.
  2. 2.
  3. 3.
    Spread the sign. (2015).
  4. 4.
    Abowd, G.D., Dey, A.K.: Towards a better understanding of context and context-awareness. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, pp. 304–307. Springer, Heidelberg (1999) CrossRefGoogle Scholar
  5. 5.
    Ackerman, M., Darrell, T., Weitzner, D.J.: Privacy in context. Hum.-Comput. Interact. 16(2–4), 167–176 (2001)CrossRefGoogle Scholar
  6. 6.
    Antunes, D.R.: Um Modelo de Descrição Computacional da Fonologia da Língua de Sinais Brasileira. Master’s thesis, Pós-Graduação em Informática, UFPR (2011)Google Scholar
  7. 7.
    Antunes, D.R., Guimarães, C., García, L.S., Oliveira, L.E.S., Fernandes, S.: A framework to support development of sign language human-computer interaction: building tools for effective information access and inclusion of the deaf. In: Proceedings of the Fifth IEEE International Conference on Research Challenges in Information Science, pp. 126–137 (2011)Google Scholar
  8. 8.
    Baker, C.A.: Microanalysis of the nonmanual components of questions in American Sign Language. Ph.D. thesis, University of California, Berkeley (1983)Google Scholar
  9. 9.
    Barros, L.: Suporte a ambientes distribuídos para aprendizagem cooperativa. Ph.D. thesis, COPPE/UFRJ, Rio de Janeiro (1994)Google Scholar
  10. 10.
    Brentari, D.: A Prosodic Model of Sign Language Phonology. A Bradford book - MIT Press, London (1998) Google Scholar
  11. 11.
    Bungerot, J., Stein, D., Dreuw, P., Ney, H., Morrissey, S., Way, A., van Zijl, L.: The atis sign language corpus (2008)Google Scholar
  12. 12.
    Chomsky, N.: Knowledge of Language: Its Nature, Origin and Use. Praeger Publishers, New York (1986) Google Scholar
  13. 13.
    Chvátal, V.: A greedy heuristic for the set-covering problem. Math. Oper. Res. 4(3), 233–235 (1979)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Cormen, T.H., Leiserson, C.E., Rivest, R.L., Stein, C.: Introduction to Algorithms, 2nd edn. The MIT Press, Cambridge (2001)zbMATHGoogle Scholar
  15. 15.
    Crasborn, O., Zwitserlood, I.: The corpus NGT: an online corpus for professionals and laymen. In: Workshop of Representation and Processing of Sign Languages (2008)Google Scholar
  16. 16.
    Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5(1), 4–7 (2001). CrossRefGoogle Scholar
  17. 17.
    Dreuw, P., Neidle, C., Athitsos, V., Sclaroff, S., Ney, H.: Benchmark databases for video-based automatic sign language recognition. In: LREC 2008, ELRA (2008)Google Scholar
  18. 18.
    Efthimiou, E., Fotinea, S.E., Hanke, T., Glauert, J., Bowden, R., Braffort, A., Collet, C., Maragos, J., Goudenove, F.: Dicta-sign: Sign language recognition, generation, and modelling: a research effort with applications in deaf communication proceedings of the language resources and evaluation. In: Conference Workshop on the Representation and Processing of Sign Languages : Corpora and Sign Languages Technologies (2010)Google Scholar
  19. 19.
    Efthimiou, E., Fotinea, S.-E.: GSLC: creation and annotation of a Greek sign language corpus for HCI. In: Stephanidis, C. (ed.) HCI 2007. LNCS, vol. 4554, pp. 657–666. Springer, Heidelberg (2007) CrossRefGoogle Scholar
  20. 20.
    Felipe, T.A.: Os Processos de Formação de Palavra na Libras. ETD - Educação Tematica Digital 7(2), 199–216 (2006)Google Scholar
  21. 21.
    Fernandes, S.: Educação de Surdos, 2nd edn. Editora Ibpex, Curitiba (2011)Google Scholar
  22. 22.
    García, L.S., Guimarães, C., Antunes, D.R., Fernandes, S.: HCI Architecture for Deaf Communities Cultural Inclusion and Citizenship. In: Proceedings of the 15th International Conference on Enterprise Information Systems - ICEIS 2013, vol. 3, pp. 68–75. Angers, France, July 2013Google Scholar
  23. 23.
    Guimarães, C., Antunes, D.R., Fernandes, S., García, L.S., Miranda, A.J.: Empowering collaboration among the deaf: Internet-based knowledge creation system.In: IADIS WWW/Internet 2011 Conference. Proceedings of the IADIS International Conference on WWW/Internet, pp. 137–144 (2011)Google Scholar
  24. 24.
    Jacko, J.A., Sears, A. (eds.): The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. L. Erlbaum Associates Inc., Hillsdale (2003) Google Scholar
  25. 25.
    Johnston, T., Schembri, A., Adam, R., Napier, J., Thornton, D.: Auslan Signbank: the Auslan Lexical Database (2015).
  26. 26.
    Kumar, E., Kishore, S.R.C., Kishore, P.V.V., Kumar, P.: Video audio interface for recognizing gestures of indian sign language. Int. J. Image Process. (IJIP) 5(4), 479–503 (2011)Google Scholar
  27. 27.
    Liddell, S.K., Johnson, R.E.: American sign language: the phonological base. In: Valli, C., Lucas, C. (eds.) (org.) Linguistics of American Sign Language: an introduction. Clerc Books/Gallaudet Press, Washington, D.C. (2002) (1989)Google Scholar
  28. 28.
    Martinez, A., Wilbur, R., Shay, R., Kak, A.: Purdue rvl-slll asl database for automatic recognition of american sign language. In: 2002 Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces, pp. 167–172 (2002)Google Scholar
  29. 29.
    Melnyk, M., Shadrova, V., Karwatsky, B.: Towards computer assisted international sign language recognition system: a systematic survey. Int. J. Comput. Appl. 89(17), 44–51 (2014)Google Scholar
  30. 30.
    Preece, J., Rogers, Y., Sharp, H.: Interaction Design, 1st edn. John Wiley & Sons Inc., New York (2002) Google Scholar
  31. 31.
    de Quadros, R.M., Karnopp, L.B.: Língua de Sinais Brasileira: Estudos Linguísticos. Artmed, Porto Alegre (2004)Google Scholar
  32. 32.
    da Rocha, L.V., Edelweiss, N., Iochpe, C.: Geoframe-t: a temporal conceptual framework for data modeling. In: Proceedings of the 9th ACM International Symposium on Advances in Geographic Information Systems. GIS 2001, pp. 124–129. ACM, New York, NY, USA (2001)Google Scholar
  33. 33.
    Rodden, T., Cheverst, K., Davies, K., Dix, A.: Exploiting context in hci design for mobile systems. Workshop on HCI with Mobile Devices (1998)Google Scholar
  34. 34.
    Schembri, A., Fenlon, J., Rentelis, R., Reynolds, S., Cormier, K.: Building the british sign language corpus. Lang. Documentation Conserv. 7, 136–154 (2013)Google Scholar
  35. 35.
    Shehabuddeen, N., Buddeen, N., Probert, D., Phaal, R., Platts, K.: Representing and approaching complex management issues: part 1 - role and definition. Centre for Technology Management (CTM) (1999)Google Scholar
  36. 36.
    Stokoe, W.C., Casterline, D., Croneberg, C.: The Dictionary of American Sign Language on Linguistic Principles. Gallaudet College Press, USA (1965)Google Scholar
  37. 37.
    Tijiboy, A.V., Maçada, D.L., Santarosa, L.M.C., Fagundes, L.d.C.: Aprendizagem cooperativa em ambientes telemáticos. Informática na Educação: teoria & prática. Porto Alegre, vol. 1(2) (abr. 1999), pp. 19–28 (1999)Google Scholar
  38. 38.
    Trindade, D.F.G.: InCoP: Um Framework Conceitual para o Design de Ambientes Colaborativos Inclusivos para Surdos e Não-Surdos de Cultivo a Comunidades de Prática. Ph.D. thesis, UFPR, Informatics Program, Curitiba, PR (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Diego Roberto Antunes
    • 1
    Email author
  • André L. P. Guedes
    • 1
  • Laura Sánchez García
    • 1
  1. 1.Federal University of Paraná (UFPR)CuritibaBrazil

Personalised recommendations