Comparing Hand Gesture Vocabularies for HCI

  • Alexander Mehler
  • Tim vor der Brück
  • Andy Lücking
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8511)


HCI systems are often equipped with gestural interfaces drawing on a predefined set of admitted gestures. We provide an assessment of the fitness of such gesture vocabularies in terms of their learnability and naturalness. This is done by example of rivaling gesture vocabularies of the museum information system WikiNect. In this way, we do not only provide a procedure for evaluating gesture vocabularies, but additionally contribute to design criteria to be followed by the gestures.


Image Description Section Header Museum Visitor Iconic Gesture Circular Segment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Pavlovic, V.I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 677–695 (1997)CrossRefGoogle Scholar
  2. 2.
    Quek, F.K.H., McNeill, D., Bryll, R.K., Duncan, S., Ma, X.F., Kirbas, C., McCullough, K.E., Ansari, R.: Multimodal human discourse: Gesture and speech. ACM Transactions on Computer-Human Interaction 9(3), 171–193 (2002)CrossRefGoogle Scholar
  3. 3.
    Poggi, I.: Iconicity in different types of gestures. Gesture 8(1), 45–61 (2008)CrossRefGoogle Scholar
  4. 4.
    Burks, A.W.: Icon, index, and symbol. PPR 9(4), 673–689 (1949)Google Scholar
  5. 5.
    Baudel, T., Beaudouin-Lafon, M.: Charade: Remote control of objects using free-hand gestures. Communications of the ACM 36(7), 28–35 (1993)CrossRefGoogle Scholar
  6. 6.
    Grandhi, S.A., Joue, G., Mittelberg, I.: Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In: Proceedings of SIGCHI, pp. 821–824 (2011)Google Scholar
  7. 7.
    Stern, H., Wachs, J., Edan, Y.: A method for selection of optimal hand gesture vocabularies. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds.) GW 2007. LNCS (LNAI), vol. 5085, pp. 57–68. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  8. 8.
    Mehler, A., Lücking, A.: WikiNect: Towards a gestural writing system for kinetic museum wikis. In: Proceedings of UXeLATE, pp. 7–12 (2012)Google Scholar
  9. 9.
    Mehler, A., Lücking, A., Abrami, G.: WikiNect: Image schemata as a basis of gestural writing for kinetic museum wikis. Universal Access in the Information Society (2014) (accepted)Google Scholar
  10. 10.
    Inceoglu, M.R.: WikiNect. BA thesis, Goethe University Frankfurt (2013)Google Scholar
  11. 11.
    Asir, A., Creech, B., Homburg, T., Hoxha, N., Röhrl, B., Stender, N., Uslu, T., Wiegand, T., Kastrati, L., Valipour, S., Akemlek, D., Auth, C., Hemati, A.: Korchi, Said Omari, S., Schöneberger, C.: Praktikum WikiNect (2013)Google Scholar
  12. 12.
    Klein, W.: Raumausdrücke. Linguistische Berichte 132, 77–114 (1991)Google Scholar
  13. 13.
    Lücking, A., Bergmann, K., Hahn, F., Kopp, S., Rieser, H.: The Bielefeld speech and gesture alignment corpus (SaGA). In: Multimodal Corpora: Advances in Capturing, Coding and Analyzing Multimodality, LREC 2010, pp. 92–98 (2010)Google Scholar
  14. 14.
    Jörgensen, C., Jaimes, A., Benitez, A., Chang, S.: A conceptual framework and empirical research for classifying visual descriptors. Journal of the Am. Soc. f. Inf. Sci. a. Tech. 52(11), 938–947 (2001)CrossRefGoogle Scholar
  15. 15.
    Zipf, G.K.: Human Behavior and the Principle of Least Effort. An Introduction to Human Ecology. Hafner Publishing Company, New York (1972)Google Scholar
  16. 16.
    Newman, M.E.J.: Power laws, Pareto distributions and Zipf’s law. Cont. Phys. 46, 323–351 (2005)CrossRefGoogle Scholar
  17. 17.
    Adamic, L.A.: Zipf, power-law, Pareto — A ranking tutorial (2000),
  18. 18.
    Rohde, H., Clarke, A., Elsner, M.: Wally referring expression corpus (wrec) v0.1.0, (dataset). University of Edinburgh. School of Philosophy, Psychology, & Language Sciences. Linguistics & English Language (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Alexander Mehler
    • 1
  • Tim vor der Brück
    • 1
  • Andy Lücking
    • 1
  1. 1.Text Technology Lab, Department of Computer Science and MathematicsGoethe-University Frankfurt am MainGermany

Personalised recommendations