Abstract
This paper presents a new design and evaluation of customizable gesture commands on pen-based devices. Our objective is to help users during the definition of gestures by detecting confusion among gestures. We also help the memorization gestures with the guide of a new type of menu “Customizable Gesture Menus”. These menus are associated with an evolving gesture recognition engine that learns incrementally, starting from few data samples. Our research focuses on making user and recognition system learn at the same time, hence the term “cross-learning”. Three experimentations are presented in details in this paper to support these ideas.
Chapter PDF
Similar content being viewed by others
References
Kurtenbach, G., Buxton, W.: The limits of expert performance using hierarchic marking menus. In: Proc. INTERACT 1993, pp. 482–487. ACM Press (1993)
Kurtenbach, G., Moran, T.P., Buxton, W.: Contextual animation of gestural commands. Computer Graphics Forum 13(5), 305–314 (1994)
Zhao, S., Agrawala, M., Hinckley, K.: Zone and Polygon Menus: Using Relative Position to Increase the Breadth of Multi-stroke Marking Menus. In: Proc. CHI 2006, pp. 1077–1086. ACM Press (2006)
Zhao, S., Balakrishnan, R.: Simple vs. Compound Mark Hierarchical Marking Menus. In: Proc. UIST 2004, pp. 33–42. ACM Press (2004)
Bau, O., Mackay, W.E.: OctoPocus: a dynamic guide for learning gesture-based command sets. In: Proc. UIST 2008, pp. 37–46. ACM Press (2008)
Delaye, A., Anquetil, E.: Hbf49 feature set: A first unified baseline for online symbol recognition. Pattern Recognition 46(1), 117–130 (2013)
Delaye, A., Sekkal, R., Anquetil, E.: Continuous Marking Menus for learning Cursive Pen-based Gestures. In: Proc. IUI 2011, pp. 319–322. ACM Press (2011)
Bailly, G., Lecolinet, E., Nigay, L.: Wave Menus: Improving the Novice Mode of Hierarchical Marking Menus. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 475–488. Springer, Heidelberg (2007)
Almaksour, A., Anquetil, E., Quiniou, S., Cheriet, M.: Evolving Fuzzy Classifier: Application to Incremental Learning of Handwritten Gesture recognition Systems. In: Proc. ICPR 2010 (2010)
Almaksour, A., Anquetil, E.: Improving premise structure in evolving Takagi-Sugeno neuro-fuzzy classifiers. Evolving Systems 2, 25–33 (2011), doi:10.1007/s12530-011-9027-0
Petzold, C.: Canonical Splines in WPF and Silverlight, http://www.charlespetzold.com/blog/2009/01/Canonical-Splines-in-WPF-and-Silverlight.html
Guimbretiére, F., Winograd, T.: FlowMenu: combining command, text, and data entry. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, San Diego, California, United States, November 06-08, pp. 213–216 (2000), doi:10.1145/354401.354778
Igarashi, T., Matsuoka, S., Kawachiya, S., Tanaka, H.: Interactive beautification: a technique for rapid geometric design. In: Proc. UIST 1997, pp. 105–114. ACM Press (1997)
Norman, D.A.: Natural user interfaces are not natural. ACM Magazine Interactions 17(3), 6–10 (2010)
LaViola, J., Zeleznik, R.: A Practical Approach to Writer-Dependent Symbol Recognition Using a Writer-Independent Recognizer. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(11), 1917–1926 (2007)
Wobbrock, J.O., Wilson, A.D., Li, Y.: Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In: Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2007), Newport, Rhode Island, October 7-10, pp. 159–168. ACM Press, New York (2007)
Bouillon, M., Li, P., Anquetil, E., Richard, G.: Using Confusion Reject to Improve User and System Cross-Learning of Gesture Commands. In: Proc. ICDAR 2013 (to be appeared, 2013)
Li, P., Anquetil, E.: Graphical Gesture Commands’ learning with the help of Customizable Gesture Menus. In: Proc. IGS 2013 (to be appeared, 2013)
Li, P., Delaye, A., Anquetil, E.: Evaluation of Continuous Marking Menus for Learning Cursive Pen-based Commands. In: Proc. IGS 2011, pp. 217–220 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Li, P., Bouillon, M., Anquetil, E., Richard, G. (2013). User and System Cross-Learning of Gesture Commands on Pen-Based Devices. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40480-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-40480-1_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40479-5
Online ISBN: 978-3-642-40480-1
eBook Packages: Computer ScienceComputer Science (R0)