Abstract
Current gesture interfaces accept relatively simple postures and motions for reliable inputs, which are still far from natural and intuitive experiences for the users. This paper suggests a unique idea that haptic feedback has a potential to improve not only user experiences but also gesture recognition performances. We expect haptic feedback to provide users cues for natural writing movement and accordingly generate movement easily recognized by the system. We developed a writing gesture recognition system using the K-Means clustering algorithm for writing state estimation and a haptic feedback system which involved frictional sensation during writing and impulsive sensation at the beginning and ending of writing. The experiments on five participants showed an approximately 5 % and 4 % improvement in the true positive and the false negative gesture recognition rate with visual-haptic feedback compared to visual feedback alone. We confirmed that the improvement was due to changes in hand motion by haptic feedback, which led to a higher correlation between reference waveform and performed motion and an increase of the finger stopping time at the end of the writing. We also confirmed the positive effects of our haptic feedback on the user experiences.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13, 6380–6393 (2013)
Monnai, Y., Hasegawa, K., Fujiwara, M., Yoshino, K., Inoue, S., Shinoda, H.: HaptoMime: mid-air haptic interaction with a floating virtual Screen. In: Proceedings of ACM UIST, pp. 663–667 (2014)
Adams, R.J., Olowin, A.B., Hannaford, B., Sands, O.S.: Tactile data entry for extravehicular activity. In: 2011 IEEE World Haptics Conference (WHC), pp. 305–310 (2011)
Krol, L.R., Aliakseyeu, D., Subramanian, S.: Haptic feedback in remote pointing. In: Proceedings of CHI 2009 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2009), pp. 3763–3768 (2009)
Burke, J.L., Prewett, M.S., Gray, A.A., Yang, L., Stilson, F.R.B., Coovert, M.D., Elliot, L.R., Redden, E.: Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. In: Proceedings of the 8th International Conference on Multimodal Interfaces (ICMI 2006), pp. 108–117 (2006)
Lehtinen, V., Oulasvirta, A., Salovaara, A., Nurmi, P.: Dynamic tactile guidance for visual search tasks. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 445–452 (2012)
Rotella, M.F., Guerin, K., Xingchi, H., Okamura, A.M.: HAPI Bands: a haptic augmented posture interface. In: 2012 IEEE Haptics Symposium (HAPTICS), pp. 163–170 (2012)
Bark, K., Hyman, E., Tan, F., Cha, E., Jax, S.A., Buxbaum, L.J., Kuchenbecker, K.J.: Effects of vibrotactile feedback on human learning of arm motions. IEEE Trans. Neural Syst. Rehabil. Eng. 23(1), 51–63 (2015)
Xu, M., Wang, D., Zhang, Y., Song, J., Wu, D.: 2015 IEEE Performance of simultaneous motion and respiration control under guidance of audio-haptic cues. In: World Haptics Conference (WHC), pp. 421-427 (2015)
Tsuchiya, S., Konyo, M., Yamada, H., Yamauchi, T., Okamoto, S., Tadokoro, S.: Virtual Active Touch II: vibrotactile representation of friction and a new approach to surface shape display. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3184–3189 (2009)
Okamura, A.M., Cutkosky, M.R., Dennerlein, J.T.: Reality-based models for vibration feedback in virtual environments. IEEE/ASME Trans. Mechatron. 6(3), 245–252 (2001)
Acknowledgment
This work was supported in part from ImPACT Program (Tough Robotics Challenge).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Babu, D., Kim, S., Nagano, H., Konyo, M., Tadokoro, S. (2016). Can Haptic Feedback Improve Gesture Recognition in 3D Handwriting Systems?. In: Kubota, N., Kiguchi, K., Liu, H., Obo, T. (eds) Intelligent Robotics and Applications. ICIRA 2016. Lecture Notes in Computer Science(), vol 9834. Springer, Cham. https://doi.org/10.1007/978-3-319-43506-0_41
Download citation
DOI: https://doi.org/10.1007/978-3-319-43506-0_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43505-3
Online ISBN: 978-3-319-43506-0
eBook Packages: Computer ScienceComputer Science (R0)