Abstract
A wearable device for sign language translation, called Talking Hands, is presented. It is composed by a custom data glove, which is designed to optimize the data acquisition, and a smartphone application, which offers user personalizations. Although Talking Hands can not translate a whole sign language, it offers an effective communication to deaf and mute people with everyone through a scenario-based translation. The different challenges of a gesture recognition system have been overcame with simple solutions, since the main goal of this work is an user-based product.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Khan, R.Z., Ibraheem, N.A.: Hand gesture recognition: a literature review. Int. J. Artif. Intell. Appl. 3(4) (2012)
Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 37(3) (2007)
Ong, S.C.W., Ranganath, S.: Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27(6) (2005)
Vogler, C.: American sign language recognition: reducing the complexity of the task with phoneme-based modeling and parallel hidden Markov models. Ph.D. thesis, University of Pennsylvania (2003)
Cooper, H., Pugeault, N., Bowden, R.: Reading the signs: a video based sign dictionary. IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Nov 2011
Starner, T., Weaver, J., Pentland, A.: Real time American Sign Language recognition using desk and wearable computer based video. IEEE Trans. Pattern Anal. Mach. Intell. 20(12) (1998)
Kelly, D., McDonald, J., Markham, C.: A person independent system for recognition of hand postures used in sign language. Pattern Recognit. Lett. 31, 1359–1368 (2010)
Ho-Sub, Y., Jung, S., Younglae, J.B., Hyun, S.Y.: A person independent system for recognition of hand postures used in sign language. Pattern Recognit. 34, 1491–1501 (2001)
Parvini, F., McLeod, D., Shahabi, C., Navai, B., Zali, B., Ghandeharizadeh, S.: An Approach to Glove-Based Gesture Recognition, California 90089-0781 (2009)
Bukhari, J., Rehman, M., Malik, S.I., Kamboh, A.M., Salman, A.: American Sign Language translation through sensory glove; SignSpeak. Int. J. u- and e-Serv. Sci. Technol. 8(1), 131–142 (2015)
Akhmadeev, K.: A testing system for a real-time gesture classification using surface EMG. In: Preprints of the 20th World Congress, The International Federation of Automatic Control, Toulouse, France, 9–14 July 2017
Kouichi, M., Hitomi, T.: Gesture recognition using recurrent neural networks. In: ACM Conference on Human Factors in computing Systems: Reaching Through Technology (1999)
Xingyan, L.: Gesture Recognition Based on Fuzzy C-Means Clustering Algorithm. Departement of Computer Science, The University of Tennessee Knoxville
Huynh, D.Q.: Metrics for 3D rotations: comparison and analysis. J. Math. Imaging Vis. 35, 155–164 (2009)
Sensortec, B.: BNO055 Intelligent 9-axis absolute orientation sensor. https://cdn-shop.adafruit.com/datasheets/BST_BNO055_DS000_12.pdf
Acknowledgements
This work is supported by Limix S.r.l. (www.limix.it), an Italian start-up and spin-off of the University of Camerino. The intellectual property of Talking Hands and its different parts (hardware, software, design) is of Limix S.r.l.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Pezzuoli, F., Corona, D., Corradini, M.L., Cristofaro, A. (2019). Development of a Wearable Device for Sign Language Translation. In: Ficuciello, F., Ruggiero, F., Finzi, A. (eds) Human Friendly Robotics. Springer Proceedings in Advanced Robotics, vol 7. Springer, Cham. https://doi.org/10.1007/978-3-319-89327-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-89327-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-89326-6
Online ISBN: 978-3-319-89327-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)