Abstract
Sign language (SL) is based on the movement of hands, body gestures and motions to express information instead of speech or written forms. SL has been used since 384-322 BC and developed in many countries, including Vietnam. In some countries, there are several applications of using technology to develop SL and communicate within the deaf community. However, there is lack of studies in these areas in Vietnam. This study is approaching of using 3D avatar of the HamNoSys and building a dictionary for Vietnamese SL animation. The study builds a data set and applies the machine learning decision tree (ID3) to convert the Vietnamese normal sentences into the short sentences of the deaf. The conversion process generates SiGML language to express the SL by a virtual signer leading to present the television news. The assessment results by experts in SL institutions indicate high precision of proposed solution and show the needs of the study.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Quinlan, J.: C4.5, Programs for Machine Learning. Morgan Kaufmann Publishers, Burlington (1993)
Hanke, T. (ed.): Interface Definitions, Virtual Signing: Capture, Animation, Storage and Transmission, Deliverable D5-1 (2001)
Al-Ohali, Y.: Identification of most desirable parameters in SIGN language tools: a comparative study. Glob. J. Comput. Sci. Technol. 10(6), 23–29 (2010)
Stewart, J.: VCom3D - Sign Smith studio (2012)
Waterfall Rainbows, Sign to Me (BSL) - User Guide (2005)
Kipp, M., Heloir, A., Nguyen, Q.: Signing avatars: a feasibility study. In: DFKI – Embodied Agents Research Group, Saarbruecken, Germany (2011)
Courty, N., Gibet, S.: Why is the creation of a virtual signer challenging computer animation? In: Boulic, R., Chrysanthou, Y., Komura, T. (eds.) MIG 2010. LNCS, vol. 6459, pp. 290–300. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16958-8_27
Chai, X., Li, G., et al.: Sign language recognition and translation with kinect. In: The FiDiPro Program of Tekes and Natural Science Foundation of China under contracts, Nos. 61001193 and 60973067. Microsoft Research Asia (2013)
Hong Thanh, L., Rathany Chan, S., Hoan Cong, N., Thuy Thanh, N.: Named entity recognition in Vietnamese text using label propagation. In: Proceedings of the 5th International Conference of Soft Computing and Pattern Recognition, SoCPaR (2013)
Hong Phuong, L., Thi Minh Huyen, N., Roussanaly, A., Vinh, H.T.: A hybrid approach to word segmentation of Vietnamese texts. In: Martín-Vide, C., Otto, F., Fernau, H. (eds.) LATA 2008. LNCS, vol. 5196, pp. 240–249. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88282-4_23
Bao, H.T.: About Vietnamese processing in ICT, JAIST, VLSP-KC01/06-10 (2012). (in Vietnamese)
Phuong, N.T., Ton, N.D.: Some problems of Vietnamese sign language syntaxes. J. Ngon Ngu (4), 17–31 (2012). ISSN 0866-7519. (in Vietnamese)
ISO/TC 37/SC 4 AWI N309: Language Resource Management - Word Segmentation of Written Texts for Mono-lingual and Multi-lingual Information Processing. Technical report. ISO (2006)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of International Conference on Machine Learning, ICML, pp. 282–289 (2001)
Agacy, R.L.: Generalized Kronecker delta and permanent deltas, their spinor and tensor equivalents and applications. J. Math. Phys. 40(4), 2055–2063 (1999)
Byrd, R.H., Lu, P., Nocedal, J.: A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Stat. Comput. 16(5), 1190–1208 (1995)
Forney Jr., G.D.: The Viterbi algorithm. Proc. IEEE 61, 268–278 (1973)
Hanke, T.: Interface Definitions, Virtual Signing: Capture, Animation, Storage and Transmission, Deliverable D5-1 (2001)
Hanke, T., Popescu, H.: Intelligent Sign Editor. ESIGN D2.3 Report, Institute of GermanSign Language and Deaf Communication, University of Hamburg (2003)
Hanke, T., Marshall, I., Safar, E., Schmaling, C., Langer, G., Metzger, C.: Interface definitions. ViSiCAST Report D5.1 (2001)
Shannon, C.-E.: A mathematical theory of communication. Bell Syst. Technol. J. 27, 379–423 (1948). pp. 623–656
Bau, N.T.: Vietnamese synonym an antonym dictionary. Ha Noi Social Sciences Publishing House (2016). (in Vietnamese)
VNIES - Trung tam nghien cuu giao duc tre khuyet tat, Ky hieu cu chi dieu bo cua nguoi diec Viet Nam, Ha Noi (2002). (in Vietnamese)
Ngon, N.C., Da, Q.L.: Application of HamNoSys and avatar 3D JASigning to construction of Vietnamese sign language animations. J. Sci. Technol. 1(11), 61–65 (2017). ISSN 1859 – 1531. (in Vietnamese)
Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of Association for Machine Translation in the Americas (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Da, Q.L., Khang, N.H.D., Ngon, N.C. (2019). Converting the Vietnamese Television News into 3D Sign Language Animations for the Deaf. In: Duong, T., Vo, NS. (eds) Industrial Networks and Intelligent Systems. INISCOM 2018. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 257. Springer, Cham. https://doi.org/10.1007/978-3-030-05873-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-05873-9_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05872-2
Online ISBN: 978-3-030-05873-9
eBook Packages: Computer ScienceComputer Science (R0)