Abstract
Machine Translation is an important part of Natural Language Processing. The model based on convolution neural network and attention mechanism (Fcnn model), which was proposed by Facebook in 2017, has been successful. We use this Fcnn model as the baseline model of this subject, and on the base of this model, we try to improve it by the combination of bytes pair encoding method, model ensemble method. In this issue, we use Bilingual Evaluation Understudy (BLEU) as a criterion to measure the quality of translation. After testing, these methods can improve the translation quality of the model. Finally, the overall translation quality increased from 0.28 of the baseline Fcnn model to 0.32.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60(2), 2012 (2012)
Och, F.J., Ney, H.: Discriminative training and maximum entropy models for statistical machine translation. In: Meeting on Association for Computational Linguistics. Association for Computational Linguistics, pp. 295–302 (2002)
Papineni, K., Roukos, S., Ward, T., et al.: BLEU: a method for automatic evaluation of machine translation. In: Meeting on Association for Computational Linguistics. Association for Computational Linguistics, pp. 311–318 (2002)
Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space. Comput. Sci. (2013)
Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks, vol. 4, pp. 3104–3112 (2014)
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. Comput. Sci. (2014)
Graves, A.: Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks, pp. 1735–1780. Springer, Berlin (2012)
Vaswani, A., Bengio, S., Brevdo, E., et al.: Tensor2Tensor for neural machine translation. CoRR (2018)
Luong, M.T., Brevdo, E., Zhao, R.: Neural machine translation (seq2seq) tutorial (2017). https://github.com/tensorflow/nmt
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Han, Z., Li, S. (2020). Research on Machine Translation Model Based on Neural Network. In: Liang, Q., Liu, X., Na, Z., Wang, W., Mu, J., Zhang, B. (eds) Communications, Signal Processing, and Systems. CSPS 2018. Lecture Notes in Electrical Engineering, vol 517. Springer, Singapore. https://doi.org/10.1007/978-981-13-6508-9_31
Download citation
DOI: https://doi.org/10.1007/978-981-13-6508-9_31
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-6507-2
Online ISBN: 978-981-13-6508-9
eBook Packages: EngineeringEngineering (R0)