Advertisement

Soft Computing

, Volume 22, Issue 11, pp 3591–3601 | Cite as

ELM-based convolutional neural networks making move prediction in Go

  • Xiangguo Zhao
  • Zhongyu Ma
  • Boyang Li
  • Zhen Zhang
  • Hengyu Liu
Focus

Abstract

With the rapid development of machine learning, artificial intelligence (AI) has drawn much more attention. Under this circumstances, abstract strategy games, such as chess, checkers and Go, have been a fascinating problem of AI research. Most of the existing state-of-the-art Go programs used deep neural network technology, like convolutional neural networks (CNNs). However, CNNs require multiple iterations to optimize weights and spend a lot of training time. Therefore, in this paper, in order to solve the above shortcomings, we propose a new learning algorithm ECNN, which integrates CNNs with extreme learning machine (ELM). We remove pooling layers of CNNs and insert ELM layers between convolutional layers. The newly added ELM layers will be updated in back-propagation process, and they accelerate the convergence of weights in CNNs. Therefore, our ECNN can reduce the training time of CNNs. Further, we propose ECNN-Go algorithm, which applies ECNN to Go game. Because of the advantage of ECNN, ECNN-Go algorithm has the fast learning speed to make move prediction in Go game. Finally, the experimental results show the efficiency and accuracy of ECNN algorithm and demonstrate the strength of ECNN-Go.

Keywords

Artificial intelligence Go programs Convolutional neural networks Extreme learning machine 

Notes

Acknowledgements

This research is partially supported by National Natural Science Foundation of China under Grant Nos. 61672145, 61572121, 61602323, 61702086 and U1401256, and the China Postdoctoral Science Foundation under Grant No. 2016M591455.

Compliance with ethical standards

Conflict of interest

The authors declare that they have no potential conflict of interest.

Human participants and animals

This article does not contain any studies involving human participants and/or animals by any of the authors.

Informed consent

Informed consent was obtained from all individual participants.

References

  1. Chellapilla K, Fogel DB (1999) Evolving neural networks to play checkers without relying on expert knowledge. IEEE Trans Neural Netw 10(6):1382–91CrossRefGoogle Scholar
  2. Cheng Y, Yuan Y, Chen L, Wang G, Giraud-Carrier CG, Sun Y (2016) Distr: a distributed method for the reachability query over large uncertain graphs. IEEE Trans Parallel Distrib Syst 27(11):3172–3185CrossRefGoogle Scholar
  3. Cheng Y, Yuan Y, Chen L, Giraud-Carrier CG, Wang G (2017) Complex event-participant planning and its incremental variant. In: 33rd IEEE international conference on data engineering, ICDE 2017, San Diego, CA, USA, April 19–22, 2017, pp 859–870Google Scholar
  4. Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: International conference, pp 160–167Google Scholar
  5. Cui D, Huang GB, Liu T (2016) Smile detection using pair-wise distance vector and extreme learning machine. In: International joint conference on neural networks, pp 2298–2305Google Scholar
  6. Ding S, Zhang N, Zhang J, Xu X, Shi Z (2017) Unsupervised extreme learning machine with representational features. Int J Mach Learn Cybern 8(2):587–595CrossRefGoogle Scholar
  7. Duc HH, Jihoon L, Keechul J (2016) Suggesting moving positions in go-game with convolutional neural networks trained data. Int J Hybrid Inf Technol 9(4):51–58CrossRefGoogle Scholar
  8. Enzenberger M (1996) The integration of a priori knowledge into a go playing neural network. http://www.markus-enzenbergerde/neurogohtml
  9. Gelly S, Kocsis L, Schoenauer M, Sebag M, Silver D, Szepesvári C, Teytaud O (2012) The grand challenge of computer go: Monte carlo tree search and extensions. Commun ACM 55(3):106–113CrossRefGoogle Scholar
  10. Guo L, Ding S (2015) A hybrid deep learning CNN-ELM model and its application in handwritten numeral recognition. J Comput Inf Syst 11(7):2673–2680Google Scholar
  11. He K, Sun J (2015) Convolutional neural networks at constrained time cost. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5353–5360Google Scholar
  12. Hu K, Yang W, Gao X (2017) Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform. Exp Syst Appl 86:135–144CrossRefGoogle Scholar
  13. Huang GB, Zhu QY, Siew CK (2005) Extreme learning machine: a new learning scheme of feedforward neural networks. In: IEEE international joint conference on neural networks, 2004. Proceedings, vol 2, pp 985–990Google Scholar
  14. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501CrossRefGoogle Scholar
  15. Liu M, Liu B, Zhang C, Wang W, Sun W (2017) Semi-supervised low rank kernel learning algorithm via extreme learning machine. Int J Mach Learn Cybern 8(3):1039–1052CrossRefGoogle Scholar
  16. Mao W, Wang J, Xue Z (2017) An ELM-based model with sparse-weighting strategy for sequential data imbalance problem. Int J Mach Learn Cybern 8(4):1333–1345CrossRefGoogle Scholar
  17. Matsugu M, Mori K, Mitari Y, Kaneda Y (2003) Subject independent facial expression recognition with robust face detection using a convolutional neural network. Neural Netw Off J Int Neural Netw Soc 16(5–6):555CrossRefGoogle Scholar
  18. Müller M (2002) Computer Go. Artif Intell 134(1–2):145–179CrossRefzbMATHGoogle Scholar
  19. Oord A, Den RV, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. In: International conference on neural information processing systems, pp 2643–2651Google Scholar
  20. Rafique MA, Pedrycz W, Jeon M (2017) Vehicle license plate detection using region-based convolutional neural networks. Soft Comput.  https://doi.org/10.1007/s00500-017-2696-2
  21. Schaeffer J (2000) The games computers (and people) play. Adv Comput 52:189–266CrossRefGoogle Scholar
  22. Schaeffer J, Van den Herik HJ (2002) Games, computers, and artificial intelligence. Artif Intell 134(1–2):1–7CrossRefzbMATHGoogle Scholar
  23. Shan P, Yang X (2016) Deep convolutional extreme learning machine and its application in handwritten digit classification. Comput Intell Neurosci 2016(3):1–10MathSciNetCrossRefGoogle Scholar
  24. Silver D, Huang A, Maddison CJ, Guez A, Sifre L, Van Den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M (2016) Mastering the game of Go with deep neural networks and tree search. Nature 529(7587):484CrossRefGoogle Scholar
  25. Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. arXiv preprint arXiv:1412.6806
  26. Stern D, Herbrich R, Graepel T (2006) Bayesian pattern ranking for move prediction in the game of go. In: International conference, pp 873–880Google Scholar
  27. Sutskever I, Nair V (2008) Mimicking go experts with convolutional neural networks. Artif Neural Netw ICANN 2008:101–110Google Scholar
  28. Tian Y, Zhu Y (2015) Better computer go player with neural network and long-term prediction. Comput Sci. arXiv preprint arXiv:1511.06410v3
  29. Tong Y, Chen L, Zhou Z, Jagadish HV, Shou L, Lv W (2018) Slade: a smart large-scale task decomposer in crowdsourcing. IEEE Trans Knowl Data Eng PP(99):1–1CrossRefGoogle Scholar
  30. Wang XZ, Zhang T, Wang R (2017) Noniterative deep learning: incorporating restricted Boltzmann machine into multilayer random weight neural networks. IEEE Trans Syst Man Cybern Syst PP(99):1–10Google Scholar
  31. Wang Z, Wang X (2017) A deep stochastic weight assignment network and its application to chess playing. J Parallel Distrib Comput. https://doi.org/10.1016/j.jpdc.2017.08.013
  32. Yen SJ, Yang TN, Chen C, Hsu SC (2007) Pattern matching in go game records. In: International conference on innovative computing, information and control, pp 297–297Google Scholar
  33. Zhai J, Zhang S, Wang C (2017) The classification of imbalanced large data sets based on mapreduce and ensemble of ELM classifiers. Int J Mach Learn Cybern 8(3):1009–1017CrossRefGoogle Scholar
  34. Zhu R, Wang B, Yang X, Zheng B, Wang G (2017) SAP: improving continuous top-k queries over streaming data. IEEE Trans Knowl Data Eng PP(99):1–1Google Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.College of Computer Science and EngineeringNortheastern UniversityShenyangChina

Personalised recommendations