Advertisement

Comparative Analysis of Restricted Boltzmann Machine Models for Image Classification

  • Christine Dewi
  • Rung-Ching ChenEmail author
  • Hendry
  • Hsiu-Te Hung
Conference paper
  • 273 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12034)

Abstract

Many applications for Restricted Boltzmann Machines (RBM) have been developed for a large variety of learning problems. Recent developments have demonstrated the capacity of RBM to be powerful generative models, able to extract useful features from input data or construct deep artificial neural networks. In this work, we propose a learning algorithm to find the optimal model complexity for the RBM by improving the hidden layer. We compare the classification performance of regular RBM use RBM() function, classification RBM use stackRBM() function and Deep Belief Network (DBN) use DBN() function with different hidden layer. As a result, Stacking RBM and DBN could improve our classification performance compare to regular RBM.

Keywords

Classification comparison DBN RBM Stack-RBM 

Notes

Acknowledgment

This paper is supported by Ministry of Science and Technology, Taiwan. The Nos are MOST-107-2221-E-324-018-MY2 and MOST-106-2218-E-324-002, Taiwan.

References

  1. 1.
    Gehler, P.V., Holub, A.D., Welling, M.: The rate adapting Poisson model for information retrieval and object recognition. In: Proceedings of the 23rd International Conference on Machine Learning, ser. ICML 2006. ACM, New York, pp. 337–344 (2006). http://doi.acm.org/10.1145/1143844.1143887
  2. 2.
    Hinton, G.E.: To recognize shapes, first learn to generate images. Progress Brain Res. 165, 535–547 (2007)CrossRefGoogle Scholar
  3. 3.
    Hinton, G.E.: A Practical Guide to Training Restricted Boltzmann Machines, pp. 599–619. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-35289-832
  4. 4.
    Larochelle, H., Mandel, M., Pascanu, R., Bengio, Y.: Learning algorithms for the classification restricted Boltzmann machine. J. Mach. Learn. Res. 13(1), 643–669 (2012)MathSciNetzbMATHGoogle Scholar
  5. 5.
    Larochelle, H., Bengio, Y.: Classification using discriminative restricted Boltzmann machines. In: Proceedings of the 25th International Conference on Machine Learning, ser. ICML 2008, pp. 536–543. ACM, New York (2008). http://doi.acm.org/10.1145/1390156.1390224
  6. 6.
    Jongmin, Y., Jeonghwan, G., Sejeong, L., Moongu, J.: An incremental learning approach for restricted Boltzmann machines. In: 2015 International Conference on Control, Automation and Information Sciences (ICCAIS), pp. 113–117 (2015)Google Scholar
  7. 7.
    Jiang, Y., Xiao, J., Liu, X., Hou, J.: A removing redundancy restricted Boltzmann machine. In: 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI), pp. 57–62 (2018)Google Scholar
  8. 8.
    Hinton, G.E., Dayan, P., Frey, B.J., Neal, R.M.: The wake-sleep algorithm for unsupervised neural networks. Science 268, 1158 (1995)CrossRefGoogle Scholar
  9. 9.
    Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006).  https://doi.org/10.1162/neco.2006.18.7.1527MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proceedings IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  11. 11.
    Cun, Y.L., et al.: Handwritten digit recognition with a back-propagation network. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems 2, pp. 396–404. Morgan Kaufmann Publishers Inc., San Francisco (1990). http://dl.acm.org/citation.cfm?id=109230.109279
  12. 12.
    Han-Gyu, K., Seung-Ho, H., Ho-Jin, C.: Discriminative restricted Boltzmann machine for emergency detection on healthcare robot. In: 2017 IEEE International Conference on Big Data and Smart Computing (BigComp), pp. 407–409. IEEE (2017)Google Scholar
  13. 13.
    Jinyong, Y., Tao, S., Jiangyun, Z., Xiaolon, B.: Fault prognosis based on restricted Boltzmann machine and data label for switching power amplifiers. In: 2018 12th International Conference on Reliability, Maintainability, and Safety (ICRMS), pp. 287–291. IEEE (2018)Google Scholar
  14. 14.
    Renshu, W., Bin, C., Jingdong, G., Jing, Z.: The image recognition based on restricted Boltzmann machine and deep learning framework. In: 2019 4th International Conference on Control and Robotics Engineering (ICCRE), pp. 161–164. IEEE (2019)Google Scholar
  15. 15.
    Shamma, N., Justine, L.D., Supriyo, B., Amit, R.T.: Low power restricted Boltzmann machine using mixed-mode magneto-tunneling junctions. IEEE Electron. Device Lett. 40(2), 345–384 (2019)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Information ManagementChaoyang University of TechnologyTaichungTaiwan, R.O.C.
  2. 2.Faculty of Information TechnologySatya Wacana Christian UniversitySalatigaIndonesia

Personalised recommendations