Extreme Learning Classifier with Deep Concepts
The text below describes a short introduction to extreme learning machines (ELM) enlightened by new developed applications. It also includes an introduction to deep belief networks (DBN), noticeably tuned into the pattern recognition problems. Essentially, the deep belief networks learn to extract invariant characteristics of an object or, in other words, an DBN shows the ability to simulate how the brain recognizes patterns by the contrastive divergence algorithm. Moreover, it contains a strategy based on both the kernel (and neural) extreme learning of the deep features. Finally, it shows that the DBN-ELM recognition rate is competitive (and often better) than other successful approaches in well-known benchmarks. The results also show that the method is extremely fast when the neural based ELM is used.
KeywordsExtreme Learning Machines Deep learning Neural Networks
- 2.Hinton, G.: A practical guide to training Restricted Boltzmann Machines. Tech. rep., Dep. of Computer Science, University of Toronto (2010)Google Scholar
- 5.Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: A new learning scheme of feedforward neural networks. In: IEEE International Joint Conference on Neural Networks, pp. 985–990 (2004)Google Scholar
- 8.Lopes, N., Ribeiro, B.: GPUMLib: An efficient open-source GPU machine learning library. International Journal of Computer Information Systems and Industrial Management Applications 3, 355–362 (2011)Google Scholar
- 10.Ranzato, M., Boureau, Y., LeCun, Y.: Sparse feature learning for deep belief networks. In: Advances in Neural Information Processing Systems, vol. 20 (2007)Google Scholar
- 14.Yu, K., Xu, W., Gong, Y.: Deep learning with kernel regularization for visual recognition. In: Neural Information Processing Systems, NIPS (2009)Google Scholar