Abstract
Extreme learning machine (ELM) has shown to be extremely fast with better generalization performance. However, the implementation of ELM encounters two problems. First, ELM tends to require more hidden nodes than conventional tuning-based algorithms. Second, subjectivity is involved in choosing hidden nodes number. In this paper, we apply the modified Gram-Schmidt (MGS) method to select hidden nodes which maximize the increment to explained variance of the desired output. The Akaike’s final prediction error (FPE) criterion are used to automatically determine the number of hidden nodes. In comparison with conventional ELM learning method on several commonly used regressor benchmark problems, our proposed algorithm can achieve compact network with much faster response and satisfactory accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)
Liang, N.-Y., Huang, G.-B., Saratchandran, P., Sundararajan, N.: A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Netw. 17, 1411–1423 (2006)
Huang, G.-B., Chen, L., Siew, C.-K.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 17, 879–892 (2006)
Huang, G.-B., Chen, L.: Enhanced random search based incremental extreme learning machine. Neurocomputing 71, 3460–3468 (2008)
Feng, G., Huang, G.-B., Lin, Q., Gay, R.: Error minimized extreme learning machine with growth of hidden nodes and incremental learning. IEEE Trans. Neural Netw. 20, 1352–1357 (2009)
Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Netw. 2, 302–309 (1991)
Chen, S., Billings, S.A., Luo, W.: Orthogonal least squares methods and their application to non-linear system identification. Int. J. Control 50, 1873–1896 (1989)
Li, K., Peng, J.X., Irwin, G.W.: A fast nonlinear model identification method. IEEE Trans. Automatic Control 50, 1211–1216 (2005)
Akaike, H.: Statistical predictor identification. Ann. Inst. Stat. Math. 22, 202–217 (1970)
Zhang, Q.: Using wavelet network in nonparametric estimation. IEEE Trans. Neural Netw. 8, 227–236 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yin, J., Wang, N. (2010). Enhanced Extreme Learning Machine with Modified Gram-Schmidt Algorithm. In: Zhang, L., Lu, BL., Kwok, J. (eds) Advances in Neural Networks - ISNN 2010. ISNN 2010. Lecture Notes in Computer Science, vol 6063. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13278-0_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-13278-0_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13277-3
Online ISBN: 978-3-642-13278-0
eBook Packages: Computer ScienceComputer Science (R0)