Abstract
In this paper, an algorithm to determine the most probable model, amongst a large number of models formed with a set of wider class of basis functions, based on Bayesian model comparison is developed. The models consist of linear coefficients and nonlinear basis functions, which may themselves be parametrised, with different models constructed with different subsets of basis functions. By a suitable encoding, genetic algorithms are used to search over the space of all possible subsets of basis functions to determine the most probable model that describes the given observations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
D. S. Broomhead & D. B. Lowe. Multivariable functional interpolation and adaptive networks. Complex Systems, Vol. 2, pp. 321 – 355, 1988.
S. Chen, S. A. Billings & P. M. Grant. Nonlinear system identification using neural networks. International Journal of Control, Vol. 51, No. 6,pp: 1191 – 1214, 1990.
D. E. Goldberg. Genetic algorithms in search, optimization and machine learning. Addison-Wesley, MA: Reading, 1989.
S. F. Gull. Developments in maximum entropy data analysis. In J. Skilling. (ed.) Maximum entropy and Bayesian methods, Kluwer, pp: 53–71, 1989.
V. Kadirkamanathan. A statistical inference based growth criterion for the RBF network. In Proc. IEEE Workshop on Neural Network for Signal Processing, pp. 12–21,1994.
V. Kadirkamanathan, M. Niranjan & F. Fallside. Sequential adaptation of radial basis function neural network and its application to time-series prediction. In D. S. Touretzky (ed.) Advances in Neural Information Processing Systems 3, Morgan Kaufmann, CA: San Mateo, pp. ???–???,1991.
G. P. Liu & V. Kadirkamanathan. Multiobjective criteria for nonlinear model selection and identification with neural networks. Research Report No. 508, Department of Automatic Control & Systems Engineering, University of Sheffield, UK, March 1994.
D. J. C. MacKay. Bayesian Interpolation. Neural Computation, Vol. 4, No. 3,pp: 415–447, 1992.
M. J. D. Powell. Radial basis functions for multivariable interpolation: A review. In J. C. Mason & M. G. Cox (eds.) Algorithms for approximation, Oxford University Press, Oxford, pp. 143–167, 1987.
J. D. Scharfer & D. Whitley (eds.). Combinations of genetic algorithms and neural networks. IEEE Computer Society Press, CA: Los Alamitos, 1992.
S. Sibisi. Bayesian Interpolation. In W. T. Grandy, Jr. (ed.) Maximum entropy and Bayesian methods, Kluwer, pp: 349–355, 1991.
J. Skilling. On parameter estimation and quantified MaxEnt. In W. T. Grandy, Jr. (ed.) Maximum entropy and Bayesian methods,Kluwer, pp: 267–273, 1991.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Kluwer Academic Publishers
About this paper
Cite this paper
Kadirkamanathan, V. (1996). Bayesian Inference for Basis Function Selection in Nonlinear System Identification using Genetic Algorithms. In: Skilling, J., Sibisi, S. (eds) Maximum Entropy and Bayesian Methods. Fundamental Theories of Physics, vol 70. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-0107-0_15
Download citation
DOI: https://doi.org/10.1007/978-94-009-0107-0_15
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-010-6534-4
Online ISBN: 978-94-009-0107-0
eBook Packages: Springer Book Archive