A genetic algorithm for graphical model selection
Graphical log-linear model search is usually performed by using stepwise procedures in which edges are sequentially added or eliminated from the independence graph. In this paper we implement the search procedure as a genetic algorithm and propose a crossover operator which operates on subgraphs. In a simulation study the proposed procedure is shown to perform better than an automatic backward elimination procedure at the cost of a small increase of computational time.
KeywordsAIC Genetic Algorithm Graphical model Log-linear model Model selection Undirected graph
Unable to display preview. Download preview PDF.
- Akaike, H. (1973), Information theory and an extension of the maximum likelihood principle. In2nd International Symposium on Information Theory, (eds. B. N. Petrov and F. Csaki), 267–281. Budapest: Akademia Kiado.Google Scholar
- Badsberg, J. H. (1991), A guide to CoCo.Technical Report 91-43, Institute for Electronic Systems, University of Aalborg.Google Scholar
- Baker, J. (1987), Reducing bias and inefficiency in the selection algorithm. InGenetic Algorithms and Their Applications: Proceedings of the Second International Conference on Genetic Algorithms (ed. J. J. Grefenstette), Erlbaum.Google Scholar
- Box, G. E. P. (1957), Evolutionary operation: A method for increasing industrial productivity.J. Roy. Statist. Soc., C 6, 2, 81–101.Google Scholar
- Goldberg, D. E. (1989),Genetic Algorithms in Search, Optimisation, and Machine Learning. Addison-Wesley.Google Scholar
- Holland, J. H. (1975),Adaptation in Natural and Artificial Systems, Ann Arbor: The University of Michigan Press.Google Scholar
- Holland, J. H. (1995),Hidden Order, how adaptation builds complexity. Reading: Addison-Wesley Publishing Corporation, Inc.Google Scholar
- Larrañaga, P., Murga, R. H., Poza, M. andKuijpers, C. M. H. (1996), Structure learning of Bayesian networks by hybrid genetic algorithms. InLearning from Data: Artificial Intelligence and Statistics V, (eds. D. Fisher and H. Lenz), 165–174. New York: Springer-Verlag.Google Scholar
- Lauritzen, S. L. (1996),Graphical Models. Oxford: Oxford University Press.Google Scholar
- Malvestuto, F. M. (1996), An axiomatisation of log-linear models with an application to the model-search problem. InLearning from Data: Artificial Intelligence and Statistics V, (eds. D. Fisher and H. Lenz), 175–184. New York: Springer-Verlag.Google Scholar
- Mitchell, M. (1996),An Introduction to Genetic Algorithms. M.I.T. Press.Google Scholar