Stochastic Algorithms for Searching Causal Orderings in Bayesian Networks
The structure of a Bayesian network depends heavily on the ordering of its variables: given any ordering it is always possible to build a Bayesian network whose arcs are consistent with the initial ordering; however, the topology of the network, and therefore the number of conditional independence relationships that may be explicitly represented can vary greatly from one ordering to another. As a sparse representation is always preferable to a denser representation of the same model, the task of determining the ordering giving rise to the network with minimum number of arcs is important. In this work we propose methods to obtain a good approximation to the optimal ordering, using only partial information. More precisely, we only use conditional independence relationships of order zero and one, and search for the ordering which best preserves this information. The search process will be guided by genetic algorithms and simulated annealing.
KeywordsGenetic Algorithm Simulated Annealing Bayesian Network Conditional Independence None None
Unable to display preview. Download preview PDF.
- S. Acid and L.M. de Campos. Benedict: An algorithm for learning probabilistic belief netwoks. In Proc. of the IPMU-96 Conference, 979 - 984, 1996.Google Scholar
- N. Ansari and E. Hou. Computational Intelligence for Optimization. Kluwer Academic Publishers, 1997.Google Scholar
- R. Bouckaert. Optimizing causal orderings for generating dag’s from data. In Proc. of the Eighth Conference on Uncertainty in Artificial Intelligence, 9 - 16, 1992.Google Scholar
- I. Beinlich, H. Seurmondt, R. Chavez, and G. Cooper. The alarm monitoring system: a case study with two probabilistic inference techniques for belief networks. In Proc. of the Second European Conference on Artificial Intelligence in Medicine, 247 - 256, 1989.Google Scholar
- D. Chickering, D. Geiger, and D. Heckerman. Learning bayesian networks is NP-hard. Technical Report MSR-TR-94-17, Microsoft Research, 1994.Google Scholar
- D. Heckerman, D. Geiger, and D.M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Machine Learning, 20: 197243, 1995.Google Scholar
- J.H. Holland. Adaptation in Natural and Artificial Systems. Ann Arbor, MI: The University of Michigan Press, 1975.Google Scholar
- J. Pearl. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan and Kaufmann, San Mateo, 1988.Google Scholar
- P. Spirtes, C. Glymour, and R. Scheines. Causation, Prediction and Search. Lecture Notes in Statistics 81. Springer Verlag, New York, 1993.Google Scholar
- T. Verma and J. Pearl. Equivalence and synthesis of causal models. In Proc. of the Sixth Conference on Uncertainty in Artificial Intelligence, 220-227, Mass, 1990.Google Scholar