Abstract
Recently, new representation languages that integrate first order logic with Bayesian networks have been developed. Bayesian logic programs are one of these languages. In this paper, we present results on combining Inductive Logic Programming (ILP) with Bayesian networks to learn both the qualitative and the quantitative components of Bayesian logic programs. More precisely, we show how to combine the ILP setting learning from interpretations with score-based techniques for learning Bayesian networks. Thus, the paper positively answers Koller and Pfeffer’s question, whether techniques from ILP could help to learn the logical component of first order probabilistic models.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
H. Blockeel and L. De Raedt. ISIDD: An Interactive System for Inductive Databse Design. Applied Artificial Intelligence, 12(5):385, 421 1998.
R. G. Cowell, A. P. Dawid, S. L. Lauritzen, and D. J. Spiegelhalter. Probabilistic networks and expert systems. Springer-Verlag New York, Inc., 1999.
J. Cussens. Parameter estimation in stochastic logic programs. Machine Learning, 2001. to appear.
L. De Raedt and M. Bruynooghe. A theory of clausal discovery. In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence (IJCAI-1993), pages 1058–1063, 1993.
L. De Raedt and L. Dehaspe. Clausal discovery. Machine Learning, (26):99–146, 1997.
N. Friedman, L. Getoor, D. Koller, and A. Pfeffer. Learning probabilistic relational models. In Proceedings of Sixteenth International Joint Conference on Artificial Intelligence (IJCAI-1999), Stockholm, Sweden, 1999.
L. Getoor, D. Koller, B. Taskar, and N. Friedman. Learning probabilistic relational models with structural uncertainty. In Proceedings of the AAAI-2000 Workshop on Learning Statistical Models from Relational Data, 2000.
W. R. Gilks, A. Thomas, and D. J. Spiegelhalter. A language and program for complex bayesian modelling. The Statistician, 43, 1994.
D. Heckerman. A tutorial on learning with Bayesian networks. Technical Report MSR-TR-95-06, Microsoft Research, Advanced Technology Division, Microsoft Corporation, One Microsoft Way, Redmond, WA 98052, March 1995.
D. Heckerman, D. Geiger, and D. M. Chickering. Learning Bayesian networks: The combination of knowledge and statistical data. Technical Report MSR-TR-94-09, Microsoft Research, 1994.
M. Jaeger. Relational Bayesian networks. In Proceedings of UAI-1997, 1997.
K. Kersting and L. De Raedt. Adaptive Bayesian Logic Programs. In this volume.
K. Kersting and L. De Raedt. Bayesian logic programs. In Work-in-Progress Reports of the Tenth International Conference on Inductive Logic Programming (ILP-2000), 2000. http://SunSITE.Informatik.RWTH-Aachen.DE/Publications/CEUR-WS/Vol-35/.
K. Kersting and L. De Raedt. Bayesian logic programs. Technical Report 151, University of Freiburg, Institute for Computer Science, April 2001.
K. Kersting, L. De Raedt, and S. Kramer. Interpreting Bayesian Logic Programs. In Working Notes of the AAAI-2000 Workshop on Learning Statistical Models from Relational Data, 2000.
D. Koller and A. Pfeffer. Learning probabilities for noisy first-order rules. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (IJCAI-1997), pages 1316–1321, Nagoya, Japan, August 23–29 1997.
W. Lam and F. Bacchus. Learning Bayesian belief networks: An approach based on the MDL principle. Computational Intelligence, 10(4), 1994.
J. W. Lloyd. Foundations of Logic Programming. Springer, Berlin, 2. edition, 1989.
S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19(20):629–679, 1994.
S. H. Muggleton. Learning stochastic logic programs. In L. Getoor and D. Jensen, editors, Proceedings of the AAAI-2000 Workshop on Learning Statistical Models from Relational Data, 2000.
K. P. Murphy. Bayes Net Toolbox for Matlab. U. C. Berkeley. http://www.cs.berkeley.edu/murphyk/Bayes/bnt.html.
L. Ngo and P. Haddawy. Answering queries form context-sensitive probabilistic knowledge bases. Theoretical Computer Science, 171:147–177, 1997.
J. Pearl. Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, 2. edition, 1991.
D. Poole. Probabilistic Horn abduction and Bayesian networks. Artificial Intelligence, 64:81–129, 1993.
T. Sato and Y. Kameya. A viterbi-like algorithm and EM learning for statistical abduction. In Proceedings of UAI2000 Workshop on Fusion of Domain Knowledge with Data for Decision Support, 2000.
L. Sterling and E. Shapiro. The Art of Prolog: Advanced Programming Techniques. The MIT Press, 1986.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kersting, K., De Raedt, L. (2001). Towards Combining Inductive Logic Programming with Bayesian Networks. In: Rouveirol, C., Sebag, M. (eds) Inductive Logic Programming. ILP 2001. Lecture Notes in Computer Science(), vol 2157. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44797-0_10
Download citation
DOI: https://doi.org/10.1007/3-540-44797-0_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42538-0
Online ISBN: 978-3-540-44797-9
eBook Packages: Springer Book Archive