Abstract
Knowledge bases play an important role in many forms of artificial intelligence research. A simple approach to producing such knowledge is as a database of ground literals. However, this method is neither compact nor computationally tractable for learning or performance systems to use. In this paper, we present a statistical method for incremental learning of a hierarchically structured, first-order knowledge base. Our approach uses both rules and ground facts to construct succinct rules that generalize the ground literals. We demonstrate that our approach is computationally efficient and scales well to domains with many relations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lavrač, N., Džeroski, S.: Inductive Logic Programming: Techniques and Applications. Ellis Horwood, New York (1994)
De Raedt, L.: Inductive Theory Revision: An Inductive Logic Programming Approach. Academic Press, London (1992)
Minsky, M., Papert, S.: Perceptrons: An Introduction to Computational Geometry (Expanded Edition). MIT Press, Cambridge (1972)
Anderson, J.: A spreading activation theory of memory. Journal of Verbal Learning and Verbal Behavior 22, 261–295 (1983)
Stracuzzi, D.J.: Scalable Knowledge Acquisition Through Cumulative Learning and Memory Organization. PhD thesis, Department of Computer Science, University of Massachusetts, Amherst, MA (2006)
Utgoff, P.E.: Perceptron trees: A case study in hybrid concept representations. Connection Science 1(4), 377–391 (1989)
Stracuzzi, D.J., Utgoff, P.E.: Randomized variable elimination. Journal of Machine Learning Research 5, 1331–1364 (2004)
Quartz, S.R., Sejnowski, T.J.: The neural basis of development: A constructivist manifesto. Behavioral and Brain Sciences 20, 537–596 (1997)
Quinlan, J.R., Cameron-Jones, R.M.: Foil: A midterm report. In: Brazdil, P.B. (ed.) ECML 1993. LNCS, vol. 667, pp. 3–20. Springer, Heidelberg (1993)
Kok, S., Singla, P., Richardson, M., Domingos, P.: The Alchemy system for statistical relational AI. Technical report, University of Washington, Seattle, WA (2005), http://www.cs.washington.edu/ai/alchemy/
Richardson, M., Domingos, P.: Markov logic networks. Journal of Machine Learning Research 62(1-2), 107–136 (2006)
Pearl, J.: On the connection between the complexity and credibility of inferred models. Internation Journal of General Systems 4, 255–264 (1978)
Jensen, D.D., Cohen, P.R.: Multiple comparisons in induction algorithms. Machine Learning 38(3), 309–338 (2000)
Blockeel, H., De Raedt, L.: Inductive database design. In: Michalewicz, M., Raś, Z.W. (eds.) ISMIS 1996. LNCS (LNAI), vol. 1079, pp. 376–385. Springer, Heidelberg (1996)
De Raedt, L., Bruynooghe, M.: A theory of clausal discovery. In: Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, Chambéry, France, pp. 1058–1063. Morgan Kaufmann, San Francisco (1993)
Sammut, C., Banerji, R.B.: Learning concepts by asking questions. In: Machine Learning: An Artificial Intelligence Approach. Morgan Kaufmann, San Mateo (1986)
Shapiro, E.: An algorithm that infers theories from facts. In: Drinan, A. (ed.) Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pp. 446–451. Morgan Kaufmann, San Francisco (1981)
Taylor, K.: Autonomous Learning by Incremental Induction and Revision. PhD thesis, Australian National University (1996)
Basilio, R., Zaverucha, G., Barbosa, V.C.: Learning logic programs with neural networks. In: Rouveirol, C., Sebag, M. (eds.) ILP 2001. LNCS (LNAI), vol. 2157, pp. 15–26. Springer, Heidelberg (2001)
Carpenter, amd Grossberg, G.A., Rosen, S., David, B.: Fuzzy ART: Fast, stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks 4, 759–771 (1991)
De Raedt, L., Kersting, K.: Probabilistic logic learning. SIGKDD Explorations 5(1), 31–48 (2003)
Muggleton, S.: Stochastic logic programs. In: De Raedt, L. (ed.) Advances in Inductive Logic Programming, pp. 254–264. IOS Press, Amsterdam (1996)
Kersting, K., De Raedt, L.: Bayesian logic programs. In: Cussens, J., Frisch, A. (eds.) Proceedings of the Work-in-Progress Track at the 10th International Conference on Inductive Logic Programming, pp. 138–155. Springer, Heidelberg (2000)
Cussens, J.: Parameter estimation in stochastic logic programs. Machine Learning 44(3), 245–271 (2001)
Muggleton, S.H.: Learning stochastic logic programs. In: Getoor, L., Jensen, D. (eds.) Proceedings of the AAAI 2000 Workshop on Learning Statistical Models from Relational Data. AAAI Press, Menlo Park (2000)
Muggleton, S.H.: Learning structure and parameters of stochastic logic programs. In: Matwin, S., Sammut, C. (eds.) ILP 2002. LNCS (LNAI), vol. 2583, pp. 198–206. Springer, Heidelberg (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stracuzzi, D.J., Könik, T. (2008). A Statistical Approach to Incremental Induction of First-Order Hierarchical Knowledge Bases. In: Železný, F., Lavrač, N. (eds) Inductive Logic Programming. ILP 2008. Lecture Notes in Computer Science(), vol 5194. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85928-4_22
Download citation
DOI: https://doi.org/10.1007/978-3-540-85928-4_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85927-7
Online ISBN: 978-3-540-85928-4
eBook Packages: Computer ScienceComputer Science (R0)