Abstract
Statistical Relational Learning (SRL) combines the benefits of probabilistic machine learning approaches with complex, structured domains from Inductive Logic Programming (ILP). We propose a new SRL algorithm, GleanerSRL, to generate the probability that an example is positive within highly-skewed relational domains. In this work, we combine clauses from Gleaner, an ILP algorithm for learning a wide variety of first-order clauses, with the propositional learning technique of support vector machines to learn well-calibrated probabilities. We find that our results are comparable to SRL algorithms SAYU and SAYU-VISTA on a well-known relational testbed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Caruana, R., Niculescu-Mizil, A.: An Empirical Comparison of Supervised Learning Algorithms. In: Proceedings of the 23rd International Conference on Machine Learning (2006)
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, Cambridge (2000)
Davis, J., Dutra, I.C., Page, D., Costa, V.S.: Establish Entity Equivalence in Multi-Relation Domains. In: Proceedings of the International Conference on Intelligence Analysis, Vienna, Va (2005)
Davis, J., Ong, I., Struyf, J., Burnside, E., Page, D., Costa, V.S.: Change of Representation for Statistical Relational Learning. In: Proceedings of the 20th International Joint Conference on Artificial Intelligence (2007)
Džeroski, S., Lavrac, N.: An Introduction to Inductive Logic Programming. In: Relational Data Mining, pp. 48–66. Springer, Heidelberg (2001)
Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian Network Classifiers. Machine Learning 29(2-3), 131–163 (1997)
Friedman, N., Getoor, L., Koller, D., Pfeffer, A.: Learning Probabilistic Relational Models. In: Proceedings of the 16th International Conference on Artificial Intelligence, pp. 1300–1309 (1999)
Getoor, L., Taskar, B.: Introduction to Statistical Relational Learning. MIT Press, Cambridge (2007)
Goadrich, M., Oliphant, L., Shavlik, J.: Gleaner: Creating Ensembles of First-order Clauses to Improve Recall-Precision Curves. Machine Learning 64, 231–262 (2006)
Hoos, H., Stutzle, T.: Stochastic Local Search: Foundations and Applications. Morgan Kaufmann, San Francisco (2004)
Koller, D., Pfeffer, A.: Learning Probabilities for Noisy First-Order Rules. In: Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI), Nagoya, Japan (August 1997)
Landwehr, N., Passerini, A., Raedt, L.D., Frasconi, P.: kFOIL: Learning Simple Relational Kernels. In: Proceedings of the 21st National Conference on Artificial Intelligence (2006)
Muggleton, S., Amini, A., Lodhi, H., Sternberg, M.: Support Vector Inductive Logic Programming. In: Proceedings of the 8th International Conference on Discovery Science (2005)
Niculescu-Mizil, A., Caruana, R.: Predicting Good Probabilities with Supervised Learning. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 625–632 (2005)
Pompe, U., Kononenko, I.: Naive Bayesian Classifier within ILP-R. In: Fifth International Workshop on Inductive Logic Programming, pp. 417–436 (1995)
Ray, S., Craven, M.: Representing Sentence Structure in Hidden Markov Models for Information Extraction. In: Proceedings of the 17th International Joint Conference on Artificial Intelligence (2001)
Richardson, M., Domingos, P.: Markov Logic Networks. Machine Learning 62, 107–136 (2006)
Srinivasan, A.: The Aleph Manual Version 4 (2003), http://web.comlab.ox.ac.uk/oucl/research/areas/machlearn/Aleph/
Srinivasan, A., King, R.: Feature Construction with Inductive Logic Programming: A Study of Quantitative Predictions of Biological Activity Aided by Structural Attributes. In: Muggleton, S. (ed.) Proceedings of the 6th International Workshop on Inductive Logic Programming. Stockholm University, Royal Institute of Technology, pp. 352–367 (1996)
Taskar, B., Abbeel, P., Wong, M.-F., Koller, D.: Label and Link Prediction in Relational Data. In: IJCAI Workshop on Learning Statistical Models from Relational Data (2003)
Zadrozny, B., Elkan, C.: Transforming Classifier Scores into Accurate Multiclass Probability Estimates. In: The Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Goadrich, M., Shavlik, J. (2008). Combining Clauses with Various Precisions and Recalls to Produce Accurate Probabilistic Estimates. In: Blockeel, H., Ramon, J., Shavlik, J., Tadepalli, P. (eds) Inductive Logic Programming. ILP 2007. Lecture Notes in Computer Science(), vol 4894. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78469-2_15
Download citation
DOI: https://doi.org/10.1007/978-3-540-78469-2_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78468-5
Online ISBN: 978-3-540-78469-2
eBook Packages: Computer ScienceComputer Science (R0)