A Hybrid Approach for Probabilistic Relational Models Structure Learning

  • Mouna Ben IshakEmail author
  • Philippe Leray
  • Nahla Ben Amor
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9897)


Probabilistic relational models (PRMs) extend Bayesian networks (BNs) to a relational data mining context. Just like BNs, the structure and parameters of a PRM must be either set by an expert or learned from data. Learning the structure remains the most complicated issue as it is a NP-hard problem. Existing approaches for PRM structure learning are inspired from classical methods of learning the BN structure. Extensions for the constraint-based and score-based methods have been proposed. However, hybrid methods are not yet adapted to relational domains, although some of them show better experimental performance, in the classical context, than constraint-based and score-based methods, such as the Max-Min Hill Climbing (MMHC) algorithm. In this paper, we present an adaptation of this latter to relational domains and we made an empirical evaluation of our algorithm. We provide an experimental study where we compare our new approach to the state-of-the art relational structure learning algorithms.


Probabilistic relational model Relational structure learning Relational Max-Min Hill Climbing 


  1. 1.
    Ben Ishak, M.: Probabilistic relational models: learning and evaluation. Ph.D. dissertation, Université de Nantes, Ecole Polytechnique; Université de Tunis, Institut Supérieur de Gestion de Tunis (2015)Google Scholar
  2. 2.
    Ben Ishak, M., Leray, P., Ben Amor, N.: Probabilistic relational model benchmark generation: principle and application. Intell. Data Anal. Int. J. 20, 615–635 (2016)CrossRefGoogle Scholar
  3. 3.
    Chickering, D.M., Geiger, D., Heckerman, D.: Learning Bayesian networks is NP-hard. Technical report, MSR-TR-94-17, Microsoft Research (1994)Google Scholar
  4. 4.
    Cooper, G.F., Herskovits, E.: A Bayesian method for the induction of probabilistic networks from data. Mach. Learn. 9, 309–347 (1992)zbMATHGoogle Scholar
  5. 5.
    Daly, R., Shen, Q., Aitken, S.: Learning Bayesian networks: approaches and issues. Knowl. Eng. Rev. 26, 99–157 (2011)CrossRefGoogle Scholar
  6. 6.
    Friedman, N., Getoor, L., Koller, D., Pfeffer, A.: Learning probabilistic relational models. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 1300–1309 (1999)Google Scholar
  7. 7.
    Getoor, L., Koller, D., Friedman, N., Pfeffer, A., Taskar, B.: Probabilistic relational models. In: Getoor, L., Taskar, B. (eds.) Introduction to Statistical Relational Learning. MIT Press, Cambridge (2007)Google Scholar
  8. 8.
    Getoor, L., Taskar, B.: Introduction to Statistical Relational Learning. MIT Press, Cambridge (2007)zbMATHGoogle Scholar
  9. 9.
    Heckerman, D., Meek, C., Koller, D.: Probabilistic models for relational data. Technical report, Microsoft Research, Redmond, WA (2004)Google Scholar
  10. 10.
    Koller, D., Pfeffer, A.: Probabilistic frame-based systems. In: Proceedings of AAAI, pp. 580–587. AAAI Press (1998)Google Scholar
  11. 11.
    Lee, S., Honavar, V.: On learning causal models from relational data. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI 2016), pp. 3263–3270 (2016)Google Scholar
  12. 12.
    Li, X.-L., He, X.-D.: A hybrid particle swarm optimization method for structure learning of probabilistic relational models. Inf. Sci. 283, 258–266 (2014)CrossRefGoogle Scholar
  13. 13.
    Maier, M., Marazopoulou, K., Arbour, D., Jensen, D.: A sound and complete algorithm for learning causal models from relational data. In: Proceedings of the Twenty-Ninth Conference on Uncertainty in Artificial Intelligence, pp. 371–380 (2013)Google Scholar
  14. 14.
    Maier, M., Taylor, B., Oktay, H., Jensen, D.: Learning causal models of relational domains. In: Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, pp. 531–538 (2010)Google Scholar
  15. 15.
    Marazopoulou, K., Maier, M., Jensen, D.: Learning the structure of causal models with relational and temporal dependence. In: Proceedings of the Thirty-First Conference on Uncertainty in Artificial Intelligence, pp. 572–581 (2015)Google Scholar
  16. 16.
    Pearl, J.: Probabilistic Reasoning in Intelligent Systems. Morgan Kaufmann, San Francisco (1988)zbMATHGoogle Scholar
  17. 17.
    Pfeffer, A.J.: Probabilistic reasoning for complex systems. Ph.D. dissertation, Stanford University (2000)Google Scholar
  18. 18.
    Tsamardinos, I., Brown, L.E., Aliferis, C.F.: The max-min hill-climbing Bayesian network structure learning algorithm. Mach. Learn. 65, 31–78 (2006)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Mouna Ben Ishak
    • 1
    Email author
  • Philippe Leray
    • 2
  • Nahla Ben Amor
    • 1
  1. 1.LARODEC Laboratory, ISGUniversité de TunisTunisTunisia
  2. 2.DUKe Research Group, LINA Laboratory UMR 6241University of NantesNantesFrance

Personalised recommendations