Advertisement

Bayesian Root Cause Analysis by Separable Likelihoods

  • Maciej SkorskiEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11376)

Abstract

Root Cause Analysis for anomalies is challenging because of the trade-off between the accuracy and its explanatory friendliness, required for industrial applications. In this paper we propose a framework for simple and friendly RCA within the Bayesian regime under certain restrictions (namely that Hessian at the mode is diagonal, in this work referred to as separability) imposed on the predictive posterior. Within this framework anomalies can be decomposed into independent dimensions which greatly simplifies readability and interpretability.

We show that the separability assumption is satisfied for important base models, including Multinomial, Dirichlet-Multinomial and Naive Bayes. To demonstrate the usefulness of the framework, we embed it into the Bayesian Net and validate on web server error logs (real world data set).

Keywords

Bayesian modeling Anomaly detection Root Cause Analysis 

References

  1. [Deh17]
    Dehaene, G.P.: Computing the quality of the Laplace approximation, November 2017. http://adsabs.harvard.edu/abs/2017arXiv171108911D
  2. [HO00]
    Hyvrinen, A., Oja, E.: Independent component analysis: algorithms and applications. Neural Netw. 13, 411–430 (2000)CrossRefGoogle Scholar
  3. [KF09]
    Koller, D., Friedman, N.: Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning. The MIT Press, Cambridge (2009)Google Scholar
  4. [Pad14]
    Padmanaban, H.: Comparative analysis of naive Bayes and tree augmented naive Bayes models (2014). http://scholarworks.sjsu.edu/etd_projects/356
  5. [Shl14]
    Shlens, J.: Notes on Kullback-Leibler divergence and likelihood. http://arxiv.org/abs/1404.2000 (2014)
  6. [SMRE17]
    Solé, M., Muntés-Mulero, V., Rana, A.I., Estrada, G.: Survey on models and techniques for root-cause analysis. http://arxiv.org/abs/1701.08546 (2017)
  7. [SWF16]
    Salvatier, J., Wiecki, T.V., Fonnesbeck, C.: Probabilistic programming in Python using PYMC3. Peer J. Comput. Sci. 2, e55 (2016)CrossRefGoogle Scholar
  8. [Tu15]
    Stephen, T.: The Dirichlet-multinomial and Dirichlet-categorical models for Bayesian inference (2015). https://people.eecs.berkeley.edu/~stephentu/writeups/dirichlet-conjugate-prior.pdf
  9. [ZZZS17]
    Zhang, Y., Zhou, H., Zhou, J., Sun, W.: Regression models for multivariate count data. J. Comput. Graph. Stat. 26(1), 1–13 (2017)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.DELLKlosterneuburgAustria

Personalised recommendations