Abstract
A new algorithm for causal discovery in linear acyclic graphic model is proposed in this paper. The algorithm measures the entropy of observed data sequences by estimating the parameters of its approximate distribution to a generalized Gaussian family. Causal ordering can be discovered by an entropy base method. Compared with previous method, the sample complexity of the proposed algorithm is much lower, which means the causal relationship can be correctly discovered by a smaller number of samples. An explicit requirement of data sequences for correct causal inference in linear acyclic graphic model is discussed. Experiment results for both artificial data and real-world data are presented.
This work is supported by the Funds NSFC61171121 and the Science Foundation of Chinese Ministry of Education-China Mobile 2012.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Daniusis, P., Janzing, D., Mooij, J., Zscheischler, J., Steudel, B., Zhang, K., Schoelkopf, B.: Inferring deterministic causal relations. In: Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence, UAI 2010 (2010)
Do, M.N., Vetterli, M.: Wavelet-based texture retrieval using generalized gaussian density and kullback cleibler distance. IEEE Transaction in Image Processing 11(2), 146–158 (2006)
Hoyer, P.O., Janzing, D., Mooij, J., Peters, J., Scholkopf, B.: Nonlinear causal discovery with additive noise models. In: Proceedings of the Twenty-Second Annual Conference on Neural Information Processing Systems (NIPS 2008), Vancouver (December 2008)
Hyvarinen, A., Shimizu, S., Hoyer, P.O.: Causal modelling combining instantaneous and lagged effects: an identifiable model based on non-gaussianity. In: Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland (2008)
Lacerda, G., Spirtes, P.L., Ramsey, J., Hoyer, P.O.: Discovering cyclic causal models by independent components analysis. In: Proceedings of the Twenty-Fourth Conference on Uncertainty in Artificial Intelligence, UAI 2008 (2008)
Mooij, J., Janzing, D.: Distinguishing between cause and effect. Journal of Machine Learning Research Workshop & Conference Proceedings 6, 147–156 (2010)
Nadarajah, S.: A generalized normal distribution. Journal of Applied Statistics 32(7), 685–698 (2005)
Nadarajah, S., Kotz, S.: On the generation of gaussian noise. IEEE Transaction in Signal Processing 55(3), 1172 (2007)
Pearl, J.: Causality: Models, Reasoning, and inference. Cambridge University Press (2008)
Shimizu, S., Hoyer, P.O., Hyvarinen, A., Kerminen, A.: A linear non-gaussian acyclic model for causal discovery. Journal of Machine Learning Reseach 7, 2003–2030 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhang, Y., Luo, G. (2013). An Entropy Based Method for Causal Discovery in Linear Acyclic Model. In: Lee, M., Hirose, A., Hou, ZG., Kil, R.M. (eds) Neural Information Processing. ICONIP 2013. Lecture Notes in Computer Science, vol 8227. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-42042-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-42042-9_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-42041-2
Online ISBN: 978-3-642-42042-9
eBook Packages: Computer ScienceComputer Science (R0)