Abstract
We combine Minimum Message Length (MML) evaluation of linear causal models with Monte Carlo sampling to produce a program that, given ordinary joint sample data, reports the posterior probabilities of equivalence classes of causal models and their member models. We compare our program with TETRAD II [7.15] and the Bayesian MCMC program of Madigan et al. [7.11]. Our approach differs from that of Madigan et al. [7.11] particularly in not assigning equal prior probabilities to equivalence classes of causal models and in merging models from distinct equivalence classes when the causal links are sufficiently weak that the sample data available could not be expected to distinguish between them (which we call ‘small effect equivalence’).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Asher, H. B. (1983): Causal modeling. Sage
Bernardo, J. M. and Smith, A. F. M. (1994): Bayesian theory. Wiley
Chickering, D. M. (1995): A transformational characterization of equivalent Bayesian network structures. Proc. 11th Conf. on Uncertainty in Artificial Intelligence, 87–98. Morgan Kaufmann
Forbes, J. (1997): A characterization of Bayesian network structures and its application to learning. Proc. 6th Int. Workshop on Artificial Intelligence and Statistics, 203–210
Heckerman, D., Mamdani, A. and Wellman, M. P. (1995): Real-world applications of Bayesian networks. Comm. ACM, 38(3), 24–26
Humphreys, P. and Freedman, D. (1996): The grand leap. Br. J. Philosophy of Sci. 47, 113–123
Karzanov, A. and Khachiyan, L. (1990): On the conductance of order Markov chains. Technical report DCS TR 268, Computer Science, Rutgers University
Kirkpatrick, S., Gelatt Jr., C. D. and Vecchi, M. P. (1983): Optimization by simulated annealing. Science, 220, 671–680
Korb, K. B. and Wallace, C. S. (1997): In search of the philosopher’s stone: Remarks on Humphreys and Freedman’s critique of causal discovery. Br. J. Philosophy of Sci. 48, 543–553
Lindley, D. V. (1972): Bayesian statistics: A review. Society for Industrial and Applied Mathematics
Madigan, D., Andersson, S. A., Perlman, M. D. and Volinsky, C. T. (1995): Bayesian model averaging and model selection for Markov equivalence classes of acyclic digraphs. NIPS 95 Workshop on Learning in Bayesian Networks and Other Graphical Models
McKim, V. R. and Turner, S. P. (eds.) (1997): Causality in crisis? Statistical methods and the search for causal knowledge in the social sciences. University of Notre Dame Press
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. and Teller, E. (1953): Equations of state calculations by fast computing machines. J. Chem. Phys. 21, 1087–1091
Spirtes, P., Glymour, C. and Scheines, R. (1993): Causation, prediction and search. Springer-Verlag
Spirtes, P., Glymour, C., Scheines, R. and Meek, C. (1994): TETRAD II: Tools for causal modeling. Lawrence Erlbaum
Verma, T. and Pearl, J. (1990): Equivalence and synthesis of causal models. Proc. 6th Conf. on Uncertainy in Artificial Intelligence, 462–470. Morgan Kaufmann
Wallace, C. S., Korb, K. B. and Dai, H. (1996): Causal discovery via MML. Proc. 13th Int. Conf. on Machine Learning, 516–524. Morgan Kaufmann. (Also published as technical report TR 96/254, Computer Science, Monash University)
Wallace, C. S. and Freeman, P. R. (1987): Estimation and inference by compact coding. J. Roy. Statist. Soc. B, 49, 240–252
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wallace, C.S., Korb, K.B. (1999). Learning Linear Causal Models by MML Sampling. In: Gammerman, A. (eds) Causal Models and Intelligent Data Management. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-58648-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-58648-4_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-63682-0
Online ISBN: 978-3-642-58648-4
eBook Packages: Springer Book Archive