Abstract
Bayesian network structure identification is known to be NP-Hard in the general case. We demonstrate a heuristic search for structure identification based on aggregation hierarchies. The basic idea is to perform initial exhaustive searches on composite “high-level” random variables (RVs) that are created via aggregations of atomic RVs. The results of the high-level searches then constrain a refined search on the atomic RVs. We demonstrate our methods on a challenging real-world neuroimaging domain and show that they consistently yield higher scoring networks when compared to traditional searches, provided sufficient topological complexity is permitted. On simulated data, where ground truth is known and controllable, our methods yield improved classification accuracy and structural precision, but can also result in reduced structural recall on particularly noisy datasets.
Chapter PDF
Similar content being viewed by others
References
Anderson, C., Domingos, P., Weld, D.: Relational Markov models and their application to adaptive web navigation. In: KDD, pp.143–152 (2002)
Burge, J., Lane, T.: Learning Class-Discriminative Dynamic Bayesian Networks. ICML 22, 97–104 (2005)
Buckner, R.L., Snyder, A., Sanders, A., Marcus, R., Morris, J.: Functional Brain Imaging of Young, Nondemented, and Demented Older Adults. Journal of Cognitive Neuroscience 12(2), 24–34 (2000)
Chickering, D., Geiger, D., Heckerman, D.: Learning Bayesian Networks is NP-Hard. Technical Report MSR-TR-94-17, Microsoft (1994)
Clark, V.P., Friedman, L., Manoach, D., Ho, B.C., Lim, K., Andreasen, N.: A collaborative fMRI study of the novelty oddball task in schizophrenia: Effects of illness duration. Society for Neuroscience Abstracts, 474.9 (2005)
Dartmouth fMRI Data Center, The (2006), http://www.fmridc.org/f/fmridc
Fine, S., Singer, Y., Tishby, N.: The Hierarchical Hidden Markov Model: Analysis and Applications. Machine Learning 32, 41–62 (1998)
Grossman, D., Domingos, P.: Learning Bayesian Network Classifiers by Maximizing Conditional Likelihood. In: ICML, vol. 21, pp. 361–368 (2004)
Gyftodimos, E., Flach, P.: Hierarchical Bayesian Networks: An Approach to Classification and Learning for Structured Data. In: Proceedings of Methods and Applications of Artificial Intelligence, Third Hellenic Conference in AI, pp. 291–300 (2004)
Heckerman, D., Geiger, D., Chickering, D.M.: Learning Bayesian Networks: the Combination of Knowledge and Statistical Data. Machine Learning 20, 197–243 (1995)
Kiehl, K.: An event-related functional magnetic resonance imaging study of an auditory oddball task in schizophrenia. Schizophrenia Research 48, 159–171 (2001)
Lancaster, J.L., Woldorff, M.G., Parsons, L.M., Liotti, M., Freitas, C.S., Rainey, L., Kochunov, P.V., Nickerson, D., Mikiten, S.A., Fox, P.T.: Automated Talairach Atlas labels for functional brain mapping. Human Brain Mapping 10, 120–131 (2000)
Lam, W., Bacchus, F.: Learning Bayesian belief networks: An approach based on the MDL principle. Computational Intelligence 10, 269–293 (1994)
Margaritis, D., Thrun, S.: Bayesian Network Induction via Local Neighborhoods. In: Advances in Neural Information Processing Systems 12, Denver, CO (1999)
McCallum, A., Rosenfeld, R., Mitchell, T., Ng, A.Y.: Improving Text Classification by Shrinkage in a Hierarchy of Classes. In: ICML (1998)
The MIND Institute (2006), http://www.themindinstitute.org/
Pearl, J.: Fusion, Propagation and Structuring in Belief Networks. AI 29(3), 241–288 (1986)
Schwarz, G.: Estimating the dimension of a model. Annals of Stats. 6, 461–464 (1978)
Sutton, R.S., Precup, D., Singh, S.: Between MDPs and semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. AI 112, 181–211 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Burge, J., Lane, T. (2006). Improving Bayesian Network Structure Search with Random Variable Aggregation Hierarchies. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds) Machine Learning: ECML 2006. ECML 2006. Lecture Notes in Computer Science(), vol 4212. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11871842_11
Download citation
DOI: https://doi.org/10.1007/11871842_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45375-8
Online ISBN: 978-3-540-46056-5
eBook Packages: Computer ScienceComputer Science (R0)