Abstract
Many examples exist of multivariate time series where dependencies between variables change over time. If these changing dependencies are not taken into account, any model that is learnt from the data will average over the different dependency structures. Paradigms that try to explain underlying processes and observed events in multivariate time series must explicitly model these changes in order to allow non-experts to analyse and understand such data. In this paper we have developed a method for generating explanations in multivariate time series that takes into account changing dependency structure. We make use of a dynamic Bayesian network model with hidden nodes. We introduce a representation and search technique for learning such models from data and test it on synthetic time series and real-world data from an oil refinery, both of which contain changing underlying structure. We compare our method to an existing EM-based method for learning structure. Results are very promising for our method and we include sample explanations, generated from models learnt from the refinery dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bilnes, J.A.: Dynamic Bayesian Multinets. In: Proceedings of the 16th Annual Conference on Uncertainty in AI, pp. 38–45 (2000)
Chatfield, C.: The Analysis of Time Series – An Introduction, 4th edn. Chapman and Hall, Boca Raton (1989)
Cooper, G.F., Herskovitz, E.: A Bayesian Method for the Induction of Probabilistic Networks from Data. Machine Learning 9, 309–347 (1992)
Friedman, N.: Learning the Structure of Dynamic Probabilistic Networks. In: Proceedings of the 14th Annual Conference on Uncertainty in AI, pp. 139–147 (1998)
Friedman, N.: The Bayesian Structural EM Algorithm. In: Proceedings of the 14th Annual Conference on Uncertainty in AI, pp. 129–138 (1998)
Ghahramani, Z., Hinton, G.E.: Variational Learning for Switching State-Space Models. Neural Computation 12(4), 963–996 (1999)
Heckerman, D.: A Tutorial on Learning with Bayesian Networks Technical Report, MSR-TR-95-06, Microsoft Research (1996)
Henrion, M.: Propagating uncertainty in Bayesian networks by probabilistic logic sampling. In: Proceedings of the 2nd Annual Conference on Uncertainty in AI, pp. 149–163 (1988)
Michalewicz, Z., Fogel, D.B.: How To Solve It: Modern Heuristics. Springer, Heidelberg (1998)
Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco (1988)
Ramoni, M., Sebstiani, P., Cohen, P.: Bayesian Clustering by Dynamics. Machine Learning 47(1), 91–121 (2002)
Tucker, A., Liu, X., Ogden-Swift, A.: Evolutionary Learning of Dynamic Probabilistic Models with Large Time Lags. International Journal of Intelligent Systems 16, 621–645 (2001)
Tucker, A.: The Automatic Explanation of Multivariate Time Series PhD Thesis, Birkbeck College, University of London (2001)
Ueda, N., Nakano, R.: Deterministic Annealing Variant of the SEM algorithm. Advances in Neural Information Processing Systems 7, 545–552 (1995)
Wong, M., Lam, W., Leung, S.: Using Evolutionary Programming and Minimum Description Length Principle for Data Mining of Bayesian Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(2), 174–178 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tucker, A., Liu, X. (2003). Learning Dynamic Bayesian Networks from Multivariate Time Series with Changing Dependencies. In: R. Berthold, M., Lenz, HJ., Bradley, E., Kruse, R., Borgelt, C. (eds) Advances in Intelligent Data Analysis V. IDA 2003. Lecture Notes in Computer Science, vol 2810. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45231-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-45231-7_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40813-0
Online ISBN: 978-3-540-45231-7
eBook Packages: Springer Book Archive