Abstract
Typical structured learning models consist of a regression component of the explanatory variables (observations) and another regression component that accounts for the neighboring states. Such models, including Conditional Random Fields (CRFs) and Maximum Margin Markov Network (M3N), are essentially Markov random fields with the pairwise spatial dependence. They are effective tools for modeling spatial correlated responses; however, ignoring the temporal correlation often limits their performance to model the more complex scenarios. In this paper, we introduce a novel Temporal Maximum Margin Markov Network (TM3N) model to learn the spatial-temporal correlated hidden states, simultaneously. For learning, we estimate the model’s parameters by leveraging on loopy belief propagation (LBP); for predicting, we forecast hidden states use linear integer programming (LIP); for evaluation, we apply TM3N to the simulated datasets and the real world challenge for occupancy estimation. The results are compared with other state-of-the-art models and demonstrate superior performance.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Desai, C., Ramanan, D., Fowlkes., C.: Discriminative models for multi-class object layout. In: ICCV (2009)
Dong, B., Andrews, B., Lam, K., Hoynck, M., Chiou, Y., Zhang, R., Benitez, D.: An Information Technology Enabled Sustainability Test-Bed (ITEST) For Occupancy Detection Through An Environmental Sensing Network. Energy and Buildings. Energy and Buildings 42(7) (2010)
Fildes, R.: Forecasting structural time series models and the kalman filter: Andrew harvey, p. 554. Cambridge University Press, Cambridge (1989); International Journal of Forecasting 8(4), 635–635 (December 1992), http://ideas.repec.org/a/eee/intfor/v8y1992i4p635-635.html , ISBN: 0-521-32196-4
Gould, S., Fulton, R., Koller, D.: Decomposing a scene into geometric and semantically consistent regions. In: ICCV (2009)
Kalman, R.E.: A new approach to linear filtering and prediction problems. Trans. Am. Soc. Mech. Eng., Series D. Journal of Basic Engineering 82 (1960)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of the 18th International Conference on Machine Learning, pp. 282–289 (2001)
Li, R., Tian, T.P., Sclaroff, S.: Simultaneous Learning of Nonlinear Manifold and Dynamical Models for High-dimensional Time Series. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8 (October 2007), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4409044
Murphy, K.P., Weiss, Y., Jordan, M.I.: Loopy belief propagation for approximate inference: An empirical study. In: Proceedings of Uncertainty in AI, pp. 467–475 (1999)
Oh, S.M., Ranganathan, A., Rehg, J.M., Dellaert, F.: A Variational inference method for Switching Linear Dynamic Systems Need for Variational methods Variational method. Computing (2005)
Qian, X., Jiang, X., Zhang, Q., Huang, X., Wu, L.: Sparse higher order conditional random fields for improved sequence labeling. In: ICML, p. 107 (2009)
Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proceedings of the IEEE, 257–286 (1989)
Sarawagi, S., Gupta, R.: Accurate max-margin training for structured output spaces. In: ICML 2008: Proceedings of the 25th International Conference on Machine Learning, pp. 888–895. ACM, New York (2008)
Taskar, B., Guestrin, C., Koller, D.: Max-margin markov networks. Advances in Neural Information Processing Systems 16, 25–32 (2003)
Taskar, B.: Learning structured prediction models: A large margin approach. Stanford University, Ph.D. thesis (2004)
Tsochantaridis, I., Joachims, T., Hofmann, T., Altun, Y.: Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res. 6, 1453–1484 (2005)
Duong, T.V., Phung, D.Q., Bui, H.H., Venkatesh, S.: Behavior recognition with generic exponential family duration modeling in the hidden semi-markov model. In: Proceedings of the 18th International Conference on Pattern Recognition, vol. 3 (2006)
Welch, L.R.: Hidden markov models and the baum-welch algorithm. IEEE Information Theory Society Newsletter 53(4) (December 2003), http://www.itsoc.org/publications/nltr/it_dec_03final.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, X., Dong, B., Sweeney, L. (2010). Temporal Maximum Margin Markov Network. In: Balcázar, J.L., Bonchi, F., Gionis, A., Sebag, M. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2010. Lecture Notes in Computer Science(), vol 6321. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15880-3_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-15880-3_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15879-7
Online ISBN: 978-3-642-15880-3
eBook Packages: Computer ScienceComputer Science (R0)