Modified Baum Welch Algorithm for Hidden Markov Models with Known Structure

  • Kim SchmidtEmail author
  • Karl Heinz Hoffmann
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 903)


Hidden Markov Models (HMMs) are widely used in speech and handwriting recognition, behavior prediction in traffic, time series analysis, biostatistics, image and signal processing, and many other fields. For some applications in those real world problems, a-priori knowledge about the structure of the HMM is available. For example the shape of the state transition matrix and/or the observation matrix might be given. We might know that some entries in these matrices are equal and others are zero. For training such a model, we have two options: use the common Baum Welch Algorithm (BWA) and enforce the given structure after training or modify the BWA to enforce it during training. This paper shows several approaches for modifying the BWA and compares the results of all training methods.


Hidden Markov Model HMM Baum Welch Algorithm Multiple sequence learning A-priori knowledge 



This research was supported by the European Social Fund and the Free State of Saxony under Grant No. 100269974.


  1. 1.
    Wendemuth, A.: Grundlagen der stochastischen Sprachverarbeitung. Oldenbourg Verlag, München (2004)CrossRefGoogle Scholar
  2. 2.
    Fink, G.A.: Markov Models for Pattern Recognition, 2nd edn. Springer, London (2014)CrossRefGoogle Scholar
  3. 3.
    Kuge, N., Yamamura, T., Shimoyama, O., Liu, A.: A driver behavior recognition method based on a driver model framework. SAE Technical Paper, Technical report (2000)Google Scholar
  4. 4.
    Streubel, T., Hoffmann, K.H.: Prediction of driver intended path at intersections. In: Intelligent Vehicles Symposium Proceedings, 8–11 June 2014, pp. 134–139. IEEE, Dearborn (2014)Google Scholar
  5. 5.
    Knab, B.: Erweiterung von Hidden-Markov-Modellen zur Analyse ökonomischer Zeitreihen. Ph.D. dissertation, Universit ̈at zu Köln (2000)Google Scholar
  6. 6.
    Hassan, M.R., Nath, B.: Stock market forecasting using hidden Markov model: a new approach. In: 5th International Conference on Intelligent Systems Design and Applications (ISDA 2005), pp. 192–196 (2005)Google Scholar
  7. 7.
    Schliep, A., Schönhuth, A., Steinhoff, C.: Using hidden Markov models to analyze gene expression time course data. Bioinformatics 19(1), i255–i263 (2003)CrossRefGoogle Scholar
  8. 8.
    Holzmann, H., Munk, A., Suster, M., Zucchini, W.: Hidden Markov models for circular and linear-circular time series. Environ. Ecol. Stat. 13(3), 325–347 (2006)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Li, J., Najmi, A., Gray, R.M.: Image classification by a two-dimensional hidden Markov model. IEEE Trans. Signal Process. 48(2), 517–533 (2000)CrossRefGoogle Scholar
  10. 10.
    Dash, D.P., Kolekar, M.H.: Epileptic seizure detection based on EEG signal analysis using hierarchy based Hidden Markov Model. In: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 1114–1120 (2017)Google Scholar
  11. 11.
    Rabiner, L.R., Juang, B.-H.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)CrossRefGoogle Scholar
  12. 12.
    Li, X., Parizeau, M., Plamondon, R.: Training hidden Markov models with multiple observations - a combinatorial method. Trans. PAMI 22(4), 371–377 (2000)CrossRefGoogle Scholar
  13. 13.
    Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bull. 1(6), 80–83 (1945)CrossRefGoogle Scholar
  14. 14.
    McCornack, R.L.: Extended tables of the Wilcoxon matched pair signed rank statistic. J. Am. Stat. Assoc. 60(311), 864–871 (1965)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Pearson, E.S., Hartley, H.O.: Biometrika Tables for Statisticians, vol. 1. Cambridge University Press, New York (1966)zbMATHGoogle Scholar
  16. 16.
    Owen, D.B.: Handbook of Statistical Tables. Addison-Wesley, Reading (1962)zbMATHGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Chemnitz University of TechnologyChemnitzGermany

Personalised recommendations