A Simulation Study on Fuzzy Markov Chains

  • Juan C. Figueroa García
  • Dusko Kalenatic
  • Cesar Amilcar Lopez Bello
Part of the Communications in Computer and Information Science book series (CCIS, volume 15)


This paper presents a simulation study on Fuzzy Markov chains to identify some characteristics about their behavior, based on matrix analysis. Through experimental evidence it is observed that most of fuzzy Markov chains does not have an ergodic behavior. So, several sizes of Markov chains are simulated and some statistics are collected.

Two methods for obtaining the Stationary Distribution of a Markov chain are implemented: The Greatest Eigen Fuzzy Set and the Powers of a Fuzzy Matrix. Some convergence theorems and two new definitions for ergodic fuzzy Markov chains are presented and discussed allowing to view this fuzzy stochastic process with more clarity.


Markov Chain Stationary Distribution Fuzzy Relation Fuzzy Random Variable Fuzzy Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Sanchez, E.: Resolution of Eigen Fuzzy Sets Equations. Fuzzy Sets and Systems 1, 69–74 (1978)zbMATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Sanchez, E.: Eigen Fuzzy Sets and Fuzzy Relations. J. Math. Anal. Appl. 81, 399–421 (1981)zbMATHCrossRefMathSciNetGoogle Scholar
  3. 3.
    Avrachenkov, K.E., Sanchez, E.: Fuzzy Markov Chains and Decision-making. Fuzzy Optimization and Decision Making 1, 143–159 (2002)zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Araiza, R., Xiang, G., Kosheleva, O., Skulj, D.: Under Interval and Fuzzy Uncertainty, Symmetric Markov Chains Are More Difficult to Predict. In: Proceedings of the IEEE NAFIPS 2007 Conference, vol. 26, pp. 526–531 (2007)Google Scholar
  5. 5.
    Grimmet, G., Stirzaker, D.: Probability and Random Processes. Oxford University Press, Oxford (2001)Google Scholar
  6. 6.
    Ross, S.M.: Stochastic Processes. John Wiley and Sons, Chichester (1996)zbMATHGoogle Scholar
  7. 7.
    Ching, W.K., Ng, M.K.: Markov Chains: Models, Algorithms and Applications. Springer, Heidelberg (2006)zbMATHGoogle Scholar
  8. 8.
    Thomason, M.: Convergence of Powers of a Fuzzy Matrix. J. Math. Anal. Appl. 57, 476–480 (1977)zbMATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    Pang, C.T.: On the Sequence of Consecutive Powers of a Fuzzy Matrix with Maxarchimedean t-norms. Fuzzy Sets and Systems 138, 643–656 (2003)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    Gavalec, M.: Computing Orbit Period in Max-min Algebra. Discrete Appl. Math. 100, 49–65 (2000)zbMATHCrossRefMathSciNetGoogle Scholar
  11. 11.
    Gavalec, M.: Periods of special fuzzy matrices. 16, pp. 47–60. Tatra Mountains Mathematical Publications (1999)Google Scholar
  12. 12.
    Gavalec, M.: Reaching matrix period is np-complete, vol. 12, pp. 81–88. Tatra Mountains Mathematical Publications (1997)Google Scholar
  13. 13.
    Avrachenkov, K.E., Sanchez, E.: Fuzzy Markov Chains: Specifities and properties. In: 8th IEEE IPMU 2000 Conference, Madrid, Spain (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Juan C. Figueroa García
    • 1
  • Dusko Kalenatic
    • 2
  • Cesar Amilcar Lopez Bello
    • 3
  1. 1.Universidad Distrital Francisco José de CaldasBogotáColombia
  2. 2.Universidad de la Sabana, Chia - Colombia, Universidad Católica de ColombiaBogotáColombia
  3. 3.Universidad Distrital Francisco José de Caldas, Bogotá - Colombia, Universidad de la SabanaChiaColombia

Personalised recommendations