Abstract
In the early twentieth century, Markov (1856–1922) introduced in Markov (Izvestiya Fiziko-matematicheskogo Obschestva pri Kazanskom Universitete 15:135–156, 1906) a new class of models called Markov chains, applying sequences of dependent random variables that enable one to capture dependencies over time.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Apostol, T.: Calculus II. Wiley, London (1969)
Bellman, R.: Introduction to Matrix Analysis. SIAM, Philadelphia (1997)
Bernstein, S.N.: The Theory of Probabilities. Leningrad, Moscow (1946)
Erdős, P., Feller, W., Pollard, H.: A theorem on power series. Bull. Amer. Math. Soc. 55, 201–203 (1949)
Feller, W.: An Introduction to Probability Theory and Its Applications, vol. I. Wiley, New York (1968)
Foster, F.G.: On the stochastic matrices associated with certain queuing processes. Ann. Math. Stat. 24, 355–360 (1953)
Gikhman, I., Skorokhod, A.: The Theory of Stochastic Processes, vol. I. Springer, Berlin (1974)
Gikhman, I.I., Skorokhod, A.V.: The Theory of Stochastic Processes, vol. II. Springer, Berlin (1975)
Haccou, P., Jagers, P., Vatutin, V.A.: Branching Processes: Variation, Growth, and Extinction of Populations, vol. 5. Cambridge University Press, Cambridge (2005)
Harris, T.E.: The Theory of Branching Processes. Courier Corporation, Chelmsford (2002)
Izsák, J., Szeidl, L.: Population dynamic models leading to logarithmic and Yule distribution. Acta Inform. Hung. 15(1), 149–162 (2018)
Johnson, N.L., Kemp, A.M., Kotz, S.: Univariate Discrete Distributions, 3rd edn. Wiley, London (2005)
Kamke, E.: Differencialgleichungen. I. Gewoehnliche Differencialgleichungen, 10th edn. Springer, Berlin (1977)
Kendall, D.G.: On the generalized birth-and-death process. Ann. Math. Stat. 19(1), 1–15 (1948)
Kendall, D.G.: Stochastic processes and population growth. J. R. Stat. Soc. Ser. B 11(2), 230–282 (1949)
Klimov, G.P.: Extremal Problems in Queueing Theory. Energia, Moscow (1964)
Lange, K.: Applied Probability, 2nd edn. Springer, Berlin (2010)
Markov, A.A.: Rasprostranenie zakona bol’shih chisel na velichiny, zavisyaschie drug ot druga. Izvestiya Fiziko-matematicheskogo Obschestva pri Kazanskom Universitete 15, 135–156 (1906)
Matveev, V.F., Ushakov, V.G.: Queueing Systems. MGU, Moscow (1984)
Meyn, S., Tweedie, R.: Markov Chains and Stochastic Stability. Springer, Berlin (1993)
Olver, P.J.: Introduction to Partial Differential Equations. Springer, Berlin (2014)
Seneta, E.: Non-negative Matrices and Markov Chains. Springer, Berlin (2006)
Serfozo, R.: Basics of Applied Stochastic Processes. Springer, Berlin (2009)
Shiryaev, A.N.: Probability. Springer, Berlin (1994)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Lakatos, L., Szeidl, L., Telek, M. (2019). Markov Chains. In: Introduction to Queueing Systems with Telecommunication Applications. Springer, Cham. https://doi.org/10.1007/978-3-030-15142-3_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-15142-3_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-15141-6
Online ISBN: 978-3-030-15142-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)