Abstract
This paper presents a matrix-analytic solution for second-order Markov fluid models (also known as Markov-modulated Brownian motion) with level-dependent behavior. A set of thresholds is given that divide the fluid buffer into homogeneous regimes. The generator matrix of the background Markov chain, the fluid rates (drifts) and the variances can be regime dependent. The model allows the mixing of second-order states (with positive variance) and first-order states (with zero variance) and states with zero drift. The behavior at the upper and lower boundary can be reflecting, absorbing, or a combination of them. In every regime, the solution is expressed as a matrix-exponential combination, whose matrix parameters are given by the minimal nonnegative solution of matrix quadratic equations that can be obtained by any of the well-known solution methods available for quasi birth death processes. The probability masses and the initial vectors of the matrix-exponential terms are the solutions of a set of linear equations. However, to have the necessary number of equations, new relations are required for the level boundary behavior, relations that were not needed in first-order level dependent and in homogeneous (non-level-dependent) second-order fluid models. The method presented can solve systems with hundreds of states and hundreds of thresholds without numerical issues.
Similar content being viewed by others
Notes
The implementation can be downloaded from http://www.hit.bme.hu/~ghorvath/software.
References
Ahn, S., Ramaswami, V.: A quadratically convergent algorithm for first passage time distributions in the Markov-modulated Brownian motion. Stoch. Models 33(1), 59–96 (2017)
Akar, N., Sohraby, K.: An invariant subspace approach in \(M/G/1\) and \(G/M/1\) type Markov chains. Commun. Stat. Stoch. Models 13(3), 381–416 (1997)
Akar, N., Sohraby, K.: Infinite-and finite-buffer Markov fluid queues: a unified analysis. J. Appl. Probab. 41, 557–569 (2004)
Asmussen, S.: Stationary distributions for fluid flow models with or without Brownian noise. Commun. Stat. Stoch. Models 11(1), 21–49 (1995)
Bass, R.F., Pardoux, E.: Uniqueness for diffusions with piecewise constant coefficients. Probab. Theory Relat. Fields 76(4), 557–572 (1987). doi:10.1007/BF00960074
Bean, N.G., O’Reilly, M.M.: Performance measures of a multi-layer Markovian fluid model. Ann. Oper. Res. 160(1), 99–120 (2008)
Bekker, R., Boxma, O.J., Resing, J.A.C.: Levy processes with adaptable exponent. Adv. Appl. Probab. 41(1), 117–205 (2009)
Bini, D., Meini, B., Steffé, S., Van Houdt, B.: Structured Markov chains solver: software tools. In: Proceeding from the 2006 Workshop on Tools for Solving Structured Markov Chains. ACM, p. 14 (2006)
Bini, D.A., Latouche, G., Meini, B.: Numerical Methods for Structured Markov Chains (Numerical Mathematics and Scientific Computation). Oxford University Press Inc, New York (2005)
Breuer, L.: Exit problems for reflected Markov-modulated Brownian motion. J. Appl. Probab. 49(3), 697–709 (2012)
Chen, D., Hong, Y., Trivedi, K.S.: Second-order stochastic fluid models with fluid-dependent flow rates. Perform. Eval. 49(1), 341–358 (2002)
Cox, D.R., Miller, H.D.: The Theory of Stochastic Processes. Chapman and Hall Ltd, London (1972)
da Silva Soares, A., Latouche, G.: Fluid queues with level dependent evolution. Eur. J. Oper. Res. 196(3), 1041–1048 (2009)
da Silva, Soares A., Latouche, G.: Matrix-analytic methods for fluid queues with finite buffers. Perform. Eval. 63(4–5), 295–314 (2006)
Gribaudo, M., Manini, D., Sericola, B., Telek, M.: Second order fluid models with general boundary behaviour. Ann. Oper. Res. 160(1), 69–82 (2008)
Hohn, N., Veitch, D., Papagiannaki, K., Diot, C.: Bridging router performance and queuing theory. SIGMETRICS Perform. Eval. Rev. 32(1), 355–366 (2004)
Ivanovs, J.: Markov-modulated Brownian motion with two reflecting barriers. J. Appl. Probab. 47(4), 1034–1047 (2010)
Karandikar, R.L., Kulkarni, V.: Second-order fluid flow models: reflected Brownian motion in a random environment. Oper. Res. 43, 77–88 (1995)
Latouche, G., Nguyen, G.: Fluid approach to two-sided reflected Markov-modulated Brownian motion. Queueing Syst. 80(1–2), 105–125 (2015a)
Latouche, G., Nguyen, G.T.: The morphing of fluid queues into Markov-modulated Brownian motion. Stoch. Syst. 5(1), 62–86 (2015b)
Le, L., Aikat, J., Jeffay, K., Smith, F.D.: The effects of active queue management and explicit congestion notification on web performance. IEEE/ACM Trans. Netw. 15(6), 1217–1230 (2007)
Ramaswami ,V.: Matrix analytic methods for stochastic fluid flows. In: International Teletraffic Congress, Edinburg, pp. 1019–1030(1999)
Rogers, L.C.G.: Fluid models in queueing theory and Wiener-Hopf factorization of Markov chains. Ann. Appl. Probab. 4(2), 390–413 (1994)
Stanford, D.A., Latouche, G., Woolford, D.G., Boychuk, D., Hunchak, A.: Erlangized fluid queues with application to uncontrolled fire perimeter. Stoch. Models 21(2–3), 631–642 (2005). doi:10.1081/STM-200056242
Stroock, D.W., Varadhan, S.S.: Multidimensional Diffusion Processes. Springer, Berlin (2007)
Telek, M., Vécsei, M.: Finite queues at the limit of saturation. In: 2012 Ninth International Conference on Quantitative Evaluation of Systems, pp. 33–42 (2012)
Acknowledgements
The authors thank the exceptional efforts of the anonymous reviewers, their comments helped to improve the manuscript significantly. The authors thank the help of Balázs Ráth as well, for the useful advises in revising Sect. 4. This research is partially supported by the OTKA-123914 project.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Horváth, G., Telek, M. Matrix-analytic solution of infinite, finite and level-dependent second-order fluid models. Queueing Syst 87, 325–343 (2017). https://doi.org/10.1007/s11134-017-9544-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11134-017-9544-z
Keywords
- Second-order Markov fluid queue
- Markov-modulated Brownian motion
- Level-dependent behavior
- Stationary analysis
- Matrix-analytic solution