Aggregation and Truncation of Reversible Markov Chains Modulo State Renaming
The theory of time-reversibility has been widely used to derive the expressions of the invariant measures and, consequently, of the equilibrium distributions for a large class of Markov chains which found applications in optimisation problems, computer science, physics, and bioinformatics. One of the key-properties of reversible models is that the truncation of a reversible Markov chain is still reversible. In this work we consider a more general notion of reversibility, i.e., the reversibility modulo state renaming, called \(\rho \)-reversibility, and show that some of the properties of reversible chains cannot be straightforwardly extended to \(\rho \)-reversible ones. Among these properties, we show that in general the truncation of the state space of a \(\rho \)-reversible chain is not \(\rho \)-reversible. Hence, we derive further conditions that allow the formulation of the well-known properties of reversible chains for \(\rho \)-reversible Markov chains. Finally, we study the properties of the state aggregation in \(\rho \)-reversible chains and prove that there always exists a state aggregation that associates a \(\rho \)-reversible process with a reversible one.
- 1.Akyildiz, I.F.: Exact analysis of queueing networks with rejection blocking. In: Perros, H.G., Atliok, T. (eds.) Proceedings of the 1st International Workshop on Queueing Networks with Blocking, pp. 19–29 (1989)Google Scholar
- 5.Block, R., Van Houdt, B.: Spatial fairness in multi-channel CSMA line networks. In: Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS, pp. 1–8 (2014)Google Scholar
- 18.Marin, A., Rossi, S.: On discrete time reversibility modulo state renaming and its applications. In: Proceedings of the 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS, pp. 1–8 (2014)Google Scholar
- 19.Marin, A., Rossi, S.: On the relations between lumpability and reversibility. In: Proceedings of the IEEE 22nd International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS 2014), pp. 427–432 (2014)Google Scholar
- 21.Marin, A., Rossi, S.: On the relations between Markov chain lumpability and reversibility. Acta Inform., 1–39 (2016). doi: 10.1007/s00236-016-0266-1
- 22.Pan, R., Prabhakar, B., Psounis, K.: CHOKe, a stateless active queue management scheme for approximating fair bandwidth allocation. In: Proceedings of IEEE INFOCOM 2000, pp. 942–951. IEEE Computer Society Press, Washington, DC (2000)Google Scholar