Markov Chains at Equilibrium

Abstract

In this chapter we will study the long-term behavior of Markov chains. In other words, we would like to know the distribution vector s(n) when n → ∞. The state of the system at equilibrium or steady state can then be used to obtain performance parameters such as throughput, delay, loss probability, etc.