Application of Markov Chains

Abstract

This paper introduces the theory of Markov Chains and illustrates the deduction of its transition probability matrix. A mathematical model for the growth of a bacteria colony and a mathematical model of the artificial intelligence in the venous transfusion are built. They are based on Markov chains and accord with the properties of transition matrix. The limitation of the model is discussed. The material is cited from authoritative websites, research done by academic institutions, and scientific essays.