Introduction to Markov modeling

Abstract

This chapter introduces the reader to Markov modeling with an applied exercise concerning a Hepatitis B vaccination decision problem. Beginning here should give readers an understanding of probability theory as it applies to the Markovian assumption for advanced modeling techniques. These skills will be useful for mapping out infectious diseases with transitioning health states, which of course are common.