Markov Chains: Theory and Applications

Dust jacket notes: "MARKOV CHAINS is a practical book based on proven theory for those who use Markov models in their work. Isaacson/Madsen take up the topic of Markov chains, emphasizing discrete time chains. It is rigorous mathematically but not restricted to mathematical aspects of the Markov chain theory. The authors stress the practical aspects of Markov chains through numerous examples and illustrations. Balanced between theory and applications this will serve as a prime resource for faculty and students in mathematics, probability, and statistics as well as those in computer science, industrial engineering, and other fields using Markov models. Includes integrated discussions of: the classical approach to discrete time stationary Markov chains; chains using algebraic and computer approaches; nonstationary Markov chains using the ergodic coefficient approach (not emphasized in most other texts). Presents recent results with illustrations and examples, including unsolved problems in the area of nonstationary Markov chains. Applies basic properties of continuous time Markov chains to birth and death processes and relates this topic to earlier chapters. Exercises help readers understand and extend the material."