Dynamic Programming and Markov Process

The book presents an analytic structure for a decision-making system that is at the same time both general enough to be descriptive and yet computationally feasible. It is based on the Markov process as a system model, and uses and iterative technique like dynamic programming as its optimization method.