Markov Decision Processes

Discrete Stochastic Dynamic Programming

af Martin L. (University of British Columbia) Puterman

This book is an up-to-date, unified and rigorous treatment of theoretical, computational and applied research on Markov decision process models. The concentration of the book is on infinite-horizon discrete-time models, and it also discusses arbitrary state spaces, finite-horizon and continuous-time discrete-state models.