Constrained Markov decision processes

Approximate dynamic programming

Reinforcement learning and dynamic programming using function approximators

Foundations of non-stationary dynamic programming with discrete time parameter

Markov Decision Processes

Digital control of dynamic systems

Applied dynamic programming

Hidden Markov models for time series

The theory of stochastic processes

Approximate Iterative Algorithms

Markov decision processes in artificial intelligence

Continuous semi-Markov processes

Handbook of hidden Markov models in bioinformatics

Machiavelli and Renaissance Italy

Finite Markov chains

Bioinformatics

Queueing networks and Markov chains