Markov chains

Hidden Markov models for time series

The theory of stochastic processes

Approximate Iterative Algorithms

Markov decision processes in artificial intelligence

Continuous semi-Markov processes

Handbook of hidden Markov models in bioinformatics

Machiavelli and Renaissance Italy

Finite Markov chains

Markov Decision Processes

Constrained Markov decision processes

Bioinformatics

Queueing networks and Markov chains

Diffusions, Markov processes, and martingales

Initiation aux mathématiques des processus de diffusion, contagion et propagation

Methodes et modeles de la recherche operationnelle (Collection Gestion : serie : politique generale, finance et marketing)

Markov chain models--rarity and exponentiality

Cont Markov Chains

The construction theory of denumerable Markov processes