Markov models and related models