Markov model for safety analysis