Assignment:
1. Draw the transition diagram for each of the transition matrices below:
How do you classify the three MCs? Why? Compute the steady state probability probability vector π, whenever possible.
2. Consider the MC with transition probability
Classify the MC and determine the asymptotic probability vector, if possible.
3. Consider the MC with transition probability
Classify the MC and determine the asymptotic state probability vector, if possible.