(d) Use the method in Question 1(c) to calculate the steady-state vector, q. In the long run,
what is the probability the weather will be good on a given day?
3. According to Theorem 18, when P is stochastic and regular, and vis any probability vector,
the sequence of vectors v, Pv, P2v, . . . converge, and the limit vector will be the steady-state
vector of P. In other words, when the power kis big enough, Pkvwill look like the unique
steady-state vector. This is not an efficient way to calculate the steady-state vector, but it
is interesting to see the sequence v, Pv, P2v, . . . converge for a few examples. The following
Maple commands can be used to compute the first 10 terms in the sequence. If more terms are
needed, change 10 to a larger number and re-execute.
Estimate kfor both Exercise 2, using matrix P, and Exercise 4, using matrix W. Use each of
the initial vectors shown below and at least one more probability vector vof your own. For each
v, calculate Pkvuntil you find a big enough kso that Pkvlooks like the steady-state vector
for P (compare to the steady-state vectors you found in Questions 1(d) and 2(d)). Repeat this
for each vand W, and record the smallest value of kwhich is big enough in each case. Record
your results, including the initial vector that you chose, in the table below.
Animal Experiment (using matrix P) Weather Forecast (using matrix W)
v0
1
0
0.2
0.6
0.35
0.35
0
1
0.40
0.20
0.33
0.34