A Markov chain on {0,1,2,3,4,5} has absorbing states 0 and 5. For interior states:
p(1,0)=41,p(1,2)=43,
p(2,1)=31,p(2,3)=32,
p(3,2)=21,p(3,4)=21,
p(4,3)=32,p(4,5)=31.
Let T=inf{n≥0:Xn∈{0,5}}.
(a) A function f on {0,…,5} is *harmonic* on {1,2,3,4} if f(i)=∑jp(i,j)f(j) for i∈{1,2,3,4}. Find the harmonic function with f(0)=0, f(5)=1, and use it to compute P(XT=5∣X0=2).
(b) Compute E[T∣X0=2].