let xn n 0 be a markov chain with state space e 0 1 and transition probabilities given by p0 0 1 p0 1 3 4 pi i 1 1 2 1 1 i