Step 1: rows are close. Let p,q be two rows of P, probability vectors with all entries ≥δ. The vector d=p−q has zero sum, so ∑idi+=∑idi−=21∥d∥1, where d± are the positive/negative parts. Moreover
i∑di+=i∑(pi−qi)+=1−i∑min(pi,qi)≤1−nδ.
Step 2: oscillation contracts. For x∈Rn, (Px)r−(Px)s=d⋅x with d=pr−ps. Because ∑di=0,
d⋅x=∑di+xi−∑di−xi≤(∑di+)maxx−(∑di−)minx=(∑di+)osc(x).
Hence osc(Px)≤(1−nδ)osc(x), and by induction osc(Pkx)≤(1−nδ)kosc(x).
Step 3: Pkx converges to a constant. Since P is stochastic, each coordinate of Px is an average of the coordinates of x: maxPkx is nonincreasing, minPkx is nondecreasing, and both converge; as the oscillation tends to 0, they converge to the same limit c(x). So Pkx→c(x)1, with ∣Pkx−c(x)1∣∞≤(1−nδ)kosc(x).
Step 4: the limit matrix. c is linear in x (a limit of linear maps), so c(x)=π⋅x for πi=c(ei). Taking x=ei with c(ei)≥0 (the entries of Pk are ≥0) and x=1 with c(1)=1 shows that πi≥0 and ∑πi=1. Therefore Pkx→1πTx for each x, i.e. Pk→1πT.
Example. P=(0.90.20.10.8) has δ=0.1 and ratio ≤0.8 (the actual second eigenvalue is 0.7); π=(32,31).
Remark. The constant 1−nδ is the Dobrushin ergodicity coefficient. Also πP=π follows from 1πTP=limPk+1=1πT, and π is unique, so the Markov chain forgets its initial state exponentially fast.