3.3 HOW TO finite Markov chain

3.3.1 How to find \(f_{ij}^{\left ( n\right ) }\)
3.3.2 How to find \(f_{ij}\)
3.3.3 How to find \(E\left ( V_{ij}\right ) \) the expected number of visits to j before absorbing?
3.3.4 How to find average number of steps \(E\left ( T_{ij}\right ) \) between state \(i\) and state \(j\)?
3.3.5 How to find number of visits to a transient state?