Chapter 3
study notes,lecture notes

3.1 some code I wrote for testing things...
3.2 Definitions
3.3 HOW TO finite Markov chain
3.4 Some useful formulas
3.5 Diagram to help understanding