Markov chains and random walks

Homogeneous Markov chains in finite and countable state space. Foster-Lyapunov criterion for recurrence and transience. Random walks in one and more dimensions. Polya theorem. Limit theorems: law of iterated logarithms, functional central limit theorem. Connections with the Brownian motion and the heat equation. Applications of random walks to finance and insurance.