Handstein Wang

Introduction

Markov Chain

Let $(\Omega,\mathcal{F})$ be a measurable space, $P:\Omega\times \mathcal{F}\to [0,1]$ be a transition kernel, that is,

• for every $x\in \Omega$, $P(x,\cdot)$ is a probability measure on $\mathcal{F}$;
• for every $A\in \mathcal{F}$, $x\mapsto P(x,A)$ is measurable.