You just remember the probability of each state (of which in the real world there is always only a finite number).

→ View original post on X — @pmddomingos