State Accessibility

Description:

• State $j$ is said to be accessible from state $i$ if $P_{ij}^n>0$ for some $n\ge 0$
  • for any number of steps, state $j$ is reachable from state $i$