In a typical RL setting, each action performed by the agent will change its state, and the agent will perform a series of actions (called an epoch) until it reaches certain states or the number of actions reaches a certain limit.
in the analogy above, actions does not affect the state, and after each action we restart with another unrelated state, so each epoch consists of only one action.