The difficulty is that, at any point in the dialogue, the system cannot be sure what will happen in the remainder of the dialogue, and thus cannot be sure what effect its actions will have on the total reward at the end of the dialogue.
the system must choose an action based on the average reward it has observed previously after it has performed that action in states similar to the current one.