Having a large number of states is a more realistic scenario for practical, flexible, and generic dialogue systems, but it also makes many RL approaches intractable.
with a large number of states it is not possible to learn estimates of the expected future reward for every state, unless we can exploit commonalities between different states.