Imagine a system that learns to change its strategy as it realizes that a particular user is no longer a novice user, or that a user no longer cares about five star restaurants.
it is important to investigate RL approaches that do not make such assumptions about the user/environment.