In section 2.4.1, we highlighted the fact that the n-gram user simulations are not completely realistic and that this will make certain state features more or less important in learning a strategy.
had we been able to use even more realistic user simulations, including certain additional context features in the state might have enabled a greater improvement over the baseline.