Ideally, we would like to see an increase in dialog success rate and a decrease in dialog length, as is the case when comparing the learned and static policies.
the agent asks a fixed number of queries before guessing.