But this type of delayed reward functions doesn't have immediate rewards at each turn, which makes the model converge slowly.
we propose to incorporate the learned conversational exchange transition information as an immediate reward.