We first evaluate the performance of each conversation turn, in terms of both turn-level keyword prediction and response selection.
we disable the discourse-level target constraint, and focus on measuring how accurate the systems can predict the next keyword and retrieve the correct response on the test set of the conversation data.