Unlike the state-ofthe-art approach, which treats an action as a sequence, our model uses an attention mechanism to integrate information from a set of comments.
the prediction of Q-value is invariant to the permutation of the comments, which leads to a more consistent agent behavior.