In a nutshell, the attention mechanism outputs a weighted sum of the comment representations, where the weights are learned by a subnetwork to indicate the importance of each comment.
the action embedding is invariant to the permutation of the comments, which leads to a permutation invariant Qvalue prediction.