Furthermore, to investigate the attention mechanism in more detail, we computed the top influential entities in the attention mechanism for each class on the 20NG and R8 datasets.
we calculated the number of times each entity obtained the highest attention weight in the test documents in each class and selected the five most frequent ones.