As shown in Table 3, the performance dropped after we applied these two constraints, which indicated that the network had already paid attention to these words without using the attention mechanism, and effectively used them for classification.
such attentions are redundant.