The attention weights of ambiguous nouns are lower than those of nouns in general.
more attention is distributed to context words, which implies that self-attention recognizes ambiguous nouns and distributes more attention to the context.