In this example, the word "talk" performs attention operation over input sequence, where the words "Bush", "held" and "Sharon" are chosen as the truly-significant words.
due to their high frequency with a limited vocabulary (e.g., 150 words 9 ), content-free words, or function words generally receive a lot of attention, although they have very little substantive meaning.