We first rewrite the context window c as: where we replace the average of the word embeddings with a weighted sum of the individual word embeddings within the context.
each word is w i at relative position i is attributed an attention level representing how much the attention model believes this it is important to look at in order to predict the center word.