If there was a sentence including the word below, the surrounding word vector for the word is the concatenated vector of the word embeddings or the words , , , and .
the surrounding word vectors of A are created not from all word tokens of A, but from only word tokens of A predicted as Sense 1 at the n-1 prediction.