CBOW predicts the target word w t given nearby context words in a window with width δ: The set C near wt contains in total at most 2δ words, including δ words to the left and δ words to the right of a target word.
we train the word vectorsṽ wt and v c (c ∈ C near wt ) by maximizing the following prediction probability: The CBOW captures both semantic and syntactic word similarity through the training using nearby context words.