Standard word embedding algorithms, such as word2vec and Glove, make a restrictive assumption that words are likely to be semantically related only if they co-occur locally within a window of fixed size.
this restrictive assumption may not capture the semantic association between words that co-occur frequently but non-locally within documents.