Given a text corpus, the Skip-Gram model aims to find word representations that are good at predicting the context words.
given a sequence of training words, denoted as w 1 , w 2 , • • • , w T , the objective of Skip-Gram model is to minimize the log loss of predicting the context using target word embedding, which can be expressed as follows: where s is the window size of the context sampling.