(2013) proposed a simple negative sampling method, which generates r noise samples for each input word to estimate the target word, in which r is a very small number compared with N .
the training time yields linear scale to the number of noise samples and it becomes independent of the vocabulary size.