Then, the probability of predicting the word w o given the word w i is defined as: wo) w∈V e ow i (w) This is referred as the softmax objective.
for larger vocabularies it is inefficient to compute o w i , since this requires the computation of a |V |×d w matrix multiplication.