the label y vector for one token v i is defined by However, computing the loss over the whole entity vocabulary would be infeasible, because the entity mention vocabulary is very large and the gradients for the entity classifier would exceed our GPU memory.
to improve memory efficiency and increase convergence speed, we use negative sampling.