For each of the N words w i in phrase p we construct the embedding: where e w i is the embedding for word i; and refers to point-wise product.
we report NCE loss with a fixed set of samples for NCE trained models.