In a related example, Figure 1 shows the projections onto a 2D space 3 of the representations for the two senses ofåsna: 'donkey' or 'slow-witted person', and those of their corresponding nearest neighbors.
formally: our training objective is to maximize the sum of the log-probabilities of context words c given a sense s of the target word w plus the logprobability of the sense s given the target word: We must now consider two distinct vocabularies: V containing all possible word forms (context and target words), and S containing all possible senses for the words in V , with sizes |V | and |S|, resp.