Our experimental results show that the model leveraging the context embedding outperforms other methods and provide us with findings, for example, on how to construct context embeddings and which corpus to use.
given the characteristics described in the previous paragraph and SGNS's equivalence with shifted positive pointwise mutual information (Levy and Goldberg, 2014), if we want to measure to what extent word w t tends to co-occur with w k in the training data, then we should use the similarity of In this study, we show the importance of using v OU T in a task where we need to see if a word matches its context.