First, this is the first paper to conduct a comprehensive study covering a wide range of evaluation criteria and popular embedding techniques.
we study how outcomes from three different evaluation criteria are connected: word relatedness, coherence, downstream performance.