It is generally assumed that the geometry of word embeddings is determined by semantic relatedness.
the large majority of interactions are between frequent terms or between frequent and infrequent terms.