For example, English and Japanese fastText vectors (Bojanowski et al., 2017) have different substructures around "girl" (Figure 1 left).
first, they motivate the zero-mean condition based on the heuristic argument that two randomly selected word types should not be semantically similar (or dissimilar) in expectation.