This is a linear transformation in the word embedding space and does not affect the topology of the embedding space.
translating word embeddings such that they have a zero mean has shown to improve performance in similarity tasks Mu et al.