(2017) built on this work, exploring several strategies for rotating embeddings to obtain more semantically meaningful dimensions.
to our knowledge, orthogonal transformations themselves have not been used to represent word relationships; our work is novel in this respect.