However, this mapping should not just model the inherent transformation, but also ensure that the resulting vector is 'natural'.
assuming that word representations lie on a manifold, the mapping should return one of its values.