For example, we can easily calculate the semantic relatedness between two words 'dog' and 'cat' using cosine distance of their continuous representations.
a representation learning method aims at mapping a linguistic unit with k words S = [w 1 , w 2 , ..., w k ] into a continuous vector in a low dimensional feature space.