We then concatenated the vector to the rest of the word embeddings.
this approach did not result in significant improvements because new words are added to the language almost every day, and it is impossible to capture them all.