In the following, we elaborate the model in detail: Word Hash Layer (l 1 ): Traditionally, each word is represented by a one-hot word vector, where the dimensionality of the vector is the vocabulary size.
due to the large size of vocabulary in realworld tasks, it is very expensive to learn such kind of models.