We define a random lookup table for these features, and learn its parameters during training.
our feature set is crafted from distant supervision applied to Wikipedia, a much less time-consuming process which we showed to be nevertheless adapted to rare words.