For large-scale QE feature space, we enrich the feature  set using unsupervised learning.
we trained a multiplicative LSTM (Krause et al., 2017) with 4, 096 units on a very large public English corpus (see McAuley et al.