As above,VU can be done efficiently by looking up the embedding matrix.
for the computational efficiency purpose, we may apply FOFE to the word embedding vectors instead of the original highdimensional one-hot vectors.