Every word is initially mapped to a d-dimensional vector.
vector q t is computed via q t = W q e (q t ), where W q ∈ R d×|V| is a word embedding matrix, |V| is the vocabulary size, and e (q t ) is a one-hot vector.