Given a question consisting of N words q = {w 1 , w 2 , ..., w N }, every word w n is converted into a real-valued vector r wn .
for each question, the input to the next NN layer is a sequence of real-valued vectors q emb = {r w 1 , r w 2 , ..., r w N } Word representations are encoded by column vectors in an embedding matrix W 0 ∈ R d×|V | , where V is a fixed-sized vocabulary.