Given a sentence x consisting of N words x = {w 1 , w 2 , ..., w N }, every word w n is converted into a real-valued vector r wn .
the input to the next layer is a sequence of real-valued vectors Word representations are encoded by column vectors in an embedding matrix W wrd ∈ R d w ×|V | , where V is a fixed-sized vocabulary.