For parameter initialization, we use random initialization within (-0.01, 0.01) for all parameters except the word embedding matrix E w .
we adopt pre-trained English word embeddings from (Collobert et al., 2011).