The architecture of our model is shown in Figure 1.
a word embedding layer transforms indexed words to real valued vectors x i with a pre-trained word embedding matrix (Mikolov et al., 2013;Pennington et al., 2014).