We employ the pretrained word vector, GloVe (Pennington et al., 2014), to obtain the fixed word embedding of each word.
we denote the embedding lookup matrix as L ∈ R dv×|V | , where d v is the word vector dimension and |V | is the vocabulary size.