The word embeddings are pre-trained on much larger unannotated corpora to achieve better generalization given limited amount of training data (Turian et al., 2010).
our experiments utilize the GloVe embeddings 7 trained by Pennington et al.