Previous research (Collobert et al., 2011;Socher et al., 2011) has shown the usefulness of using pretrained word vectors to improve the performance of various models.
in our experiments, we have used the publicly available pre-trained GloVe word vectors for Twitter by (Pennington et al., 2014a).