The input memory representation m i of tweet t i is a matrix of size N × dim, where N is the length of the tweet.
because not all words contribute equally to the tweets meaning, and the importance degree of the word w ij should be considered in our models, we propose a probability layer to achieve the goal.