Finally, a softmax function is employed as classifier.
methods for modeling short text S mainly have problem that its semantic meaning is determined by a few of key-phrases, however, these meaningful phrases may appear at any position of S. simply combining all words of S may introduce unnecessary divergence and hurt the overall semantic representation.