The importance of different words to the meanings of an instance is unequal, thus it is worth pointing out which words are useful and which words are useless.
we apply an attention mechanism (Yang et al., 2016) to get those important words and assemble them to compose a more informative instance vector s j , and the definitions are as follows s where h j t is the t hidden word embedding of instance x j , it was encoded through the instance encoder, and has the same hidden size with x j .