Further, the word-by-context embedding for sequence t a is obtained by taking the weighted average over all word embeddings Intuitively, α i may be understood as the relevance score between the ith word in t a and sequence t b .
keywords within t a , in the context of t b , should be assigned larger weights, while less important words will be correspondingly downweighted.