Inspired by these observations, we use these two kinds of element-wise interactions to complement the representation of a word in a document.
for each word w in document d, we derive its interaction-based representation e c w towards category c as follows: where ⊕ is the vector concatenation operation.