Given a specific word w, the interaction-based representation e c w for each category c could be very different.
for a specific local context, the extracted relevance signal from a particular convolution filter could be also distinct for different categories.