We transform initial context-agnostic representations for target word types by taking an elementwise product of the word type vectors with vectors representing the context.
for the context representations learned in Section 3.1, we take an elementwise product of the word type vectors ( w * ) with ( c * ,max , c * ,min , c * ,mean ) where * ∈ {l, r}.