This is necessary because it will be concatenated with the purple attentive context representation, in encoding space; we found that performance is better when both meanings are in the encoding space.
the RNN HG does concatenate vectors from two different spaces; this works because they are representations of the same word, rather than word versus context.