(2016), we use the idea of expected word embedding to approximate Q(E|Y ).
the expected word embedding is a weighted sum of embeddings of all the possible words at each time step: where for each time step j, we enumerate all possible words that are in the union of V g and V z e .