For the convenience of further discussions, we introducer to denote the underlying (distributional) fake response produced by the decoder.
,r stands for a sequence of word distributions projected from the hidden layers of the decoder RNN, based on which one would sample the output response utterance in a traditional Seq2Seq generator.