RNN decoders are typically trained to act as conditional language models.
one attempts to model the probability of the t'th target word conditioned on x and the target history by stipulating that p , for some parameterized function g typically computed with an affine layer followed by a softmax.