Unlike in applications like entity-tagging and parsing where the length of the output is determined based on the input, in applications like response generation valid outputs can be of widely varying length.
pr(y|x, θ) should be well-calibrated over all sequence lengths.