A necessary extension is made for generating the next sentence given a previous sentence.
when generating the second sentence, we regard the first sentence as the source language sentence in a MT task and regard the second sentence as the target language sentence.