In practice, a simple beam search procedure that explores K prospective histories at each time-step has proven to be an effective decoding approach.
as noted above, decoding in this manner after conditional languagemodel style training potentially suffers from the is-sues of exposure bias and label bias, which motivates the work of this paper.