The model quickly learns to generate simple sequences that exploit the teacher for high rewards despite being incoherent recipes (e.g., Figure 4).
it is possible that generated sequences are no longer readable (Pasunuru and Bansal, 2017;Paulus et al., 2018).