Repetition can be reduced by prohibiting recurrence of the trigrams as a hard rule (Paulus et al., 2018).
such hard constraints do not stop RNNs from repeating through paraphrasing while preventing occasional intentional repetition.