's work (Kuncoro et al., 2016) in which modeling of composition can achieve better performance, the Seq2Dep model which learns about the syntactic dependencies and tree structure performance is probably able to learn the blocks of the form "Nonterminal word }" like a phrase-structure in sen- Figure 6: Comparison of the repetition rate of the baseline and Seq2Dep models tences, so it is unlikely to generate the same word repeatedly.
it is possible to prevent the long repeated words in long sentences.