Since the proposed method consists of a character-based decoder, it sometimes generated  words unrelated to a source sentence.
we applied a simple re-ranking to each n-best headlines generated by the proposed method (n = 20 in this experiment) based on the contained words.