This paper revisits several objective functions that have been commonly used for structured prediction tasks in NLP (Gimpel and Smith, 2010) and apply them to a neural sequence to sequence model (Gehring et al., 2017b) ( §2).
we consider likelihood training at the sequencelevel, a margin loss as well as expected risk training.