We model all of the conditional probability factors in equation 2using a neural sequence-tosequence model with parameters θ.
we follow Kann and Schütze (2016) and use a long short-term memory-based sequence-to-sequence (seq2seq) model (Sutskever et al., 2014) with attention (Bahdanau et al., 2015).