(2018) found non-monotonic models (with either soft attention or hard alignment) outperform popular monotonic models (Aharoni and Goldberg, 2017) in the three above mentioned tasks.
the inductive bias of monotonicity, if correct, should help learn a better model or, at least, learn the same model.