First, we see that restricting the decoder to only generate known words is extremely useful, with SEQ+DICT improving over SEQ by 6.2 points.
we also improve the accuracy of seq2seq-only derived word systems by adding external information through constrained decoding and hypothesis rescoring.