While these methods are all tailored to their specific tasks, they all inspire our choice of a self-attending mechanism.
in all of our models, we limit the maximum length of samples and POS tags to 60 tokens.