Without the warm-up period and the additional copying tasks, our model's dev accuracy is worse than any of the baselines.
our two-step attention trained with the additional copying task already improves over most baselines without any of the additional biases, with a dev accuracy of 48.