The BiLSTM layer in the baseline and our model is capable of capturing high-order information to some extent.
without prior knowledge of high-order parts, it may require more training data to learn this capability than a high-order decoder.