In the future, we plan to investigate better methods for training the SAT to further shrink the performance gap between the SAT and the Transformer.
we believe that the following two directions are worth study.