Instead of traditionally exploiting deeper and complicated operations in upper neural layers, our work innovatively provides another lightweight way for improving the ability of neural model.
we propose a novel architecture named Encoder1-Encoder2 with two Interaction Modes for their interacting.