The simpler implementation of the fusion layer leads to evidently worse performance, indicating that the fu-   sion layer cannot be further simplified.
the alignment layer and the prediction layer can be simplified on some of the datasets.