Next, we explore how the features extracted by an encoder can be further enhanced by incorporating additional information.
we investigate the combination of transformer layers with RNMT+ layers in the same encoder block to build even richer feature representations.