Accordingly, we feed the information of the additional recurrence encoder into the decoder of Transformer.
we serve an additional attention layer R n d as the fourth sub-layer in each decoder block to perform attention over the output of the recurrence encoder H N r .