It is possible that each hidden state in the decoder takes the previous hidden state into consideration, which would be somewhat similar to the proposed RPEs.
the encoder would not be expected to contain this mechanism.