The first N − 1 layers are identical and represent the original layers of Trans-  Context encoder: The context encoder is composed of a stack of N identical layers and replicates the original Transformer encoder.
to related work (Jean et al., 2017;Wang et al., 2017), we found in preliminary experiments that using separate encoders does not yield an accurate model.