For the encoders and decoders, we follow the recently emerged Transformer (Vaswani et al., 2017).
each encoder is composed of a stack of four identical layers, and each layer consists of a multi-head self-attention sub-layer and a fully connected feed-forward sub-layer.