Firstly, we vary the number of encoder and decoder layers respectively to see which will bring more performance gain.
on a basic model with a 5-layer encoder and a 5-layer decoder, we increase the number of layers to the encoder and decoder separately.