Results on the model ratio show that self-attention sublayer has a (near) increasing effect (β > 1) that intensifies error signal, while feed-forward sublayer manifests a decreasing effect (β < 1).
though the encoder-decoder attention sublayer and the self-attention sublayer share the same attention formulation, the model ratio of the former is smaller.