In this way, we can see that both post-norm and pre-norm are special cases of the general residual unit.
the post-norm Transformer is the special case when: while for pre-norm Transformer, it is: Here we take a stack of L sub-layers as an example.