We observe the same general ordering on the 12-layer BERT-base model ( Figure A.2).
there appears to be a "stretching effect", where the representations for a given task tend to concentrate at the same layers relative to the top of the model; this is illustrated side-by-side in Figure A.3.