This indicates that lower layers in a Transformer model do not really require a long attention span in this particular task.
few attention heads in the higher layers have very long spans, exceeding several thousand.