This shows that the initialization of α does not predetermine its sparsity level or the role the head will have throughout.
head 8 in the encoder self-attention layer 2 first drops to around α = 1.3 before becoming one of the sparsest heads, with α ≈ 2.