We find that without the constraint of the softmax operation in (6) the model prefers to link all words together and assign all words to the same constituency.
giving both s i,i+1 and s i,i−1 large values, so the attention head freely attends to any position without restriction of constituent prior, which is the same as the original Transformer.