We present the weight distribution in four heads as an instance.
it is interesting to see that all of them showing significant higher attention weights on the true second sentence "text use changes ..." than other sentences in the text.