We ran a paired sample t-test and confirmed that the average attention weight of sentences addressed by successful comments was significantly greater than that of sentences addressed by unsuccessful comments (p < 0.05).
as expected in the case where the attention works as designed, the model more often picks out the sentences that successful challengers address.