This is likely explained in part by the signal pertinent to the classification being distributed across a document (e.g., a "Sports" question in the Yahoo Answers dataset could signal "sports" in a few sentences, any one of which suffices to correctly categorize it).
given that these results are for the HAN models, which typically compute attention over ten or fewer sentences, this is surprising.