In dense data, each label has sufficient documents, therefore, self-attention can sufficiently obtain label-specific document representation.
label text is helpful to extract the semantic relations between labels and documents.