Concretely, where w α ∈ R 1×d and H a ∈ R d×|a| , denoting hidden size by d and article length by |a|.
the best performing model (and hence current leader) is the variant that uses pretrained, conditional attention, which aligns with the average results in table 2.