Structured attention at the sentence level helps performance for all except WQ, where no form of attention helps.
structured attention at the document level yields mostly negative results, in contrast to the improvements reported in L&L.