The former module is similar to the Memory Networks architecture of  in that it uses sentencelevel information.
there are two key differences: (i) we use MultiHead attention as in the Transformer architecture, and (ii) our context attention is dynamic such that we have a separate attention for each query word.