Our pairwise word interaction model shares similarities with recent popular neural attention models (Bahdanau et al., 2014;Rush et al., 2015).
there are important differences: For example, we do not use attention weight vectors or weighted On the Mat There Sit Cats Cats Sit On the Mat Figure 3: The similarity focus layer helps identify important pairwise word interactions (in black dots) depending on their importance for similarity measurement.