In terms of supervised techniques, we first follow previous approaches to classifying paired data that create separate learned representations of elements in a pair that are then concatenated for the final predictive model (Bowman et al., 2015;Mueller and Thyagarajan, 2016;Potash et al., 2016b).
we experiment with creating separate representations using either a BLSTM or summing individual token embeddings.