For a fair comparison, our models and all baselines use the same neural encoder to encode text spans before the attention or OT operation is applied.
we use RoBERTa (Liu et al., 2019), a state-of-the-art pre-trained encoder, for the StackExchange and MultiRC dataset.