For all experiments we make use of the Deep Averaging Network (DAN) architecture (Iyyer et al., 2015) as our baseline sequence-to-vector encoder, f s2v (x).
embeddings corresponding to each token are summed and passed through a multi-layer perceptron.