We estimate p θ (q |q) using neural networks given their successful application to paraphrase identification tasks (Socher et al., 2011;Yin and Schütze, 2015;.
the input question and its paraphrases are encoded as vectors.