These compact representations are in turn based on word and sentence embeddings, which are learned using neural networks.
network parameters: We train our neural network using SGD with adagrad, an initial learning rate of η = 0.01, mini-batches of size 30, and L 2 regularization with a decay parameter λ = 1e −4 .