The other hyper-parameters are tuned according to the development set.
we adopt Adam optimizer (Kingma and Ba, 2014) with an initial learning rate of 0.01 for crossentropy training and adopt the SGD optimizer with a learning rate of 0.002 for all policy gradients training.