Throughout, we use a hidden layer size of 100 which provided a good trade-off between time and accuracy in initial experiments.
we also plan to change the cross entropy objective to a BLEU-inspired objective in a discriminative training regime, which we hope to be more effective.